Senior Data Engineer
Allegro
This is a Senior Data Engineer role focused on building a highly scalable data ingestion platform for Allegro's clickstream data. You will work with a team of 150+ engineers in the Data & AI area, using Google Cloud Platform services (Dataflow, Pub/Sub, BigQuery, Kafka) and frameworks like Apache Beam and Spark. The platform handles billions of events daily, requiring strong distributed systems knowledge. You will write code in Scala, Java, or Python, participate in code reviews, and ensure robust CI/CD practices.
Brakuje: recruitment process not described, team size not specified.
This is a Senior Data Engineer role focused on building a highly scalable data ingestion platform for Allegro's clickstream data. You will work with a team of 150+ engineers in the Data & AI area, using Google Cloud Platform services (Dataflow, Pub/Sub, BigQuery, Kafka) and frameworks like Apache Beam and Spark. The platform handles billions of events daily, requiring strong distributed systems knowledge. You will write code in Scala, Java, or Python, participate in code reviews, and ensure robust CI/CD practices.
- ✓Autonomy in technology choice and ownership of solutions
- ✓Modern AI tools provided to automate repetitive tasks
- ✓Large-scale data platform (billions of events per day, petabytes of data)
- ✓Developer-friendly ecosystem with Kubernetes, Docker, GitHub Actions, self-service tools
- ✓Internal tech community and conferences (Allegro Tech Meeting, blog, podcasts)
- !No mention of on-call responsibilities
- !No information about team size
- !Recruitment process not specified
- •Designing and implementing data ingestion pipelines for clickstream data
- •Working with Apache Beam and Dataflow on GCP
- •Processing streaming data with Kafka and Pub/Sub
- •Building batch processing pipelines with Spark
- •Writing and reviewing code in Scala/Java/Python
- •Participating in code reviews and ensuring code quality (TDD, CI/CD)
- •Optimizing data storage and querying with BigQuery
- •Maintaining and troubleshooting Unix/Linux environments
Oferta dla doświadczonych specjalistów (Senior).
A solid mid-level Data Engineer with at least 3 years of experience in data engineering, comfortable with at least one of Scala/Java or Python, and some hands-on experience with cloud data services and distributed processing frameworks. Ready to grow into a senior role with support from a large team.
Not suitable for junior engineers with less than 3 years of experience, or for those seeking fully remote work or unwilling to work in a hybrid model based in Warsaw.
- ?How many engineers are in the data ingestion team?
- ?Is there an on-call rotation for the platform?
- ?What is the recruitment process (number of stages, technical test or live coding)?
- ?What is the specific training budget amount?
- ?What percentage of time is spent on new development vs. maintenance?
- −Recruitment process not described
- −Team size not specified
- −On-call responsibilities not mentioned
- −Annual bonus percentage not given
- −Training budget amount not specified
Collaborative and innovative team of top-class specialists with autonomy, continuous development, and a strong emphasis on knowledge sharing (top conferences, internal guilds, blog).
Poniżej mediany rynkowej
Dane z aktywnych ofert zawierających technologię AWS. Pełne statystyki zarobków →