Senior Data Engineer (Databricks)
Addepto
You will work as a Senior Data Engineer in a consulting company, designing and building data platforms and pipelines for large clients using Azure, Databricks, Spark, and related technologies. You will be involved in architecture decisions, CI/CD, MLOps, and ensuring data governance. The role is hands-on but also requires consulting and client-facing skills.
Brakuje: number of team members you would work with, typical project duration and frequency of switching.
You will work as a Senior Data Engineer in a consulting company, designing and building data platforms and pipelines for large clients using Azure, Databricks, Spark, and related technologies. You will be involved in architecture decisions, CI/CD, MLOps, and ensuring data governance. The role is hands-on but also requires consulting and client-facing skills.
- ✓B2B contract with 20 paid days off
- ✓Training budget and Databricks certification support
- ✓International projects with top-tier clients
- ✓Well-being support including psychotherapy
- ✓Flat structure and small teams
- !Requires Master's or PhD, which may be a hard filter
- !Consulting experience explicitly required – may not suit pure technical roles
- !Flat structure may limit career progression
- !No detail on team size or project rotation
- •Design and optimize scalable data processing pipelines for streaming and batch workloads using Databricks, Apache Airflow, and Dagster.
- •Architect end-to-end data platforms ensuring high availability, performance, and reliability.
- •Lead development of CI/CD and MLOps processes to automate deployments and monitoring.
- •Develop applications for aggregating, processing, and analyzing data from diverse sources.
- •Collaborate with Data Science teams on ML projects, including feature engineering and model deployment.
- •Design complex data transformations using Databricks, DBT, and Apache Airflow.
- •Translate business requirements into scalable technical solutions and ensure data security and governance.
- •Write and review Python and SQL code, including performance tuning and optimization.
Oferta dla doświadczonych specjalistów (Senior).
A data engineer with at least 5 years of commercial experience in Big Data, proficient in Python and SQL, with hands-on experience in Azure, Databricks, and Spark, and ability to work autonomously on client projects.
Juniors or mid-level engineers without significant Big Data experience. Also not for those who prefer product development over consulting or dislike client-facing interactions.
- ?How many data engineers are on the typical project team?
- ?How are projects assigned? Do I have a say in which projects I work on?
- ?What is the typical duration of client engagements?
- ?How much interaction with clients is expected per week?
- ?Are there opportunities for internal knowledge sharing or conference speaking?
- ?What is the on-call expectation, if any?
- ?How is performance evaluated in a flat structure?
- −Number of team members you would work with
- −Typical project duration and frequency of switching
- −On-call or support duties
- −Specific benefits for well-being (psychotherapy etc.) details
A supportive team of AI and Big Data enthusiasts with a flat structure and small teams, encouraging knowledge sharing and personal branding.
Na poziomie rynkowym
≈ 125,0–170,0 zł/h
Dane z aktywnych ofert zawierających technologię Python. Pełne statystyki zarobków →