Senior Data Platform Engineer (Databricks)
P&P Solutions
You will architect and build a data platform on Databricks for real-time aircraft engine telemetry analysis. The system collects sensor data, processes in real-time, and serves ML models for predictive maintenance. You'll design end-to-end architecture, manage MLOps, and ensure governance. The role is deeply technical, combining data engineering, ML engineering, and platform engineering.
Brakuje: team size and composition, project duration and timeline.
You will architect and build a data platform on Databricks for real-time aircraft engine telemetry analysis. The system collects sensor data, processes in real-time, and serves ML models for predictive maintenance. You'll design end-to-end architecture, manage MLOps, and ensure governance. The role is deeply technical, combining data engineering, ML engineering, and platform engineering.
- ✓Cutting-edge tech stack (Databricks, MLflow, Delta Lake, Mosaic AI)
- ✓International project in aviation with real-time data
- ✓Significant influence on architecture and technology decisions
- ✓Modern tooling and focus on MLOps best practices
- −The role is through a staffing agency (P&P Solutions) for a client project, which may mean less direct involvement with the product team and potential instability after project ends.
- !Broad scope of responsibilities – may require wearing many hats
- !No information about team size or structure
- !Unclear how much time is spent on each area (pipeline vs MLOps vs governance)
- •Designing architecture using Databricks Lakehouse (Delta Lake, Unity Catalog, MLflow)
- •Building real-time data pipelines with Structured Streaming and Delta Lake
- •Managing ML model lifecycle: monitoring, retraining, A/B testing via MLflow
- •Developing low-latency model serving endpoints with auto-scaling and routing
- •Implementing data governance and security with Unity Catalog and compliance (SOC 2, GDPR)
- •Optimizing Databricks cluster cost and performance (autoscaling, spot usage)
- •Collaborating with engineering, MLOps, and product teams on system integration
- •Creating dashboards and human-in-the-loop workflows using Databricks SQL and React frontend
Oferta dla doświadczonych specjalistów (Senior).
A mid-senior engineer with solid Databricks experience, good Python, and some MLOps knowledge, but maybe less experience in real-time systems or large-scale production. Must have the core Databricks skills and be willing to learn the rest.
Junior engineers or those without hands-on Databricks experience. Also not for someone looking for a pure machine learning research role – this is about building the platform, not developing models.
- ?How large is the team I'll be joining and what is the team structure?
- ?Is there direct communication with the client or through a project manager?
- ?What is the expected project duration and possibility of extension?
- ?Is there an on-call rotation or production support requirement?
- ?What level of autonomy do I have in architectural decisions?
- ?Are Databricks certifications required to start or can be obtained during the project?
- ?What are the main current challenges in the project?
- −Team size and composition
- −Project duration and timeline
- −Detailed breakdown of responsibilities between team members
- −On-call or support expectations
International team with collaboration across engineering, MLOps, and product. Project is for a global aviation client.
Rozmowa HR + weryfikacja angielskiego, Rozmowa techniczna, Decyzja
Powyżej mediany rynkowej
≈ 175,0–210,0 zł/h
Dane z aktywnych ofert zawierających technologię Data Lake.