Databricks Data Engineer/Architect

Tech stack:

• Databricks (Unity Catalog, Delta Live Tables) 
• Python (PySpark), SQL 
• Azure, AWS, or GCP 
• Data Lakehouse, Data Mesh, Data Marts 
• DevOps, CI/CD Pipelines 
• Agile (Scrum/Kanban) 

Codzienne zadania

• Design and maintain robust data pipelines and distributed data processing systems using Databricks. 
• Implement and manage data governance and security frameworks via Unity Catalog. 
• Develop sophisticated data models (Relational and Non-Relational) to support complex analytical requirements. 
• Improve the performance and reliability of Big Data workflows and ETL processes. 
• Work within an Agile environment, integrating DevOps and CI/CD principles into the data lifecycle. 
• Act as a subject matter expert, guiding the team through complex big data challenges and architectural decisions. 

Must have

• Databricks
• UNITY
• Delta Live Table
• PySpark
• SQL
• Azure
• AWS
• GCP
• Data Lake
• DevOps
• CI/CD Pipelines
• Kanban
• Data engineering
• Big Data
• Data pipelines
• Python
• ETL
• Data warehouses
• Public cloud
• Storage
• Security