Data Engineer (Scala / Spark / Azure)

We are an internal software house operating within the international insurance group AXA. We provide IT solutions for the needs of AXA companies in Europe. We work in English on a daily basis, in close-knit teams, carrying out international development projects.

About the project:

We are looking for a Data Engineer to join our team to support the development and maintenance of data pipelines built on a Azure-based stack. The role focuses primarily on implementing data model changes, maintaining existing transformations, and ensuring the reliability and performance of data processing workflows.

Your responsibilities:

• Implement new data structures by adding tables and columns based on provided specifications
• Maintain and troubleshoot existing pipelines, including identifying and fixing bugs
• Modify and enhance data transformations in response to evolving business requirements
• Optimize data processing workflows to improve performance and efficiency
• Collaborate with other team members to ensure data consistency and quality
• Use Databricks notebooks for debugging, testing, and validating data processing logic

Our requirements:

• Hands-on experience with Scala (at least one commercial or substantial project; expert level not required)
• Experience working with Apache Spark
• Familiarity with Databricks for data processing and development
• Experience with Azure Data Factory (ADF) or similar orchestration tools
• Understanding of data pipeline concepts, ETL/ELT processes, and data modeling basics
• Proactive and communicative approach to work
• Good command of English (written and spoken) is required
• Ability to work with existing codebases and adapt to changing requirements