Azure Data Engineer

Job Title: Azure Data Engineer

Experience: 8 Years

Location: Warsaw, Poland (3 Days Onsite per week)

Employment Type: 6+ Months Contract B2B

Job Overview

We are looking for an experienced Azure Data Engineer to design, develop, and optimize scalable data solutions on Microsoft Azure. The ideal candidate will have strong expertise in data engineering, distributed data processing, and cloud-based architectures, along with hands-on experience in Python and Databricks.

Key Responsibilities

Design and implement scalable data pipelines using Azure technologies

Work with structured and unstructured data using SQL and NoSQL databases

Develop and optimize data workflows using Databricks (PySpark – batch & structured streaming)

Build and manage data solutions using Azure ADLS, Event Hub, Event Grid, and Azure SQL Data Warehouse

Develop serverless data processing solutions using Azure Functions

Implement infrastructure as code using Terraform

Ensure data quality, performance, and reliability across pipelines

Collaborate with cross-functional teams to understand data requirements and deliver solutions

Required Skills

Strong experience as an Azure Data Engineer

Proficiency in Python

Hands-on experience with SQL and NoSQL databases

Strong experience with Databricks and PySpark (batch & streaming)

Experience with:

Azure Data Lake Storage (ADLS)

Azure Event Hub & Event Grid

Azure SQL Data Warehouse (Synapse)

Azure Functions (serverless architecture)

Good understanding of Terraform (theoretical knowledge is mandatory; practical experience is a plus)

Good to Have Skills

Experience with Azure Data Factory (ADF)

Knowledge of ARM Templates

Exposure to Kubernetes

Familiarity with Google Cloud Platform (GCP)

Basic understanding of Machine Learning / AI concepts