Senior Data Engineer

Senior Data Engineer (PySpark)

📍 Location: Kraków, Poland (hybrid: 2 days in the office, 3 days remote)

📄 B2B Contract: 200 – 240 PLN / hour

We are looking for a proactive Senior Data Engineer (PySpark) to join an international Agile team delivering large‑scale data processing solutions for the financial sector. You will work closely with Engineers, Data Analysts and Business Analysts to design, build and optimize data pipelines supporting critical business processes.

This role sits within a collaborative engineering environment and offers the opportunity to influence architecture, development standards and delivery quality across a complex data ecosystem.

Key Responsibilities:

• Design and develop scalable data processing solutions using PySpark or Scala.
• Build and maintain data pipelines leveraging Hadoop ecosystem components (Spark, Hive, YARN, MapReduce).
• Promote engineering best practices through code reviews, mentoring and knowledge sharing.
• Provide production support, troubleshoot issues and ensure system stability.
• Implement tools and processes ensuring performance, availability, accuracy and monitoring.
• Collaborate with Business Analysts to ensure correct interpretation and implementation of requirements.
• Contribute to architecture and system design discussions.
• Participate in Agile ceremonies: sprint planning, reviews, retrospectives and daily stand‑ups.

Must have

• PySpark
• Apache Spark
• Hadoop
• Hive
• Spark SQL
• Airflow
• Unix
• Linux
• ETL
• SQL
• REST API
• Git
• GitHub
• CD tools
• Ansible
• Jira
• Data modelling