Data Engineer
📝 Opis główny / Wstęp
Unleash the Power of Data — Shape the Future of Big Data & Cloud Innovation!
Krakow-based opportunity with hybrid work model, allowing up to 3 days remote per week.
As a Senior Data Engineer, you will be working for our client, a leading player in the data and analytics industry. You will contribute to designing and building scalable, high-performance data pipelines that drive business insights and innovation. This role offers a unique chance to be at the forefront of big data and cloud technologies, shaping meaningful solutions for global clients.
Your main responsibilities:
Develop and optimize data pipelines using PySpark, Scala, and Hadoop components to support scalable analytics solutions.
Work with Apache Spark, Hive, YARN, and ETL frameworks to process large datasets efficiently.
Collaborate with Business Analysts to interpret requirements and translate them into technical solutions.
Implement and maintain automated testing, deployment, and monitoring tools to ensure system reliability.
Provide production support, troubleshoot issues, and improve performance and scalability.
Participate actively in Agile rituals, including sprint planning, reviews, and retrospectives.
Contribute to system architecture and design discussions, ensuring best practices and standards.
You're ideal for this role if you have:
4+ years of experience in data engineering or similar roles.
Strong proficiency in PySpark or Scala development and design.
Hands-on experience with scheduling tools such as Airflow.
Knowledge of Hadoop ecosystem components (Hive, Spark, Spark SQL, YARN).
Experience with SQL, RESTful services, and Unix/Linux environments.
Familiarity with version control (Git, GitHub), CI/CD tools (Jenkins, Ansible), and requirement management systems (JIRA).
It is a strong plus if you have: (optional)
Experience with Elasticsearch.
Development experience with Java APIs.
Knowledge of data ingestion techniques.
Understanding of cloud design patterns.
Exposure to DevOps methodologies and Agile practices like Scrum and Kanban.
Language Required for the role:
Fluent in English.
Eligibility for the role:
Only candidates with an existing legal right to work in Europe will be considered for this role.
#MAKEYourCareerBETTER
Interested? Apply now and include your CV (preferably in English) along with a statement confirming your consent to the processing and storage of your personal data.
We offer you
At ITDS, you will work on innovative and impactful technology projects for international companies across multiple industries in Europe and beyond. We create an environment for ambitious, driven professionals who want to grow, deliver value, and build their careers in modern IT and digital transformation.
Our offer includes:
Stable and long-term cooperation with attractive conditions
Opportunities to develop your technical expertise across various industries and technologies
The chance to work on high-impact, strategic IT and digital transformation projects
A clear career path and the opportunity to grow quickly by contributing to diverse client initiatives over time
International environment, knowledge sharing, social events, and training opportunities
Access to an attractive medical package
Access to the Multisport program
Access to learning platforms such as Pluralsight
Flexible working hours and remote work options