
Senior Data Engineer (PySpark, NoSQL)
EPAM Systems (Poland) sp. z o.o.•Kraków, Grzegórzki
💰 Wynagrodzenie
Widełki nieujawnione
📋 Informacje
🛠 Wymagane technologie
🌐 Wymagane języki
📝 Twój zakres obowiązków
Your responsibilities, Provide end-to-end support for NoSQL databases, including monitoring, troubleshooting, and performance tuning, Design and optimize large-scale data pipelines using PySpark, Work with distributed NoSQL technologies (e.g., Cosmos DB, Cassandra, DynamoDB, or other production-grade systems), Build and maintain scalable ETL/ELT workflows in Azure environments, Troubleshoot and resolve production issues related to performance, latency, and availability, Optimize Spark jobs (partitioning, execution plans, resource usage), Implement best practices for scalability, security, and data reliability, Collaborate with cross-functional teams to support data-driven solutions, Contribute to automation and operational improvements, Maintain documentation and participate in production support rotations
5+ years of experience as a Data Engineer or similar role, Strong hands-on experience with PySpark in production (transformations, tuning, optimization), Solid experience with distributed NoSQL databases (e.g., Cosmos DB, Cassandra, DynamoDB, or similar), Strong understanding of Spark architecture and performance optimization, Experience building scalable data pipelines in Azure, Knowledge of NoSQL data modeling and cloud-based troubleshooting, Strong analytical and problem-solving skills, Ability to work effectively in high-availability environments, Strong communication skills (English B2+)
Optional, Experience with code generation, including non-AI and AI-assisted approaches, Exposure to Data Science workflows, Experience with Big Data platforms and distributed systems, Knowledge of financial instruments and financial services data, Hands-on experience with industry-standard LLMs (including GPT, Claude, or similar)
This is how we work on a project, Continuous Deployment, Continuous Integration, DevOps
Development opportunities we offer, conferences in Poland, development budget, external training, industry-specific e-learning platforms, intracompany training, mentoring, soft skills training, space for experimenting, substantive support from technological leaders, support of IT events, technical knowledge exchange within the company
What we offer, Engineering community of industry professionals, Friendly team and enjoyable working environment, Flexible schedule and opportunity to work remotely within Poland, Chance to work abroad for up to 60 days annually, Business-driven relocation opportunities, Outstanding career roadmap, Leadership development, career advising, soft skills, and well-being programs, Certification (GCP, Azure, AWS), Unlimited access to LinkedIn Learning, Get Abstract, Cloud Guru, English language classes, Stable income (Employment Contract or B2B), Participation in the Employee Stock Purchase Plan, Benefits package (health insurance, multisport, shopping vouchers), Strategically located offices featuring entertainment and relaxation zones, table tennis and football, free snacks, fantastic coffee, and more, Referral bonuses, Corporate, social and well-being events
Benefits, private medical care, life insurance, flexible working time, fruits, integration events, retirement pension plan, no dress code, video games at work, coffee / tea, parking space for employees, leisure zone, employee referral program, charity initiatives
EPAM Systems (Poland) sp. z o.o., EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
About the project
We are seeking a Senior Data Engineer with strong expertise in cloud-based NoSQL databases, Azure, and PySpark, skilled in designing, implementing, and maintaining robust data processing solutions. This role focuses on ensuring platform reliability, optimizing performance, and enabling scalable and efficient data operations within a production-grade environment.
⚙️ Praktyki developerskie
This is how we work on a project, Continuous Deployment, Continuous Integration, DevOps
📝 Opis główny / Wstęp
About the project
We are seeking a Senior Data Engineer with strong expertise in cloud-based NoSQL databases, Azure, and PySpark, skilled in designing, implementing, and maintaining robust data processing solutions. This role focuses on ensuring platform reliability, optimizing performance, and enabling scalable and efficient data operations within a production-grade environment.
Your responsibilities
- Provide end-to-end support for NoSQL databases, including monitoring, troubleshooting, and performance tuning
- Design and optimize large-scale data pipelines using PySpark
- Work with distributed NoSQL technologies (e.g., Cosmos DB, Cassandra, DynamoDB, or other production-grade systems)
- Build and maintain scalable ETL/ELT workflows in Azure environments
- Troubleshoot and resolve production issues related to performance, latency, and availability
- Optimize Spark jobs (partitioning, execution plans, resource usage)
- Implement best practices for scalability, security, and data reliability
- Collaborate with cross-functional teams to support data-driven solutions
- Contribute to automation and operational improvements
- Maintain documentation and participate in production support rotations
🎁 Co oferujemy (Dodatkowe detale)
Benefits, private medical care, life insurance, flexible working time, fruits, integration events, retirement pension plan, no dress code, video games at work, coffee / tea, parking space for employees, leisure zone, employee referral program, charity initiatives
EPAM Systems (Poland) sp. z o.o., EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.
About the project
We are seeking a Senior Data Engineer with strong expertise in cloud-based NoSQL databases, Azure, and PySpark, skilled in designing, implementing, and maintaining robust data processing solutions. This role focuses on ensuring platform reliability, optimizing performance, and enabling scalable and efficient data operations within a production-grade environment.