Data Engineer (Spark / Streaming / Java)

Your responsibilities, Develop and maintain the leading IT solution for the energy market using Apache Spark, Databricks, Delta Lake, and Apache Kafka, Have end-to-end responsibility for the full lifecycle of features you develop, Design technical solutions for business requirements from the product roadmap, Maintain alignment with architectural principles defined on the project and organizational level, Ensure optimal performance through continuous monitoring and code optimization., Refactor existing code and enhance system architecture to improve maintainability and scalability., Design and evolve the test automation strategy, including technology stack and solution architecture., Prepare reviews, participate in retrospectives, estimate user stories, and refine features ensuring their readiness for development.

Have 4+ years of Apache Spark experience and have faced various data engineering challenges in batch or streaming, Have an interest in stream processing with Apache Spark Structured Streaming on top of Apache Kafka, Have experience leading technical solution designs, Have experience with distributed systems on a cloud platform, Have experience with large-scale systems in a microservice architecture, Are familiar with Git and CI/CD practices and can design or implement the deployment process for your data pipelines, Possess a proactive approach and can-do attitude, Are excellent in English and Polish, both written and spoken, Have a higher education in computer science or a related field, Are a team player with strong communication skills

Optional, Apache Spark Structured Streaming, Azure, Domain Driven Development, Docker containers and Kubernetes, Message brokers (i.e. Kafka) and event-driven architecture, Agile/Scrum

What we offer, Professional Development, Grow in your role, Enjoy on-site meetups, Participate in conferences in Poland and abroad, Attend an average of 40 hours of training yearly, Take part in Internal Mobility Program, Scandinavian Culture and Workplace, Earn Competitive hourly rates/salary, Enjoy MyBenefit Cafeteria system with wide range of services, Make the most of your work and life, Sport & passion communities and CSR initiatives, Work in a human-oriented company, Use high-level equipment, Feel good at green and ergonomic office and enjoy surprise treats, Meaningful and impactful work, Make an impact that lasts - create and implement technological solutions, And improve the lives of millions of people in the public and private sectors, Talented and Trusted People, Cooperate with open-minded colleagues, Work with experienced managers in an atmosphere full of trust

Benefits, sharing the costs of sports activities, private medical care, sharing the costs of foreign language classes, sharing the costs of professional training & courses, life insurance, remote work opportunities, flexible working time, integration events, dental care, corporate sports team, mobile phone available for private use, computer available for private use, retirement pension plan, no dress code, coffee / tea, leisure zone, extra social benefits, holiday funds, employee referral program, charity initiatives, MyBenefit Cafeteria system, 21 days full-paid stand-by

additional-module

What does the recruitment process look like? , Phone conversation with Recruitment Partner, Technical interview with the Hiring Team, Cognitive test, Offer

additional-module

What product do we develop?, We are building an innovative solution, KMD Elements, on Microsoft Azure cloud dedicated to the energy distribution market (electrical energy, gas, water, utility, and similar types of business). Our customers include institutions and companies operating in the energy market as transmission service operators, market regulators, distribution service operators, energy trading, and retail companies., KMD Elements delivers components allowing implementation of the full lifecycle of a customer on the energy market: meter data processing, connection to the network, physical network management, change of operator, full billing process support, payment, and debt management, customer communication, and finishing on customer account termination and network disconnection., The key market advantage of KMD Elements is its ability to support highly flexible, complex billing models as well as scalability to support large volumes of data. Our solution enables energy companies to promote efficient energy generation and usage patterns, supporting sustainable and green energy generation and consumption.

KMD Poland Sp. z o.o., KMD Poland is the largest foreign-affiliated branch at KMD Group. We are responsible for important solutions and processes in the IT, R&D, Finance, HR, and Support areas. We help Nordic business and the public sector make another major leap in their digital evolution., , KMD (an NEC company) is committed to providing equal opportunities. Hence, we invite all qualified interested applicants to apply for career opportunities. At KMD all aspects of employment and cooperation including the decision to hire/cooperate with will be based on merit, competence, performance, and business needs without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age,, , Hooray! You’ve reached out the end of our job ad! But it’s not over yet! Now click Apply button and see why its #GOODTOBEINKMD! 😊

This is how we work,

About the project

How do we work?

#Agile #Scrum #Teamwork #CleanCode #CodeReview #Feedback #BestPracticies

• We follow Scrum principles in our work – we work in biweekly iterations and produce production-ready functionalities at the end of each iteration – every 3 iterations we plan the next product release

• We have end-to-end responsibility for the features we develop – from business requirements, through design and implementation up to running features on production

• More than 75% of our work is spent on new product features

• Our teams are cross-functional (7-8 persons) – they develop, test and maintain features they have built

• Teams’ own domains in the solution and the corresponding system components

• We value feedback and continuously seek improvements

• We value software best practices and craftsmanship

Product principles:

• Domain model created using domain-driven design principles

• Distributed event-driven architecture / microservices

• Large-scale system for large volumes of data (>100TB data), processed by Apache Spark streaming and batch jobs powered by Databricks platform

additional-module

What does the recruitment process look like? , Phone conversation with Recruitment Partner, Technical interview with the Hiring Team, Cognitive test, Offer

additional-module

What product do we develop?, We are building an innovative solution, KMD Elements, on Microsoft Azure cloud dedicated to the energy distribution market (electrical energy, gas, water, utility, and similar types of business). Our customers include institutions and companies operating in the energy market as transmission service operators, market regulators, distribution service operators, energy trading, and retail companies., KMD Elements delivers components allowing implementation of the full lifecycle of a customer on the energy market: meter data processing, connection to the network, physical network management, change of operator, full billing process support, payment, and debt management, customer communication, and finishing on customer account termination and network disconnection., The key market advantage of KMD Elements is its ability to support highly flexible, complex billing models as well as scalability to support large volumes of data. Our solution enables energy companies to promote efficient energy generation and usage patterns, supporting sustainable and green energy generation and consumption.

About the project

How do we work?

#Agile #Scrum #Teamwork #CleanCode #CodeReview #Feedback #BestPracticies

• We follow Scrum principles in our work – we work in biweekly iterations and produce production-ready functionalities at the end of each iteration – every 3 iterations we plan the next product release

• We have end-to-end responsibility for the features we develop – from business requirements, through design and implementation up to running features on production

• More than 75% of our work is spent on new product features

• Our teams are cross-functional (7-8 persons) – they develop, test and maintain features they have built

• Teams’ own domains in the solution and the corresponding system components

• We value feedback and continuously seek improvements

• We value software best practices and craftsmanship

Product principles:

• Domain model created using domain-driven design principles

• Distributed event-driven architecture / microservices

• Large-scale system for large volumes of data (>100TB data), processed by Apache Spark streaming and batch jobs powered by Databricks platform

Your responsibilities

• Develop and maintain the leading IT solution for the energy market using Apache Spark, Databricks, Delta Lake, and Apache Kafka
• Have end-to-end responsibility for the full lifecycle of features you develop
• Design technical solutions for business requirements from the product roadmap
• Maintain alignment with architectural principles defined on the project and organizational level
• Ensure optimal performance through continuous monitoring and code optimization.
• Refactor existing code and enhance system architecture to improve maintainability and scalability.
• Design and evolve the test automation strategy, including technology stack and solution architecture.
• Prepare reviews, participate in retrospectives, estimate user stories, and refine features ensuring their readiness for development.

What does the recruitment process look like?

• Phone conversation with Recruitment Partner
• Technical interview with the Hiring Team
• Cognitive test
• Offer

What product do we develop?

• We are building an innovative solution, KMD Elements, on Microsoft Azure cloud dedicated to the energy distribution market (electrical energy, gas, water, utility, and similar types of business). Our customers include institutions and companies operating in the energy market as transmission service operators, market regulators, distribution service operators, energy trading, and retail companies.
• KMD Elements delivers components allowing implementation of the full lifecycle of a customer on the energy market: meter data processing, connection to the network, physical network management, change of operator, full billing process support, payment, and debt management, customer communication, and finishing on customer account termination and network disconnection.
• The key market advantage of KMD Elements is its ability to support highly flexible, complex billing models as well as scalability to support large volumes of data. Our solution enables energy companies to promote efficient energy generation and usage patterns, supporting sustainable and green energy generation and consumption.

Benefits, sharing the costs of sports activities, private medical care, sharing the costs of foreign language classes, sharing the costs of professional training & courses, life insurance, remote work opportunities, flexible working time, integration events, dental care, corporate sports team, mobile phone available for private use, computer available for private use, retirement pension plan, no dress code, coffee / tea, leisure zone, extra social benefits, holiday funds, employee referral program, charity initiatives, MyBenefit Cafeteria system, 21 days full-paid stand-by

additional-module

What does the recruitment process look like? , Phone conversation with Recruitment Partner, Technical interview with the Hiring Team, Cognitive test, Offer

additional-module

What product do we develop?, We are building an innovative solution, KMD Elements, on Microsoft Azure cloud dedicated to the energy distribution market (electrical energy, gas, water, utility, and similar types of business). Our customers include institutions and companies operating in the energy market as transmission service operators, market regulators, distribution service operators, energy trading, and retail companies., KMD Elements delivers components allowing implementation of the full lifecycle of a customer on the energy market: meter data processing, connection to the network, physical network management, change of operator, full billing process support, payment, and debt management, customer communication, and finishing on customer account termination and network disconnection., The key market advantage of KMD Elements is its ability to support highly flexible, complex billing models as well as scalability to support large volumes of data. Our solution enables energy companies to promote efficient energy generation and usage patterns, supporting sustainable and green energy generation and consumption.

KMD Poland Sp. z o.o., KMD Poland is the largest foreign-affiliated branch at KMD Group. We are responsible for important solutions and processes in the IT, R&D, Finance, HR, and Support areas. We help Nordic business and the public sector make another major leap in their digital evolution., , KMD (an NEC company) is committed to providing equal opportunities. Hence, we invite all qualified interested applicants to apply for career opportunities. At KMD all aspects of employment and cooperation including the decision to hire/cooperate with will be based on merit, competence, performance, and business needs without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age,, , Hooray! You’ve reached out the end of our job ad! But it’s not over yet! Now click Apply button and see why its #GOODTOBEINKMD! 😊

This is how we work,

About the project

How do we work?

#Agile #Scrum #Teamwork #CleanCode #CodeReview #Feedback #BestPracticies

• We follow Scrum principles in our work – we work in biweekly iterations and produce production-ready functionalities at the end of each iteration – every 3 iterations we plan the next product release

• We have end-to-end responsibility for the features we develop – from business requirements, through design and implementation up to running features on production

• More than 75% of our work is spent on new product features

• Our teams are cross-functional (7-8 persons) – they develop, test and maintain features they have built

• Teams’ own domains in the solution and the corresponding system components

• We value feedback and continuously seek improvements

• We value software best practices and craftsmanship

Product principles:

• Domain model created using domain-driven design principles

• Distributed event-driven architecture / microservices

• Large-scale system for large volumes of data (>100TB data), processed by Apache Spark streaming and batch jobs powered by Databricks platform