Job Description

Do you thrive on building cutting-edge AI systems?

Are you ready to solve complex engineering challenges at the intersection of AI and edge computing?

Join the Akamai Inference Cloud Team!

The Akamai Inference Cloud team is part of Akamai's Cloud Technology Group. We build AI platforms for efficient, compliant, and high-performing applications. These platforms support customers in running inference models and empower developers to create advanced AI solutions effectively. #AIC

Partner with the best

As a Senior II Software Engineer, you will design and implement core capabilities for a globally distributed AI inference platform. Responsibilities include CDN, gateway, ingress, Kubernetes orchestration, observability, and deployment models. You will build a secure, scalable platform layer supporting authentication, load balancing, rate limiting, firewalls, and OpenAI-compatible APIs. Expertise in distributed systems, cloud-native engineering, and API infrastructure is essential.

As a Senior II Software Engineer, you will be responsible for:

• Designing and implementing critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability.
• Driving technical decisions for your domain, selecting appropriate tools, frameworks, and approaches for AI inference workloads.
• Leading the evolution of platform capabilities including authentication, load balancing, rate limiting, firewall integration, and externally facing API patterns.
• Designing and improving data plane APIs, including OpenAI-compatible interfaces and other standards required to support diverse inference and AI application workloads.
• Defining and advancing platform observability through metrics, logging, tracing, monitoring, and operational diagnostics for distributed systems at scale.
• Driving capacity planning and scalability strategies to ensure the platform can support growth in traffic, models, and regional deployments.
• Leading Kubernetes-based orchestration patterns for platform services, helping ensure efficient, resilient, and operable deployment of containerized workloads.
• Mentoring and guiding engineers on the team through code reviews, design discussions, and technical problem-solving.
  
  

Do What You Love

To be successful in this role you will:

• Bring 8+ of software engineering experience with expertise in distributed systems, cloud services, and platform engineering.
• Demonstrate deep experience building and operating internet-facing platform services such as API gateways, ingress layers, reverse proxies, or service infrastructure.
• Demonstrate expertise in cloud-native architectures, incorporating containerization and orchestration technologies such as Kubernetes.
• Have proven experience building scalable, high-performance systems with modern DevOps practices, CI/CD pipelines, and infrastructure-as-code.
• Exhibit technical leadership by mentoring, promoting code quality, and delivering effective solutions to address complex platform challenges.
• Have experience designing and operating API platforms, including authentication, authorization, traffic management, and service protection patterns.
• Demonstrate expertise in observability, monitoring, alerting, and debugging practices for managing large-scale distributed systems effectively.
• Have experience with capacity planning, performance analysis, and reliability engineering for production services.
  
  

Work in a way that works for you

FlexBase, Akamai's Global Flexible Working Program, is based on the principles that are helping us create the best workplace in the world. When our colleagues said that flexible working was important to them, we listened. We also know flexible working is important to many of the incredible people considering joining Akamai. FlexBase, gives 95% of employees the choice to work from their home, their office, or both (in the country advertised). This permanent workplace flexibility program is consistent and fair globally, to help us find incredible talent, virtually anywhere. We are happy to discuss working options for this role and encourage you to speak with your recruiter in more detail when you apply.

Learn what makes Akamai a great place to work

Connect with us on social and see what life at Akamai is like!

We power and protect life online, by solving the toughest challenges, together.

At Akamai, we're curious, innovative, collaborative and tenacious. We celebrate diversity of thought and we hold an unwavering belief that we can make a meaningful difference. Our teams use their global perspectives to put customers at the forefront of everything they do, so if you are people-centric, you'll thrive here.

Working for you