Principal Software Engineer - Akamai Inference Cloud; Remote

Principal Software Engineer - Akamai Inference Cloud (Remote)

Join to apply for the Principal Software Engineer - Akamai Inference Cloud (Remote) role at Akamai Technologies
.

Job Description

Do you thrive on solving complex technical challenges in AI infrastructure? Are you ready to architect the future of AI at the edge? Join the Akamai Inference Cloud Team!

The Akamai Inference Cloud team is part of Akamai's Cloud Technology Group. We design, implement, deploy and operate AI platforms that enable customers to run inference models and developers to create AI applications with unmatched performance, compliance, and economics.

As a Principal Software Engineer, you will serve as a technical leader and architect for our globally distributed AI inference platform. You will drive critical technical decisions, establish architectural patterns, and guide the team in building a platform that delivers OpenAI-compatible endpoints while orchestrating inference workloads across regions at massive scale.

• Providing thought leadership, drive architectural decisions, and mentor engineers while delivering hands‑on technical contributions
• Architecting and designing the core infrastructure of Akamai Inference Cloud, ensuring it is performant, compliant, economical, and explainable
• Providing thought leadership on AI inference optimization, model serving architectures, and establishing technical standards for the platform
• Making critical technical decisions on frameworks, tools, and approaches for AI workload deployment and global traffic orchestration
• Contributing hands‑on to critical-path development, code reviews, and architectural implementations
• Collaborating with cross-functional teams to define technical requirements and elevate team capabilities

• Have 12+ years of relevant experience and a Bachelor's degree or its equivalent
• Have deep expertise in AI inference optimization, model serving, and LLM deployment at scale
• Provide thought leadership on AI inference optimization, model serving architectures, and establishing technical standards for the platform
• Show expert-level proficiency with cloud-native technologies, Kubernetes, distributed systems, and architecting services at global scale with strict SLOs
• Possess solid opinions and proven experience building AI platforms developers love, including API design and cost optimization for compute-intensive workloads
• Demonstrate excellent technical leadership with the ability to mentor engineers, influence architectural decisions, and communicate effectively across teams
• Have experience with building platforms for AI application developers (RAG, agents, fine-tuning workflow)
• Possess working knowledge of AI safety and practices, MLOps practices and AI model lifecycle management

Flex Base, Akamai's Global Flexible Working Program, is based on the principles that are helping us create the best workplace in the world. When our colleagues said that flexible working was important to them, we listened. We also know flexible working is important to many of the incredible people considering joining Akamai. Flex Base gives 95% of employees the choice to work from their home, their office, or both (in the country advertised).

This permanent workplace flexibility program is consistent and fair globally, to help us find incredible talent, virtually anywhere. We are happy to discuss working options for this role and encourage you to speak with your recruiter in more detail when you apply.

• Your health
• Your finances
• Your family
• Your time at work
• Your time pursuing other endeavors

For US-based candidates only, the base salary for this position ranges from $148,200 - $307,800 per year. Salary is based on factors such as work experience, skills, certifications, and location. Candidates outside the US will receive a varying compensation package. The package may include incentive compensation, equity awards, and an Employee Stock Purchase Plan. Akamai also offers healthcare, 401(k) savings plan, vacation (PTO), sick time, family-friendly benefits, and an employee assistance program focusing on mental and financial wellness.

Akamai Technologies is an Affidative Action, Equal Opportunity Employer that values the strength that diversity brings to the workplace. All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of gender, gender identity, sexual orientation, race/ethnicity, protected veteran status, disability, or other protected group status.