Principal Software Development in Test - Akamai Inference Cloud; Remote

Principal Software Development in Test - Akamai Inference Cloud (Remote)

United States (Remote)

Do you thrive on ensuring excellence in AI systems?

Are you ready to define quality standards for AI inference at global scale?

Join the Akamai Inference Cloud Team!

The Akamai Inference Cloud team is part of Akamai's Cloud Technology Group. We design, implement, deploy and operate AI platforms that enable customers to run inference models and developers to create AI applications with unmatched performance, compliance, and economics.

Partner with the best

As a Principal SDET, you will serve as the technical leader for quality, performance and accuracy of our AI inference platform. You will establish frameworks and methodologies for evaluating performance, quality and reliability s role goes beyond traditional testing—you'll define what quality means for our AI systems, develop sophisticated evaluation frameworks and ensure our platform delivers accurate, reliable and performant AI inference globally.

As a Principal SDET, you will be responsible for:

• Establishing quality frameworks and standards for AI inference, including model accuracy evaluation, performance benchmarking, and output quality validation
• Designing and implementing sophisticated testing strategies for LLM and inference workloads, including accuracy testing, regression detection, and model behavior validation
• Providing thought leadership on AI quality metrics, evaluation methodologies, and best practices for ensuring reliable AI systems at scale
• Building tools and automation for continuous model validation, performance testing, and quality assessment across global deployments
• Collaborating with engineering and product teams to define quality requirements, SLOs, and acceptance criteria for AI services

Do what you love

To be successful in this role you will:

• 12 years of relevant experience and a Bachelor's degree or its equivalent
• Have expertise in AI/ML quality assessment, model evaluation, and performance testing of inference systems
• Demonstrate extensive knowledge of LLM evaluation frameworks, metrics (perplexity, BLEU, ROUGE, etc.), and methodologies for assessing model accuracy and output quality
• Show mastery of test automation, CI/CD integration, and building quality infrastructure for distributed systems at scale
• Possess solid opinions on AI quality standards including model explainability, bias detection, safety validation, and responsible AI practices
• Demonstrate excellent technical leadership with ability to influence quality culture, mentor engineers, and establish testing best practices across teams

Work in a way that works for you

Flex Base, Akamai's Global Flexible Working Program, is based on the principles that are helping us create the best workplace in the world. When our colleagues said that flexible working was important to them, we listened. We also know flexible working is important to many of the incredible people considering joining Akamai. Flex Base, gives 95% of employees the choice to work from their home, their office, or both (in the country advertised).

This permanent workplace flexibility program is consistent and fair globally, to help us find incredible talent, virtually anywhere. We are happy to discuss working options for this role and encourage you to speak with your recruiter in more detail when you apply. Learn what makes Akamai a great place to work

#AIC

Connect with us on social and see what life at Akamai is like!

We power and protect life online, by solving the toughest challenges, together.

At Akamai, we're curious, innovative, collaborative and tenacious. We celebrate diversity of thought and we hold an unwavering belief that we can make a meaningful difference. Our teams use their global perspectives to put customers at the forefront of everything they do, so if you are people-centric, you'll thrive here.

Working for you

At Akamai, we will provide you with opportunities to grow, flourish, and achieve great things. Our benefit options are designed to meet your individual needs for today and in the future. We provide benefits surrounding all aspects of your life:

• Your health
• Your finances
• Your family
• Your…