Principal Software Development in Test - Akamai Inference Cloud; Remote

Principal Software Development in Test - Akamai Inference Cloud (Remote)

Join to apply for the Principal Software Development in Test - Akamai Inference Cloud (Remote) role at Akamai Technologies
.

Do you thrive on ensuring excellence in AI systems?

Are you ready to define quality standards for AI inference at global scale?

Join the Akamai Inference Cloud Team! The Akamai Inference Cloud team is part of Akamai's Cloud Technology Group. We design, implement, deploy and operate AI platforms that enable customers to run inference models and developers to create AI applications with unmatched performance, compliance, and economics.

• Establishing quality frameworks and standards for AI inference, including model accuracy evaluation, performance benchmarking, and output quality validation
• Designing and implementing sophisticated testing strategies for LLM and inference workloads, including accuracy testing, regression detection, and model behavior validation
• Providing thought leadership on AI quality metrics, evaluation methodologies, and best practices for ensuring reliable AI systems at scale
• Building tools and automation for continuous model validation, performance testing, and quality assessment across global deployments
• Collaborating with engineering and product teams to define quality requirements, SLOs, and acceptance criteria for AI services

• 12 years of relevant experience and a Bachelor's degree or its equivalent
• Expertise in AI/ML quality assessment, model evaluation, and performance testing of inference systems
• Extensive knowledge of LLM evaluation frameworks, metrics (perplexity, BLEU, ROUGE, etc.), and methodologies for assessing model accuracy and output quality
• Mastery of test automation, CI/CD integration, and building quality infrastructure for distributed systems at scale
• Solid opinions on AI quality standards including model explainability, bias detection, safety validation, and responsible AI practices
• Excellent technical leadership with ability to influence quality culture, mentor engineers, and establish testing best practices across teams

• Your health
• Your finances
• Your family
• Your time at work
• Your time pursuing other endeavors

Mid-senior level

Full-time

Engineering and Information Technology

Technology, Information and Internet

Referrals increase your chances of interviewing at Akamai Technologies by 2×.

Akamai Technologies is an affirmative action, equal opportunity employer that values the strength that diversity brings to the workplace. All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of gender, gender identity, sexual orientation, race/ethnicity, protected veteran status, disability, or other protected group status.

Base salary ranges from $148,200 to $307,800 per year. Compensation for candidates outside the US will vary. The package may include incentive compensation, equity awards, and an Employee Stock Purchase Plan.