Senior AI Platform Engineer: Gateway & Guardrails

Our Mission

As the world’s number 1 job site*, our mission is to help people get jobs. We strive to cultivate an inclusive and accessible workplace where all people feel comfortable being themselves. We're looking to grow our teams with more people who share our enthusiasm for innovation and creating the best experience for job seekers.

(
* Comscore, Total Visits, March 2025)

Day to Day

As a Software Engineer III on the AI Gateway & Guardrails team at Indeed, you will own and drive the development of platform services that connect Indeed's AI-powered products to large and small language models (LLM and SLM), and safeguards AI actions. You will work alongside experienced engineers developing features for two core services;
1) AI Gateway, Indeed’s unified entry point for multiple model providers with built-in best practices, and
2) AI Guardrails Platform, Indeed’s universal safety layer for language model powered products.

In this role, you’d remove technical barriers to entry for teams all across Indeed to experiment with generative AI. This work provides an opportunity to leverage cutting-edge technologies across multiple cloud providers, influence the product direction for a broad spectrum of client teams, and guide best practices for AI use. You will contribute to architectural decisions, drive service reliability through SLOs and operational readiness, and partner with product teams across Indeed to ensure the platform meets compliance and quality standards required for production AI deployment.

Responsibilities

• Design, implement, and maintain platform services that provide secure, scalable, and reliable access to LLM and SLM providers across multiple cloud environments.

• Contribute to multi-provider access, failover, and rate-limiting capabilities across cloud platforms (Azure, AWS, and GCP).

• Drive improvements to the AI Guardrails Platform, such as content moderation and Personally Identifiable Information (PII) redaction

• Facilitate technical discussions and contribute architectural decisions at the service and system level.

• Identify and implement reliability improvements through SLOs, observability tooling, alerting, and runbook development.

• Collaborate with engineers, product managers, and governance partners across teams to deliver compliant, production-ready AI systems.

• Share knowledge and provide technical guidance with teammates.

Skills/Competencies

• Requires a Bachelor’s degree in Computer Science, Mathematics, Computer Engineering, or Electrical Engineering, and a minimum of 5 years of related experience; or a Master’s degree with a minimum of 3 years of experience; or a PhD without experience

• Experience building or operating large-scale distributed systems, ideally within platform or infrastructure environments

• Proficiency with cloud infrastructure across major providers (AWS, GCP, or Azure), including deployment, monitoring, and operations

• Experience with or interest in AI/ML systems, including LLM-based services, prompt engineering, or AI safety approaches

• Familiarity with reliability engineering practices such as SLOs, error budgets, observability tools, and on-call readiness

• Solid grounding in data structures, algorithms, and core computer science principles, with a track record of solving complex technical problems

• Demonstrated ownership, accountability, and a proactive mindset, paired with curiosity and a drive to continuously learn

Salary Range Transparency

Tier 1 - United States of America 118, USD per year

Tier 2 - United States of America 131, USD per year

Tier 3 - United States of America 145, USD per year

Tier 4 - N/A

Tier 5 - United States of America 166, USD per year

Salary Range Disclaimer

The salary range for this role reflects the minimum and maximum compensation for the role. Offers are typically made between the range minimum and the range midpoint. Actual compensation will be determined based on job-related skills, experience, and expertise, as evaluated during the interview process. The range(s) listed is just one component of Indeed's total compensation package for employees. Other rewards may include quarterly bonuses, Restricted Stock Units (RSUs), a Paid Time Off policy, and many…