Software Engineer, CI​/CD & ML Infrastructure

Software Engineer, CI/CD & ML Infrastructure | OpenAI

Careers

Hardware - San Francisco

OpenAI’s Hardware organization develops AI-native silicon and system-level solutions for the unique demands of advanced AI workloads. Building on efforts like Jalapeño, the team is developing future generations of AI-native silicon and tightly integrated systems to power the next generation of frontier models. By co-designing chips, systems, tools, and methodologies, the team helps deliver faster, more efficient, and production-ready hardware for OpenAI’s supercomputing platform.

About the Role

You will define and build the CI/CD systems that qualify frontier models and the software stack running on OpenAI’s custom AI accelerators. Your work will make correctness, performance, and stability measurable on every change, from individual commits through production releases.

This role spans model workloads, accelerator software, systems infrastructure, and developer productivity. You will establish scalable CI/CD, Git Ops, and monorepo practices; design trustworthy regression and benchmarking pipelines; and partner with model, compiler, kernel, runtime, firmware, and hardware teams to shorten feedback loops without compromising production readiness.

In this role, you will:

• Define the model CI strategy for frontier models running on OpenAI custom silicon and integrated accelerator systems.
• Build production CI/CD pipelines for functional regression, performance benchmarking, software stability, and release qualification.
• Design representative test matrices across models, configurations, hardware generations, software components, and deployment environments.
• Create reliable performance baselines, regression detection, bisect and triage workflows, and clear ownership for failures.
• Establish Git Ops practices for reproducible configuration, promotion, rollback, auditability, and environment consistency.
• Shape monorepo architecture, dependency management, build and test boundaries, change validation, and developer workflows at scale.
• Develop scalable orchestration, artifact management, caching, scheduling, observability, and capacity controls for accelerator-backed CI.
• Partner with model, compiler, kernel, runtime, firmware, validation, and hardware teams to translate release risks into automated gates.
• Improve CI reliability, speed, debuggability, and cost efficiency while maintaining high confidence in production software.

You might thrive in this role if:

• Have built or operated large-scale CI/CD, developer infrastructure, test automation, or production engineering systems.
• Understand modern software delivery practices, including Git Ops, release promotion, rollback, reproducibility, and policy-driven automation.
• Have experience designing monorepos, build systems, dependency graphs, test selection, or change-impact analysis.
• Can design regression and performance-benchmarking systems with stable baselines, useful metrics, and actionable failure diagnosis.
• Are proficient in Python, Go, Rust, C++, or another language used to build reliable infrastructure and automation.
• Have worked with distributed systems, schedulers, containers, clusters, or heterogeneous compute infrastructure.
• Can collaborate with model and systems engineers to turn complex accelerator workloads into repeatable production qualification.
• Care deeply about reliability, observability, developer experience, and reducing time from code change to trustworthy signal.

To comply with U.S. export control laws and regulations, candidates for this role may need to meet certain legal status requirements as provided in those laws and regulations.

About OpenAI

OpenAI is an AI research and deployment company dedicated to ensuring that…