Senior Machine Learning Engineer, Infrastructure

# Senior Machine Learning Engineer, Infrastructure

OpenAI##

Job Description ### About the Role We are seeking a Senior ML Infrastructure Engineer to build the backbone of our large-scale training and inference systems. You will work closely with researchers to optimize the performance, throughput, and reliability of cluster operations running across tens of thousands of GPUs.### Responsibilities
- Architect, build, and scale distributed training and inference infrastructure.

- Diagnose and resolve complex performance bottlenecks in multi-node GPU clusters.

- Develop tools and automation for continuous integration, deployment, and monitoring of ML workloads.

- Collaborate with hardware vendors to prototype and integrate next-gen accelerator chips.### Requirements- B.S., M.S., or Ph.D. in Computer Science or related field.

- 5+ years of software engineering experience with deep expertise in distributed systems.

- Proficiency in C++, Python, CUDA, and modern cluster orchestration tools (Kubernetes, Ray).

- Deep understanding of networking protocols (Infini Band, RoCE) and distributed training frameworks (Megatron-LM, Deep Speed).### Benefits
- Industry-leading compensation and equity.

- Full medical, dental, and vision coverage with 100% premium coverage options.

- Unlimited paid time off and flexible remote work policies.

- Wellness stipends and learning budgets.## Skills & Tagspythonc++cudakubernetesdistributed-systems infrastructure## Job Details Full-time

San Francisco, CA $320k – $500k USDPosted August 13, 2026

Expires October 12, 2026
#J-18808-Ljbffr