Production Systems Engineer, Automation

Production Systems Engineer, Automation# Production Systems Engineer, Automation Menlo Park, CA Hardware+ 1 more Apply nowMeta is seeking a Production Systems Engineer, Tooling to join our Production Systems Engineering organization, where you will help drive the reliability, efficiency, and scalability of Meta's large-scale hardware infrastructure through improvements by test automation. You will design and build the systems tooling, test automation, and frameworks that keep Meta's global production fleet — spanning compute, storage, networking, and custom silicon — operating at peak performance.

Working at the intersection of hardware and software, you will partner with data center operations, hardware engineering, platform teams, and ODM/vendor partners to drive systemic improvements across the full infrastructure stack.

---## Production Systems Engineer, Automation Responsibilities
* Design, build, and scale test orchestration and validation tooling, CI/CD pipelines, and automation frameworks that qualify large-scale AI hardware platforms at cluster scale — spanning provisioning, monitoring, and lifecycle management of compute, storage, and networking infrastructure
* Develop tooling for hardware lifecycle management, fleet health observability, and automated remediation of production system failures across Meta's data center fleets
* Identify and resolve systemic reliability and performance issues by analyzing hardware telemetry, failure patterns, and system-level diagnostics at scale
* Collaborate with hardware engineering teams to define software interfaces, firmware integration requirements, and bring-up workflows for new server and accelerator platforms
* Lead cross-functional efforts to evaluate, qualify, and integrate new hardware technologies into the production environment, including validation and qualification workflows
* Develop scalable infrastructure automation that reduces operational toil and accelerates hardware deployment and remediation across the global fleet
* Mentor other engineers on systems software design, debugging methodologies, and production infrastructure best practices
* Communicate technical designs and architectural decisions through written documentation and cross-functional stakeholder alignment##

Minimum Qualifications
* Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience
* 3+ years of experience in production systems engineering or infrastructure software engineering, including development in C, C++, or Python for Linux-based environments
* 3+ years of experience with large-scale hardware infrastructure systems, including fleet automation, hardware lifecycle management, or data center operations software
* 3+ years of experience in designing and operating distributed systems software at scale, including monitoring, alerting, and automated remediation pipelines
* 3+ years of experience in communicating system designs and technical decisions through written documentation and cross-functional stakeholder engagement
* Demonstrated troubleshooting skills across hardware products and automation software##

Preferred Qualifications
* Master's Degree in Computer Science, Computer Engineering, or similar field
* 6+ years of experience across a variety of infrastructure components such as network, and compute in a datacenter or large-scale production environment
* 3+ years of experience in building or operating CI/CD pipelines and test automation frameworks for infrastructure software
* Familiarity with custom silicon or accelerator platform integration, including firmware and platform management interfaces
* Expertise guiding cross-functional teams or ODM/vendor partners through the setup,…