Software Engineer, AI Compute Platform

Position: Staff Software Engineer, AI Compute Platform
As a software Engineer on the AI Compute Platform team, you will design and build a secure, reliable, and easy-to-use platform for running AI workloads  will develop control-plane services, APIs, orchestration systems, and developer tools for distributed training and inference, working closely with compute infrastructure teams, AI engineers, and internal users to improve reliability, scalability, and developer productivity across Arm’s AI workloads.

Responsibilities:

Build scalable backend services, APIs, and asynchronous workflows for managing AI workloads.

Develop Kubernetes controllers that manage workload submission, recovery, and long-running service life cycles.

Deliver secure multi-tenant capabilities covering access, secrets, quotas, and auditability.

Improve platform scalability, observability, reliability, and developer workflows.

Partner across teams to deliver distributed training, evaluation, and inference capabilities while strengthening engineering quality.

Essential

Skills and Experience:

5+ years of experience building distributed systems, cloud platforms, or production backend services

Experience with distributed ML training or inference systems

Strong programming skills in Go, Python, or similar systems languages

Practical knowledge of APIs, Kubernetes, containers, asynchronous processing, and relational databases.

Ability to build clear interfaces and simplify infrastructure for engineers and researchers.

Clear communication and a collaborative approach to problem-solving.

Desired

Skills and Experience:

Experience with Kubernetes operators, schedulers, resource management, or Git Ops or equivalent experience

Knowledge of RPC systems, PostgreSQL, Kafka, Open Telemetry, Prometheus and Grafana Familiarity with distributed AI platforms, inference serving, or frameworks such as PyTorch, Ray, or vLLMExperience delivering developer tools or platform capabilities from early build through production

Technical leadership, mentoring experience, or an advanced degree or equivalent experience in a related field

In Return:

You will have the opportunity to work on important technical challenges in AI and platform engineering as part of a growing team in Seattle. This position offers a chance to contribute to core platform capabilities. You’ll work alongside skilled colleagues from various subject areas and help invent the way new AI services are built and scaled at  addition to meaningful technical work, Arm offers an environment that values thoughtful engineering, collaboration, and continuous learning.

This opportunity suits someone who enjoys solving complex systems problems, working across teams, and contributing to technology important to the future of AI itional Information Please note that a relocation package (including visa sponsorship assistance) is offered for this role, for candidates who need it.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment.

Please contact us to request accommodation.

Salary Range:$209,100-$282,900 per year

We value people as individuals and our dedication is to reward people competitively and equitably for the work they do and the skills and experience they bring to Arm. Salary is only one component of Arm's offering. The total reward package will be shared with candidates during the recruitment and selection process.

O…