Engineering Manager, ML Infrastructure

Selection changes the language of the page/content

London, England, United Kingdom Software and Services

Apple's cloud AI inference platform is growing quickly, and so is the organisation that builds it. We have a complex inference stack, a rapidly changing generative-AI landscape, and more responsibility than our current teams can hold — so we are looking for engineering managers to take ownership of components of that stack and lead the teams that build them. This role is based in London.

Private Cloud Compute is the system that lets Apple Intelligence reach beyond the device without compromising a user's privacy: generative AI inference running in Apple's cloud, with verifiable privacy guarantees no other large-scale AI platform offers. It is the server software behind Apple Intelligence, and it is the critical function this organisation exists to deliver.

The stack is deep. On-device client frameworks hand requests to a cloud service that attests, routes, and orchestrates them; an inference engine serves them; and model runtimes execute across heterogeneous hardware platforms, from Apple silicon to industry-standard accelerators, each with different performance characteristics and constraints. Cutting across all of it are the problems that decide whether the platform is fast, affordable, and operable: context and cache management, model asset management and lifecycle, throughput and latency, observability, and the developer and test infrastructure that everything else is built on.

You would own set of components in this stack. The generative-AI landscape is a rapidly evolving and we are looking for managers with an agile mindset that are energized by change. You can hold a clear technical direction while the ground shifts and have a strong desire to help define our roadmap.

Day to day you will hire, grow, and lead a team of engineers; own delivery against a roadmap you help set; lead design reviews and make architectural calls yourself when your team needs a decision; run a healthy on-call and incident practice; and partner across time zones with ML research, hardware and platform teams, security and privacy, SRE, and the product teams that depend on you.

You will work with teams in London, Cupertino, and Seattle whose work spans low-level operating systems and accelerator runtimes through data-centre services, network protocols, and public APIs.You should be technically credible — you do not need to be the strongest individual contributor on the team, but you must be able to hold your own in a design review, read the code when it matters, and tell a good argument from a confident one.

You should be able to absorb shifting priorities on behalf of your team rather than passing them along. And you should care about the privacy promise this platform makes to users; much of what makes the engineering here hard, and interesting, is that the usual shortcuts are not available to us.

• Build, coach, and retain a high-performing, inclusive team: hiring, onboarding, growth, feedback, and performance management.
• Take ownership of one or more areas of the inference stack, and be accountable for their delivery, quality, and technical direction.
• Set and defend a technical roadmap that stays credible as priorities and platforms change, balancing near-term delivery against longer-term investment.
• Partner across engineering, research, hardware, security and privacy, SRE, and product to deliver outcomes that span team boundaries.
• Hold a rigorous engineering bar: honest measurement, reproducible results, operational readiness, incident review, and documentation.
• Represent your team's work to senior leadership, and advocate for the resources and direction it needs.
• Develop technical leads within your team, delegating real architectural ownership rather than retaining it.
• Ensure the team applies privacy-by-design and secure-by-design principles throughout, particularly around what may and may not be observed or logged in a system handling user content.

• Experience managing software engineers, including hiring, coaching,…