Software Engineer - AI Agentic Compute

We are looking for curious and motivated engineers to join us in building the compute platform for AI at scale!

Agentic AI is changing what CPU performance means in the cloud . As AI systems evolve from individual model calls towards complex, distributed workflows, performance increasingly depends on efficiently orchestrating models, data, tools and services across the whole system.

You will join a diverse, dedicated and inclusive group based in Arm's vibrant office at the heart of Manchester. Your work will help ensure the latest developments in AI take full advantage of Arm Neoverse platforms and pioneering cloud-server technologies like AGI-CPU, our CPU for next-generation AI data centers. Together with teams from across Arm, the open source community, and our partners, you will be accelerating AI and helping build the future of computing on Arm.

We work on the full stack, from applications and frameworks, to compilers, libraries, and assembly; we encourage everyone in the team to get involved in all parts. The team has a wide remit, but we are all aligned on a common goal. We trust and empower engineers with the autonomy to identify and solve problems without silos and with the support of their team mates.

• Strong software engineering and programming skills, preferably C++ and Python
• Eager to dive into unfamiliar software stacks and codebases , debug complex issues, and identify performance opportunities
• Familiarity with Linux development environments , profiling, debugging and performance analysis
• A degree in a computational or numerate subject , or equivalent experience

• Experience with ML frameworks and LLM inference , such as PyTorch, vLLM, SGLang, llama.cpp or similar
• Experience using heterogeneous CPU + accelerator systems
• Familiarity with agentic AI frameworks and protocols
• An interest in understanding end-to-end application and system performance , from higher-level applications through runtimes and libraries to the underlying hardware
• Understanding of CPU bottlenecks in agentic workloads
• Understanding of databases, vector search and retrieval systems
• Familiarity with containers and cloud/server infrastructure
• Understanding of parallel programming, collective communications or distributed AI workloads
• Experience engaging with the open-source community
• Familiarity with SIMD technologies, such as Neon, SVE and SME

• Comfortable sharing ideas, asking questions, and collaborating with others.
• Able to work independently, make pragmatic decisions and navigate ambiguity and change
• Experience delivering technical work involving multiple contributors

You will receive an attractive reward package with generous stock awards. We also know that people do their best work when they feel rested and psychologically safe, so we have a progressive leave policy including generous parental leave, days of care and 4 weeks of sabbatical every 4 years. We are flexible on working hours, and allow hybrid working. We strive to provide an open and accepting environment where you are encouraged to share your ideas and opinions;

which enables collective innovation and creativity, and supports your professional and personal growth.

We are an equal opportunity employer and value diversity at our company. We do not discriminate on the basis of race, religion, color, national origin, sex, gender, gender expression, sexual orientation, age, marital status, veteran status, or disability status. We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment.

Please contact us to request accommodation.

Please note this role does not meet the eligibility requirements for sponsorship, and therefore the successful candidate must have the right to work in the UK without relying on sponsorship by Arm.

At Arm, we believe progress happens when people are empowered to think bigger and push beyond what seems possible. Our 10x mindset is about curiosity, ambition and creating impact that will be used by millions. We learn fast, prioritise collaboration and turn bold ideas into real technology. We look for people who are inspired by this way of working and want to grow in an environment where bold ideas are welcomed.

Discover how the 10x mindset shapes life at Arm:

At…