Principal Product Manager - AI Tooling

Job Overview

We are building a unified developer experience that helps machine learning engineers move from a trained model to an optimized, validated and deployable artifact on Arm-based systems.
Our AI tooling will bring together model graph inspection, hardware compatibility analysis, graph partitioning, quantization and other performance optimization techniques with benchmarking and deployment packaging across Arm CPUs, GPUs, Ethos-U NPUs and will evolve alongside Arm's roadmap.
We are looking for a Principal Product Manager to own the product strategy and delivery of Arm's AI tools. Together, we will turn a portfolio of powerful but fragmented capabilities into a coherent product that meets developers in their existing workflows, including agentic harnesses.

This is a senior individual-contributor leadership role. You will set direction across multiple engineering teams, align architecture and product investments, develop ecosystem partnerships and be accountable for delivering a product that developers embrace and trust.

• Define the product vision, roadmap and success measures for Arm AI tools to achieve a simple model-to-deployment journey, including the technical positioning and product launch.
• Deliver an extraordinary developer experience across command-line tools, Python, Jupyter notebooks, IDEs, CI and AI coding agents.
• Help developers use Arm's tooling within familiar ML frameworks including PyTorch.
• Prioritize capabilities that increase model compatibility with Arm accelerators, ensuring that developers can benefit during pre-or-post Silicon.
• Turn UX research, product and market data into roadmap decisions.
• Incorporate groundbreaking approaches to agentic model optimization, including safe and reproducible automation.
• Develop partnerships with ML frameworks, runtime providers, silicon partners and accelerator vendors.

Are you motivated by translating technical challenges into clear product decisions? If you are comfortable discussing model formats, quantization, graph partitioning, latency, memory and hardware acceleration, you'll excel in this role. Additionally, you'll need to demonstrate:

• Proven product management in development tools and software including CLIs, SDKs and APIs.
• Knowledge of machine learning frameworks, runtimes, infrastructure such as PyTorch, ONNX, Execu Torch, Llama.cpp, vLLM and LiteRT.
• Understanding of model deployment to edge, embedded or heterogeneous computing, with an understanding of trade-offs between accuracy, performance and power consumption.

• An engineering or computer science background.
• Experience taking a technical product from concept to adoption and an ability to make hard trade-offs in defining a product roadmap.
• The ability to build alignment without direct authority, and evidence of clear communication with developers, partners and senior leaders.
• Good judgement about build, partnership and acquisition choices.

In your first year, you will establish product vision, strategy and roadmap, defining a developer workflow that is validated with ML engineers and application developers. You'll make rapid progress on delivering an agent-ready product experience, measuring adoption and developer success, all while building your network in the Arm ecosystem!

We will welcome you to a highly motivated product management team, with groundbreaking work happening across the board and a once-in-a-career opportunity to build the future of ML engineering on the worlds' most pervasive compute platform - Arm.

If skilled worker sponsorship is required, Arm will meet costs associated with sponsorship for the employer only. All fees associated with the individual’s application e.g. visa application fee and Immigration Health Surcharge, will be the responsibility of the successful candidate.

At Arm, we want to build extraordinary teams. If you need an adjustment or an accommodation during the recruitment process, please email [email protected]. All accommodation or adjustment requests will be treated with confidentiality, and information…