Senior Product Manager - LLM Inference

This role owns the strategy, roadmap and commercial results for an LLM inference product, covering the model catalog, API capabilities and production readiness. A strong candidate has led developer facing or API products end to end and can weigh model quality, latency, throughput and cost when setting priorities. Hands on comfort with testing APIs, reading usage data and working through technical trade offs with engineers matters more than formal titles.

The product itself is AI infrastructure, so the work is about making model serving fast, reliable and affordable for teams building on top of it. AI tools speed up parts of discovery, prototyping and analysis, but judgment about which models to offer, what developers actually need and where the unit economics hold stays with the person in the role. Customer conversations and cross team alignment remain human work.

The role builds direct experience with production LLM serving, model evaluation and the trade offs around latency, context length and token cost. It also offers exposure to usage based pricing and capacity planning for dedicated inference. Someone preparing for this could study how serving frameworks and API compatibility work and practice benchmarking models on realistic workloads.

• API product ownership
• LLM inference knowledge

This is our own read, written from the employer's posting and the company's Spotlight. The employer's posting is the source of truth for the role.

High-performance inference platform providing serverless and dedicated GPU infrastructure across thousands of machine learning models.