Sr. Product Manager, Technical, Amazon Selection and Catalog Systems
-
Business
-
IT/Tech
Job Description & How to Apply Below
Full-time On-site 2mo ago Posted 64 days ago. It may already be filled.
Leadership LLMs
Requirements- 5+ years of product or program management, product marketing, business development or technology experience
- Experience with feature delivery and tradeoffs of a product
- Experience owning/driving roadmap strategy and definition
- Experience with end to end product delivery
- Experience contributing to engineering discussions around technology decisions and strategy related to a product
- Experience with AI/ML technologies
- Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status.
- The base salary range for this position is listed below. Your Amazon package will include sign-on payments and restricted stock units (RSUs). Final compensation will be determined based on factors including experience, qualifications, and location. Amazon also o
Amazon is seeking a Senior Product Manager
- Technical to own the vision and roadmap for MARS (Model Accelerator and Recommender Service), our hardware-agnostic platform for optimizing, benchmarking, and containerizing large language models across heterogeneous compute (Inferentia2, Trainium, and GPU). MARS automatically tunes and recommends optimal hosting configurations, delivering substantial inference cost reduction, throughput gains, and accelerator-utilization improvements for teams across the organization-from model hosting and catalog enrichment to search this role, you will work backwards from internal customers to define a multi-year product strategy that scales MARS into a shared, self-service optimization platform.
You will partner closely with science and engineering to expand the platform's capabilities-new hardware backends, quantization and distillation techniques, and automated benchmarking-while establishing the operating model, intake, and prioritization framework needed to grow adoption. You will own key business metrics such as cost per million tokens, accelerator utilization, and realized IMR savings, and communicate progress and trade-offs to senior leadership.
The ideal candidate is a technical product leader who thrives at the intersection of ML infrastructure, cost optimization, and cross-org influence, and who can turn ambiguous, high-leverage problems into measurable outcomes.
Key job responsibilities
As a Senior Product Manager
- Technical for MARS (Model Accelerator and Recommender Service), you will own the product vision, strategy, and roadmap for Amazon's hardware-agnostic model optimization and benchmarking platform. MARS automatically optimizes, containerizes, and recommends optimal hosting configurations for LLMs across heterogeneous compute (Inferentia2, Trainium, and GPU), driving significant inference cost reduction and throughput gains for teams across the organization.
You will:
Define and drive the multi-year MARS product roadmap, translating cost-optimization and capacity goals into prioritized, measurable deliverables.
Partner with science and engineering to expand MARS capabilities-new hardware backends, quantization and distillation techniques, and automated benchmarking.
Work backwards from internal customers (model hosting, search ranking, catalog enrichment) to identify high-leverage optimization opportunities and unblock adoption.
Establish the MARS operating model, intake process, and prioritization framework to scale the platform as a shared service.
Own key business metrics-cost per million tokens, GPU/accelerator utilization, throughput, and realized IMR savings-and report progress to senior leadership.
Drive cross-org alignment across…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction