Software Product Manager

Job Description

The AI Compute Software Product Manager owns the product strategy, roadmap, and execution for performance‑critical middleware layers enabling AI training and inference on modern accelerators and CPUs. This role sits at the intersection of hardware capabilities, frameworks, and system‑level software, ensuring scalable, high‑performance, and developer‑friendly compute plumbing across AI workloads.

• Job Type: Experienced Hire
• Shift: Shift 1 (United States of America)
• Primary
  
  Location:
  
  US, California, Santa Clara
• Additional Locations: US, Arizona, Phoenix; US, Oregon, Hillsboro; US, Texas, Austin

• Define and own the product vision and roadmap for AI compute middleware.
• Translate hardware capabilities into middleware features that unlock performance and usability.
• Drive performance, scalability, and correctness requirements across AI training and inference workloads.
• Partner closely with Framework PMs (PyTorch, JAX, vLLM, etc.), Driver and firmware teams, Compiler and kernel engineers.
• Prioritize investments based on model and workload trends, customer requirements, competitive analysis and benchmarks.
• Ensure Day‑0 enablement for new hardware, models, and software releases.
• Align backlog and milestones across multiple product lines in a matrixed operating model.
• Represent middleware strategy in internal reviews and external technical engagements as needed.
• Reason about hardware–software co‑design tradeoffs.
• Proven experience working in complex, matrixed organizations.
• Strong technical communication and decision‑making skills.

• AI workloads achieve measurable performance, efficiency, and scaling gains.
• Middleware is adopted broadly by frameworks and solution teams.
• Product releases are Day‑0 ready with minimal gaps and escalations.
• Developers experience a stable, predictable, and performant compute layer.
• Investments result in clear competitive differentiation or cost/TCO improvements.

• Bachelor's degree with 6 years of experience, or Master's degree in Computer Science, Software Engineering, MBA, or related field with 4 years of experience.
• 6+ years of software product management experience and 2+ years of background in systems engineering or performance‑critical software development.
• Experience in AI training and inference workloads, compute kernels, math libraries, and runtime performance tuning.
• Experience with accelerator architectures (GPU/AI accelerators) and CPUs.

• Hands‑on experience with OneDNN, SYCL, Triton, CUDA‑like or kernel‑level programming models.
• Experience with AI frameworks or compiler stacks.
• Experience with benchmarking, profiling, and performance analysis tools.

We offer a total compensation package that ranks among the best in the industry, consisting of competitive pay, stock bonuses, and benefit programs including health, retirement, and vacation. Your recruiter can share more about the specific compensation range for your preferred location during the hiring process.

All qualified applicants will receive consideration for employment without regard to race, color, religion, religious creed, sex, national origin, ancestry, age, physical or mental disability, medical condition, genetic information, military and veteran status, marital status, pregnancy, gender, gender expression, gender identity, sexual orientation, or any other characteristic protected by local law, regulation, or ordinance.