Machine Learning Engineer, Foundation Model Services

Seattle, Washington, United States Machine Learning and AI

The Foundation Model Services team within the Machine Learning Platform Technologies organization powers Apple’s largest foundation models on servers. The team builds frameworks, services, and tools that enable high‑throughput inference for services such as Apple Search, Apple Music, Siri, and many other products that power billions of user interactions daily.

• Work closely with product teams to build production‑grade solutions that launch models serving millions of customers in real time.
• Collaborate with the Foundation Model Research team to prototype and develop inference for cutting‑edge model architectures.
• Build tools to understand bottlenecks in inference for different hardware and use cases.

• 5+ years of industry experience in ML technologies (LLMs, machine learning, NLP, information retrieval, statistics).
• Experience with high‑throughput services, particularly at supercomputing scale.
• Proficient with running applications on cloud platforms (AWS, Azure, or equivalent) using Kubernetes, Docker, etc.
• Proficient in building and maintaining systems written in modern languages (e.g., Golang, Python).
• Bachelor’s degree or higher in Computer Science or a related technical field.

• Familiarity with popular ML frameworks such as PyTorch, Tensor Flow.
• Familiarity with foundational deep‑learning architectures such as Transformers, encoder/decoder models.
• Familiarity with Nvidia Tensor
  
  RT‑LLM, vLLM, Deep Speed, Nvidia Triton Server, etc.

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $171,600 and $302,200, and your base pay will depend on your skills, qualifications, experience, and location.

Apple employees also have the opportunity to become shareholders through participation in Apple’s discretionary employee stock programs. Employees are eligible for discretionary restricted stock unit awards and can purchase Apple stock at a discount if voluntarily participating in the Apple Employee Stock Purchase Plan. You will also receive comprehensive medical and dental coverage, retirement benefits, discounted products and free services, and reimbursement for certain educational expenses—including tuition.

Additionally, this role may be eligible for discretionary bonuses or commission payments as well as relocation support.

Apple benefit, compensation, and employee stock programs are subject to eligibility requirements and other terms of the applicable plan or program.

Apple is an equal‑opportunity employer committed to inclusion and diversity. We seek to promote equal opportunity for all applicants without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, veteran status, or any other legally protected characteristic. Learn more about your EEO rights as an applicant.

At Apple, we believe accessibility is a fundamental human right. This belief is reflected in our culture, benefits, and digital tools. By welcoming diverse perspectives, we help you build a career where you feel like you belong.

Learn about accessibility in Apple’s workplace.

Learn about reasonable accommodations for job applicants.