Sr. Software Engineer, Generative

Santa Clara, California, United States Machine Learning and AI

Are you interested in revolutionizing how hundreds of millions of people utilize their devices to access information? As an engineer on the team, you will bridge the gap between cutting-edge foundation models and the end user, helping guide the products and features that bring our generative AI technologies to life.

In this role, you will be the critical engineering link between backend machine learning and the final user interface. You will be responsible for designing and implementing intelligent user experiences that leverage Large Language Models (LLMs). To make these experiences fast, accurate, and context-aware, you will integrate with data and services from multiple providers, building the complex orchestration layer required for Retrieval-Augmented Generation (RAG).

You will work closely with our platform team to define the infrastructure interfaces necessary for low-latency model serving and secure data handling. Because you bring strong product thinking to the room, you will also partner directly with Apple Design and client-side teams to ensure a great user experience, translating complex AI interactions into flawless, intuitive features across Siri, Spotlight, and Safari.

• Engineering Model-Driven Products:
  Leverage the latest advancements in machine learning by building the robust software application layer that translates foundation model capabilities into intuitive, generative user experiences.
• Complex Integrations & Privacy:
  Orchestrate ML APIs with internal data and services to power RAG architectures, ensuring all integrations maintain Apple's high standards for secure, direct, and privacy-preserving data handling.
• Championing the User
  
  Experience:
  
  Partner closely with design, product, and client-side teams to craft elegant solutions for emerging generative UI paradigms, ensuring fluid text streaming, dynamic widget generation, and graceful fallbacks.
• Cross-Functional Collaboration:
  
  Collaborate with diverse teams—including ML infrastructure, quality, data, and core platform—to define system contracts, ensuring optimal latency, robust error handling, and scalable orchestration.
• Evaluation & Telemetry Tooling:
  Develop the engineering frameworks, benchmark tooling, and telemetry required to accurately measure, calibrate, and evaluate the real-time performance and quality of model responses in production.
• Global Reach & Mentorship:
  Work with the globalization team to ensure localized, culturally aligned experiences, and mentor aspiring engineers to broaden their horizons and amplify the team's overall impact.

• 3+ years of industry related experience, working in collaborative environments
• Experience with prompt engineering and prompt tuning techniques to tasks, conducting systematic evaluation and iteration based on quality and consistency metrics.
• Opinionated product-sense and focus on the end user-experience
• Excellent problem solving, critical thinking, and communication skills
• Proficient in at least two programming languages such as: C/C++, Go, Python, Java
• Understanding product requirements then translating them into engineering tasks
• Bachelors in Computer Science or related field or 2 years of equivalent work experience

• Prior experience in consumer facing product is desired
• In-depth experience with server-side development and deployment
• Advanced degree in CS

At Apple, base pay is one part of our total compensation package and is determined within a range. This provides the opportunity to progress as you grow and develop within a role. The base pay range for this role is between $184,700 and $277,600, and…