Senior AI​/ML Engineer - Agentic AI

Summary

We'rebuilding specialized foundation models and AI agents that accelerate SAP customers' data transformation journeys.

The agents you build will directly power SAP's Autonomous Enterprise, where AI runs core business processes end-to-end across finance, supply chain, HR, and procurement atglobalscale.

You'llset technical direction, define how we architect and scale multi-agent systems, and raise the engineering bar across a global team.

You'llwork directly with pretraining and fine-tuning team leads in Europe, India, and early-adopter customers.

We want someone who has shipped agentic systems in production and knows where they break.

• Architect and lead multi-agent systems: design, orchestration patterns, failure modes, memory, planning, and human-in-the-loop
• Own the path from prototype to production: containerization, guardrails, cost and latency optimization, scalable serving
• Define the team's evaluation strategy: offline/online harnesses, trajectory quality, tool-call accuracy, regression testing, CI/CD eval gates
• Lead instrumentation and observability: tracing, span capture, automated scoring, closing the trace → eval → fix loop
• Drive tool integration architecture via MCP across multiple product teams
• Mentor junior and mid-level engineers through code and architecture reviews; set engineering standards

• Education:
  
  BS, MS, or PhD in Computer Science, ML, or a related field.
• Experience:
  
  6+ years building and shipping ML systems, with 3+ years hands-on with LLMs and agents in production.

• PyTorch; working knowledge of fine-tuning and PEFT methods (LoRA,QLoRA)
• LLM application development: prompting, structured outputs, tool calling, context management
• Human-in-the-loop annotation workflows at scale
• Agent frameworks and orchestration(production experience with at least three)
• Lang Graph/Lang Chain
• CrewAI,Auto Gen/AG2, or equivalent
• Coding agents:
  Claude Code,Open Code, or similar
• Evaluation and observability(production experience with at least two)
• Langfuse,Lang Smith,Arize, or equivalent
• LLM-as-judge evaluators, CI/CD eval gates

• Demonstrated track recordmentoring engineers and raising team technical quality
• Drives decisions in ambiguous, fast-moving environments
• Writes design docs that earn buy-in acrossteams

• Continued pretraining or fine-tuning pipelines (SFT, DPO, RLHF)

The Foundation Model team is part of the Generative AI foundation within Business AI  build domain-specialized foundation models on SAP business data through continued pretraining and fine-tuning, and we build the agentic layer that brings them into SAP products.

SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development.

Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.

SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential.

We ultimately believe in unleashing all talent and creating a better world.

Qualified applicants will receive consideration for employment without regard to their age, race, religion, national origin, ethnicity, age, gender (including pregnancy, childbirth,…