Enterprise AI Orchestration Architect, Senior Manager

The Opportunity:

In this role, you’ll build reusable agents and intelligent applications that perform enterprise work reliably. You will develop agent behavior, orchestration, tool integrations, and evaluation capabilities that support customer solutions from demonstration through production. You will translate workflows into tested software using model APIs, retrieval, tool calling, memory, and human oversight. You will instrument execution, maintain evaluation datasets, and improve quality through trace analysis and regression testing.

Partnering with Platform, Data, and Forward-Deployed Engineering, you will deliver reusable components, integration contracts, and deployment guidance. You will own agent behavior and application quality, including the evidence needed to validate them. Join us. The world can’t wait.

• 10+ years of experience building maintainable applications, APIs, and automated tests using version control and software engineering practices, including proficiency in Python or Type Script
• Experience integrating large language models into applications, including prompt and context management, structured outputs, and tool calling
• Experience implementing agent orchestration, workflow state, retrieval-augmented generation, and enterprise API integrations
• Experience instrumenting model calls, tool execution, state transitions, and outcomes with logs or distributed traces
• Experience developing evaluation datasets and regression tests for task success, groundedness, safety, tool correctness, latency, and cost
• Ability to design appropriate human approval steps, tool permissions, input and output validation, error handling, and fallback behavior
• Ability to diagnose application failures and distinguish agent behavior defects from data, platform, or customer configuration issues
• Ability to document interfaces and limitations and collaborate on customer readiness and reusable engineering improvements
• Bachelor’s degree

• Experience with Lang Graph, Semantic Kernel, MCP, Open Telemetry, Lang Smith, Langfuse, or comparable technologies
• Experience with multi-agent coordination, memory design, reusable SDKs, or reference architectures
• Experience with delivering full-stack AI applications or improving production workflows through evaluation and trace analysis

At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well-being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs.

Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We encourage you to learn more about our total benefits by visiting the Resource page on our Careers site and reviewing Our Employee Benefits page.

• health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work-life programs, and dependent care.
• Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values.
• Full-time and part-time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs. Individuals that do not meet the threshold are only eligible for select…