AI​/ML Engineer

As an AI/ML Engineer, you’re excited by the rapid evolution of AI and the impact modern LLM technologies can have on real users. You understand that building dependable AI capabilities requires more than clever prompts — it requires thoughtful engineering, clear communication, and the ability to collaborate across diverse technical and mission teams. We’re seeking someone with a strong foundation in IT, systems, software, data, cloud, infrastructure, integration, or related technical disciplines who is eager to apply that experience to scalable AI/ML solutions that support enterprise-level environments and sensitive data workflows.

As an AI/ML Engineer on our team, you’ll design and refine prompts, help build LLM‑powered workflows, and support the development of retrieval augmented systems that improve decision making and operational efficiency. You’ll work closely with senior technical leaders who will guide AI/ML direction while you contribute hands‑on execution and apply your broader IT and technical experience to real mission applications. You’ll collaborate with cross‑functional teams and apply modern AI practices in secure, regulated environments.

Join us. The world can’t wait.

You Have:

• 8+ years of experience in IT, systems administration, software development, systems integration, cloud services, data engineering, cybersecurity, infrastructure, enterprise applications, or automation
• Experience with AI/ML, LLM‑enabled tools, prompt engineering, automation, analytics, data workflows, or emerging technology solutions
• Experience in designing, testing, and iterating on prompts for LLM‑powered applications
• Experience with Retrieval Augmented Generation such as chunking, embeddings, retrieval, and grounding responses in source data
• Experience with Python, including writing clean and reusable code
• Experience with Git, Git Hub, or version control tools
• Experience supporting the assessment, design, integration, documentation, implementation, or troubleshooting of IT or technical solutions
• Ability to effectively communicate, confirm requirements, reduce churn, and maintain alignment across teams
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
• Bachelor’s degree in a Computer Science, Information Technology, or STEM field

Nice If You Have:

• Experience with prompting techniques such as few‑shot prompting, structured output formats, ReAct, or similar prompting approaches
• Experience building or supporting simple multi‑step LLM workflows using tools such as Lang Chain, Llama Index, Semantic Kernel, Lang Graph, or similar tools
• Knowledge of responsible AI practices including content filtering, guardrails, output validation, or safe handling of model outputs
• Experience working with PHI, PII, or within HIPAA, IRB, or ATO environments
• Experience with vector databases or semantic search systems
• Experience building evaluation sets for prompt testing
• Experience with enterprise tools such as Jira, Confluence, or API‑driven workflows
• Experience in healthcare, research data, or regulated data environments
• Experience with Microsoft Azure services, Azure OpenAI, or Azure ML and AI Foundry tooling
• Experience applying IT, systems, software, data, cloud, or integration experience to emerging technology initiatives

Vetting:

Applicants selected will be subject to a government investigation and may need to meet eligibility requirements of the U.S. government client.

At Booz Allen, we celebrate your contributions, provide you with opportunities and choices, and support your total well‑being. Our offerings include health, life, disability, financial, and retirement benefits, as well as paid leave, professional development, tuition assistance, work‑life programs, and dependent care. Our recognition awards program acknowledges employees for exceptional performance and superior demonstration of our values. Full‑time and part‑time employees working at least 20 hours a week on a regular basis are eligible to participate in Booz Allen’s benefit programs.

Individuals that do not meet the threshold are only eligible for select offerings, not inclusive of health benefits. We…