AI​/ML Engineer

Opportunity

As an AI/ML Engineer, you’re excited by the rapid evolution of AI and the impact modern LLM technologies can have on real users. You understand that building dependable AI capabilities requires more than clever prompts— it requires thoughtful engineering, clear communication, and the ability to collaborate across diverse technical and mission teams. We’re seeking someone with a strong foundation in IT, systems, software, data, cloud, infrastructure, integration, or related technical disciplines who is eager to apply that experience to scalable AI/ML solutions that support enterprise‑level environments and sensitive data workflows.

As an AI/ML Engineer on our team, you’ll design and refine prompts, help build LLM‑powered workflows, and support the development of retrieval augmented systems that improve decision making and operational efficiency. You’ll work closely with senior technical leaders who will guide AI/ML direction while you contribute hands‑on execution and apply your broader IT and technical experience to real mission applications. You’ll collaborate with cross‑functional teams and apply modern AI practices in secure, regulated environments.

Join us. The world can’t wait.

• 8+ years of experience in IT, systems administration, software development, systems integration, cloud services, data engineering, cybersecurity, infrastructure, enterprise applications, or automation
• Experience with AI/ML, LLM‑enabled tools, prompt engineering, automation, analytics, data workflows, or emerging technology solutions
• Experience in designing, testing, and iterating on prompts for LLM‑powered applications
• Experience with Retrieval Augmented Generation such as chunking, embeddings, retrieval, and grounding responses in source data
• Experience with Python, including writing clean and reusable code
• Experience with Git, Git Hub, or version control tools
• Experience supporting the assessment, design, integration, documentation, implementation, or troubleshooting of IT or technical solutions
• Ability to effectively communicate, confirm requirements, reduce churn, and maintain alignment across teams
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
• Bachelor’s degree in a Computer Science, Information Technology, or STEM field

• Experience with prompting techniques such as few‑shot prompting, structured output formats, ReAct, or similar prompting approaches
• Experience building or supporting simple multi‑step LLM workflows using tools such as Lang Chain, Llama Index, Semantic Kernel, Lang Graph, or similar tools
• Knowledge of responsible AI practices including content filtering, guardrails, output validation, or safe handling of model outputs
• Experience working with PHI, PII, or within HIPAA, IRB, or ATO environments
• Experience with vector databases or semantic search systems
• Experience building evaluation sets for prompt testing
• Experience with enterprise tools such as Jira, Confluence, or API‑driven workflows
• Experience in healthcare, research data, or regulated data environments
• Experience with Microsoft Azure services, Azure OpenAI, or Azure ML and AI Foundry tooling
• Experience applying IT, systems, software, data, cloud, or integration experience to emerging technology initiatives

Applicants selected will be subject to a government investigation and may need to meet eligibility requirements of the U.S. government client.

Salary: $99,000.00 to $ annualized USD. The estimate displayed represents the typical salary range for this position and is one component of Booz Allen’s total compensation package. Benefits include health, life, disability, financial, and retirement benefits, paid leave, professional development, tuition assistance, work‑life programs, and dependent care.

All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, local, or international law.