Senior AI Engineer

CDW is a Fortune 500 technology solutions provider that helps businesses, government, education, and healthcare organizations achieve what’s possible through technology.

We are seeking a Senior AI Engineer to transition our AI capabilities from "prototype" to "production." In this role, you will not just experiment with models; you will architect robust Agentic Systems that can plan, reason, and execute complex workflows autonomously for a wide variety of business user needs while experimenting with cutting‑edge models and tools to push the boundaries of what’s possible.

• Agentic Engineering & Orchestration – Design complex, multi‑agent workflows using Microsoft AI tech stack and develop agents to handle loops, interruptions, and human‑in‑the‑loop interventions.
• Tool Use & Function Calling – Build reliable "tool layers" that allow LLMs to safely interact with internal APIs, databases, and third‑party SaaS platforms (e.g., Salesforce, Workday, Service Now).
• State Management – Design persistence layers to manage agent memory, conversational history, and context windows efficiently.
• Advanced Data & RAG Strategy Retrieval Pipelines – Build production‑grade data retrieval and integration systems, optimize vector indexing, document chunking, and re‑ranking algorithms for high‑precision context retrieval.
• Data Quality – Collaborate with Data Engineers to curate "Golden Datasets" for agent consumption.
• LLMOps, Evaluation & Quality – Build CI/CD pipelines for AI that include "LLM‑as‑a‑Judge" testing and scripts to score agent outputs for accuracy, hallucination, and safety.
• Observability – Instrument applications with tracing tools to visualize agent reasoning chains, monitor latency, and debug failures in production.
• Cost Optimization – Monitor token usage and latency, optimizing prompt density and caching strategies to maintain high performance at sustainable costs.
• Innovation & Collaboration – Rapidly validate new ideas using state‑of‑the‑art models and refactor successful prototypes into maintainable, tested production code; stay ahead of emerging technologies to standardize agent connectivity.

• Core Engineering – Bachelor’s degree and 5 years of software engineering experience with exposure to AI/ML applications, or 9 years of software engineering experience with exposure to AI/ML applications.
• AI Specialization – 2+ years building with LLMs; deep familiarity with orchestration frameworks (Lang Chain, Lang Graph, or similar), vector DBs (Pinecone, Weaviate, or pgvector), and advanced prompt engineering techniques (Chain‑of‑Thought, ReAct, Few‑Shot). Production mindset is required—experience operating models, handling rate limits, context window overflows, and non‑deterministic errors.
• Soft Skills – Ability to explain "probabilistic software" to non‑technical stakeholders, manage expectations, excellent communication skills, documentation experience, and team knowledge transfer ability.

• Pay range: $124,000 – $174,600 depending on experience and skill set.
• Benefits overview:  (salary ranges may be subject to geographic differentials).
• Opportunity to design and build the next generation of enterprise AI agents in a collaborative environment that encourages experimentation and innovation.

CDW is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability status, protected veteran status or any other basis prohibited by state and local law.