AI Engineer Lead

Overview

At Allstate, great things happen when our people work together to protect families and their belongings from life’s uncertainties. Our Investments Technology group supports an $80bn portfolio with a focus on excellence, innovation, and ethics. We are seeking an AI Developer who can move quickly from idea to working prototypes, validate value early, and guide PoCs into scalable, production-ready AI solutions.

• Collaborate with a diverse team of professionals and partner with product and platform leaders to build AI systems.
• Continuously expand your skill set by learning new technologies, tools, and methodologies.
• Identify opportunities for innovation with autonomy to rapidly explore, prototype, and validate new ideas.
• Design, develop, and deploy AI/ML solutions and lead the transition from proof of concept to production-ready implementations.

• Minimum of 5 years of Python development.
• Minimum of 3 years of experience on AI projects with a focus on productizing AI/ML solutions.
• Strong understanding of machine learning fundamentals and ability to apply them to AI/ML solution development.
• Experience with GenAI technologies and techniques (e.g., RAG, fine-tuning, vector stores, agentic frameworks).
• Data-driven decision making with robust analytical thinking and business judgment.
• Excellent communication with both technical and non-technical team members.
• Hands-on involvement in AI/ML experimentation and model development.
• Solid grasp of software development principles, including design patterns, testing, and version control (Git) (preferred).
• Inquisitive nature with understanding of both technical and business aspects (preferred).

• 1) Programming & Engineering Excellence:
  Python (advanced), APIs, pipelines, AI orchestration. Java/React
  
  JS (optional).
• 2) LLM & GenAI Engineering:
  Hands-on experience with LLMs (preferably GPT models), prompting patterns, structured outputs, model evaluation (accuracy/faithfulness checks, hallucination mitigation, regression testing), safety/guardrails patterns for enterprise use.
• 3) Data Skills — SQL + SQL Server (Microsoft Fabric optional): query authoring, joins, indexing awareness, design of data access patterns for AI.
• 4) LLM & GenAI Engineering:
  Hands-on experience with LLMs (commercial), RAG architecture with ingestion pipelines, chunking strategies, vector database/search with metadata filtering, MCP patterns, MCP servers/tool endpoints integration, agentic workflows (multi-agent planner/executor/reviewer/retriever).
• 5) Git Hub Copilot for rapid scaffolding of code, services, APIs (experience with code acceleration).
• 6) Cloud: MS Azure Fabric preferred.
• 7) Observability & Production Support: operating AI-enabled services in production with logging, metrics, tracing (APM tools such as Datadog), model/prompt monitoring and drift detection.

This job does not have supervisory duties.

4 year Bachelor’s Degree

Compensation offered for this role is  -  annually and is based on experience and qualifications.

The candidate(s) offered this position will be required to submit to a background investigation.

Effective July 1, 2014, it is against public policy to discriminate against veterans in hiring. Allstate generally does not sponsor individuals for employment-based visas for this position. For Fair Chance Ordinances and EEO rights, please review the organization posters and policies as applicable.