GenAI Engineer; LLM

Being good neighbors – helping people, investing in our communities, and making the world a better place – is who we are at State Farm. It is at the core of how we operate and the reason for our success. Come join a #1 team and do some good!

HYBRID: Hybrid Work Arrangement: A "Hybrid" position means selected candidates will be assigned to a facility and will spend some time working both in the office and from home. For Enterprise Technology, a hybrid work arrangement will require approximately 40% in-office time each month, beginning in late 2027.
HUB LOCATIONS: Bloomington, IL;
Dunwoody, GA;
Richardson, TX; or Tempe, AZ

SPONSORSHIP: Applicants for this position are required to be eligible to lawfully work in the U.S. immediately; employer will not sponsor applicants for U.S. work authorization (e.g. H-1B visa) for this opportunity

We are looking for a skilled Lead Software Engineer with strong expertise in Python backend development and AI/LLM integration. In this role, you will be responsible for designing, building, and maintaining the LARRY FastAPI backend, including LLM-powered conversation flows, RAG (Retrieval-Augmented Generation) pipelines, and knowledge ingestion APIs. You will collaborate with architects, product owners, and SMEs to shape a platform that processes interviews, documents, and mainframe artifacts into structured, queryable knowledge objects.

This role offers the opportunity to work on impactful greenfield AI work while navigating the unique challenges of enterprise-scale knowledge management. If you are passionate about Python, LLMs, and cloud-native architecture, you will thrive on our team.

• Design, develop, and maintain the LARRY FastAPI backend, including REST API endpoints for conversation, ingestion, and knowledge retrieval
• Build and support LLM-powered RAG pipelines that query the kcd-repository knowledge base and surface relevant answers
• Lead backend architecture decisions and mentor junior engineers on the team
• Collaborate with business stakeholders, product owners, and architects to ensure accurate knowledge processing and retrieval
• Implement and maintain CI/CD pipelines via Git Lab CI/CD for deployment to ROSA (Open Shift)
• Participate in code reviews, unit testing, and integration testing to maintain high-quality, secure code
• Integrate with Entra  (Azure AD) for authentication and manage secure API access patterns
• Research and adopt emerging LLM and RAG patterns to improve knowledge quality and retrieval accuracy

• Strong Python or React experience, including FastAPI or similar async web frameworks
• Experience with LLM integration and RAG architecture patterns
• Experience designing, developing, and maintaining RESTful APIs
• Hands-on experience with CI/CD pipelines and containerized deployment
• Solid understanding of Git and version control workflows
• Experience with AWS or other cloud environments

• Process and transform mainframe artifacts (JCL, DB2 , COBOL) into structured, schema-compliant knowledge objects
• Experience with vector databases or embedding-based
• Experience with JSON schema design and knowledge graph or structured data patterns
• Integrate with Entra  (Azure AD) for authentication and manage secure API access patterns

Because work-life balance is a priority at State Farm, compensation is based on our standard 38:45-hour work week!

• Potential starting salary range: $85,000 - $142,000 (Starting salary will be based on skills, background, and experience. High end of the range limited to applicants with significant relevant experience.)
• Potential yearly incentive pay up to 15% of base salary

At State Farm, we offer more than just a paycheck. Check out our suite of benefits designed to give you the flexibility you need to take care of you and your family!

• Get Paid! On top of our competitive pay, you are eligible for an annual raise and bonus.
• Stay Well! Focus on you and your family’s health with our robust health and wellbeing programs. State Farm pays most of your healthcare premium, and we offer multiple healthcare plan options, including a high deductible plan. All medical plans provide 100% coverage for in-network preventative care, AND you and your family have access to vision, dental, telemedicine, 24/7 mental health professionals, and much more!
• Develop and Grow! Take advantage of educational benefits like industry leading training programs, top-notch tuition assistance programs, employee…