Applied Machine Learning & Data Engineering Senior Consultant II

Applied Machine Learning Engineer Senior Consultant II

National General is a part of The Allstate Corporation. We provide a range of insurance products through independent agents and direct to consumers. This role focuses on AI and data automation initiatives to improve data ingestion, transformation, and mapping across the organization.

This position advances AI‑assisted data mapping capabilities to reduce manual effort, enhance accuracy, and deliver scalable, maintainable solutions. Key responsibilities include building intelligent import tools, developing mapping logic, creating ingestion templates, and supporting analytics and dashboarding. The scope will expand to broader AI and automation projects aligned with business priorities.

• Reduce manual mapping effort
• Improve data accuracy and processing efficiency
• Deliver scalable, maintainable AI‑driven pipelines

• Design and build AI‑powered data pipelines to process structured and unstructured data (PDF, Excel, CSV, etc.)
• Develop and optimize LLM‑based solutions (prompt engineering, mapping, extraction, and transformation)
• Translate complex data and technical outputs into actionable insights for business stakeholders
• Partner with cross‑functional teams (product, engineering, business SMEs) to define and deliver solutions
• Validate and improve solution accuracy through testing, iteration, and stakeholder feedback
• Support integration of ML/AI solutions into enterprise systems and workflows (APIs, databases, cloud platforms)
• Document solutions to ensure scalability, maintainability, and long‑term adoption

• Analyze and process carrier and CMS datasets
• Build AI/ML mapping logic using LLMs and prompts
• Develop data pipelines with Python/C#, SQL, APIs, Azure
• Validate outputs against expected results with business stakeholders
• Troubleshoot accuracy, performance, and edge cases
• Document pipelines and ensure production readiness
• Support integration into enterprise systems (C#, APIs, Azure)

40% ML/prompt and mapping logic, 35% data engineering / pipeline implementation, 25% stakeholder collaboration and validation.

• 3+ years of related experience
• Strong proficiency in Python and SQL for data analysis and engineering
• Experience with Generative AI / LLMs (prompt engineering, APIs, or similar)
• Hands‑on experience with data transformation, file parsing, and pipeline development
• Knowledge of Dev Ops practices (CI/CD pipelines, version control, cloud deployment)
• Familiarity with cloud platforms, preferably Azure
• Ability to communicate effectively with both technical and non‑technical stakeholders
• Proven ability to work in ambiguous, fast‑evolving environments

• Experience with C# / .NET integration or enterprise application development
• Familiarity with LLM frameworks (Lang Chain, etc.) or document processing tools
• Knowledge of API design, JSON processing, and system integration patterns
• Background in insurance, healthcare, or other regulated industries

Base salary ranges from $130,000 to $150,000 annually.

• Allstate provides a comprehensive technology setup, including laptop, monitors, headset, keyboard, and mouse.
• Employees eligible to work from home receive a monthly connectivity reimbursement to offset internet costs.
• Minimum internet speeds of 50MB download and 5MB upload required for remote work.

National General Holdings Corp. is an Equal Opportunity employer – Veterans/Disabled and other protected categories. All qualified applicants will receive consideration for employment regardless of any characteristic protected by law. Candidates must possess authorization to work in the United States; we do not sponsor individuals for work visas.