Lead Data Scientist

Alternate Locations:
Radnor, PA (Pennsylvania);
Greensboro, NC (North Carolina) Work Arrangement:

Hybrid :
Employee will work 3 days a week in a Lincoln office

Relocation assistance:  is not available for this opportunity.

Requisition #: 76402

The Role at a Glance Lincoln Financial Group is seeking a Data Scientist to join our AI Product & Delivery organization, focused on the agentic AI systems powering our next generation of products. You will generate insights from data, build and validate models, design experiments, and measure the business value AI agents deliver — while establishing rigorous evaluation frameworks that keep agentic systems accurate, safe, and reliable in a regulated financial services environment.

You will partner closely with product owners, engineers, and business stakeholders to turn analysis into decisions and evals into guardrails.

What you'll be doing

Insights & Analysis Analyze usage, performance, and outcome data to surface actionable insights on how agentic AI features are used and where they fall short.

Translate findings into clear, actionable recommendations for product, engineering, and business stakeholders.

Build and maintain dashboards and reporting that track agent performance and business impact.

Modeling & Agentic AI Systems Design, build, and validate models and agentic workflows.

Evaluate model and agent architecture choices, balancing accuracy, latency, cost, and risk.

Collaborate with engineering to product ionize models and agents and monitor them post-launch.

Experimentation Design and run experiments — A/B tests, offline evaluations, holdouts — to test agent behavior, prompt or model changes, and feature variants.

Define hypotheses, success metrics, and sample size or power requirements; ensure statistical rigor.

Interpret results and translate them into clear go/no-go recommendations.

Value Measurement Define and track metrics that connect agentic AI features to business value — efficiency gains, cost savings, revenue, and customer or employee experience.

Build measurement frameworks that isolate AI-driven impact from other contributing factors.

Report on ROI and value realization to product and business leadership.

Evaluations (Evals) for Agentic AIDesign and maintain eval suites and benchmarks covering task success, reasoning quality, tool-use correctness, safety, and failure modes.

Build regression frameworks and test case libraries to catch performance degradation across model or prompt updates.

Partner with product owners on human-in-the-loop review processes and use eval findings to guide model and agent improvements.

What we’re looking forMust haves:3–8 years of experience in data science, applied machine learning, or a related analytical role.

Hands-on experience building and evaluating ML models; experience with agentic AI systems (LLM agents, tool use, multi-step reasoning) strongly preferred.

Experience designing and analyzing experiments (A/B testing, causal inference, or similar).Proficiency in Python, SQL, and standard ML/data science tooling.

Strong ability to communicate technical findings to non-technical stakeholders.

Bachelor's or Master's degree in Data Science, Statistics, Computer Science, or a related field.

Grade level: final grade level for this position will be determined based on the selected candidate's experience.

Nice to haves:

Experience building or evaluating LLM-based agents or multi-agent systems.

Familiarity with eval frameworks and observability tools (e.g., Lang Smith, Weights & Biases, Ragas).

Experience with LLM APIs or enterprise AI platforms (e.g., Azure OpenAI, AWS Bedrock, Anthropic Claude, Google Vertex AI).Advanced degree (Master's or Ph.D.) in a quantitative field.

Domain experience in life insurance, annuities,…