Principal Data Scientist
Job in
Raleigh, Wake County, North Carolina, 27608, USA
Listed on 2026-07-20
Listing for:
TEKsystems
Full Time
position Listed on 2026-07-20
Job specializations:
-
Software Development
AI Engineer (Applied/Software), Machine Learning/ ML Engineer
Job Description & How to Apply Below
NEED TO HAVE THE FOLLOWING SKILLS (NO EXCEPTIONS):
- Education:
Master's or PhD Preferred
- 6-12+ years in Data Science / ML Engineering, with deep experience in LLM‑based systems.
Proven experience building multi-agent architectures (planner‑executor, tool‑use agents, ReAct‑style reasoning).
Strong background in RAG, embeddings, retrieval optimization, and evaluation.
Expertise in NLP, transformers, deep learning, and model fine‑tuning.
Proficiency with PyTorch, Hugging Face, Lang Chain/Llama Index, RAG, Kubernetes, and vector databases.
Experience designing production‑grade ML systems with monitoring, evaluation, and observability.
Description
TEKsystems is partnered with a software company in Raleigh that needs to hire a Senior Data Scientist for their flagship product, a leading global provider of information and analytics. Recently our client has focused on the general availability of their product for U.S. customers, a generative AI solution designed to transform legal work. Their product delivers trusted results in a familiar, easy-to-use interface with linked hallucination-free legal citations that combine the power of generative AI with proprietary search technology, Shepard's® Citations functionality, and authoritative content.
This role leads the design and development of an advanced multi‑agent AI platform that powers intelligent research, drafting, and reasoning capabilities for large‑scale enterprise knowledge environments. You will architect agent frameworks, optimize retrieval‑augmented generation pipelines, fine‑tune language models, and build the infrastructure that enables AI systems to collaborate, plan, and execute complex tasks reliably. The work directly shapes the next generation of AI‑driven professional tools used by experts in high‑stakes domains.
Core Responsibilities
Architect and implement multi‑agent systems capable of planning, tool use, and coordinated task execution.
Design and optimize RAG pipelines including embeddings, hybrid retrieval, reranking, and context‑window strategies.
Fine‑tune and evaluate small, medium, and large language models for domain‑specific reasoning and summarization.
Develop prompt engineering frameworks, guardrails, and automated evaluation suites for agent reliability.
Build scalable ML services and APIs for production deployment in distributed environments.
Collaborate with product, engineering, and domain experts to translate complex workflows into agentic AI solutions.
Establish best practices for model evaluation, observability, safety, and compliance.
Mentor DS/ML engineers and contribute to long‑term AI strategy and architecture.
Required Expertise
6-12+ years in Data Science / ML Engineering, with deep experience in LLM‑based systems.
Proven experience building agentic architectures (planner‑executor, tool‑use agents, ReAct‑style reasoning).
Strong background in RAG, embeddings, retrieval optimization, and evaluation.
Expertise in NLP, transformers, deep learning, and model fine‑tuning.
Proficiency with PyTorch, Hugging Face, Lang Chain/Llama Index, Ray, Kubernetes, and vector databases.
Experience designing production‑grade ML systems with monitoring, evaluation, and observability.
Strong communication skills and ability to lead technical direction.
Preferred Qualifications
Experience in enterprise search, knowledge management, or high‑compliance domains.
Experience with model distillation, LoRA/QLoRA, PEFT, and model compression.
Experience building evaluation frameworks for hallucination, grounding, and agent reliability.
Familiarity with knowledge graphs, symbolic reasoning, or hybrid neuro‑symbolic systems.
Publications, patents, or open‑source contributions in LLMs or agent systems.
Strong coding skills in Python 7+ years
Be a natural problem solver, able to take a lead in collaborating to resolve issues
Proficiency in IDE debugging : VSCODE and PYCHARM
Have communication skills
5+ years of experience in AI and machine learning
Deep understanding of machine learning algorithms, classification models, diagnostic testing of models
Experience working directly and Transformer based architectures including BERT,…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×