More jobs:
Data Scientist
Job in
Plano, Collin County, Texas, 75086, USA
Listed on 2026-02-21
Listing for:
Virtusa
Full Time
position Listed on 2026-02-21
Job specializations:
-
IT/Tech
AI Engineer, Data Scientist
Job Description & How to Apply Below
- Define retriever and generator evaluation frameworks for RAG pipelines
- Vector retrieval relevance
- LLM response quality, grounding, and hallucination detection
- Establish offline and online metrics (Recall@K, MRR, faithfulness, latency, cost)
- Collaborate on corpus restructuring strategy to improve semantic retrieval
- Define monitoring and drift detection for production RAG and agents
- Analyze production telemetry and recommend calibration strategies
- Support agent performance evaluation
, including tool usage accuracy - Provide statistical validation of model improvements and regressions
- Strong experience with RAG systems evaluation
- NLP, embeddings, semantic search expertise
- LLM evaluation frameworks (custom or open-source)
- Data visualization and storytelling
- 7–10+ years in data science / applied ML
- Experience with enterprise AI or LLM-based systems
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×