Skip to content
×

Senior RAG and AI Evaluation Engineer

Job in Toronto, Ontario, C6A, Canada
Listing for: enableIT
Full Time position Listed on 2026-11-19
Job specializations:
Salary/Wage Range or Industry Benchmark: 120000 - 180000 CAD Yearly CAD 120000.00 180000.00 YEAR

Job Description & How to Apply Below

Lead RAG troubleshooting and LLM evaluation with embeddings, vector search, retrieval optimization, and measurable quality testing.
As a Senior Agentic AI Engineer, you will improve how enterprise AI applications retrieve information and generate grounded responses. The role combines RAG pipeline analysis, agentic workflow development, prompt engineering, and quality evaluation. You will work across ingestion, chunking, embeddings, retrieval, reranking, context, and generation.

Key Responsibilities:

Troubleshoot RAG pipelines from ingestion through response generation
Optimize retrieval quality, grounding, relevance, and response accuracy
Design evaluation strategies with metrics and test datasets
Implement prompt engineering, tool calling, and structured outputs
Support production troubleshooting and continuous application improvement
Requirements:
Experience developing RAG solutions with embeddings and vector search
Experience evaluating LLM applications with regression testing
Hands-on agentic AI or LLM application development experience
Strong understanding of context management and multi-step workflows
Excellent communication of technical designs and engineering trade-offs
Combine RAG optimization, agentic workflows, and rigorous evaluation to strengthen enterprise LLM application quality and grounding.

Position Requirements

10+ Years work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary