More jobs:
AI Evaluation and Cost Engineer
Job Description & How to Apply Below
Build AI evaluation systems and cost controls for Velixo Intelligence from anywhere in Canada, with priority for Quebec candidates. Python or Type Script skills matter.
As Velixo’s Applied AI Engineer, you will replace anecdotal quality judgments with evidence for MCP-based ERP querying and governed write backs. You will build regression suites, instrument Gateway actions, and guide model, prompt, and pricing decisions. The work spans LLM APIs, observability, data analysis, and financial systems.
Key Responsibilities:
Build regression suites for GIQL, write backs, and tool selection
Run evaluations before model upgrades and prompt changes
Instrument tokens, caching, models, latency, and tenants
Establish cost-per-action baselines and reduction roadmaps
Supply unit cost data for pricing and allowances
Requirements:
Production experience building on LLM APIs
Previous experience creating an evaluation harness
Hands-on familiarity with Langfuse and promptfoo
Comfort with token accounting and caching strategies
Python or Type Script proficiency
Shape Velixo Intelligence through rigorous evaluation, cost engineering, model strategy, and clear analysis for finance decisions.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×