More jobs:
AI Evaluation and Cost Engineer
Job Description & How to Apply Below
Build AI evaluation systems and cost controls for Velixo Intelligence from anywhere in Canada, with priority for Quebec candidates. Python or Type Script skills matter.
As Velixo’s Applied AI Engineer, you will replace anecdotal quality judgments with evidence for MCP-based ERP querying and governed write backs. You will build regression suites, instrument Gateway actions, and guide model, prompt, and pricing decisions. The work spans LLM APIs, observability, data analysis, and financial systems.
Key Responsibilities:- Build regression suites for GIQL, write backs, and tool selection
- Run evaluations before model upgrades and prompt changes
- Instrument tokens, caching, models, latency, and tenants
- Establish cost-per-action baselines and reduction roadmaps
- Supply unit cost data for pricing and allowances
- Production experience building on LLM APIs
- Previous experience creating an evaluation harness
- Hands-on familiarity with Langfuse and promptfoo
- Comfort with token accounting and caching strategies
- Python or Type Script proficiency
Shape Velixo Intelligence through rigorous evaluation, cost engineering, model strategy, and clear analysis for finance decisions.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×