Skip to content
×

Senior LLM Platform Observability Engineer

Job in Toronto, Ontario, C6A, Canada
Listing for: Aimlroles
Full Time position Listed on 2026-11-08
Job specializations:
Salary/Wage Range or Industry Benchmark: 80000 - 175000 CAD Yearly CAD 80000.00 175000.00 YEAR

Job Description & How to Apply Below

Shape LLM platform observability at BMO, using Open Telemetry, Prometheus, and Grafana in a hybrid engineering environment.

The Senior AI Engineer builds capabilities for tracing agent workflows and managing production AI behavior. Responsibilities include capturing spans, prompts, tool calls, and intermediate outputs, while controlling token costs and log cardinality. You will also standardize pipelines, configure dashboards, and support automated anomaly detection and incident response.

Key Responsibilities:
  • Implement Open Telemetry-based agent tracing frameworks
  • Capture prompts, spans, tools, and outputs
  • Build telemetry strategies for token optimization
  • Configure logging sidecars and centralized dashboards
  • Replace static thresholds with anomaly detection
Requirements:
  • Bachelor's degree in Computer Science or Engineering
  • Seven to ten years of Site Reliability Engineering experience
  • Experience automating detection, investigation, and remediation
  • Python experience for custom evaluations
  • SQL or LogQL/PromQL querying experience

Use LLM tracing, platform engineering, and intelligent monitoring to govern BMO’s autonomous AI workflows.

Position Requirements

10+ Years work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary