Skip to content
×

Inference Performance Engineer

Job in Montreal, Montréal, Province de Québec, G4F, Canada
Listing for: Baseten
Full Time position Listed on 2026-11-18
Job specializations:
Salary/Wage Range or Industry Benchmark: 256000 CAD Yearly CAD 256000.00 YEAR

Job Description & How to Apply Below

Position: Inference Performance Engineer at Baseten
Location: Montreal

Elevate AI workloads with Baseten as an Inference Performance Engineer. Focus on optimizing cutting-edge inference techniques while working in a dynamic, fast-paced environment.

At Baseten, we're seeking an Inference Performance Engineer committed to improving AI model performance. This role requires expertise in runtime internals and includes skills such as quantization, decoder specs, and KV-cache management. You’ll be directly impacting how our customers’ models run and how efficiently we serve them.

Key Responsibilities:

• Implement advanced inference techniques for runtime optimization

• Optimize end-to-end performance, identifying bottlenecks

• Provide clear latency/throughput/cost tradeoffs to stakeholders

• Bring up new model architectures on release day

• Develop benchmarking frameworks for performance measurement

Requirements:

• Degree in Computer Science, Engineering, or related field

• Proficient in Python, C++, or similar languages

• Familiarity with LLM optimization techniques

• Strong experience with ML libraries like Py Torch

• Deep understanding of GPU architecture

Make a significant impact on AI performance with your expertise in inference techniques at Baseten.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary