Skip to content
×

Senior LLM Serving Optimization Engineer

Job in Toronto, Ontario, C6A, Canada
Listing for: Capgemini Engineering
Full Time position Listed on 2026-11-18
Job specializations:
Salary/Wage Range or Industry Benchmark: 101000 - 194000 CAD Yearly CAD 101000.00 194000.00 YEAR

Job Description & How to Apply Below

Optimize LLM serving as a senior machine learning systems engineer, working remotely across Canada with vLLM, PyTorch, and accelerator workloads. The mandate spans production inference.
Capgemini Engineering’s engineer extends model coverage and tunes inference behavior across AWS Neuron and Trainium platforms. You will read and modify implementations involving attention, mixture-of-experts routing, and KV-cache management. Responsibilities include hybrid state-space models, kernel-level optimization, and clear communication of engineering trade-offs.

Key Responsibilities:

Extend model coverage across hybrid and mixture-of-experts architectures
Reuse and generalize existing inference implementations where practical
Optimize prefill, decode, batching, and parallelism behavior
Profile framework, compiler, or kernel-level accelerator workloads
Document implementation choices and benchmark reproducibility
Requirements:
Strong Python and PyTorch skills with model implementation experience
Hands-on LLM serving framework experience such as vLLM
Deep understanding of LLM inference performance trade-offs
Experience designing rigorous performance experiments
Kernel development using NKI, Triton, or CUDA preferred
Use LLM serving, model architecture, and accelerator optimization expertise to advance production inference systems at Capgemini Engineering.

Position Requirements

10+ Years work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary