Skip to content
×

Machine Learning Engineer - GPU & Low-Latency Inference

Job in Chicago, Cook County, Illinois, 60290, USA
Listing for: Fintal Partners
Full Time position Listed on 2026-11-16

Job Description & How to Apply Below

Position: Machine Learning Engineer - GPU Performance & Low-Latency Inference
Job Description

We’re partnering with a leading global trading firm to hire a Machine Learning Engineer to make ML models run as fast as possible. You’ll work close to the hardware, squeezing latency out of real-time inference and speeding up training, in an environment where microseconds matter.

What you’ll do

  • Build and optimize low-latency inference pipelines that deliver real-time predictions in production
  • Profile and optimize ML workloads at the device level: memory, compute, kernels and compilers
  • Write and tune custom GPU code (CUDA, Triton or equivalent) where libraries fall short
  • Apply and validate low-precision techniques (FP8/INT8, quantization), knowing which optimizations stay bit-exact,
  • Optimize batching, KV caching and serving paths for latency-critical workloads.
  • Extend the internals of PyTorch and inference frameworks to raise performance on specific workloads

What you’ll bring

  • 3+ years in machine learning, focused on inference or GPU performance
  • Hands-on experience optimizing ML at the GPU level: CUDA, Triton, C++, TensorRT or similar
  • Experience with profiling tools (Nsight, torch.profiler) and reasoning about memory bandwidth, latency and throughput
  • A strong grasp of modern ML architectures, attention in particular, and how they map onto hardware
  • Production-quality Python (C++ a strong plus), with testing discipline and ownership of the systems you ship
  • A habit of measuring before optimizing, and the judgment to know when to build versus buy

Nice to have

  • Experience building real-time, low-latency prediction systems in high-performance environments
  • Experience with numerics: mixed precision, quantization and correctness at scale
  • Contributions to open-source projects such as PyTorch, vLLM, Triton or Flash Attention

No trading experience is required. What matters is deep, hands-on performance engineering and a drive to make things faster.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary