×
Register Here to Apply for Jobs or Post Jobs. X

Machine Learning Engineer (Training & Inference Systems

Job in New York, New York County, New York, 10261, USA
Listing for: Jobzhr
Apprenticeship/Internship position
Listed on 2026-08-14
Job specializations:
  • Software Development
    Machine Learning/ ML Engineer
Salary/Wage Range or Industry Benchmark: 180000 - 280000 USD Yearly USD 180000.00 280000.00 YEAR
Job Description & How to Apply Below
Position: Machine Learning Engineer (Training & Inference Systems)
Location: New York

A leading global trading firm is building out its machine learning function and hiring engineers to develop the distributed training and inference systems that take models from research into production. This is the most urgent hire on a team that sits unusually close to the trading desk — you'll feel more like part of the trading floor than a traditional ML function.

What you'll do

  • Build and scale distributed training systems for large models
  • Develop low-latency inference pipelines to get models into production
  • Work directly with researchers training the models and the traders/quants relying on them
  • Operate on a rapidly growing GPU footprint (low thousands today, scaling into the tens of thousands over the next few years)

What we're looking for

  • Strong experience building training and/or inference infrastructure at scale
  • Deep PyTorch fluency and strong performance-engineering instincts
  • Distributed systems experience — multi-GPU/multi-node training, model serving
  • A track record of hands-on building (this is an IC-heavy role, not a strategy seat)
  • Background at a top tech firm, trading firm, or a strong big-tech + startup combination
  • 3+ years of relevant experience; flexible on level for the right person

Why it's exciting

  • Real impact, fast. Your systems directly enable production models that drive trading decisions — no research-to-nowhere, no shipping into a void.
  • Scale that's actually scaling. A GPU footprint growing 10x+ over the next two to three years, with the mandate and budget to match.
  • Proximity to the work that matters. You'll sit alongside researchers and traders, not three layers removed. Tight feedback loops, smart people, genuine ownership.
  • Top-of-market comp for engineers who can build at this level.
#J-18808-Ljbffr
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary