More jobs:
Machine Learning Engineer (Training & Inference Systems
Job in
New York, New York County, New York, 10261, USA
Listed on 2026-08-14
Listing for:
Jobzhr
Apprenticeship/Internship
position Listed on 2026-08-14
Job specializations:
-
Software Development
Machine Learning/ ML Engineer
Job Description & How to Apply Below
Location: New York
A leading global trading firm is building out its machine learning function and hiring engineers to develop the distributed training and inference systems that take models from research into production. This is the most urgent hire on a team that sits unusually close to the trading desk — you'll feel more like part of the trading floor than a traditional ML function.
What you'll do
- Build and scale distributed training systems for large models
- Develop low-latency inference pipelines to get models into production
- Work directly with researchers training the models and the traders/quants relying on them
- Operate on a rapidly growing GPU footprint (low thousands today, scaling into the tens of thousands over the next few years)
What we're looking for
- Strong experience building training and/or inference infrastructure at scale
- Deep PyTorch fluency and strong performance-engineering instincts
- Distributed systems experience — multi-GPU/multi-node training, model serving
- A track record of hands-on building (this is an IC-heavy role, not a strategy seat)
- Background at a top tech firm, trading firm, or a strong big-tech + startup combination
- 3+ years of relevant experience; flexible on level for the right person
Why it's exciting
- Real impact, fast. Your systems directly enable production models that drive trading decisions — no research-to-nowhere, no shipping into a void.
- Scale that's actually scaling. A GPU footprint growing 10x+ over the next two to three years, with the mandate and budget to match.
- Proximity to the work that matters. You'll sit alongside researchers and traders, not three layers removed. Tight feedback loops, smart people, genuine ownership.
- Top-of-market comp for engineers who can build at this level.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×