Backend/infra engineer
Listed on 2026-01-01
-
Software Development
AI Engineer, Cloud Engineer - Software
Location: New York
Not Diamond is a multi
-model AI infrastructure platform that helps enterprise AI/ML seamlessly assess, onboard, and optimize new AI models through evaluation, automatic prompt adaptation, intelligent model routing, and continuous monitoring. Instead of water falling development inefficiently through one model at a time, we help leading startups and Fortune 100s save tens of thousands of engineering hours and improve output accuracy up to 35% by evaluating all candidate model and parameter configurations in parallel through our data-driven platform.
We’re backed by Defy VC and angels like Jeff Dean (Google), Julien Chaumond (Hugging Face), Ion Stoica (Anyscale, Databricks), Zack Kass (OpenAI), Tom Preston-Werner (Github), Scott Belsky (Adobe), Jeff Weiner (Linked In), Eoghan McCabe (Intercom), Alex Chung (Giphy), and many more.
We believe in a multi-model future. The world won’t have one single, giant model that everyone sends everything to—instead, there will be hundreds of foundation models, millions of fine-tuned variants of those models, and billions of custom inference engines running on top of them. We believe this is not only a better future for AI, but a safer one as well.
But for this to happen requires massive infrastructure shifts that can enable us to better ensemble diverse models together. We started Not Diamond to enable this multi-model future.
As a machine learning researcher at Not Diamond, you’ll work closely with myself and our founding team to help define and execute our technical vision and contribute to a world-class research and engineering organization. We want to work with immensely thoughtful, voraciously curious, and mission-driven contributors. You will play a pivotal role in proposing and conducting novel ML research, designing and developing new ML-driven features for our core product, implementing them in production-grade code, and informing decisions for secure, reliable, and scalable supporting infrastructure.
Ideally we’re looking to work with folks who have over 5 years of research experience with a focus in language models, agents, reinforcement learning, evaluation, multi-modality, routing, recommendations, and/or privacy.
We’re offering a competitive salary, generous equity, and robust benefits. And while we think of this as an opportunity to build a generational company from the ground-up, we also guarantee an investment in your next startup if you ever decide to build something yourself in the future. Our team is guided by top-percentile ambition, constant learning, and a bias towards action, and our focus on execution is rooted in a dedication to emotional intelligence, high integrity, and the ability to work through healthy conflict.
You can read some notes on our culture here .
- 6+ years of IC experience with backend, data, and infra with strong familiarity of Python
- Experience architecting and managing cloud infrastructure, including containerized environments and network security
- Experience building services from 0 to 1
- Leadership, hiring, and management skills
- Exceptional communication skills and emotional intelligence
- Exceptionally versatile and high ownership
Your work background might include the core skills listed above along with other unconventional or complementary experiences. In that spirit, we might collaborate well together if you also have:
- Familiarity with Golang (nice to have)
- MLOps/ML engineering (nice to have)
- Security engineering (nice to have)
- Experience scaling an early stage company of 20 people through to $500M+ in valuation (nice to have)
- Competitive salary and generous equity
- Beautiful San Francisco and New York office spaces
- Full remote friendly policy
- Unlimited paid time off
- Paid parental leave
- $3000 yearly personal equipment and personal development stipend
- ( 50K
* years at Not Diamond) investment in your next startup
Email me at t7 and I’ll get back to you within 24 hours.
If this isn’t the right role for you
Please take a moment to reflect on the 1 or 2 most brilliant collaborators you’ve ever worked with and consider whether this might be a fit for them.…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).