Member of Technical Staff — Design Engineering

Tensor Zero enables a data and learning flywheel for optimizing LLM applications: a feedback loop that turns production metrics and human feedback into smarter, faster, and cheaper models and agents.

Today, we provide an open-source stack for building industrial-grade LLM applications that unifies an LLM gateway, observability, optimization, evaluation, and experimentation. You can take what you need, adopt incrementally, and complement with other tools. Over time, these components enable you to set up a principled feedback loop for your LLM application. The data you collect is tied to your KPIs, ports across model providers, and compounds into a competitive advantage for your business.

Our vision is to automate much of LLM engineering. We're laying the foundation for that with open-source Tensor Zero. For example, with our data model and end-to-end workflow, we will be able to proactively suggest new variants (e.g. a new fine-tuned model), backtest it on historical data (e.g. using diverse techniques from reinforcement learning), enable a gradual, live A/B test, and repeat the process.

With a tool like this, engineers can focus on higher-level workflows — deciding what data goes in and out of these models, how to measure success, which behaviors to incentivize and disincentivize, and so on — and leave the low-level implementation details to an automated system. This is the future we see for LLM engineering as a discipline.

For more details, see:

• Git Hub Repository

• Announcement:
  Tensor Zero Raises $7.3M Seed Round to Build an Open-Source Stack for Industrial-Grade LLM Applications

• Case Study:
  Automating Code Change logs at a Large Bank with LLMs

• Essay:
  Think of LLM Applications as POMDPs — Not Agents

• Venture Beat:
  Tensor Zero nabs $7.3M seed to solve the messy world of enterprise LLM development

We are looking for a Member of Technical Staff with a background in design engineering. The vast majority of your work will be open source. You’ll have an opportunity to continue to master your current skills with the flexibility to learn new ones from scratch.

As a preview, if you joined today, you'd take on our open-source UI that helps engineers manage the entire Tensor Zero operation — think of it like the AWS Console for Tensor Zero. The UI streamlines workflows for observability, optimization (e.g. fine-tuning), evaluations, and more.

We’re a small,
deeply technical team based in NYC (in person). As an early contributor, you’ll work closely with us and have a significant impact on the project’s future and vision.

• Viraj Mehta (Co-Founder & CTO) is an ML researcher with deep expertise in reinforcement learning, generative modeling, and LLMs. He received a PhD from CMU with an emphasis on data-efficient RL for nuclear fusion and LLMs, and previously worked in machine learning at KKR and a fintech startup. He holds a BS in math and an MS in computer science from Stanford.

• Gabriel Bianconi (Co-Founder & CEO) was the chief product officer at Ondo Finance ($20B+ valuation) and previously spent years consulting on machine learning for companies ranging from early-stage tech startups to some of the largest financial firms. He holds BS and MS degrees in computer science from Stanford.

• Aaron Hill (MTS) is a back-end engineer with deep expertise in Rust. He became one of the maintainers of the Rust compiler… while still in college. Later, he worked on back-end infrastructure at AWS and Svix. He’s also an active contributor to many notable open-source Rust projects (e.g. Ruffle).

• Andrew Jesson (MTS) is an ML researcher with deep expertise in Bayesian ML, causal inference, RL, and LLMs. He recently completed a postdoc at Columbia and previously received a PhD from Oxford, during which he interned  has 3.3k+ citations and several first-author papers at NeurIPS and other top ML venues.

• Alan Mishler (MTS) is an ML researcher with a background in causal inference, sequential decision making, uncertainty quantification, and algorithmic fairness (1.2k+ citations). Previously, he was an AI Research Lead at JPMorgan AI Research and received a PhD in Statistics from CMU, during which he interned at Google and…