Eval Researcher

San Francisco — Onsite

I'm hiring an
Evaluation Researcher
for a well-funded frontier AI startup building at the intersection of
multimodal AI, real-time voice systems and intelligent agents
.

The team is developing next-generation
AI companions
capable of understanding live environments, holding natural conversations, managing interruptions and interacting with users in real time.

They're looking for someone to help define, measure and improve what makes these AI systems genuinely intelligent, reliable and engaging.

You'll work on the research and development of
evaluation frameworks for real-time, multimodal AI systems
, designing benchmarks and testing methodologies that measure model performance across speech, reasoning, interaction and conversational behaviour.

• Strong
  ML research and engineering
  fundamentals.
• Experience with
  LLM evaluations, benchmarking or model assessment
  .
• Strong
  Python and deep learning
  experience.
• Familiarity with
  multimodal models, speech AI or conversational agents
  .
• Ability to design experiments, analyse model behaviour and translate findings into improvements.

Backed by
leading venture capital investors and prominent startup accelerators
, this is an opportunity to join an early-stage research team and help shape how next-generation AI systems are evaluated.

If you're interested in working at the forefront of LLM evaluations, multimodal AI and real-time intelligent systems