AI Researcher; Multimodal Perception Models

AI Researcher (Multimodal Perception Models)

Join to apply for the AI Researcher (Multimodal Perception Models) role at Tavus

Tavus is a research lab pioneering human computing. We’re building AI Humans: a new interface that closes the gap between people and machines, free from the friction of today’s systems. Our real-time human simulation models let machines see, hear, respond, and even look real—enabling meaningful, face-to-face conversations. AI Humans combine the emotional intelligence of humans with the reach and reliability of machines, making them capable, trusted agents available 24/7, in every language, on our terms.

Imagine a therapist anyone can afford. A personal trainer that adapts to your schedule. A fleet of medical assistants that can give every patient the attention they need. With Tavus, individuals, enterprises, and developers can all build AI Humans to connect, understand, and act with empathy at scale.

We’re a Series A company backed by world-class investors including Sequoia Capital, Y Combinator, and Scale Venture Partners.

We’re looking for an AI Researcher to join our core AI team and help push the frontier of multimodal conversational intelligence. If you thrive in fast-paced environments, love turning abstract ideas into running code, and get energy from exploring the edge of what’s possible then this is the perfect role for you.

• Conduct research on Foundational Multimodal Models in the context of Conversational Avatars (e.g., Neural Avatars, Talking-Heads).
• Model video, audio, and language sequences using Autoregressive, Predictive Architectures (e.g., V‑JEPA), and/or Diffusion paradigms with an emphasis on temporal and sequential data rather than static images.
• Collaborate with the ML team to bring your work to life in production systems.
• Stay at the cutting of multimodal learning and help us define what “cutting edge” means next.

• A PhD (or near completion) in a relevant field, or equivalent hands‑on research experience.
• Experience modeling human behavior and generation (facial expressions, affect, or speech). Ideally in conversational or interactive settings.
• Deep understanding of sequence modeling in video/audio/language domains.
• Familiarity with large model training, especially LLMs or VLMs.
• Strong background in Deep Learning (from Transformers to Diffusion Models) and how to make them work in practice.
• Excellent programming skills, especially in PyTorch.

• Publications in top-tier conferences like CVPR, ICCV, NeurIPS, ECCV, or ACMMM.
• Broader understanding of generative AI and multimodal architectures.
• Familiarity with software engineering best practices.
• Curiosity and a flexible mindset — you like building and experimenting.

Preferred:
San Francisco (hybrid) or London (office opening soon). Remote within the U.S. or Europe available for exceptional candidates.

When you join Tavus, you’re joining a diverse and supportive team. Our work is driven by our people, and our success is shared by all. This position has a flexible work schedule, unlimited PTO, competitive healthcare, and gear stipends, as well as plenty of fun. At the end of the day, we want Tavus to be a place for you to learn, directly drive impact, and work with a team you love.

To more about our team culture and benefits, check out our hiring page.

Tavus is growing fast, and we’d like you to grow with us. If you’re excited to get your hands dirty and help make machines more human, drop your resume and we’ll be in touch.

We are not looking for cultural fits, we are looking for culture creators. Diversity is what drives our success – it’s at the core of how we hire, communicate, and work. We are inclusive to all and combine our diverse backgrounds, skill sets, and perspectives to build the best experiences for our clients.