Senior Research Engineer - Multimodal & Video Foundation Model

Overview

Senior Research Engineer - Multimodal & Video Foundation Model

As a member of the AI model team, you will drive innovation in architecture development for cutting-edge models of various scales, including small, large, and multi-modal systems. Your work will enhance intelligence, improve efficiency, and introduce new capabilities to advance the field.

• Pioneer multimodal and video-centric research that moves fast and breaks ground, contributing directly to usable prototypes and scalable systems.
• Design and implement novel AI architectures for multimodal language models, integrating text, visual, and audio modalities.
• Engineer scalable training and inference pipelines optimized for large-scale multimodal datasets and distributed GPU systems across thousands of GPUs.
• Optimize systems and algorithms for efficient data processing, model execution, and pipeline throughput.
• Build modular tools for preprocessing, analyzing, and managing multimodal data assets (e.g., images, video, text).
• Collaborate cross-functionally with research and engineering teams to translate cutting-edge model innovations into production-grade solutions.
• Prototype generative AI applications showcasing new capabilities of multimodal foundation models in real-world products.
• Develop benchmarking tools to rigorously evaluate model performance across diverse multimodal tasks.

• Bachelor’s degree in Computer Science, Computer Engineering, or a related technical field, or equivalent practical experience
• Expertise in Python & PyTorch, including practical experience working with the full development pipeline from data processing & data loading to training, inference, and optimization.
• Experience working with large-scale text data, or (bonus) interleaved data spanning audio, video, image, and/or text.
• Direct hands-on experience in developing or benchmarking at least one of the following topics: LLMs, Vision Language Models, Audio Language Models, generative video models

• PhD in Computer Vision, Machine Learning, NLP, Computer Science, Applied Statistics, or a closely related field
• Demonstrated expertise in computer vision, video generation foundation model and/or multimodal research.
• First-author publications at leading AI conferences such as CVPR, ICCV, ECCV, ICML, ICLR, NeurIPS etc.

• Recruitment scams have become increasingly common. To protect yourself, please keep the following in mind when applying for roles:
  Apply only through our official channels. We do not use third-party platforms or agencies for recruitment unless clearly stated. All open roles are listed on our official careers page:
• Verify the recruiter’s identity. All our recruiters have verified Linked In profiles. If you’re unsure, you can confirm their identity by checking their profile or contacting us through our website.
• Be cautious of unusual communication methods. We do not conduct interviews over Whats App, Telegram, or SMS. All communication is done through official company emails and platforms.
• Double-check email addresses. All communication from us will come from emails ending in  or
• We will never request payment or financial details. If someone asks for personal financial information or payment at any point during the hiring process, it is a scam. Please report it immediately.

• Seniority level:
  Not Applicable
• Employment type:
  
  Full-time
• Job function:
  Information Technology
• Industries:
  Technology, Information and Internet