Senior Research Scientist, Multi-Modal Language Models

Senior Research Scientist, Multi‑Modal Language Models

NVIDIA is seeking a Senior Research Scientist passionate about multi‑modal language models. Our team drives Nemotron Multi‑modal technology and will continue to develop state‑of‑the‑art open‑source multi‑modal models. We prioritize open models, open weights, and open data, aiming to deliver models that work excellently in real‑world use cases and to uplift the entire ecosystem of multi‑modal LLM users.

• Driving new abilities into the model
• Improving generalization of existing functionalities by understanding weak points, designing a data synthesis solution, and retraining models
• Developing recipes for training models that mix multiple modalities together, such as text, image, video, audio, etc.
• Design solutions that improve Pareto efficiency
• Collaborating with researchers to translate cutting‑edge ideas into production‑ready implementations.
• Exploring new paradigms for evaluation.
• Demonstrating strong engineering practices and contributing to open‑source communities.

• PhD in Computer Science, Electrical Engineering, or related field, or equivalent research experience in LLMs, systems, or related areas.
• 4+ years of experience in computer vision, especially multi‑modal LLMs.
• Proficiency in Python with hands‑on experience in frameworks such as PyTorch.
• Solid background in computer‑science fundamentals: algorithms, data structures, parallel/distributed computing, and systems programming.
• Proven ability to collaborate across research and engineering teams in multifaceted environments.

• Specific multi‑modal LLM research experience
• Experience developing and scaling large distributed systems for deep learning.
• Contributions to open‑source LLM systems or large‑scale AI infrastructure

Your base salary will be determined based on your location, experience, and the pay of employees in similar positions. The base salary range is $192,000 USD – $304,750 USD for Level 4, and $224,000 USD – $356,500 USD for Level 5. You will also be eligible for equity and benefits.

NVIDIA is committed to fostering a diverse work environment and is proud to be an equal‑opportunity employer. We do not discriminate (including in hiring and promotion practices) on the basis of race, religion, color, national origin, gender, gender expression, sexual orientation, age, marital status, veteran status, disability status or any other characteristic protected by law.

If you are a creative and collaborative researcher interested in seeking new challenges, we want to hear from you!