×
Register Here to Apply for Jobs or Post Jobs. X

Machine Learning Engineer; Video Foundation Models & Agentic AI

Job in Santa Clara, Santa Clara County, California, 95053, USA
Listing for: Maxinsights
Full Time position
Listed on 2026-11-04
Job specializations:
  • Software Development
    Machine Learning/ ML Engineer, AI Engineer (Applied/Software)
Salary/Wage Range or Industry Benchmark: 180000 - 240000 USD Yearly USD 180000.00 240000.00 YEAR
Job Description & How to Apply Below
Position: Machine Learning Engineer (Video Foundation Models & Agentic AI)
Job Description About The Team

We are building Max VLM, a next-generation video foundation model designed to understand human activities, object interactions, and the physical world through first-person video.

Our mission is to develop intelligent video understanding systems that can accurately interpret complex real-world activities and turn continuous visual observations into structured, actionable information.

As a fast-moving startup team, we work across the entire machine learning lifecycle, from data collection and model training to evaluation, optimization, and production deployment. We combine state-of-the-art multimodal AI technologies with real-world data and practical engineering to build scalable, reliable, and efficient AI systems.

Project Overview & Technical Challenges

Despite rapid advances in multimodal large language models, understanding real-world video remains a challenging problem. Existing systems often struggle with fine-grained activity recognition, temporal reasoning, long-video comprehension, and computational efficiency.

Our team focuses on building high-performance video foundation models and bringing them into real-world applications. Key technical directions include:

1 - Video Foundation Models & Multimodal Understanding
  • Fine-grained action recognition, temporal grounding, and video understanding.
  • Long-video comprehension, temporal reasoning, and event-level understanding.
  • Multimodal model fine-tuning, post-training, and performance optimization.
  • High-quality training data generation, automated labeling, and data selection.
  • Model evaluation, error analysis, and data-driven iteration to continuously improve production performance.
2 - Efficient Model Training & Deployment
  • Large-scale model training, fine-tuning, and distributed training optimization.
  • Efficient video processing, and inference acceleration. Model compression, quantization, and optimization of latency, throughput, and computational cost.
  • Production model serving, monitoring, and continuous performance improvement.
  • End-to-end optimization of model quality, reliability, and deployment efficiency.
3 - Agentic Video Understanding & Advanced Post-Training
  • Develop agentic video understanding systems with autonomous tool use and multi-step reasoning.
  • Explore reinforcement learning and advanced post-training techniques to improve model performance.
  • Apply emerging AI research to real-world applications and product improvements.
Key Responsibilities
  • Design, train, fine-tune, and optimize video-language foundation models for real-world applications.
  • Build and improve large-scale ML pipelines covering data processing, training, evaluation, and inference.
  • Analyze model failures, identify performance bottlenecks, and drive continuous improvements through data and algorithmic iteration.
  • Develop efficient model inference and deployment solutions that balance quality, latency, and computational cost.
  • Collaborate closely with product and engineering teams to translate business requirements into technical solutions and deliver production-ready ML capabilities.
  • Explore and evaluate emerging techniques in multimodal learning, reinforcement learning, and agentic AI, applying promising advances to practical problems.
  • Take ownership of ML projects from problem definition and experimentation through deployment and ongoing improvement.
Qualifications

Minimum Qualifications
  • Bachelor's, Master's, or PhD degree in Computer Science, Artificial Intelligence, Machine Learning, or a related field, or equivalent practical experience.
  • Strong understanding of deep learning and hands-on experience with model training, fine-tuning, or inference.
  • Proficiency in Python and deep learning frameworks such as PyTorch.
  • Familiarity with modern LLMs, multimodal models, or computer vision models.
  • Strong problem-solving skills and the ability to independently implement, debug, and optimize machine learning systems.
  • Ability to work in a fast-paced environment, take ownership, and deliver practical solutions to complex problems.
Preferred Qualifications
  • Strong research capabilities, demonstrated through publications at top-tier conferences (e.g., NeurIPS, ICML, ICLR, CVPR, ICCV, ECCV) or other impactful research contributions.
  • Experience with video understanding, vision-language models, or multimodal foundation models.
  • Experience with LLM/VLM post-training, including SFT, reinforcement learning, or reasoning-oriented training.
  • Experience with distributed training, efficient inference, or production-scale ML…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary