ML Infrastructure Engineer

Looking for ML Infra experts (Bay Area preferred) with deep experience in CUDA, GPU optimization, VLLMs, and LLM inference—pure language focus, no vision/audio.

Client Opportunity | Through Phizenix

Phizenix, a certified minority and women‑led recruiting firm, is hiring on behalf of an AI startup pioneering diffusion‑based large language models—built for faster generation, multimodal integration, and scalable enterprise deployment.

We’re looking for a ML Infrastructure Engineer to help build the infrastructure that powers large‑scale model training and real‑time inference. You’ll collaborate with world‑class researchers and engineers to design high‑performance, distributed systems that bring advanced LLMs into production.

• Design and manage distributed infrastructure for ML training at scale
• Optimize model serving systems for low‑latency inference
• Build automated pipelines for data processing, model training, and deployment
• Implement observability tools to monitor performance in production
• Maximize resource utilization across GPU clusters and cloud environments
• Translate research requirements into robust, scalable system designs

• Master’s or PhD in Computer Science, Engineering, or a related field (or equivalent experience)
• Strong foundation in software engineering, systems design, and distributed systems
• Experience with cloud platforms (AWS, GCP, or Azure)
• Proficient in Python and at least one systems‑level language (C++/Rust/Go)
• Hands‑on experience with Docker, Kubernetes, and CI/CD workflows
• Familiarity with ML frameworks like PyTorch or Tensor Flow from a systems perspective
• Understanding of GPU programming and high‑performance infrastructure

• Experience with large‑scale ML training clusters and GPU orchestration
• Knowledge of LLM‑serving tools (vLLM, Tensor
  
  RT, ONNX Runtime)
• Experience with distributed training strategies (e.g., data/model/pipeline parallelism)
• Familiarity with orchestration tools like Kubeflow or Airflow
• Background in performance tuning, system profiling, and MLOps best practices

At Phizenix
, we’re committed to supporting diverse and inclusive teams. This is your chance to shape the systems that power the next generation of AI innovation.

$180,000 - $200,000 USD

We invite applicants to share their demographic background. If you choose to complete this survey, your responses may be used to identify areas of improvement in our hiring process.

As set forth in Phizenix’s Equal Employment Opportunity policy, we do not discriminate on the basis of any protected group status under any applicable law.

For government reporting purposes, we ask candidates to respond to the below self‑identification survey. Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiring process or thereafter. Any information that you do provide will be recorded and maintained in a confidential file.

Why are you being asked to complete this form? We are a federal contractor or subcontractor. The law requires us to provide equal employment opportunity to qualified people with disabilities. We have a goal of having at least 7% of our workers as people with disabilities. The law says we must measure our progress toward this goal. To do this, we must ask applicants and employees if they have a disability or have ever had one.

People can become disabled, so we need to ask this question at least every five years.

Completing this form is voluntary, and we hope that you will choose to do so. Your answer is confidential. No one who makes hiring decisions will see it. Your decision to complete the form and your answer will not harm you in any way. If you want to learn more about the law or this form, visit the U.S. Department of Labor’s Office of Federal Contract Compliance Programs (OFCCP) website .gov/ofccp.

How do you know if you have a disability? A disability is a condition that substantially limits one or more of your major life activities. If you have or have ever had such a condition, you are a person with a disability. Disabilities include, but are not limited to:

• Alcohol or other substance use disorder (not…