AI Lab Infrastructure Engineer

Job Overview

Berkeley Research Group's AI Department is seeking an AI Infrastructure Engineer to lead the development of our Virtual AI Lab initiative. This role focuses on creating a virtual access layer that makes our high‑performance AI Lab remotely accessible to teams across BRG, supporting the processing of 100,000+ documents daily with state‑of‑the‑art LLMs from OpenAI and Anthropic.

• Design and implement a virtual access layer for the physical AI Lab infrastructure
• Build scalable remote processing capabilities supporting 100,000+ documents per day
• Create customizable, expandable interfaces for different BRG business units
• Optimize infrastructure for maximum LLM token throughput (OpenAI/Anthropic)
• Implement secure authentication and access management systems
• Ensure high availability and fault tolerance for mission‑critical AI workloads
• Lead infrastructure projects from conception to production deployment

• Bachelor's degree in Computer Science, Information Technology, or a related field
• Minimum six to eight (6‑8) years of hands‑on experience designing, deploying, and managing scalable cloud infrastructure
• Strong experience with Infrastructure as Code (IaC) tools and methodologies
• Experience designing, implementing, and maintaining scalable, secure, and cost‑efficient cloud/on‑prem solutions
• Proven ability to manage and lead projects to deliver high‑quality, replicable solutions
• Proficiency in VCS (Git/Git Hub), modern coding languages (Python, .NET, Java, etc.), Software Development Life Cycle, and CI/CD practices
• Experience with API design and implementation for distributed systems
• Knowledge of GPU infrastructure and optimization for AI workloads
• Hands‑on experience with AWS Services incl. EC2/Lambda, Sage Maker, S3, Fargate/ECS/EKS, CDK/Terraform, and Cost Explorer/Budgets

• Experience with LLM deployment and optimization (OpenAI, Anthropic, etc.)
• Background in building AI/ML infrastructure and platforms
• Experience with virtual desktop infrastructure (VDI) or remote access solutions
• Knowledge of distributed computing and job scheduling systems
• AWS certifications (Solutions Architect, Machine Learning, or similar)
• Experience with cost management and optimization strategies in the cloud
• Familiarity with security best practices for AI systems and data handling

BRG is proud to be an Equal Opportunity Employer. Our hiring practices provide equal opportunity for employment without regard to race, religion, color, sex, gender, national origin, age, United States military veteran status, ancestry, sexual orientation, marital status, family structure, medical condition including genetic characteristics or information, veteran status, or mental or physical disability so long as the essential functions of the job can be performed with or without reasonable accommodation, or any other protected category under federal, state, or local law.

If you need reasonable accommodation for any part of the employment process, please contact us by email at