ML Infrastructure Engineer

Today, AI is something you rent. Alpaca is building the full stack of hardware, software, models, and applications together to make it something you own.

We are developing a new computer architecture that breaks the economics keeping frontier models trapped in datacenters. On top of that, we’re building a platform of models, applications, and services that give that hardware meaning.

Personal AI is moving from the datacenter to the desk, and we are driving that change.

Our team is based in Cambridge, MA.

We are looking for a ML infra engineer to oversee the training infrastructure for our NLP and Robotics research teams. In this role, you will be responsible for

• Setting up and scaling our compute resources
• Enforcing efficient compute utilization
• Communicating with compute vendors to get us the most competitive rates
• Making compute resources easy for researchers to use
• Managing permissions & onboarding/offboarding users

ML infrastructure is key to the success and productivity of our research teams. You will play in integral part in the day-to-day operations of our teams and help accelerate our research processes. In addition to maintaining our compute resources, you will also help set up resources so developers can easily access compute when needed. You will collaborate with researchers to set up infrastructure around their usage and develop tooling to match their workflows.

• Familiar with AWS, GCP, Azure, Slurm, Kubernetes
• Proven track record of building & maintaining cloud-based infrastructure
• Familiar with distributed infra & multi-host setups
• Strong communications skills and independence in owning projects
• Familiar with building testing pipelines, CI/CD, logging/telemetry for tracking ML infra use