Senior Backend Engineer, Low-Latency ML Inference

Mountain View, CA, USA

Senior Backend Engineer, ML Inference Systems

Location:

Mountain View, CA, USA

Department: AI & Machine Learning

Requisition Q-2616050

Role description

The opportunity

Every day, we connect billions of players with the games and experiences they love.

Our Vector Gamer AI team sits at the heart of that mission, governing ad ranking and bidding decisions across billions of daily impressions, where large-scale machine learning and real-world impact converge at scale.

We're hiring a Senior Backend Engineer to build and operate the infrastructure those models depend on. You'll design and operate the distributed systems that power billions of daily decisions, with a focus on the performance, reliability, and scalability of inference systems.

Join us and help influence how billions of gaming experiences are discovered, monetized, and how creators are rewarded.

• Design, develop, and deploy production-grade backend services and distributed systems powering large-scale online model inference at billions of daily requests
• Drive technical direction of our inference platform, with a focus on low-latency, high-throughput serving infrastructure
• Partner with ML engineers to ensure online serving infrastructure scales with growing model complexity and inference volumes, without compromising latency or throughput
• Ensure the reliability, scalability, and efficiency of our systems in production using monitoring and observability tools like Prometheus and Grafana
• Manage and optimize cloud infrastructure on GCP, orchestrating workloads with Kubernetes across a high-scale production environment
• Promote and implement best practices for backend service development, testing, deployment, and monitoring (Dev Ops, SRE)

• Experience designing, deploying, and maintaining distributed systems at scale
• Expertise in Golang for building high-performance, low-latency backend infrastructure
• Hands-on experience with cloud infrastructure on GCP and workload orchestration with Kubernetes
• Strong grounding in monitoring and observability tooling, including Prometheus and Grafana
• Experience in ad tech, recommender systems, real-time personalization, or other performance-critical domains
• Familiarity with microservice architectures, containerization (Docker), and CI/CD best practices
• Familiarity with machine learning platforms, workflows, and serving infrastructure

• Experience with ML inference servers like NVIDIA Triton Inference Server
• Familiarity with auction mechanics or bidding systems in an ad tech context
• Experience embracing AI as a strategic advantage in engineering, following established best practices for code quality and security

• Relocation support is not available for this position

At Unity, we want our team members to thrive. We offer a wide range of benefits designed to support well-being and work-life balance.

Please note:

Benefits eligibility, specific offerings, and coverage vary based on the country and employment status.

While specific benefits vary, here are some of the ways we strive to take care of our eligible team members globally:
Comprehensive health, life, and disability insurance | Commute subsidy | Employee stock ownership | Competitive retirement/pension plans | Generous vacation and personal days | Support for new parents through leave and family-care programs | Office food snacks | Mental Health and Wellbeing programs and support | Employee Resource Groups | Global Employee Assistance Program | Training and development programs | Volunteering and donation matching program

Unity is a proud equal opportunity employer. We are committed to fostering an inclusive, innovative environment and celebrate our employees across age, race, color, ancestry, national origin, religion, disability, sex, gender identity or expression, sexual orientation, or any other protected status in accordance with applicable law. Our differences are strengths that enable us to support the growing and evolving needs of our customers, partners, and collaborators.

If you have a disability that means there are preparations or accommodations we can make to ensure you have a comfortable and positive interview experience, please fill out this form () to let us know.

This position requires the incumbent to have a sufficient knowledge of English to have professional verbal and written exchanges in this language since the performance of the duties related to this position requires frequent and regular communication with colleagues and partners located worldwide and whose common language is English.

Gross pay salary: $135,800—$237,050 USD