Senior Software Engineer, AI Inference Platform

Senior Software Engineer, AI Inference Platform

Sunnyvale, CA or Toronto, Canada

Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer‑scale architecture delivers industry‑leading training and inference speeds and empowers machine learning users to run large‑scale ML applications without managing hundreds of GPUs or TPUs.

We are seeking a talented Platform Software Engineer to join the team building the Cerebras Inference Platform. You will design, develop, and operate the core backend services and APIs that power the Inference platform and enable customers to deploy, manage, and serve inference workloads on dedicated Cerebras hardware.

• Design, build, and maintain the core APIs for the Inference Platform, handling model catalog management, deployment of ML workloads, scaling, and status monitoring.
• Build platform capabilities that optimize for ease‑of‑use, robustness, and self‑service access to inference models and serving.
• Collaborate with infrastructure and ML engineering teams to ensure high reliability, uptime, and smooth user interactions with the inference service.
• Design and implement features such as multi‑tenant support, deployment automation, priority queuing, and caching strategies for user requests.
• Build robust observability features by integrating with monitoring and telemetry tools (e.g., Prometheus, Grafana) to track system health, performance metrics, and request analytics.

• Bachelor’s or Master’s degree in computer science or related field, or equivalent practical experience.
• 5+ years of experience in backend software development, focused on service APIs, orchestration platforms, or user‑facing infrastructure.
• Strong proficiency in Python (C++ is a plus).
• Experience designing, building, and integrating with RESTful APIs and gRPC services.
• Solid understanding of distributed systems concepts such as concurrency, scalability, and fault tolerance.
• Hands‑on experience with containerization (Docker) and orchestration frameworks (Kubernetes).
• Experience with databases and caching systems (e.g., Postgres, Redis).
• Experience with observability, telemetry pipelines, and system monitoring best practices.
• Strong problem‑solving and debugging abilities.
• Excellent communication and cross‑functional collaboration skills.

People who are serious about software make their own hardware. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team cite five main reasons they joined Cerebras:

• Build a breakthrough AI platform beyond the constraints of the GPU.
• Publish and open source cutting‑edge AI research.
• Work on one of the fastest AI supercomputers in the world.
• Enjoy job stability with startup vitality.
• Benefit from a simple, non‑corporate work culture that respects individual beliefs.

Interested in building your career at Cerebras Systems? Get future opportunities sent straight to your email.

Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.

This website or its third‑party tools process personal data. For more details,  to review our CCPA disclosure notice.