Crawler Infrastructure Site Reliability Engineer

Improve crawler throughput with Kubernetes operations and observability on Perplexity’s Crawler team. Build safer deployments and durable reliability fixes for production services.
As a Site Reliability Engineer, you will operate fetching and rendering fleets while improving availability, latency, throughput, and resource efficiency. You will use Python, C++, Rust, or Go alongside Terraform, CI/CD workflows, and production Kubernetes. The work focuses on dependable crawler operations.

Key Responsibilities:

Optimize Kubernetes workloads and supporting crawler infrastructure
Maintain infrastructure as code and CI/CD deployment pipelines
Define SLOs, monitoring, alerting, and observability
Diagnose queue backlogs, network failures, and bottlenecks
Lead incidents and convert postmortems into reliability improvements
Requirements:
Five-plus years in SRE, production engineering, or backend infrastructure
Strong programming skills in Python, C++, Rust, or Go
Hands-on cloud, Kubernetes, Terraform, and automated deployment experience
Strong Linux and networking fundamentals
Experience diagnosing distributed-system failures and production incidents
Apply production engineering, Kubernetes, and observability expertise to strengthen Perplexity’s crawler reliability and throughput.