Lead Observability Engineer – Sumo Logic

Overview

Role : Lead Observability Engineer – Sumo Logic & SRE

Location : Remote

We are seeking a highly skilled Lead Observability Engineer to lead a critical implementation of Sumo Logic for a client migrating from Dynatrace. This role requires deep expertise in Sumo Logic, Site Reliability Engineering (SRE) practices, and Kubernetes (EKS) observability. The ideal candidate will design and implement scalable dashboards, alerts, and tracing strategies, drive service-level reliability, and enable a steady-state SRE operations model.

• Lead the end-to-end implementation of Sumo Logic observability platform for AWS and EKS environments.
• Migrate monitoring and alerting assets from Dynatrace to Sumo Logic.
• Define and implement SLIs/SLOs, error budgets, and reliability metrics for containerized services.
• Deploy and configure Sumo Logic collectors across AWS and Kubernetes workloads (EKS).
• Configure log, metric, and trace ingestion pipelines using Open Telemetry and Sumo Logic apps.
• Design and maintain dashboards for service health, performance, and reliability insights.
• Implement intelligent alerting and notification workflows, using thresholds, baselines, and anomaly detection.
• Collaborate with Dev Ops, SRE, and development teams to ensure complete tracing coverage across services.
• Ensure best practices for alert noise reduction, escalation policies, and incident response are in place.
• Contribute to observability runbooks, operational handover, and training for the client SRE team.

• Strong knowledge of the new UI navigation.
• Proven expertise in building and optimizing queries.
• Advanced troubleshooting skills.
• The ability to go beyond task execution and provide proactive recommendations to improve our setup and overall efficiency.

• Expert-level experience with Sumo Logic, including dashboarding, alerting, collector deployment, and ML features.
• Strong background in Site Reliability Engineering (SRE), including SLIs/SLOs, error budgets, MTTR/MTTD metrics.
• Proficiency in AWS services (especially Cloud Watch, Cloud Trail, Lambda, RDS) and EKS (Amazon Kubernetes Service).
• Hands-on experience with Open Telemetry for distributed tracing and service maps.
• Strong understanding of Kubernetes metrics, pod health, container resource usage, and cluster monitoring.
• Proven ability to define alert thresholds, configure notification routing (e.g. Slack, Pager Duty, Service Now), and manage alert fatigue.
• Strong scripting experience with tools like Terraform, Helm, YAML, and Git Ops workflows.
• Experience with incident triage, RCA documentation, and building operational maturity in observability teams.
• Excellent communication and stakeholder engagement skills.

• Sumo Logic certifications (Admin, Advanced Analytics) are a plus.
• Experience with Dynatrace (for migration purposes).
• Familiarity with integrating observability into CI/CD pipelines.
• Exposure to service mesh (Istio/Linkerd) and monitoring microservices in that context.

• Sumo Logic observability reference architecture
• EKS and AWS observability configuration
• SLI/SLO documentation and tracking
• Alerting and tracing setup across services
• Production-ready dashboards and runbooks
• Knowledge transfer and enablement sessions for SRE/Dev Ops teams