Reliability Engineer

This role supports the U.S. Air Force Cloud One Architecture and Common Shared Services contract. The Reliability Engineer is responsible for ensuring the availability, performance, scalability, and resiliency of mission-critical systems. This role applies software engineering principles to infrastructure and operations, with a strong emphasis on automation, monitoring, incident response, and continuous reliability improvement.

This position is hybrid remote. Candidates will be required to work onsite as needed and are preferred to be located near Hanscom AFB (Boston, MA).

• Design, implement, and maintain highly available, fault‑tolerant systems in cloud and hybrid environments.
• Define, measure, and report Service Level Indicators (SLIs), Service Level Objectives (SLOs), and error budgets.
• Identify reliability risks and implement mitigation strategies across the system lifecycle.
• Conduct capacity planning and performance modeling to ensure systems scale to meet demand.

• Implement and manage monitoring, logging, and tracing solutions to provide full system observability.
• Define actionable alerting thresholds that minimize noise and enable rapid incident detection.
• Analyze trends and metrics to proactively identify potential reliability issues.

• Participate in on-call rotations and lead incident response activities for production systems.
• Coordinate troubleshooting efforts across development, infrastructure, and security teams.
• Conduct post-incident reviews (PIRs) and develop corrective and preventive action plans.
• Track recurring issues and ensure root causes are resolved.

• Automate operational tasks to reduce manual intervention and operational risk.
• Develop scripts, tools, and services that improve system reliability and reduce mean time to recovery (MTTR).
• Promote "automation over toil" and standardize operational workflows.

• Participate in architecture and design reviews with an emphasis on reliability, resiliency, and recoverability.
• Validate disaster recovery (DR) and business continuity plans; test failover mechanisms.
• Support chaos engineering, fault injection testing, and resilience validation where appropriate.

• Partner with Dev Ops, Platform, and Security teams to ensure reliability aligns with delivery and compliance objectives.
• Document system reliability standards, runbooks, and operational procedures.
• Support compliance and audit activities (e.g., FedRAMP, FISMA, internal operational controls).

• Bachelors and eight (8) years or more of experience;
  Masters and six (6) years or more of experience. Additional experience may be accepted in lieu of degree.
• Active Secret clearance at a minimum required to start.
• US citizenship required.
• Experience with cloud platforms (AWS, Azure, OCI, or GCP), including managed services.
• Experience with containerized environments (Docker, Kubernetes).
• Familiarity with CI/CD pipelines and deployment automation.
• Experience with SLOs and error budgets.
• Capacity modeling and performance testing.
• Strong understanding of distributed systems, high‑availability architectures, Linux/Windows administration, and networking fundamentals (DNS, TCP/IP, load balancing).
• Hands‑on experience with monitoring/observability tools (e.g., Prometheus, Grafana, ELK/Elastic, Datadog, Azure Monitor), Infrastructure as Code (Terraform, ARM, Cloud Formation), and scripting/programming languages (Python, Bash, Go, Power Shell).
• Experience supporting incident management and on‑call operations.

• Experience with USAF Cloud One or Platform 1.
• Experience with Zero Trust Architecture.
• Cloud certifications in AWS, Azure, Google, or Oracle clouds.

SES provides a competitive salary and the following benefits:

• Medical, Dental, and Vision
• AD&D, STD, and LTD
• Company paid Life Insurance
• 401k with employer contribution
• Paid Time Off
• Pet Insurance