Associate Principal, Site Reliability Engineering

Associate Principal, Site Reliability Engineering Responsibilities

• Collaborate with development, operations and infrastructure teams to ensure availability of services, and to work through implementation issues
• Develop automation for incident response and to prevent problem recurrence
• Create and enhance runbooks to respond to service outages or degradations
• Assess the production readiness of services
• Define and track operational metrics for production performance, reliability, scalability and availability
• Architect, develop and maintain shared services and tools to improve reliability and reduce toil across the organization
• Contribute to the team’s continuous improvement through research, retrospectives, discussion groups and code reviews
• Influences timelines and expectations amongst the team
• Provide knowledge by guiding and mentoring junior members, and preparing stories for the sprint backlog

• Experience with maintaining and troubleshooting large-scale distributed systems
• Experience with Agile / Scrum methodology
• Able to succeed in fast‑paced environment with frequent changes
• Comfortable communicating with both technical and non‑technical audiences
• Strong documentation skills
• Analytical problem‑solving approach
• Self‑starter – takes the initiative to research, learn and deliver. Anticipates the play
• Team player – humble, collaborative, and focused on making sure the entire team succeeds

• Experience managing infrastructure in public cloud environments like AWS (preferred), Azure or GCP
• Experience with AIOps and predictive analysis for anomaly detection, forecasting system capacity using monitoring and alerting tools like Splunk, App Dynamics, Datadog, Stack Driver, Sysdig, Prometheus or Grafana
• Programming/scripting experience in languages like Java, Bash, Python or Go
• Experience with distributed messaging systems like Kafka, Rabbit
  
  MQ, or ActiveMQ
• Experience with container orchestration systems like Kubernetes, Mesos, Docker Swarm or Rancher
• Experience with using Continuous Integration and Continuous Delivery (CI/CD) tools like Jenkins, Travis, Harness, Appveyor, Code Build or Code Pipeline
• Familiarity with leveraging large language models (LLMs) to automate and optimize SRE workflows. This may include using AI‑powered tools to perform tasks such as, writing scripts, summarizing incident reports, or even creating and maintaining AI workloads.
• Familiarity with leveraging large language models (LLMs) to automate and optimize SRE workflows. This may include using AI‑powered tools to perform tasks such as, writing scripts, summarizing incident reports, data analysis or even creating and maintaining AI workloads.
• Basic exposure to Chaos Engineering tools like, Gremlin, Chaos Monkey, Harness Chaos Engineering, or cloud‑native fault injection services like AWS FIS.

• Bachelor’s or Master’s Degrees in Computer Science, Information Systems, or other related field, or equivalent work experience
• Minimum of 4+ years of experience in Site Reliability Engineering / Dev Ops

• None Required

• A hybrid work environment, up to 2 days per week of remote work
• Tuition Reimbursement to support your continued education
• Student Loan Repayment Assistance
• Technology Stipend allowing you to use the device of your choice to connect to our network while working remotely
• Generous PTO and Parental leave
• 401k Employer Match
• Competitive health benefits including medical, dental and vision

Salary Range: $ - $

Incentive Range: 8% to 15%

This position is eligible for an annual discretionary incentive compensation award, for which the target range is listed above (see Incentive Range). The amount of such award, if any, will be based on various factors, including without limitation, both individual and company performance.

OCC is an Equal Opportunity Employer.