Sr Observability Engineer

Overview

Trident Consulting is seeking a "Sr Observability Engineer" for one of our clients in “
Holmdel, NJ or Bethlehem, PA - Hybrid
” A global leader in business and technology services.

Role: Sr Observability Engineer

Location: Holmdel, NJ or Bethlehem, PA - Hybrid

Duration: Contract

Rate: $74-78/Hr

You are:

We are seeking a dedicated and detail oriented Senior Observability Engineer with expertise in Splunk, App Dynamics, Open Telemetry and Zenoss to join our Enterprise Observability Engineering team. The ideal candidate will be responsible for the administration, configuration, and maintenance of our observability tools to ensure optimal performance and reliability of our IT systems.

You have:

• Bachelor’s degree in Computer Science, Information Technology, or a related field.
• Minimum of 5–7 years in Observability/Monitoring/Site reliability engineering with a focus on Splunk, App Dynamics and Zenoss.
• Proven experience in Implementing, Managing and Maintaining observability tools.

Technical

Skills:

• Proficiency in Splunk and App Dynamics (including configuration, administration, and implementation).
• Proficiency in Zenoss (including setup, configuration, and maintenance).
• Strong in MELT, Metrics, Events, Logs and Traces; hands-on troubleshooting and support
• Open Telemetry: instrumentation patterns, context propagation, collectors, sampling etc
• Maintain platform reliability, upgrades, patching, and security hardening
• Exposure to Kubernetes observability (cluster/workload metrics, events, service discovery)
• Strong knowledge of IT infrastructure, applications, and networking.
• Experience with scripting and automation tools (e.g., Python, Bash).
• Familiarity with cloud environments (e.g., AWS, Azure) is required.

Soft Skills:

• Excellent problem-solving and analytical skills.
• Strong communication and collaboration abilities.
• Ability to work independently and in a team-oriented environment.

Preferred Qualifications:

• Experience with other monitoring and observability tools (e.g., Prometheus, Grafana).
• Knowledge of Dev Ops practices and CI/CD pipelines.
• Hands-on Infrastructure-as-Code (Terraform/Ansible) and Git-based workflows

• Administer and configure Splunk, App Dynamics, OTEL and Zenoss platforms to meet organizational monitoring needs.
• Perform regular updates, patches, and upgrades to observability tools to ensure they are up-to-date and secure.

• Continuously monitor the health and performance of the Splunk, APPD and Zenoss systems.
• Ensure data integrity and availability within the observability platforms.

• Provide support to internal users, assisting with troubleshooting and resolving issues.
• Develop and deliver training sessions for users to effectively utilize the monitoring tools.

• Create and manage dashboards, reports, and alerts
• Work with stakeholders to define monitoring requirements and implement appropriate alerting mechanisms.

• Manage the onboarding, Alert creation.
• Optimize system performance by tuning configurations and managing resource utilization.

• Maintain comprehensive documentation of configurations, processes, and procedures.
• Develop and enforce best practices for monitoring and observability within the organization.

• Collaborate with IT and Dev Ops teams to ensure comprehensive monitoring coverage.
• Participate in incident response efforts, using observability data to assist in troubleshooting and resolution.

Trident Consulting is a premier IT staffing firm providing high-impact workforce solutions to Fortune 500 and mid-market clients. Since 2005, we’ve specialized in sourcing elite technology and engineering talent for contract, direct hire, and managed services roles. Our expertise spans cloud, AI/ML, cybersecurity, and data analytics, supported by a 3M+ candidate database and a 78% fill ratio. With a highly engaged leadership team and a reputation for delivering hard-to-fill, niche talent, we help organizations build agile, high-performing teams that drive innovation and business success.

Some of our recent awards include:

• Trailblazer Women Award 2025 by Consulate General of India in San Francisco.
• Ranked as the #1 Women Owned Business Enterprise in the large category by ITServe.
• Received the Tech Serve Excellence award.
• Consistently ranked in the Inc. 5000 list of fastest-growing private companies in America.
• Recognized in the SF Business Times as one of the Largest Bay Area BIPOC/Minority-Owned Businesses in 2022.