Senior Observability Engineer

Trident Consulting is seeking a "Observability Engineer” for one of our client in "Holmdel, NJ & Bethlehem, PA”. A global leader in business and technology services.

Position:
Observability Engineer

Location:

Holmdel, NJ & Bethlehem, PA
Mode:
Contract W2
Hybrid – 3 Days onsite / 2 Days remote
Duration: 6+ Months (Possible extension)
Pay rate: 85-90/hr. on W2 Job Overview We are seeking a Senior Observability Engineer with strong expertise in Splunk administration and monitoring platforms to join the Enterprise Observability Engineering team.
The ideal candidate will be responsible for configuring, administering, and maintaining enterprise observability tools including Splunk (primary), App Dynamics, Open Telemetry, and Zenoss to ensure reliability, visibility, and optimal performance of enterprise IT systems.
This role involves working closely with Dev Ops, infrastructure, and application teams to implement monitoring strategies and improve system observability.

Key Responsibilities Observability Platform Administration

• Administer and configure Splunk, App Dynamics, Open Telemetry (OTEL), and Zenoss platforms.
• Implement monitoring solutions aligned with enterprise observability standards.
• Perform upgrades, patching, and security hardening of observability tools.

Monitoring & System Reliability

• Monitor the performance and health of observability platforms.
• Ensure high availability and data integrity of monitoring systems.
• Troubleshoot and resolve monitoring platform issues.

Dashboard & Alert Management

• Design and maintain monitoring dashboards, alerts, and reports.
• Collaborate with stakeholders to define monitoring requirements.
• Implement alerting mechanisms for proactive issue detection.

Data Management & Optimization

• Manage data ingestion and onboarding into monitoring systems.
• Optimize platform performance through configuration tuning.
• Manage resource utilization and storage within observability platforms.

Incident Response & Troubleshooting

• Support incident investigation and root cause analysis.
• Leverage observability data (metrics, logs, events, traces) to resolve issues.
• Collaborate with IT and Dev Ops teams during incident response.

Documentation & Best Practices

• Maintain documentation for monitoring configurations and procedures.
• Establish observability standards and best practices across the organization.

User Support & Training

• Provide technical support to internal teams using monitoring platforms.
  Conduct training sessions to improve observability tool adoption.

Required Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 5–7+ years of experience in Observability, Monitoring, or Site Reliability Engineering.
• Strong hands-on experience with:
  • Splunk (Administration, configuration, and implementation)
  • App Dynamics
  • Zenoss

Technical Skills

• Strong understanding of MELT framework:
  • Metrics
  • Events
  • Logs
  • Traces
• Experience with Open Telemetry including:
  • Instrumentation patterns
  • Context propagation
  • Collectors
  • Sampling
• Experience with Kubernetes observability
• Strong knowledge of IT infrastructure, applications, and networking
• Experience with scripting or automation (Python, Bash)
• Experience with cloud platforms such as AWS or Azure

Preferred Qualifications

• Experience with monitoring tools such as:
  • Prometheus
  • Grafana
• Knowledge of Dev Ops practices and CI/CD pipelines
• Experience with Infrastructure as Code (Terraform or Ansible)
• Familiarity with Git-based workflows

About Trident Consulting
Trident Consulting is an award-winning staffing and consulting firm headquartered in San Ramon, CA. Since 2005, we've partnered with Fortune 500 and high-growth companies to deliver high-quality talent across technology, engineering, business operations, and professional services.

We specialize in contract, contract-to-hire, and direct hire placements, supporting roles across IT, data & analytics, cloud, cybersecurity, finance & accounting, HR, operations, and more. With a strong focus on hard-to-fill and niche positions, our global recruiting engine enables us to deliver speed, quality, and scale.