Lead & Observability Engineer

Lead Performance Engineer

Intercontinental Exchange, Inc. (ICE), the owner of the New York Stock Exchange (NYSE), is seeking a results-oriented, self-motivated individual for its Clearing Performance Engineering team in Atlanta. This individual will serve as a technical lead within a team of software architects and performance engineers, operating in a cutting-edge technology environment responsible for running critical financial sector exchanges and clearinghouses. The successful candidate will drive performance engineering strategy across multiple platforms, mentor peers, and deliver deep-dive analysis on the most complex and time-sensitive systems in the organization.

You must be technically authoritative, outcome-focused, and capable of thriving in a mission-critical environment where end-of-day processing windows are measured in minutes. This role requires close collaboration with software architects, developers, quant library owners, infrastructure teams, and project managers to ensure our platforms meet the highest standards of reliability, scalability, and throughput.

As a Lead Performance Engineer you will own the end-to-end performance strategy for complex, event-driven Java platforms. You will define testing methodologies, build durable test harnesses, drive observability initiatives, and act as the authoritative voice on performance trade-offs across application, JVM, OS, and hardware layers.

Responsibilities

• Strategy & Investigation
  • Define and own the performance engineering strategy across multiple critical platforms; set standards for testing approach, tooling, and reporting across the team.
  • Lead deep-dive performance investigations on CPU-bound, multi-threaded Java systems—including analysis at the JVM, OS, and hardware levels.
  • Drive scalability analysis: model how system performance scales linearly (or non-linearly) as data volume and instrument counts grow; produce capacity projections to guide architecture decisions.
  • Lead critical path segregation analysis: identify which operations are time-constrained, propose architectural solutions (e.g., head-start strategies, out-of-band processing), and validate their impact.
• Observability & Monitoring Framework
  • Design and own a comprehensive observability framework spanning metrics, distributed tracing, and continuous profiling to provide full-stack visibility across platform components.
  • Build and maintain platform-wide health scoring and alerting using Prometheus and Victoria Metrics; drive adoption of consistent instrumentation and Grafana visualization standards across application and infrastructure layers.
  • Develop custom metrics exporters to surface business-layer signals — including database growth, queue depths, and pipeline latency — alongside infrastructure metrics.
  • Architect and maintain Grafana dashboard ecosystems; establish standards for dashboard organization, datasource governance, and operational visibility across teams.
  • Lead distributed tracing and continuous profiling initiatives across Java application estates; use trace and profile data to complement load test findings and accelerate root cause analysis.
  • Build automated post-test analysis pipelines that correlate load test results with observability data to produce clear, causal performance narratives for technical and non-technical stakeholders.
• Testing & Automation
  • Design and build robust test harnesses that accurately measure version-to-version performance regressions for compute-intensive components.
  • Tune JVM thread pools, garbage collection, and heap allocation for high-throughput, latency-sensitive processing pipelines.
  • Experience with load generation frameworks (JMeter, Gatling, or custom harnesses); design workloads representative of real production traffic patterns.
  • Create and maintain automation scripts and tooling to simplify repeatable performance analysis tasks.
• Collaboration & Leadership
  • Act as a technical liaison between performance, development, infrastructure, and operations teams; translate performance findings into actionable recommendations with clear data backing.
  • Champion AI-augmented workflows within the performance team: identify where AI tools accelerate root…