Principal Engineer – Marketing Technologies

Responsibilities

• Define observability strategy
• Establish standards, patterns, and designs for monitoring distributed data systems
• Drive adoption of tools such as Grafana, Splunk, Prometheus, and Open Telemetry
• Enable end-to-end visibility
• Instrument ETL pipelines, integrations, and APIs with metrics, logs, and traces
• Build dashboards for data flow health, latency, throughput, and error tracking
• Monitor data movement across SaaS, hybrid, and on-prem environments
• Strengthen data reliability
• Implement proactive alerting for pipeline failures, latency spikes, and data integrity risks
• Identify and isolate issues across multi-step data hops and integrations
• Partner with data engineering teams to embed observability into ETL frameworks (Airflow, Informatica)
• Lead incident response and problem resolution
• Drive triage for high‑severity data and platform incidents
• Distinguish root causes across data, platform, and vendor layers
• Perform root‑cause analysis and implement long‑term fixes
• Develop runbooks and playbooks for repeatable issue resolution
• Manage change and vendor coordination
• Ensure observability readiness for vendor patches, hotfixes, and configuration changes
• Validate monitoring coverage post‑change to maintain visibility and alert accuracy
• Participate in change advisory processes and track vendor release cycles
• Document change impacts and lessons learned for audit and compliance
• Drive automation and continuous improvement
• Automate observability setup for new pipelines and integrations
• Implement anomaly detection and predictive alerting
• Continuously refine dashboards, thresholds, and alert logic based on trends
• Influence architecture and engineering practices
• Partner with Enterprise Architecture and engineering teams to align solutions with standards
• Advocate for scalable, observable system design across Marketing Technology
• Contribute to technology strategy and roadmap decisions
• Share responsibility for production support of critical data flows and applications
• Improve key metrics such as availability, time to detect, and time to recover
• Promote SRE practices including SLIs, SLOs, and error budgets

• 7+ years of Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
• 5+ years designing and implementing observability solutions (e.g., Splunk, Grafana, Prometheus, Open Telemetry)
• 3+ years of experience with cloud and container platforms (Kubernetes, Open Shift)