Senior Splunk ITSI Engineer

About the role

As a Senior Splunk ITSI Engineer, you will make an impact by building and maintaining the observability infrastructure that keeps IT operations resilient and performant  will own the design, implementation, and optimization of ITSI service models, monitoring solutions, and automation workflows that directly impact service health and incident response for a global enterprise client operating in a hybrid environment. This is a hands‑on technical role for someone who thrives on solving complex monitoring challenges and wants to see their work deliver measurable improvements in operational resilience.

You will be a valued member of the Cloud Infrastructure and Security team, working closely with infrastructure, application, and security stakeholders.

• Design and build robust Splunk ITSI‑based observability solutions, including modular service models, glass tables, health scores, and KPIs that provide unified visibility across infrastructure, applications, and services.
• Implement security best practices across the Splunk environment, including user authentication, access controls, and data encryption, to ensure platform integrity and compliance.
• Configure and optimize ITSI correlation searches, notable event aggregation, and alerting policies to reduce noise, improve incident detection accuracy, and support efficient triage and response.
• Apply advanced analytics techniques including anomaly detection and predictive analytics within ITSI to proactively identify and mitigate service issues before they impact operations.
• Automate onboarding of new data sources by designing reusable ingestion patterns, field extractions, and data normalization rules to ensure CIM compliance, while developing reusable knowledge objects such as macros, lookups, and evaluation expressions.
• Develop custom scripts and automation workflows to streamline Splunk administration tasks and support continuous improvement across the platform.
• Troubleshoot and resolve Splunk and ITSI configuration, performance, and data ingestion issues at an expert level, proactively monitoring infrastructure health and providing recommendations for improvement.
• Collaborate with infrastructure, application, and security teams to translate monitoring requirements into ITSI use cases and deliver solutions aligned with organizational objectives.
• Partner with stakeholders to define success metrics, track adoption of ITSI features, and report on measurable improvements in service reliability, documenting solution designs and operational procedures for ongoing support.

We strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a remote position open to qualified applicants in Louisville, KY. Regardless of your working arrangement, we are here to support a healthy work‑life balance through our various wellbeing programs.

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you’re engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.

• 5+ years of professional experience in infrastructure monitoring or observability, with a primary focus on implementing solutions using Splunk ITSI in enterprise environments.
• Expert‑level knowledge in troubleshooting and resolving Splunk infrastructure issues, including configuration, performance, and data ingestion problems.
• Expert‑level experience writing Splunk Search Processing Language (SPL) for complex search queries, correlations, CIM compliance, and Datamodel management.
• Practical experience designing ITSI service models, glass tables, and health scores that align technical metrics with business objectives and reliability targets.
• Strong understanding of IT operations including networking, systems administration, and security, with experience implementing platform security controls.
• Proven ability to onboard diverse machine data sets into Splunk, applying appropriate parsing, normalization, and enrichment techniques to ensure CIM compliance.
• Experience integrating Splunk or ITSI…