Software Technical Leader, Test Automation, Splunk

The application window is expected to close on: 09/18/2026

Job posting may be removed earlier if the position is filled or if a sufficient number of applications are received
.

Are you ready to shape the future of AI-powered quality? We are seeking a visionary Technical Leader to architect the bold roadmap for our AI-agentic Security Operations Center (SOC)! Together, we define the strategic direction that secures the absolute reliability and performance of our most complex systems. We work to mentor world-class engineering talent, drive the adoption of groundbreaking benchmarking, and catalyze the evolution of our quality ecosystems.

Join us as we work to transform high-level challenges into scalable, high-impact solutions.

This role is designed for a strategic innovator who translates high-level quality challenges into scalable architectural solutions, driving engineering efficiency through sophisticated evaluation strategies and multi-functional leadership. In this role, you will mentor top-tier engineering talent and implement groundbreaking benchmarking protocols that redefine technical performance!

Responsibilities include:

• Architectural Leadership:
  Define and oversee the architectural roadmap for PQ foundations and evaluation frameworks, ensuring robust assessment capabilities for AI agents, complex workflows, and underlying system processes.

• Strategic Innovation:
  Identify systemic gaps in testing methodologies and lead the development of AI-based solutions or agents to proactively mitigate risk and enhance system integrity.

• Technical Mentorship & Oversight:
  Drive the technical culture by mentoring engineering talent, conducting architectural reviews, and guiding teams through the validation of complex technical hypotheses.

• Experimental Governance:
  Oversee the lifecycle of proof-of-concepts (POCs), establishing rigorous standards for experimentation and the validation of novel testing paradigms.

• Quality Ecosystem Management:
  Ensure that testing processes consistently deliver reliable, high-quality outcomes at scale, maintaining alignment with enterprise-level quality standards.

• Advanced Validation Strategy:
  Set the technical standard for groundbreaking validation techniques, including LLM-as-judge methodologies, tenant isolation probes, and behavioral regression suites.

• Cross-Functional Collaboration:
  
  Partner with engineering leadership to enforce rigorous contract testing, audit log validation, and security compliance, ensuring seamless integration of quality across the development lifecycle.

• Bachelor’s degree plus 10+ years of experience in software development and test automation, to include experience architecting large-scale testing ecosystems.

• Demonstrated experience in programming, to include Python and Go, with a demonstrated ability to design scalable, maintainable, and high-performance testing infrastructure.

• Demonstrated experience with security compliance frameworks.

• Demonstrated experience with modern performance testing methodologies.

• Demonstrated experience using AI to build automation (writing AI skills to build test automation)

• Leadership & Problem-Solving:
  Exceptional capacity to translate complex, ambiguous quality challenges into structured, actionable, and long-term architectural strategies.

• Strategic Vision:
  Proven ability to innovate within the AI/ML landscape, applying modern tooling to drive detection efficacy and system reliability.

• Test Automation:
  Go, Python, Contract testing frameworks, Playwright.

• Security & Compliance: OCSF validation libraries, vacuum linter, Caldera, tenant isolation probes, and audit log validation.

• AI/ML Testing:
  Deep expertise in LLM APIs (Claude, Codex), prompt…