Quality & Release Engineering Leader

About Bricklayer AI

Bricklayer AI is the first AI cybersecurity platform that enables autonomous AI agents to work alongside human experts to operate smarter, faster, and more effective security operations teams.

Our platform combines specialized AI agents, human oversight, enterprise governance, and deep integrations with security technologies to automate complex cybersecurity procedures while maintaining transparency, accountability, and trust.

Bricklayer empowers organizations to scale security operations without scaling headcount.

The Position

Bricklayer AI is seeking a Quality & Release Engineering Leader to establish and scale the systems, processes, and engineering practices that ensure every release of the Bricklayer platform meets the highest standards of quality, reliability, security, and customer readiness.

This is a hands‑on leadership role responsible for quality engineering, test automation, release management, validation frameworks, performance testing, and AI workflow testing. The ideal candidate is equally comfortable designing automation frameworks, building quality processes, analyzing production defects, improving release velocity, and mentoring engineers.

This role will begin as approximately 70% hands‑on contribution and 30% leadership, with responsibility for building the Quality & Release Engineering function as the company grows.

You will work closely with Application Engineering, AI Engineering, Platform Engineering, Product Management, Customer Experience, and Security teams to ensure quality is embedded throughout the software development lifecycle.

Quality Engineering Strategy

• Define and execute Bricklayer’s quality engineering strategy, standards, and roadmap
• Establish quality objectives, release criteria, and engineering best practices
• Create a culture where quality is owned throughout the software development lifecycle
• Develop and track quality metrics that drive continuous improvement

Test Automation & Validation

• Design and implement automated testing frameworks across application, API, integration, infrastructure, and agent workflow layers
• Establish automated regression testing and continuous validation processes
• Build test coverage strategies that balance speed, confidence, and engineering efficiency
• Drive automation‑first quality practices across engineering teams
• Continuously improve test coverage and reduce manual testing requirements

Release Engineering

• Own release readiness processes and production deployment validation
• Establish release quality gates within CI/CD pipelines
• Develop release management procedures that improve deployment confidence and reliability
• Coordinate release planning and cross‑functional validation activities
• Ensure production releases meet established quality and stability requirements

AI & Agent Validation

• Develop testing methodologies for autonomous AI agents, multi‑agent workflows, and AI‑assisted decision‑making
• Create frameworks to evaluate accuracy, consistency, repeatability, and reliability of agent outputs
• Validate model upgrades, prompt changes, workflow modifications, and orchestration logic
• Partner with AI Engineering to ensure AI‑powered capabilities remain predictable, explainable, and trustworthy

Performance & Reliability Testing

• Develop performance, scalability, resiliency, and load‑testing programs
• Validate platform behavior under production‑scale workloads
• Partner with Platform Engineering to identify reliability risks before deployment
• Establish testing procedures for high‑availability and fault‑tolerant systems

Quality Metrics & Continuous Improvement

• Define and monitor quality KPIs including:
• Defect escape rate
• Automated test coverage
• Release stability
• Mean time to detect issues
• Mean time to resolution
• Customer‑impacting incidents
• Lead root cause analysis and quality reviews following significant production issues
• Drive continuous improvement initiatives across engineering teams

Security & Compliance Validation

• Partner with Security and Platform Engineering teams to validate security controls
• Support SOC 2 Type II and future compliance initiatives
• Ensure testing and validation processes support enterprise customer expectations
• Participate…