Test Architect Principal

Location: Newton Center

PBM Test Architect Principal Enterprise Test Strategy, Architecture & Quality Governance

Job Description PBM Test Architect Principal will serve as the senior technical authority for end-to-end testing strategy, quality architecture, and release-readiness evidence across the New PBM Platform program. The role defines the test framework spanning the New PBM Platform, retained and modernized ESI systems, enterprise integrations, and client re-implementation activities. Working across both the build of new capability and the integration and re-implementation of existing systems, this Principal will establish common standards for test scope, sequencing, automation, data, environments, evidence, and readiness criteria so that quality decisions are consistent across the full delivery lifecycle.

This role partners with the Build Quality Lead, Integration and End-to-End Test Lead, PBM Test Lead, PBS Test Lead , platform and product engineering, enterprise architecture, delivery, security, infrastructure, and business readiness teams. The Principal provides direction on the most complex quality and testing matters, resolves issues with limited organizational precedent, and translates technical risk into clear recommendations for senior leaders and release-governance forums.

Core Responsibilities Include Test Strategy & Architecture Define and maintain the program’s end-to-end test strategy, architecture, operating model, and multi-year quality roadmap. Establish standards for unit, contract, integration, end-to-end, regression, performance, resilience, security, data-conversion, migration, and operational-readiness testing. Define the release ladder, entry and exit criteria, evidence standards, sign-off expectations, and traceability requirements used across every delivery team in the program.

Create reusable testing patterns and reference architectures that support platform scale, frequent releases, and successive client waves. Ensure test architecture aligns with enterprise architecture, security, privacy, compliance, environment, and data-handling requirements. Quality Governance & Readiness Provide technical governance for quality decisions and independently assess whether test evidence supports progression through readiness gates. Establish quality scorecards, risk indicators, defect measures, and executive reporting that present a clear view of release and migration readiness.

Define severity, triage, root-cause, risk-acceptance, and exception-management practices across the program. Identify systemic quality risks and drive corrective actions that improve prevention, detection, and recovery. Advise leaders on quality tradeoffs, unresolved risks, and the evidence required for go/no-go decisions. Automation, Test Data & AI-Assisted Quality Own the test automation strategy for the program, covering framework and tooling selection, the balance of coverage from unit through end-to-end, pipeline integration, and the standards that keep automation maintainable as the platform changes.

Define the test data strategy, including synthetic data generation, masking and de-identification of production-derived data, provisioning and refresh models across shared environments, and the controls that keep PHI and client data handled appropriately. Define how testing is performed within an AI-assisted software development lifecycle (AI-SDLC), including the use of AI-generated tests, test data, and defect analysis, the human review required before generated assets are trusted, and how traceability back to requirements is preserved.

Establish the evidence automation approach so readiness evidence is produced as a byproduct of the pipeline rather than assembled by hand. Set the standard for what good automation looks like, including stability and flakiness thresholds, execution time, and the decision rules for when a manual test remains the right answer. Cross-Program Technical Leadership Partner with the Build Quality Lead to ensure in-factory testing executes against the program strategy and quality bar.

Partner with the Integration and End-to-End Test Lead to ensure cross-estate and client-wave testing produces complete, reliable evidence. Set direction for the PBM Test Lead on testing of new platform capability, confirming that in-factory coverage, automation, and evidence meet the program standard before capability leaves the build teams. Set direction for the PBS Test Lead on testing across the existing estate, confirming that…