Testing Manager - Remote; WFH

Full-Time US

Salary Range: $ To $ Annually

Cognitive is an IT and software engineering services company dedicated to elevating the quality, speed and delivery of today’s US government healthcare programs. With a wealth of clinical expertise and hands-on experience, our team understands the significant challenges our government clients—and their customers—face every day. This real-world experience equips us to develop IT solutions that seamlessly connect all facets of healthcare delivery.

At Cognitive, we’re guiding government agencies to the forefront of technology innovation in healthcare delivery.

* This position is contingent upon contract award*

The Testing Manager is responsible for automated testing, performance testing, and security testing across the CMS Drug Data Processing System (DDPS) and Payment Reconciliation System (PRS). This individual owns the end-to-end quality assurance strategy, including the 80 percent automated unit test coverage mandate, Behavior-Driven Development (BDD) and Test-Driven Development (TDD) practices, QASP metric definition and self-assessment, and test tooling operations within the CMS enterprise test environment.

This is a remote position; however, Cognitive hires only in the following designated U.S. states based on contract and business requirements: VA, DC, MD, TN, FL, AZ, CO, OR, and TX.

• Own automated, performance, and security testing across the DDPS/PRS estate; maintain 80 percent or greater automated unit test coverage using Python Pytest/Unit Test and DBFit/Fit Nesse frameworks; support BDD and TDD practices across all sprint teams.
• Perform regression and post-implementation validation testing following each CMS release; integrate automated test execution into the CI/CD pipeline via Jenkins/Cloud Bees, JFrog Artifactory, Sonar Qube, and Snyk.
• Operate within CMS enterprise test tooling including Test Rail for test case management, JIRA for defect tracking, and Git Hub for source-controlled test artifacts.
• Propose and maintain QASP performance standards, metrics, measurement methods, reporting frequencies, and corrective action thresholds for both technical/system and operational/process metrics; submit quarterly QASP self-assessments no later than 2 weeks after PI end.
• Track and surface real-time operational quality metrics like PDE processing volumes, error rates, reconciliation accuracy, and system uptime using Cloud Watch, Splunk, and New Relic.
• Support security testing coordination with Nessus, Crowd Strike, AWS Inspector, Security Hub, and Guard Duty; comply with CMS AI governance policies when testing AI/ML models including bias detection and human-in-the-loop review.
• Operate within the CMS Lean-Agile Release Train adhering to the MEPS Iteration Schedule; contribute to PI Planning and submit Release Deliverables per the MEPS Agile Handbook.

• Bachelor's degree in Computer Scienceor related field; 8 or more years in software QA including test automation leadership on production systems.
• Hands-on expertise with Python test frameworks, Pytest and Unit Test.
• Experience with database testing using DBFit and Fit Nesse frameworks.
• Experience with test management tools including Test Rail, JIRA, and Git Hub.
• Experience designing and enforcing automated test coverage gates at 80 percent or greater within CI/CD pipelines.
• Experience with CI/CD-integrated testing using Jenkins/Cloud Bees, JFrog Artifactory/XRay, Sonar Qube, and Snyk.
• Experience developing and maintaining QASP performance standards and submitting quarterly self-assessments on federal contracts.
• Experience with monitoring and observability tools including AWS Cloud Watch, Splunk, and New Relic for real-time quality metric tracking.
• Familiarity with federal security compliance testing requirements under FISMA, NIST, and CMS ARS.
• Ability to pass CMS and internal required background checks for public trust.

• Be part of a mission-driven organization making a difference in healthcare IT.
• Collaborate with innovative and passionate professionals that are there to support you at every turn.
• Enjoy a supportive work/life balance with the flexibility of a 100% remote company.
• Benefit from opportunities for growth and development in a dynamic environment.