QA Engineer - Clearance Required Remote

RESILIENCE IN THE FACE OF DISRUPTION. DEFCON AI is an insights company that leverages artificial intelligence, mathematical optimization, data analytics, and software engineering for resilient optimization of complex systems.
In today’s dynamically changing world, DEFCON AI’s technology aligns outcomes with operational goals, better decision making, and empowers customers to anticipate assess, and mitigate the impacts of disruptions.

As QA Engineer you will own quality for an AI-enabled decision-support system: the test plan, the automated coverage, and the evidence that what was delivered is what was specified. Product defines the acceptance criteria.
You build the executable version of it
, and you hold engineering, platform, and everyone else delivering the work accountable to it.

• Own the system test plan covering functional, integration, performance, and load testing, and maintain it as a formal deliverable
• Translate the acceptance criteria set by product into executable tests
• Review acceptance criteria with product before development begins, and identify requirements that are ambiguous or not verifiable as written
• Hold engineering, platform, and partner teams accountable to the acceptance criteria, and define what evidence must exist before a change is considered complete
• Work alongside the engineering team day to day, close enough to test their work well and independent enough to report what the testing shows
• Plan and coordinate user acceptance testing with the customer, and track findings through to resolution

• Build and maintain automated test suites, and integrate them into the CI/CD pipeline as release gates
• Establish and hold an automated coverage standard, and report against it
• Build performance and load testing that validates the system under its expected user load
• Maintain regression coverage across releases

• Build and maintain labeled evaluation sets, working with subject-matter experts whose time is limited
• Design and run sampled audits confirming that automated decisions were correct
• Measure and report what the system misses alongside what it gets right
• Measure how often users override the system, and report the trend
• Document how each committed measure is computed, on what data, and what evidence accompanies a release
• Produce this evidence independently of the people building the models

• Maintain the version inventory across builds, models, configurations, and thresholds
• Produce test reports, evaluation records, and rollback criteria for each release
• Work with platform engineering to confirm that test environments match production closely enough for results to be meaningful
• Hold the gate: no release ships without the evidence its acceptance requires

• 5+ years in software quality engineering, test automation, or software engineering with substantial dedicated test ownership
• A clear point of view on how testing should be done
  , and the judgment to know which practices are worth holding to. You will be setting the standard here rather than following one
• Routine use of AI-assisted development
  , with informed judgment about where it adds value and where its output requires verification. We expect AI tooling to be part of how test coverage gets built here, not an occasional experiment
• Demonstrated experience building automated test suites and integrating them into CI/CD as release gates
• Experience owning a test plan through review and acceptance
• Demonstrated habit of testing against the requirement rather than the implementation
  , including working directly with product owners or end users to establish what correct actually means
• Experience…