Quality Assurance Tester - AI Systems

Ampcus Inc. is a certified global provider of a broad range of Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team.

Quality Assurance Tester – AI Systems

Chantilly, VA

• We are seeking an experienced, detail-oriented and methodical Quality Assurance (QA) Tester to ensure the reliability, performance, and compliance of AI-enabled applications and platforms for a leading independent federal agency focused on financial system stability.
• This role will support testing efforts across a suite of AI technologies—including Agentic AI, Generative AI (GenAI), and traditional ML models—by developing and executing test plans, identifying defects, and validating system behavior against functional and non-functional requirements.
• The QA Tester will work closely with developers, engineers, and stakeholders to uphold quality standards and ensure mission-critical systems operate as intended.

• Test Planning & Execution
  • Develop and maintain comprehensive test plans, test cases, and test scripts for AI-enabled applications and services.
  • Conduct functional, regression, integration, and performance testing across front-end, back-end, and AI components.
  • Validate the behavior of GenAI and Agentic AI systems, including autonomous workflows, user interactions, and decision outputs.
• AI-Specific Testing
  • Test AI model outputs for accuracy, consistency, and alignment with business rules and ethical guidelines.
  • Evaluate Agentic AI systems for task execution boundaries, auditability, and compliance with policy constraints.
  • Collaborate with data scientists and AI/ML engineers to define test criteria for model performance and drift.
• Automation & Tools
  • Implement automated testing frameworks and scripts to support continuous integration and delivery (CI/CD).
  • Use tools such as Selenium, Postman, JMeter, or PyTest to automate UI, API, and performance testing.
  • Integrate testing into Dev Ops pipelines and monitor test coverage and results.
• Defect Management & Reporting
  • Identify, document, and track defects using issue tracking systems (e.g., Jira, Azure Dev Ops).
  • Work with development teams to reproduce issues, validate fixes, and ensure resolution.
  • Provide regular test status reports and contribute to quality metrics dashboards.
• Collaboration & Compliance
  • Collaborate with cross-functional teams to understand requirements, user stories, and acceptance criteria.
  • Ensure testing aligns with federal security, accessibility (Section 508), and compliance standards.
  • Participate in sprint planning, reviews, and retrospectives to continuously improve QA processes.

• Experience in public sector or regulated environments.
• Knowledge of federal compliance standards.

• Bachelor's degree in Information Systems, Computer Science, or a related field.

• 7 years of experience in software testing, QA engineering, or test automation.
• Experience testing AI/ML systems, APIs, and web applications.
• Experience with accessibility testing.
• Knowledge of AI model evaluation techniques and ethical testing practices.
• Familiarity with GenAI platforms and Agentic AI system behaviors.
• Proficiency with testing tools and frameworks (e.g., Selenium, Postman, PyTest, JMeter).
• Experience with AWS cloud environments and containerized applications.
• Strong analytical, documentation, and communication skills.

Ampcus is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, protected veterans or individuals with disabilities.