Senior QA​/Test Engineer - AI & Platform

• Define and execute functional, integration, regression, and end-to-end test strategies
• Develop and maintain automated test coverage across applications, APIs, and workflows
• Support UAT, defect management, release testing, and production readiness
• Test APIs and integrations across internal and external services
• Validate AI-generated outputs for accuracy, relevance, consistency, and grounding
• Assess RAG and retrieval performance
• Establish repeatable evaluation approaches and datasets for AI-enabled functionality
• Investigate, reproduce, and resolve defects with engineering teams
• Provide quality evidence for release and go-live decisions
• Work with engineering, product, and operational teams throughout the development lifecycle

• Current SC Clearance required
• Strong experience in QA, Test Engineering, or Test Automation within production applications
• Experience with Playwright, Cypress, or Selenium
• Strong API and integration testing skills using Postman or similar tools
• Experience with SQL, CI/CD, and defect management tooling such as Jira or Azure Dev Ops
• Good technical understanding of web applications, APIs, and modern application architectures
• Understanding of AI evaluation concepts, including groundedness, relevance, hallucination testing, and retrieval quality
• Strong analytical, problem-solving, and stakeholder communication skills
• Experience testing Generative AI, LLM, or RAG solutions highly desirable
• Python, Type Script/JavaScript, or similar scripting experience advantageous

Demonstrates expertise in defining and executing comprehensive testing strategies, including functional, integration, and regression testing, while ensuring high-quality standards for AI-generated outputs and application performance. Proficient in utilizing automation tools and methodologies to enhance testing efficiency and accuracy across various platforms.

• QA Test Engineering
• Test Automation
• API Testing
• Playwright Cypress Selenium
• SC Clearance

• Test Strategy Development
• Automated Test Coverage
• Defect Management
• SQL
• CI/CD
• Python
• Type Script
• Java Script
• AI Evaluation Concepts
• Integration Testing

• Analytical Skills
• Problem-Solving
• Stakeholder Communication

• Current SC Clearance

• Generative AI
• LLM
• RAG Solutions
• Web Applications
• Modern Application Architectures

• Postman
• Jira
• Azure Dev Ops