Agentic QA & Reliability Engineer

Modernization Strike Team Full-Stack Agentic QA Engineer

Required

Skills & Experience:

Familiarity with LLMs and Agentic frameworks (OpenAI, Anthropic, Lang Chain/Lang Graph) Strong hands-on QA/SDET experience in UI test automation and API test automation Hands on ability to build AI driven testing and verification workflows Experience using Playwright for AI-driven UI exploration Proficiency with Python and SQL (Postgres or SQL Server) Knowledge of DSPy or other prompt-optimization / evaluation frameworks Background in red teaming, adversarial testing, or stress testing Exposure to vector databases (pgvector, Qdrant) and RAG systems Familiarity with data pipelines and orchestration tools (dbt, Airflow, Apache Hop) Experience with Docker, observability, or ML tooling (Open Telemetry, Weights & Biases)

Responsibilities Include:

Build and evolve an autonomous "QA Swarm" that tests the ERP UI, APIs, and financial workflows Design AI agents that explore the product, find broken flows, and validate reconciliations Replace brittle, manual tests with self-healing, AI-maintained test suites Create Judge / Eval Agents to assess agent accuracy, hallucinations, and data safety Reverse-engineer legacy business logic and wrap it in modern, automated tests Stress-test systems using synthetic ERP data and adversarial scenarios Act as the final gatekeeper of production reliability for agent-driven features