Software QA Analyst

Responsibilities

• Test the services we build — control plane APIs, intake registry, agent dispatch flows, webhook integrations — at the API and integration level.
• Review agent output — code review comments, generated tests, draft MRs — and assess accuracy, relevance, and quality against the codebase and context.
• Write and maintain test cases and evaluation criteria: API contracts, end-to-end flows, agent output quality for each agent type (reviewer, tester, builder).
• Identify failure patterns across the stack: broken API responses, dropped state, hallucinations, missed issues, bad diffs. Log them clearly.
• Work with the platform team to translate findings into fixes, guideline improvements, and guardrail changes.
• Own tickets end-to-end: test plan → findings → documented change → verified improvement.
• Sit in on design reviews; help define what "done well" looks like before work ships.

• 1-3 years of professional experience with software testing, QA tooling, or API test automation (Postman, pytest, httpx, or similar).
• Attention to detail and the ability to read code across at least one language (Python or Type Script preferred).
• Comfortable with Git, HTTP/REST APIs, basic SQL, and Linux shell.
• Writes things down clearly — test cases, failure patterns, improvement proposals.
• Asks questions and communicates what's wrong without waiting to be asked.
• Familiarity with LLMs or AI agents (Nice-to-haves).
• Python or Type Script & any CI/CD exposure (Nice-to-haves).
• AWS basics (ECS, Cloud Watch, Secrets Manager) (Nice-to-haves).

• Software Testing
• API Test Automation
• Python
• Type Script
• Basic SQL
• HTTP/REST APIs
• Linux Shell
• Test Case Writing
• Failure Pattern Identification
• CI/CD Exposure

• Clear Communication
• Attention To Detail
• Proactive Problem Solving