QA Engineer

We’re Hiring: QA Engineer (AI Platform) – Remote

Job Title: QA Engineer
Work Mode: Remote
Shift: 7:30 PM IST – 4:30 AM IST
Experience: 3+ Years

We are looking for a proactive and hands‑on QA Engineer to join our AI platform team.

This is an early‑stage role where you will work closely with the Principal QA Engineer, owning test coverage end‑to‑end and ensuring AI‑generated outputs are reliable, accurate, and ready for real‑world business use.

A. Core Testing & Automation

• Write and maintain automated test suites (unit, integration, end‑to‑end)
• Own test domains from design to execution and regression coverage
• Build evaluation pipelines for AI/LLM outputs including prompt testing and quality scoring

B. AI & Agent Testing

• Test agent orchestration systems and governance workflows
• Detect model drift and prompt sensitivity issues
• Validate AI‑generated outputs for accuracy and reliability

C. Platform & Integration Testing

• Test data ingestion pipelines across systems (CRM, email, documents, financial data)
• Validate file ingestion (Word, Excel, PowerPoint, PDF) including edge cases
• Test streaming responses, latency, and fallback mechanisms

D. Data & System Validation

• Validate knowledge graph outputs and data retrieval accuracy
• Ensure system performance under real enterprise data conditions

• 3+ years of QA Engineering experience
• Strong programming skills in Python
• Hands‑on experience with Playwright and Vitest
• Experience testing AI/LLM‑based applications
• Strong understanding of API testing, async systems, and workflows
• Ability to independently own testing responsibilities
• Strong analytical and problem‑solving skills

• AI/LLM:
  Anthropic Claude, OpenAI GPT, multi‑model routing
• Backend:
  Python (FastAPI), async systems
• Data:
  Memgraph, Neo4j, Qdrant, PostgreSQL, Redis
• Frontend:
  React, Next.js, Type Script
• Cloud:
  Google Cloud Platform, Azure
• Dev Ops:
  Git Hub Actions, Docker
• Testing:
  Playwright, Vitest

• Experience with LLM evaluation frameworks (Lang Smith, Prompt Flow, etc.)
• Exposure to agent‑based systems or orchestration frameworks
• Experience in regulated industries (finance, healthcare, etc.)

As per industry standards