QA Engineer

QA ENGINEER

Location:

Chennai / Bengaluru | Type:
Full Time
About Newpage Solutions
Newpage Solutions is a global digital health innovation company helping people live
longer, healthier lives. We partner with life sciences organisations which include,
pharmaceutical, biotech and healthcare leaders, to build transformative AI and data driven
technologies addressing real-world health challenges.
From strategy and research to UX design and agile development, we deliver and validate
impactful solutions using lean, human-centered practices.
We are proud to be a ‘ Great Place to Work®’ certified  company for the last three
consecutive years. We also hold a top  Glassdoor rating  and are named among the "Top
50 Most Promising Healthcare Solution Providers" by CIOReview. As an organisation, we
foster creativity, continuous learning and inclusivity, creating an environment where bold
ideas thrive and make a measurable difference in people’s lives.
Your Mission
We are hiring QA Engineers to validate that AI products do what they're meant to do—and
don't do what they shouldn't.
AI outputs aren't deterministic; testing them isn't either. You will design golden-question
suites, hunt hallucinations, verify evidence citations, and confirm guardrails hold under
combinatorial pressure. You will build coverage that survives an LLM swap, a prompt
change, or a new retrieval index.
You sit close to the engineers building the systems you test, and you raise the quality bar
by asking questions the model itself can't answer. You treat AI as the substrate of the
products you validate, and you stay current on how these systems break.
What You’ll DoPlan And Design

• Build test plans for AI products across large combinatorial matrices: input variants, user
roles, content states, deployment surfaces.

• Maintain golden-question test suites that catch regressions when models, prompts,
retrieval, or content change.

• Design coverage for the things AI products specifically get wrong: hallucinations,
citation drift, prompt injection, context bleed, guardrail bypass, role escalation, stale or
unapproved content surfacing where it shouldn't.

• Translate ambiguous quality requirements into concrete, repeatable test cases—
especially where audit trails, access controls, and content provenance matter.
Executive & Design

• Run structured test passes across web UIs and APIs; investigate failures deeply enough
to give engineers a useful starting point, not just a screenshot.

• Validate evidence citations point to the right sources and that "pending review" or
restricted content stays excluded from AI responses where the rules require it.

• Verify role-based access at the UI and API layers—users see what they should and
nothing more.

• Verify data integrity using read-only SQL queries; cross-check what the UI shows
against what the database holds.

• Exercise APIs directly via Postman, Insomnia, or curl; read OpenAPI specs and form
requests without help.

• File defects that are clear, reproducible, and ranked—structured enough that an
engineer can act without a meeting.
Sustain Coverage

• Maintain regression coverage as products evolve: prompts change, retrieval indexes
update, models get swapped, content gets added.

• Partner with engineers on evaluation rubrics, golden datasets, and acceptance criteria
for AI behaviour—then verify the criteria actually hold in production.

• Stay current on AI/LLM evaluation tooling and apply what's useful: golden datasets,
regression rubrics, hallucination scoring, structured eval frameworks.

• Maintain test documentation that survives team turnover: clear, structured, and
findable. What You Bring

• 5+ years manual and automation QA experience in product environments, production
- grade.

• Hands-on experience testing AI / LLM-based products: output validation,
hallucination detection, edge-case coverage, prompt injection awareness.

• Strong test-planning skills for large combinatorial test matrices.

• Hands-on with test management tooling:
Test Rail, Zephyr Scale, Xray, or equivalent.

• API testing fluency:
Postman or Insomnia; comfortable reading OpenAPI/Swagger
specs and exercising endpoints directly.

• Browser-based debugging skills:
Chrome Dev Tools…