Gen AI Tester

At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron’s progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & Dev Ops, Data, and Software Engineering, servicing an array of noteworthy financial services and technology firms. Through research and development initiatives in our Fin Labs we develop solutions for modernization, from Artificial Intelligence and Blockchain to Data Science models, Digital Underwriting, mobile-first applications and more.

Over the last 20+ years, our company has been honored with multiple employer awards, recognizing our commitment to our talented teams. With top clients to boast about, Synechron has a global workforce of 16,700+, and has 57 offices in 22 countries within key global markets.

We are seeking a highly skilled Gen AI Tester to ensure the quality, reliability, security, and performance of enterprise Generative AI applications and Large Language Model (LLM) solutions. The ideal candidate will possess strong experience in AI testing, prompt validation, LLM evaluation, automation testing, API testing, and AI risk assessment. This role offers an exciting opportunity to work on cutting‑edge AI initiatives, validating AI‑enabled applications used across Banking, Financial Services, and other enterprise domains.

The base salary for this position will vary based on geography and other factors. In accordance with law, the base salary for this role if filled within Charlotte, NC is $90K - $100K/year & benefits (see below).

• Design and execute comprehensive test strategies for Generative AI, LLM‑powered applications, AI agents, and RAG‑based solutions
  .
• Validate AI‑generated responses for accuracy, relevance, consistency, factual correctness, and business alignment
  .
• Develop and maintain test cases for prompt engineering, prompt optimization, output validation, and conversational AI workflows
  .
• Perform functional, integration, regression, end‑to‑end, and user acceptance testing of AI‑powered applications.
• Evaluate model performance for hallucinations, bias, toxicity, fairness, grounding accuracy, and response quality
  .
• Test Retrieval‑Augmented Generation (RAG) systems, vector search implementations, and enterprise knowledge repositories.
• Build and maintain automated testing frameworks using Python, Playwright, Selenium, PyTest, or Robot Framework
  .
• Conduct API testing for AI services, LLM endpoints, orchestration layers, and enterprise integrations.
• Perform AI security testing, including prompt injection, jailbreak testing, adversarial prompts, and data leakage validation
  .
• Validate AI governance controls, responsible AI guardrails, and compliance requirements.
• Collaborate with AI Engineers, Data Scientists, Product Owners, and Business Stakeholders to improve model quality and application reliability.
• Integrate AI quality assurance processes into CI/CD pipelines and deployment workflows.
• Document defects, testing results, risk assessments, and recommendations for continuous improvement.
• Stay current with emerging AI testing methodologies, tools, and industry best practices.

• 6+ years of experience in Quality Assurance, Test Automation, or Quality Engineering.
• 2+ years of hands‑on experience testing Generative AI, LLM‑based applications, or AI‑powered enterprise solutions
  .
• Strong understanding of Generative AI, Large Language Models (LLMs), Prompt Engineering, and AI application architectures
  .
• Experience with AI platforms such as Azure OpenAI, OpenAI GPT, Anthropic Claude, Google Gemini, or Meta Llama
  .
• Hands‑on experience testing AI chatbots, virtual assistants, AI agents, and RAG‑based applications
  .
• Strong expertise in automation testing using Playwright, Selenium, Cypress, or similar frameworks
  .
• Proficiency in Python for automation testing and AI evaluation frameworks.
• Experience with Postman, REST Assured, Swagger/OpenAPI
  , and API validation methodologies.
• Knowledge of AI evaluation frameworks such as Pro…