Pursue Purpose

Senior QA Automation Engineer

We are seeking a highly skilled Senior QA Automation Engineer with 6+ years of experience in Software Functional Testing and 4–7 years of expertise in Selenium. The ideal candidate will lead system integration testing, ensure adherence to quality standards, and develop AI-specific automated testing frameworks. This role requires expertise in Agile methodologies, test automation tools, and AI model evaluation using LLMs and RAG architectures.

Key Responsibilities:

• Conduct system integration testing for new and enhanced applications.
• Develop and execute automated tests using Selenium and other industry-standard tools.
• Collaborate with project teams to establish plans, standards, and procedures that optimize testing efforts.
• Ensure on-time delivery by monitoring dependencies, progress, and milestones.
• Educate business and development teams on the testing methodology, with a focus on end-to-end quality assurance.
• Lead project and quality management initiatives, including issue tracking and communication.
• Optimize resource utilization by assisting the Testing Manager in reviewing forecasting reports.
• Ensure compliance with Agile methodologies, maintaining detailed process documentation.
• Perform AI-specific testing, including validation of LLMs and RAG architectures using vector databases.
• Implement automated testing frameworks for Gen AI applications, such as Deep Eval and RAGAs.
• Develop custom validation scripts for evaluating AI model accuracy, relevance, and faithfulness.
• Test prompt engineering techniques to refine AI-generated responses.
• Execute SQL queries in Snowflake to validate database integrity and application responses.

Essential

Skills & Experience:

• 6+ years of experience in Software Functional Testing with automation expertise in Selenium.
• Experience with Jira and ALM for test and issue tracking.
• Strong proficiency in Python, with experience in AI testing frameworks such as Lang Chain, Pytest, and PyTorch.
• Hands-on expertise in LLM & RAG architecture testing using vector databases.
• Familiarity with Snowflake, SQL querying, and data validation techniques.
• Excellent communication and leadership skills to engage with stakeholders.