Senior QA Automation Engineer: AI​/LLM Testing & Playwright

About Faro Health

Faro Health aims to improve lives by helping life sciences companies answer complex clinical questions simply, efficiently, and effectively. Our software platform serves as a single source of truth for orchestrating complex clinical development. By bringing data and teams together, we empower researchers to design more intelligent trials and reach milestones faster.

We are seeking a highly skilled and analytical Senior QA Automation Engineer to drive our automation strategy, focusing on applications utilizing Large Language Models (LLMs) and advanced AI technology. This role requires expertise in Playwright (Type Script) and proficiency in Python, where you will design, develop, and maintain robust automated testing frameworks and ensure the delivery of high-quality, reliable, and cutting‑edge software.

• Automation Strategy & Development
  • Design, develop, and maintain scalable, robust, and efficient automated test suites using Playwright (Type Script)
  • Debugging Playwright tests using trace files and logs
  • Contribute significantly to the architecture and evolution of our automation frameworks
  • Integrate automated tests into the CI/CD pipeline to support continuous testing
  • Develop and execute test plans specifically for applications that incorporate Large Language Models (LLMs)
• Defect Management
  • Identify and communicate bugs found during regression or scheduled test executions
  • Work closely with the supervisor to reproduce, debug, and resolve issues
• Quality Advocacy
  • Act as a strong advocate for quality throughout the software development lifecycle
  • Continuously seek to improve QA processes, tools, and methodologies
• Collaboration
  • Participate in design reviews, sprint planning, and daily stand‑ups
  • Communicate test results, risks, and quality metrics to cross‑functional teams and supervisors

• Experience:
  
  8+ years of direct experience in Quality Assurance focused on test automation development or equivalent years of development experience
• Typescript, Playwright & Python Expertise:
  Strong experience in designing, developing, debugging and maintaining test automation frameworks and scripts specifically with Typescript, Playwright and Python
• AI Tool Proficiency:
  Demonstrated ability to effectively utilize AI‑powered developer tools, such as Cursor IDE, Claude Code, or Windsurf
• Experience with API testing
• Web Technologies:
  Solid understanding of web technologies (HTML, CSS, JavaScript, DOM, React)
• Framework:
  Solid understanding of Object‑Oriented Programming (OOP) and Design patterns
• Version Control:
  Familiar with version control systems such as Git
• Testing Methodologies:
  Experience working in Agile/Scrum development environments
• CI/CD:
  Experience integrating automated tests into CI/CD pipelines, preferably using Git Hub Actions (other examples include Git Lab CI, Jenkins)
• Log Analysis:
  Ability to read, interpret, and debug application and system logs to effectively diagnose issues
• Problem‑Solving:
  Excellent analytical and problem‑solving skills with a keen eye for detail
• Communication:
  Strong verbal and written communication skills

• Master’s/Bachelor’s degree in Computer Science, Engineering, or a related software field
• Experience testing applications that utilize Large Language Models (LLMs)
• Familiarity with cloud platforms (e.g., Azure+, AWS, GCP)
• Hands‑on performance and/or security testing

• Self‑motivated and highly capable of operating under minimal supervision
• Able to identify gaps in automated coverage and proactively develop technical solutions
• Ability to design scalable, maintainable test suites from the ground up
• Advanced proficiency in using LLMs and AI agents to accelerate the SDLC specifically for automated script generation, analysis and rapid debugging
• Proven ability to drive SDLC efficiency through AI‑integrated workflows, utilizing LLMs to automate test script creation and significantly reduce debugging turnaround times
• Direct experience in building and integrating Test Management (QASE, Jira) and CI/CD pipelines (e.g., Git Hub Actions, Jenkins) to enable automated test reporting and end‑to‑end…