Principal Manager, AI Quality Engineering

Tokio Marine North America Services (TMNAS) provides professional support services to Tokio Marine Group companies in the United States, including Tokio Marine America, First Insurance Company of Hawaii, and Philadelphia Insurance Companies. Customer service is our focus and our passion! Tokio Marine North America Services adds value in all that we do, providing the best professional service to our business partners, allowing them to achieve their goals.

Our talented team delivers actuarial, audit, corporate communications, financial and investment, human capital services, information technology, legal, and payroll expertise to our customers.

In support of the VP of Quality Assurance, this role works closely with IT and business leaders to formulate and implement comprehensive QA Automation strategies and policies. The Principal Manager, Quality Assurance provides strategic leadership and hands‑on technical expertise in Automation and Performance engineering. This pivotal role is responsible for building and advancing intelligent, Java/Python-based automation frameworks and performance testing solutions while driving AI‑augmented testing practices.

The role combines strong leadership, strategic planning, technical oversight, and active hands‑on contribution to drive innovation in quality engineering practices across the organization.

Performs essential Quality Engineering functions as applicable to the specific position, including:

• Heads the Automation Engineering and Performance Engineering functions for the QA organization, providing strategic direction, technical leadership, and hands‑on guidance to build scalable, efficient, and intelligent automation frameworks.
• Owns and drives the Enterprise business process automation coverage target across critical applications, establishing baseline metrics, gap analysis, and phased delivery roadmaps.
• Architects and maintains end‑to‑end process automation that spans multiple integrated systems (policy administration, claims, billing, document management, data reporting) validating complete business transactions.
• Drives innovation in test automation by actively evaluating, piloting, and implementing AI/ML‑powered testing capabilities including intelligent test case generation, self‑healing test scripts, AI‑assisted defect prediction, and automated root cause analysis.
• Evaluates and integrates AI coding assistants (Git Hub Copilot, Claude Code, Cursor) into QA development workflows to accelerate script development, code review, framework and process modernization.
• Designs and implements AI/ML model testing frameworks covering data quality validation, model performance testing (accuracy, precision), bias and fairness testing, and production drift monitoring — critical for insurance industry AI applications in insurance domain applications.
• Leverages Large Language Models (LLMs) and Generative AI for test case generation from requirements, synthetic test data creation, automated test documentation, and intelligent test prioritization.
• Implements Retrieval‑Augmented Generation (RAG) solutions for building QA knowledge bases and test asset repositories.

• Serves as a hands‑on technical contributor in Python/Java‑based automation development. Leverages strong proficiency in Python along with key automation packages including Selenium Web Driver, Playwright, pytest, Rest Assured, Appium, Pandas, Num Py, and AI/ML libraries (scikit‑learn, Tensor Flow/PyTorch, Lang Chain, SHAP, Fairlearn) to develop scalable automation solutions.
• Leads the migration of legacy automation scripts (UFT/QTP) to modern Automation frameworks supporting React
  
  JS, Unqork and modern web application architectures.
• Designs and implements Page Object Model (POM) frameworks, data‑driven testing architectures, and API testing solutions (Rest Assured, Postman) for comprehensive multi‑layer validation (UI, API, database, integration).
• Establishes CI/CD pipeline integration for automated test execution using Azure Dev Ops, Jenkins, or Git Hub Actions with parallel execution capabilities.
• Implements test data management strategies including…