Pursue Purpose

AI Agent Test Engineer

Key Responsibilities:

Design robust test scenarios to validate AI agent behavior and performance.

Analyze Product Requirement Documents (PRDs) to extract testing requirements and ensure comprehensive coverage.

Conduct performance testing of AI systems to identify bottlenecks and ensure scalability.

Utilize agentic tools such as Windsurf, Claude Code, and Cursor for advanced automation tasks.

Implement AI-powered Selenium plugins, including Healenium and Applitools Eyes, for visual and functional testing.

Integrate QA automation with Master Control Program (MCP) for centralized management.

Test and integrate REST and SOAP APIs for seamless system connectivity.

Analyze business workflows to identify pain points and automation opportunities.

Automate data-intensive tasks using Excel techniques.

Technical

Skills:

Industry tools: JIRA, AZDO (Azure Dev Ops), Balsamiq, MS Visio.

Automation tools: QTP, Win Runner, Visual Studio, Selenium.

Creating, executing, and managing automation scripts.

SQL Server, Load Runner, JMeter for database management and performance testing.

Version control:
Git, Git Hub, Git Lab.

CI/CD pipelines:
Jenkins, Azure Dev Ops.

Functional

Skills:

Agile and Scrum methodologies.

End-to-end defect lifecycle management, including logging, tracking, and verifying fixes.

Behavioral

Skills:

Strong analytical skills for PRD analysis, workflow review, and identifying AI automation opportunities.

Nice-to-Have:

Bachelor's degree in Computer Science, Information Technology, or related field.

Requirements:

5+ years total relevant experience.

NY local resident preferred.

English native or bilingual proficiency.