Senior Test Automation Developer Job Calgary area,Alberta Canada,Software Development

Job Details

Description

Inspirational, innovative and entrepreneurial - this is how we describe our empowered teams. Combine your passion with purpose and join a culture that is thriving in the face of change.

Make an impact with our Technology - Development team as a Senior Test Automation Developer. This diverse team of tech-savvy builders and problem solvers embraces digital transformation, and the possibilities technology brings to the future of our industry. We’re looking for team members who have a strong sense of ownership and drive, and who thrive on delivering high-quality solutions that are redefining the way MNP does business.

MNP is proudly Canadian. Providing business strategies and solutions, we are a leading national accounting, tax and business advisory firm in Canada. Entrepreneurial to our core, our talented team members transcend obstacles into opportunities and are successfully transforming mid-market business practices.

Responsibilities

Design, develop, and maintain scalable, reusable automation frameworks for UI, API, and integration testing

Contribute to automation strategy and drive implementation across assigned projects

Build and execute end-to-end automation suites covering critical business workflows

Integrate automation frameworks into CI/CD pipelines for continuous testing and delivery

Analyze failures, debug issues, and ensure high stability and reliability of automation suites

Identify gaps in automation coverage and drive improvements in test strategy and execution

Collaborate with developers, product teams, and Dev Ops to ensure testability and quality from early stages (shift-left)

Review requirements and design documents, providing technical feedback and risk assessment

Conduct code reviews for automation scripts ensuring adherence to standards and best practices

Mentor and support team members on automation best practices, frameworks, and tools

Track and report automation metrics including coverage, stability, and execution results

Ensure efficient test data management and environment configuration

Work with Docker containers for test execution, environment setup, and CI/CD integration

Contribute to QA standards, governance, and process improvements across teams

Support non-functional testing (performance, scalability) where applicable

Work in a fast-paced environment, balancing automation and hands-on QA responsibilities

Lead the testing and evaluation of AI-powered applications by validating model performance, security controls, AI guardrails, prompt robustness, and adherence to responsible AI practices

Collaborate with development and business teams to define test scenarios, execute test plans, and support successful deployment of UiPath and Microsoft Power Platform solutions

Skills and Experience

10+ years of experience in software testing, with 8+ years of strong expertise in automation

Bachelor’s degree in computer science, engineering or other equivalent combination of education and work experience

Exposure to AI-assisted development and testing tools such as Claude, Git Hub Copilot, or Codex, with familiarity in automated scripts

Hands-on experience with LLM evaluation frameworks and tools, including assessing model performance, accuracy, relevance, and reliability

Strong understanding of AI safety and security concepts, including guardrail evaluation, prompt injection testing, jailbreak detection, data leakage prevention, and responsible AI validation

Strong hands-on experience with automation tools such as Playwright or Selenium

Proficiency in programming languages such as Java or Python

Proven experience designing and maintaining automation frameworks from scratch

Strong understanding of test architecture, design patterns (POM, BDD), and scalable automation design principles

Strong experience working in Agile and Dev Ops environments

Experience integrating automation with CI/CD pipelines (Azure Dev Ops, Git Hub Actions, etc.)

Strong experience debugging and optimizing automation execution in CI/CD pipelines

Ability to identify, document, and track defects using Azure Dev Ops or Jira

Strong expertise in API testing (REST/SOAP) using Postman, Rest Assured, Swagger, etc.

Working knowledge of relational databases (SQL Server, MySQL, etc.)

Experience ensuring traceability between requirements, test cases, and defects

Strong analytical, debugging, and problem-solving skills

Proven ability to mentor team members and drive technical improvements

Excellent communication and collaboration skills across cross-functional teams