Senior Quality Engineer - AI Integrations

About the Role The Arctic Wolf security operations platform ingests and processes upwards of 600 billion events a day from a wide variety of on-premise devices and cloud platforms. The security pipeline is a distributed system of loosely-coupled microservices that constitute our Realtime analysis and threat detection systems. These services distil the incoming events into actionable intelligence that our Concierge Security Teams use to protect customers.

We are looking for experienced Sr. Quality Engineers to join our pack and work with us to build and expand the capabilities of our testing platform.

You Will:

Create and extend software frameworks and tools to run, monitor, and report on automated tests. Have experience building and maintaining Automation frameworks and CI/CD pipeline.

Review testing strategies, approaches, and test plans and provide insight to development teams.

Architect, design and build software to automate a variety of testing methods (e.g. API validation, performance/load testing, fuzzing, etc.)Develop and maintain test frameworks for GenAI-based and AI/ML applications, including model validation, LLM prompt-response consistency, hallucination detection, and regression testing for AI inference APIs.Implement evaluation pipelines to test LLM accuracy, latency, bias, toxicity, and reliability.

Work as part of a team of highly skilled software professionals.

Continuously learn and expand your technical horizons

Our Technology Stack:
Selenium, Playwright, Docker, Kubernetes, AWS (Bedrock, Lambda, SQS, S3, etc.), Lang Chain, LLM evaluation frameworks (e.g., Ragas), OpenAPI, Postgres, Linux.

You:

Are excited to work at the intersection of AIML, Big Data and the Cybersecurity problem space

Have 6+ years of experience shipping quality software

Love driving high software quality

Have experience deploying services on cloud computing platforms (e.g, AWS, Azure, GCP)
Are an expert using common tools for executing functional, load and fuzz testing (e.g. Locust, CATS)
Have worked on distributed systems and microservices architecture (preferred)
About Arctic Wolf At Arctic Wolf, we’re cultivating a collaborative and productive work environment that welcomes a diversity of backgrounds, cultures, and ideas to make our teams even stronger as we grow globally. We’ve been named one of the 50 Most Innovative Companies in the world for 2022 (Fast Company)—and the 2nd Most Innovative Security Company. We have won countless awards for our excellence in security operations and remain dedicated to providing an industry-leading customer and employee experience including:

Top Workday USA )Great Place to Work ) & Best Workplaces for Women (2024) in Canada Best Workplaces in Tech & For Women in the UK (2023)
Top Company by Kununu in Germany (2024)
Our Values Arctic Wolf recognizes that success comes from delighting our customers, so we work together to ensure that happens every day. We believe in diversity and inclusion and truly value the unique qualities and unique perspectives all employees bring to the organization. And we appreciate that—by protecting people’s and organizations’ sensitive data and seeking to end cyber risk— we get to work in an industry that is fundamental to the greater good.

We celebrate unique perspectives by creating a platform for all voices to be heard through our Pack Unity program. We encourage all employees to join or create a new alliance.

On-Camera Policy To support a fair, transparent, and engaging interview experience, candidates interviewing remotely are expected to be on camera during all video interviews.

Being on camera fosters authentic connection, improves communication, and allows for full engagement from both candidates and interviewers.

We understand that technical, bandwidth, or location-related challenges may occasionally prevent video use. If this applies, candidates are required to notify us in advance so we can explore appropriate accommodations.

Security Requirements Conducts duties and responsibilities in accordance with AWN’s Information Security policies, standards, processes, and controls to protect the confidentiality, integrity and availability of AWN business information (in accordance with our employee handbook and corporate policies).Background checks are required for this position.
#J-18808-Ljbffr