AI Quality Analyst

Overview

At Zebra, we are a community of innovators who come together to create new ways of working. United by curiosity and a culture of caring, we develop smart solutions that anticipate our customer’s and partner’s needs and solve their challenges. Being part of Zebra Nation means you are seen, heard, valued, and respected. Drawing from our unique perspectives, we collaborate to deliver on our purpose.

Here you are part of a team pushing boundaries today to redefine the work of tomorrow for organizations, their employees, and those they serve. You’ll have opportunities to learn and lead in a forward‑thinking environment, defining your path to a fulfilling career while channeling your skills toward causes you care about—locally and globally. Come make an impact every day at Zebra.

The AI Quality Analyst is a critical role responsible for ensuring the performance, safety, and reliability of our cutting‑edge AI/ML models. You will be at the forefront of our development lifecycle, designing and executing comprehensive evaluation strategies to identify model weaknesses, potential biases, and critical edge cases. This role requires a blend of analytical rigor, technical aptitude, and a deep curiosity for how AI models behave in real‑world scenarios.

• Design, develop, and maintain a comprehensive suite of test cases and evaluation benchmarks.
• Proactively identify potential model failure points, including edge cases, adversarial inputs, and sources of bias.
• Conduct systematic error analysis to categorize model failures and identify underlying patterns.
• Triage defects and prioritize them based on severity and impact, working with the development team to ensure resolution.
• Source, curate, and manage high‑quality datasets for model evaluation and testing; perform data annotation and validation to ensure the integrity of ground‑truth data.
• Perform unscripted, exploratory testing to discover unexpected model behaviors and participate in red‑teaming exercises to challenge models and identify safety and security vulnerabilities.
• Set up, maintain, and troubleshoot testing and demonstration environments to ensure a stable and reliable evaluation pipeline.
• Analyze and synthesize test results into clear, actionable reports for both technical and non‑technical stakeholders.
• Translate complex findings into concrete recommendations for model improvement.
• Actively participate in post‑hoc evaluation reviews and contribute to continuous improvement of testing methodologies, tools, and overall quality assurance processes.

• Proven experience in a quality assurance, testing, or data analysis role, preferably within the AI/ML domain.
• A deep understanding of the machine learning lifecycle and the common failure modes of AI models.
• Hands‑on experience with data annotation, data validation, and managing large datasets.
• Meticulous attention to detail and a methodical approach to problem‑solving.
• Strong analytical skills with the ability to identify patterns in data and draw meaningful conclusions.
• Expertise with industry‑standard test automation tools and libraries (e.g., Selenium, Playwright, Cypress, REST‑assured).
• Experience testing across different platforms (e.g., comprehensive testing of mobile Android/iOS and web applications).
• Experience with bug tracking systems (e.g., Jira) and test case management tools.
• Scripting skills (e.g., Python) for test automation and data manipulation.
• (Preferred) Experience testing AI systems, including evaluating agentic responses, model performance metrics, and data integrity.
• Excellent communication skills, with the ability to clearly document bugs and articulate complex technical issues.
• Familiarity with computer vision or other specific AI domains relevant to our work.

Zebra is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, protected veteran status, or any other basis prohibited by law. If you are an individual with a disability and need assistance in applying for a position, please contact workp Your rights are summarized in the EEOC "Know Your Rights" documents:https://(Use the "Apply for this Job" box below).

sus Derechos: https://-

USD  –  per year. Annual incentive of up to 12% of base pay is also available.

• Health insurance (medical, dental, vision)
• Wellness programs and inclusion networks
• Learning and development opportunities
• Community service days
• Insurance and compensation benefits
• Parental leave
• Employee assistance program
• Paid time off (depending on location)
• Hybrid work and flexible hours, with options such as Summer Flex Fridays and Focus Fridays