AI Test Engineer; m​/f​/d

HARMAN's Engineers And Designers

HARMAN's engineers and designers are creative, purposeful and agile. As part of this team, you'll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the opportunities, innovative technologies and resources to build a successful career.

As a technology leader that is rapidly on the move, HARMAN is filled with people who are focused on making life better. Innovation, inclusivity and teamwork are a part of our DNA. When you add that to the challenges we take on and solve together, you'll discover that at HARMAN you can grow, make a difference and be proud of the work you do everyday.

Introduction: A Career at HARMAN Corporate

We're a global, multi-disciplinary team that's putting the innovative power of technology to work and transforming tomorrow. At HARMAN Corporate, you are integral to our company's award-winning success.

• Enrich your managerial and organizational talents – from finance, quality, and supply chain to human resources, IT, sales, and strategy

• Augment your comprehensive skillset with expert training across decision-making, change management, leadership, and business development

• Obtain 360-degree support throughout your career life cycle, from early-stage to seasoned leader

We are looking for an AI Test Engineer to assure the quality, safety, and reliability of AI-enabled software used in connected product experiences. You will work at the intersection of AI application quality, automated testing, APIs, cloud and edge services, and connected devices. This is a hands-on role for a specialist who can turn ambiguous product behavior into precise, repeatable evaluation scenarios and clear engineering feedback.

You are an active and thoughtful user of modern generative AI tools. You understand their capabilities and limitations and use tools such as ChatGPT, OpenAI Codex, Git Hub Copilot, or comparable solutions to accelerate test design, automation, debugging, analysis, and documentation - while critically validating their output.

You will collaborate with software, machine learning, UX, hardware and product teams to validate AI-driven user journeys from prompt or voice input through orchestration, tools, services, and device responses. Your work will make prototypes and product demonstrations reproducible, observable, and ready for release decisions.

• Lead end-to-end quality engineering for AI-enabled applications, including conversational and agentic workflows, model integrations, orchestration layers, APIs, user interfaces, and connected-device experiences.

• Design and execute structured evaluations for LLM and agent-based behavior: functional correctness, instruction following, tool use, grounding, safety boundaries, consistency, failure handling, and regression risk.

• Prototype, build and maintain automated test solutions, including reusable test data, evaluation datasets, test harnesses, API collections and release-validation pipelines.

• Translate product requirements and real user journeys into deterministic and exploratory test scenarios, acceptance criteria and measurable quality signals.

• Validate multi-turn and multimodal interaction flows, including speech or text input, device controls, audio or media-related features and context-aware personalization when applicable.

• Test REST APIs and distributed services, including request/response contracts, schemas, authentication, error handling, backward compatibility, telemetry and observability.

• Investigate defects using logs, traces, test results and system behavior; isolate root causes, create high-quality defect reports and verify fixes.

• Review code changes and collaborate with developers on testability, unit-test coverage, CI quality gates and practical release criteria.

• Prepare and validate integrated software-and-device environments across Linux, Windows, mobile platforms, cloud services, local services and networked hardware.

• Communicate quality risk, test evidence, known…