Software Developer Engineer Test

Aquent, a global leader in talent solutions, is partnering with an innovative and influential organization that is at the forefront of leveraging artificial intelligence to transform its industry. This company is dedicated to building robust, reliable, and cutting-edge AI-powered applications that drive significant impact for its users and stakeholders. Join a team where your expertise will directly contribute to shaping the future of AI technology and ensuring its responsible and high-quality deployment.

Are you passionate about the intersection of software quality and groundbreaking artificial intelligence? We are seeking a dynamic and experienced engineer to play a critical role in ensuring the integrity, safety, and performance of our next-generation AI solutions. In this pivotal role, you will be instrumental in designing, automating, and executing advanced testing strategies for AI-powered applications, machine learning systems, intelligent agents, copilots, and generative AI solutions.

You will combine your strong software quality engineering background with emerging AI validation techniques to ensure our AI systems are not only innovative but also reliable, accurate, performant, and production-ready. Your work will directly enhance user trust and enable the scalable delivery of AI-powered features, making a significant impact on our product quality and strategic initiatives.

• Develop and implement comprehensive testing strategies for a diverse portfolio of AI applications, platforms, and services.
• Validate AI model outputs for critical attributes such as accuracy, consistency, reliability, and safety, ensuring high-quality user experiences.
• Design and execute a full spectrum of tests including functional, integration, end-to-end, regression, and performance testing for AI solutions.
• Create sophisticated test cases tailored for prompt-driven, agentic, and retrieval-based AI workflows.
• Validate AI guardrails, business rules, permissions, and governance controls to ensure responsible AI deployment.
• Perform adversarial, negative, and edge-case testing to proactively identify potential model failures and hallucinations.
• Build and maintain robust automated test frameworks specifically designed for AI applications, streamlining the testing process.
• Develop automated evaluation pipelines for AI responses and workflows, facilitating continuous quality assessment.
• Integrate AI testing seamlessly into CI/CD pipelines, promoting a culture of continuous quality and rapid iteration.
• Implement automated quality scoring and regression detection mechanisms to maintain high standards across releases.
• Create reusable test data, mocks, simulators, and validation frameworks to enhance testing efficiency and coverage.
• Test AI agents, workflows, APIs, and tool-calling capabilities, ensuring smooth and effective operations.
• Validate integrations with external systems, diverse data sources, and enterprise services.
• Verify the performance, reliability, scalability, and resiliency of AI workloads through rigorous testing.
• Execute load and stress testing to ensure AI services can handle anticipated demands.
• Collaborate closely with software engineers, AI engineers, product owners, architects, and security teams throughout the development lifecycle.
• Actively participate in design reviews, providing crucial quality feedback from the early stages of development.
• Contribute to defining test strategy, establishing quality standards, and promoting best practices across the organization.
• Support production readiness reviews and lead defect triage activities to ensure timely resolution of issues.

• Bachelor's degree in Computer Science, Software Engineering, Information Systems, or a related technical field.
• 3-6 years of progressive experience in software testing, QA automation, or quality engineering.
• Proven experience developing automated test solutions using one or more of the following languages:
  Python, Java, JavaScript/Type Script, C#.
• Demonstrated experience with API testing and automation tools (e.g., Postman).
• Strong foundational understanding of test automation principles and best practices.
• Solid grasp of the Software Development Lifecycle (SDLC) and Agile methodologies.
• Experience integrating testing into CI/CD pipelines (e.g., Git Hub Actions, Jenkins).
• Experience testing distributed systems, web applications, and APIs.
• Familiarity with…