Skip to content
×

AI Quality & Reliability Engineer; Python, GenAI & AWS​/Azure

Job in Abu Dhabi, Abu Dhabi Emirate, UAE/Dubai
Listing for: IDC Technologies
Full Time position Listed on 2026-11-15
Job specializations:
Salary/Wage Range or Industry Benchmark: 350000 - 550000 AED Yearly AED 350000.00 550000.00 YEAR

Job Description & How to Apply Below

Position: AI Quality & Reliability Engineer (Python, GenAI & AWS/Azure) | IDC Technologies |
Position Summary:

Driving advanced artificial intelligence quality assurance, reliability engineering, and Generative AI testing in Abu Dhabi, United Arab Emirates, IDC Technologies is actively seeking an experienced AI Quality & Reliability Engineer (QA/SRE) with 5+ years of progressive professional experience for a permanent full-time professional engagement. In this vital AI reliability and testing role, you will take full operational, tactical, and technical ownership of automated testing frameworks, LLM evaluation pipelines, RAG system validation, cloud infrastructure reliability on AWS and Azure (Azure OpenAI and AWS Bedrock), CI/CD pipelines, Terraform automation, and site reliability engineering (SRE) observability across distributed Grafana and Prometheus monitoring systems.

Bringing deep technical proficiency in Python, PyTest, JMeter, and K6 performance load testing, you will empower an elite technology solutions and IT consulting corporation to achieve uncompromised AI model stability, bulletproof system resilience, and superior production performance. This prestigious career opportunity offers competitive remuneration, enterprise client exposure, and professional growth within a leading global IT recruitment and software solutions corporation.

Detailed

Job Description:

As an AI Quality & Reliability Engineer supporting IDC Technologies on a professional on-site basis in Abu Dhabi, United Arab Emirates, you will take full operational, tactical, and technical ownership of AI testing strategies, quality assurance automation, SRE observability, and cross-functional engineering collaboration. Your day-to-day responsibilities include designing, developing, and executing comprehensive automated test suites using Python and PyTest, validating Generative AI models, Large Language Models (LLMs), and Retrieval-Augmented Generation (RAG) evaluation frameworks, managing cloud infrastructure and AI services on AWS and Azure (including Azure OpenAI and AWS Bedrock), building and maintaining CI/CD deployment pipelines utilizing Terraform and Git Hub Actions, monitoring production health, system reliability, and performance metrics via Grafana and Prometheus, executing load and stress testing using JMeter and K6, collaborating proactively with software development squads, data scientists, and technical recruitment leadership like Shweta Kasgar at IDC Technologies, adhering to strict corporate quality and security standards, and managing application requirements by submitting your updated CV via direct email to shwe

Key Responsibilities:
  • Design, develop, and execute robust automated testing frameworks and test scripts utilizing Python and PyTest.
  • Validate, test, and evaluate Generative AI models, Large Language Models (LLMs), and RAG (Retrieval-Augmented Generation) pipelines.
  • Administer and configure cloud-based AI services and infrastructure on AWS and Azure, including Azure OpenAI and AWS Bedrock.
  • Build, optimize, and maintain CI/CD deployment pipelines utilizing Terraform and Git Hub Actions.
  • Monitor system reliability, uptime, SLOs, and performance metrics across Grafana and Prometheus dashboards.
  • Execute comprehensive load, stress, and performance testing using JMeter and K6 to identify scalability bottlenecks.
  • Collaborate proactively with cross-functional data science, software engineering, and Dev Ops squads.
  • Ensure strict adherence to AI safety standards, data quality benchmarks, and enterprise security compliance frameworks.
  • Maintain meticulous test automation documentation, test case repositories, SRE runbooks, and incident post-mortem logs.
  • Participate actively in sprint planning, code reviews, and root-cause analysis (RCA) sessions for AI production anomalies.
Required

Qualifications & Skills:
  • Bachelor’s or Master’s degree in Computer Science, Artificial Intelligence, Software Engineering, or a related technical discipline.
  • Minimum of 5+ years of progressive professional hands-on experience in software quality assurance, automation testing, or site reliability engineering.
  • Strong, demonstrable operational proficiency in Python programming and PyTest automation frameworks.
  • Comprehensive working knowledge and practical hands-on experience with AI/GenAI testing, LLM evaluation, and RAG architectures.
  • Solid practical grasp of cloud platforms (AWS, Azure) and specialized AI managed services (Azure OpenAI, AWS Bedrock).
  • Proven expertise in infrastructure-as-code (Terraform), CI/CD pipelines (Git Hub Actions), and SRE observability…
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary