Skip to content
×

SDET - AI​/ML

Listing for: TechDigital Group
Full Time position Listed on 2026-11-18
Job specializations:
Salary/Wage Range or Industry Benchmark: 120000 - 170000 USD Yearly USD 120000.00 170000.00 YEAR

Job Description & How to Apply Below

Experience level: 10 + years

Must have skills: SDET skills, Azure devops, python, pytest test automation and Framework, AI ML practices, RAGAS, LLMs

Brief JD:
  • Experience in designing LLM/RAG test automation solutions
  • Experience in testing for bias, drift, and fairness.
  • Familiarity with performance metrics (precision, recall, F1, ROC-AUC).
  • Knowledge of MLflow MLOps framework
  • Knowledge of tools for synthetic data generation and boundary testing
  • Knowledge of Azure Dev Ops for CI/CD pipeline development
  • Experience in RAG/pipeline evaluation frameworks
    • pytest:
      Test automation framework
    • Deep Eval or Tru Lens: LLM test assertions
    • RAGAS: RAG-specific metrics
    • Eleuther: LLM evaluation harness
    • Garak or Promptfoo: LLM red-teaming
    • Evidently:
      Drift/performance monitoring
  • Exposure to explainability frameworks (SHAP, LIME, Captum)
  • Handson experience in API and Database testing.
  • Practical knowledge of Databricks, Azure Cloud services land distributed data validation.
  • Proficiency with Azure Dev Ops pipelines YAML templates, agent pools, CICD workflows.
  • Experience in implementing AIML practices in testing e.g., test generation, anomaly detection, log analysis to improve test efficiency and coverage.
  • Familiarity with Cucumber (BDD) and test reporting frameworks (e.g., Allure).
  • Strong understanding of integration testing across Databricks streaming jobs, applications and microservices.
  • Experience with performance testing tools (JMeter, Load Runner, or equivalent).
  • Experience with Pester framework for validating Power Shell scripts and infrastructure automation.
  • Solid understanding of Agile/Scrum methodology and handson usage of JIRA.
  • Excellent problem-solving, debugging, and communication skills, with the ability to advise development teams on testing best practices.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary