SDET - AI/ML
Job in
Rochester, Olmsted County, Minnesota, 55901, USA
Listing for:
TechDigital Group
Full Time
position
Listed on 2026-11-18
Job specializations:
-
Quality Assurance - QA/QC
Job Description & How to Apply Below
Experience level: 10 + years
Must have skills: SDET skills, Azure devops, python, pytest test automation and Framework, AI ML practices, RAGAS, LLMs
Brief JD:- Experience in designing LLM/RAG test automation solutions
- Experience in testing for bias, drift, and fairness.
- Familiarity with performance metrics (precision, recall, F1, ROC-AUC).
- Knowledge of MLflow MLOps framework
- Knowledge of tools for synthetic data generation and boundary testing
- Knowledge of Azure Dev Ops for CI/CD pipeline development
- Experience in RAG/pipeline evaluation frameworks
- pytest:
Test automation framework - Deep Eval or Tru Lens: LLM test assertions
- RAGAS: RAG-specific metrics
- Eleuther: LLM evaluation harness
- Garak or Promptfoo: LLM red-teaming
- Evidently:
Drift/performance monitoring
- pytest:
- Exposure to explainability frameworks (SHAP, LIME, Captum)
- Handson experience in API and Database testing.
- Practical knowledge of Databricks, Azure Cloud services land distributed data validation.
- Proficiency with Azure Dev Ops pipelines YAML templates, agent pools, CICD workflows.
- Experience in implementing AIML practices in testing e.g., test generation, anomaly detection, log analysis to improve test efficiency and coverage.
- Familiarity with Cucumber (BDD) and test reporting frameworks (e.g., Allure).
- Strong understanding of integration testing across Databricks streaming jobs, applications and microservices.
- Experience with performance testing tools (JMeter, Load Runner, or equivalent).
- Experience with Pester framework for validating Power Shell scripts and infrastructure automation.
- Solid understanding of Agile/Scrum methodology and handson usage of JIRA.
- Excellent problem-solving, debugging, and communication skills, with the ability to advise development teams on testing best practices.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction