×
Register Here to Apply for Jobs or Post Jobs. X

AI Automation Test Engineer

Job in 500001, Hyderabad, Telangana, India
Listing for: Tredence Inc.
Full Time position
Listed on 2026-02-04
Job specializations:
  • IT/Tech
    AI Engineer, Machine Learning/ ML Engineer, AWS, Data Scientist
Job Description & How to Apply Below
AI Automation Test Engineer (Python & GenAI/LLM)
6-12yrs
Hyderabad

Job Summary :
Test generative AI solutions on AWS, validating LLMs, RAG, prompts, and agentic workflows with n8n and Python libraries like deep checks, Ragas and Lang Chain.

Key Requirements (8 Points) :
Test LLM outputs on AWS Bedrock using boto
3.
Validate fine-tuned LLMs on AWS Sage Maker with deep checks.
Verify langchain prompts in AWS environments.
Test RAG pipelines with AWS Open Search and langchain.
Validate AI agents (crewai/autogen) on AWS Lambda/equivalent
Test n8n agentic workflows (e.g.,  n8n.io/workflows/6270 ).
Ensure deployment stability on Amazon ECS/EKS with Docker.
Monitor performance with Amazon Cloud Watch and wandb.

Must-Have Skills :
2 years testing GenAI/LLMs using Python
4+ years’ experience in QA Automation
Expertise in AWS Bedrock, Sage Maker, Lambda, boto
3.
Proficiency in deep checks, langchain, crewai, autogen, wandb.
Experience testing n8n workflows, RAG, prompts.
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)

Job Posting Language
Employment Category
Education (minimum level)
Filters
Education Level
Experience Level (years)
Posted in last:
Salary