Ai Test Engineer Mid level

Ai Engineer Mid Level

Candidates must be located in Maryland, Wash DC or Virginia.

Vega Consulting Solutions is hiring a Ai Test Engineer with automation testing experience for our client located in Baltimore, MD. This position will require candidates to work onsite once a week.

Mid Level Ai Engineer to Conduct deep technical analysis and testing of AI/ML and Generative AI systems, including validation and verification of model outputs, prompt behavior, and end-to-end application workflows.

• ML concepts and GEN AI concepts
• 3+ years of relevant testing experience with a strong background in Software QA with cloud technologies, including 3+ years of experience with hands-on exposure to AI/ML application testing.
• 2+ years of relational database experience including generating complex queries, setting up database connections, and automating query processing, with familiarity in querying ML feature stores or data pipelines.
• Experience in automated and manual testing in cloud environments, particularly for AI/ML and Gen AI applications, including validation of model outputs, embeddings, and LLM-generated responses.
• Experience designing test strategies for non-deterministic systems, including techniques for evaluating accuracy, relevance, and safety of Gen AI outputs.
• 1+ years of experience with BDD/Selenium and automation tools, with a plus for experience in AI testing frameworks.
• Experience using Agile team collaboration and requirements management tools (Jira, Confluence).
• Excellent written and oral communication skills and problem-solving abilities, with the ability to clearly articulate AI/ML testing findings to both technical and non-technical stakeholders.
• Strong aptitude to learn and adapt to emerging AI/ML technologies and evolving Gen AI tooling.
• Familiarity with AWS AI/ML services (Sage Maker, Bedrock) or equivalent cloud AI platforms is a plus.
• Bachelor's degree required; technical degree preferred.