AI​/ML Software Test Engineer; GenAI & Chatbot Solutions

Job Title: AI/ML Software Test Engineer (GenAI & Chatbot Solutions)
Location: Columbia, MD
Type: Contract
Compensation: $62 /hr
Work Model: Hybrid – onsite and remote

Seeking a Software Engineer to support innovative Machine Learning (ML) and Generative AI (GenAI) initiatives across the organization. This role will work closely with engineering leadership and cross-functional teams to evaluate, test, and optimize AI-powered solutions, including machine learning models, chatbot technologies, and automation capabilities.

The ideal candidate has a strong foundation in software engineering and testing, combined with knowledge of ML and GenAI concepts. This individual will help validate AI solution performance, analyze outputs, identify opportunities for improvement, and collaborate with technical and business stakeholders to ensure solutions deliver accurate and meaningful results.

This is an excellent opportunity for someone who enjoys working at the intersection of software engineering, AI innovation, data analysis, automation, and quality assurance.

• Support existing Machine Learning and Generative AI initiatives while contributing to new projects and enhancements.
• Collaborate with engineering teams to evaluate, test, and improve AI-powered applications and services.
• Analyze model outputs and provide feedback to improve performance, efficiency, and response quality.
• Apply ML and GenAI concepts to assess model behavior, validate outcomes, and identify opportunities for optimization.
• Work closely with business stakeholders to gather feedback and ensure AI-generated outputs meet business expectations.
• Participate in the evaluation and testing of chatbot solutions and conversational AI platforms.
• Validate AI-generated responses for accuracy, consistency, relevance, and effectiveness.
• Utilize prompt engineering techniques to improve chatbot interactions and response quality.
• Support efforts to fine-tune machine learning models and AI-powered solutions.
• Develop and execute system, integration, and automation testing activities.
• Test data pipelines and validate intermediate and final outputs throughout the AI lifecycle.
• Work with cloud-based environments and AI services to support development and testing activities.
• Document findings, recommendations, defects, and testing results using collaboration and project management tools.
• Partner with developers, engineers, and business teams to drive continuous improvement and successful project outcomes.

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent experience.
• 3+ years of software engineering experience.
• 3+ years of experience working with cloud platforms such as AWS, Microsoft Azure, or Google Cloud Platform (GCP).
• Experience applying Machine Learning (ML) concepts and Generative AI (GenAI) concepts in a professional environment.
• Experience evaluating, testing, analyzing, or supporting AI/ML solutions, models, chatbots, or related technologies.
• Experience with system testing, software testing, or quality assurance methodologies.
• Experience with automation testing using Selenium, BDD, or similar frameworks.
• Understanding of data pipelines and data-driven systems.
• Experience working with relational and non-relational databases.
• Strong analytical, troubleshooting, and problem-solving skills.
• Ability to interpret AI-generated outputs and provide actionable feedback.
• Strong verbal and written communication skills with the ability to work effectively across technical and business teams.
• Experience using collaboration tools such as Jira, Confluence, or similar platforms.

• Experience with AWS Bedrock, Amazon Sage Maker, or similar AI…