Application Engineer Senior

Location-Remote

AI Engineer (Generative AI & Agent Quality) along with Salesforce AI and Agent force. Data cloud etc

We are seeking an AI Engineer to help design, test, optimize, and support AI-powered agent experiences across customer and internal business workflows. This role combines prompt engineering, agent orchestration, quality assurance, evaluation framework development, and AI observability.

The ideal candidate is curious, analytical, and hands-on, with experience working with Large Language Models (LLMs), prompt design, testing methodologies, and modern software development practices. You will partner closely with product managers, software engineers, architects, and business stakeholders to improve agent behavior, reliability, accuracy, and user experience.

• Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
• 5-10 years of experience in software engineering, QA engineering, automation testing, business systems analysis, or related technical roles.
• 1 years of hands-on experience with Generative AI, LLMs, prompt engineering, or conversational AI solutions.
• Experience working with Azure Dev Ops or similar Agile delivery platforms.
• Experience designing and executing structured test plans.
• Strong analytical and troubleshooting skills.
• Experience working with APIs and JSON data structures.
• Excellent written and verbal communication skills.

• Prompt Engineering

• Agent Design

• AI Evaluation Frameworks

• RAG Concepts

• LLM Testing

• AI Quality Assurance

• AI Observability

• Prompt Optimization

• Arize AI

• Azure Dev Ops

• Azure OpenAI

• Git

• Postman

• Jira (optional)

• Power BI (optional)

• Python

• SQL

• REST APIs

• JSON

• Test Automation Frameworks