AI Engineer - GenAI & Customer Service

Geek Soft Consulting | Fixed Term Employment

Utrecht, Netherlands

• Help design, build and continuously improve the clients online platform.
• Research, suggest and implement new technology solutions following best practices/standards.
• Take responsibility for the resiliency and availability of different products.
• Be a productive member of the team.

• AI Data & Evaluation Engineer to work within a Scrum team, preparing, structuring, enriching, and validating enterprise data for AI knowledge bases and AI chatbots.
• Build and maintain Databricks data pipelines to process structured and unstructured data for AI knowledge bases.
• Prepare, clean, transform, and enrich source data to improve the quality and reliability of information used by AI assistants.
• Develop and maintain evaluation datasets covering realistic conversations, complex scenarios, edge cases, and multi-step workflows.
• Apply evaluation frameworks to test advanced chatbots across single-turn, multi-turn, simulation-based, and agentic scenarios.
• Implement automated testing, monitoring, and quality gates for changes to data, prompts, models, retrieval, and orchestration.
• Deploy and manage cloud infrastructure using Infrastructure as Code, particularly Azure Bicep and CI/CD pipelines.
• Analyze evaluation results and translate findings into improvements across knowledge, retrieval, prompts, tools, and application logic.
• Strong proficiency in Python, data engineering, and automated testing.
• Hands-on experience with Azure, Databricks, Dev Ops, CI/CD, and Infrastructure as Code, preferably Bicep.
• Experience building data pipelines and preparing structured and unstructured enterprise data for AI knowledge bases and RAG applications.
• Experience with chatbot evaluation, including multi-turn, simulated, and agentic interactions.
• Familiarity with Context Engineering, Agentic AI, Function Calling, retrieval strategies, and tool use.
• Strong engineering and data-quality mindset with an affinity for Agile development.
• Strong critical thinking, ownership, accountability, and problem-solving skills.
• Excellent communication skills and a customer-focused approach.
• Relevant HBO or university degree and fluency in English.
• A challenging, innovating environment.
• Opportunities for learning where needed.