Azure Databricks Engineer – GenAI

Job Title:

Azure Databricks Engineer – GenAI

Location:

Hartford, CT 06103 or Minnetonka, MN 55345 (Onsite)

Duration: 06 Months

• Azure Databricks, with good knowledge of Generative AI technologies, including LLMs, RAG, AI Agents, Vector Databases, and Prompt Engineering

• .Net

• Design, build, and maintain scalable, secure, and high performance batch and streaming data pipelines using modern data engineering practices
• Lead the modernization and migration of on premise data platforms to cloud native architectures, owning infrastructure, networking, security, and deployment pipelines
• Develop and maintain core data platform components that support reliable ingestion, transformation, enrichment, and consumption of enterprise data assets
• Collaborate with data domain experts across Operations, Product, Finance, Value Analytics, and other domains to understand data sources and design efficient, connected data models
• Ensure data accuracy, quality, relevance, and governance by implementing validation, monitoring, documentation, and security controls
• Analyze large datasets to identify trends, patterns, and actionable insights; perform data analysis to support analytics, AI use cases, and business strategy
• Enable reporting and analytics by making curated, trusted datasets available to BI and downstream consumers
• Partner with AI/ML Engineers and Leads to design, build, and improve machine learning models from scratch or enhance existing models
• Contribute to experimentation with novel ML and Generative AI architectures
• Help design and implement AI powered enterprise applications
• Analyzes and investigates

• 1 year of experience working with Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), AI Agents, Vector Databases, and Prompt Engineering.
• Experience developing AI-driven solutions using Git Hub Copilot, Microsoft 365 Copilot, Azure AI Studio, and enterprise GenAI platforms.
• Experience with healthcare domain

• Design, develop, and maintain scalable enterprise applications and AI-powered solutions using .NET, Azure, and Generative AI technologies.
• Build and integrate AI capabilities such as conversational assistants, intelligent search, summarization, content generation, and workflow automation into business applications.
• Implement secure, reliable, and high-performing software solutions while adhering to enterprise architecture, compliance, and governance standards.
• Drive continuous improvement through automation, AI-assisted development practices, code quality enhancements, and operational excellence initiatives

• 4 to 6 years

• Azure Databricks
• Py Spark
• Python