Forward Deployed Technical Consultant-Databricks: AI&Data Advanced Technology Centers

We are:
The Advanced Technology Centers (ATCs) are the engine for reinvention in our clients’ transformation journey. Powered by more than 255,000 people across 24 countries, ATCs provide our clients with seamless access to industry insights and innovative technology solutions. Stronger together! The Advanced Technology Centers (ATCs) make a tremendous impact in solving our clients’ business problems by leveraging innovation, intelligence, industry insights, new IT, and new technology skills.

With the global environment changing at a faster pace, our clients are facing unprecedented challenges, and they need us more than ever before. As a Network, ATCs are positioned to unlock greater opportunities and exponential value for our clients. The value for our clients and our people:
For our clients, the Network provides the strength of our geographic diversity, greater resilience, and seamless access to the deepest industry knowledge, the latest in Gen AI solutions, and tech expertise from around the world. For our people, it brings an opportunity to shape truly boundaryless career paths in a highly collaborative team of experts where they can learn from each other and solve the world’s most complex client challenges.

As a Forward Deployed Technical Consultant-Databricks, you will design, build, and operationalize artificial intelligence and machine learning solutions for enterprise clients, combining custom models with cloud and third- party AI services to deliver production-ready outcomes. You will design, build, and operationalize enterprise-grade data and agentic AI solutions in Databricks and Azure Data Services. Your role spans the full solution lifecycle - assessing client needs and data, selecting and customizing models (including Deep Learning, Generative AI, and Large Language Models), designing scalable data and Dev Ops & MLOps pipelines for training and production, and ensuring quality, value, and reliability of deployed systems.

You will design and implement autonomous agents using Databricks Mosaic AI Agent Framework and frameworks like Lang Chain or Auto Gen. You’ll work closely with analytics, data science, and cloud teams to ensure reliable, high-performance data delivery for the clients we serve.

• Formulate real-world problems into practical, efficient, and scalable AI and Machine Learning solutions
• Architect, develop, and maintain scalable, low-latency data pipelines to ingest and transform diverse datasets leveraging Azure Databricks workflows and Spark technologies.
• Design and optimize lakehouse architecture using Delta Lake tables following Bronze, Silver, and Gold layers to ensure efficient, reliable, and governed data storage.
• Design and implement autonomous agents using Databricks Mosaic AI Agent Framework and frameworks like Lang Chain or Auto Gen
• Build and optimize vector search indexes using Databricks Vector Search for accurate context retrieval.
• Design AI agents with retrieval, orchestration, tool invocation, evaluation harnesses, and lifecycle observability.
• Process large-scale distributed datasets on the Databricks Intelligence Platform with Apache Spark.
• Develop and implement machine learning algorithms, models, and computational systems; design and build scalable data pipelines to support model training and production with Dev Ops & MLOps
• Customize and apply Deep Learning and Gen AI models for various use cases based on the business needs, data availability, system and infrastructure requirements - including edge device and HPC
• Engage in research and development of new AI and high-performance compute algorithms, models, and simulations along with their applications to solve complex business problems at client sites
• Work with large-scale datasets and…