AI​/ML Architect Databricks

Overview

We are seeking a skilled AI/ML Architect with hands-on experience in Databricks to join our team. The ideal candidate has strong analytical capabilities, experience building scalable data pipelines and machine learning models, and the ability to collaborate with cross-functional teams to drive data-driven decision-making. This role involves working with large datasets, advanced analytics, and modern data engineering and ML frameworks—primarily using Databricks on Azure/AWS.

• Bachelor’s degree or higher in Computer Science, Data Science, Mathematics, Statistics, Engineering, or related field.
• 3+ years of experience in data science or machine learning roles.
• Advanced knowledge of Databricks, including:
• PySpark / Spark SQL
• Databricks notebooks
• Delta Lake
• MLflow
• Databricks Jobs & Workflows
• Strong programming skills in Python (pandas, numpy, scikit-learn).
• Experience working with large-scale data processing.
• Solid understanding of machine learning algorithms and statistical techniques.

• Develop, train, and optimize machine learning and statistical models using Databricks, Python, PySpark, and MLflow.
• Perform exploratory data analysis (EDA) to identify trends, patterns, and insights in large datasets.
• Deploy ML models into production using Databricks MLflow, Delta Live Tables, or other MLOps pipelines.
• Conduct A/B testing, forecasting, segmentation, anomaly detection, or recommendation systems as required by the business.
• Build scalable, high-performance ETL/ELT pipelines using PySpark, SQL, and Databricks workflows.
• Work with Delta Lake to ensure high-quality, reliable, and performant data.
• Optimize cluster usage and job performance within the Databricks environment.
• Collaborate with data engineers to ensure high-quality data availability for modeling.
• Translate business problems into analytical solutions and present findings to non-technical stakeholders.
• Partner with product, engineering, and business teams to drive data-informed decisions.
• Communicate complex statistical concepts in a clear and concise manner.

• Experience deploying models in production using MLOps frameworks.
• Knowledge of Azure Databricks or AWS Databricks environments.
• Understanding of CICD pipelines and Dev Ops concepts (Azure Dev Ops, Git Hub Actions, etc.)
• Familiarity with deep learning frameworks (Tensor Flow, PyTorch) is a plus.

• Strong analytical and problem-solving skills
• Ability to work in a fast-paced, collaborative environment
• Excellent communication and presentation skills
• Self-driven with high attention to detail

Job Type: Full-time, Contract

Pay: $ - $ per year

Work Location:

In person

Freelance data hiring powered by an engaged, trusted community — not a CV database.