Databricks Engineer

We are hiring a Databricks Engineer to design, build, and operate a scalable Data & AI platform for our client, with a strong foundation in the Medallion Architecture (Bronze/Silver/Gold layers). This role will orchestrate complex data workflows and scalable ELT pipelines, integrating data from enterprise systems (People Soft, D2L, Salesforce).

• Design, implement, and optimize end-to-end data pipelines on Databricks, following Medallion Architecture principles.
• Build robust and scalable ETL/ELT pipelines using Apache Spark and Delta Lake.
• Operationalize Databricks Workflows for orchestration and dependency management.
• Connect and ingest data from enterprise systems such as People Soft, D2L, and Salesforce.
• Implement Unity Catalog or equivalent tools for centralized metadata management, data lineage, and governance.
• Enable data scientists by delivering high-quality, feature-rich data sets, supporting the MLOps lifecycle using MLflow.

• Hands-on experience with Databricks, Delta Lake, and Apache Spark for large-scale data engineering.
• Deep understanding of ELT pipeline development, orchestration, and monitoring.
• Strong proficiency in SQL, Python, or Scala for data transformations and workflow logic.
• Proven experience integrating enterprise platforms (People Soft, Salesforce, D2L) into centralized data platforms.
• Familiarity with cloud platforms like Azure or AWS, including storage and security aspects.
• Minimum Years of
  
  Experience:
  
  Extensive hands-on experience with Databricks required.

EQUAL OPPORTUNITY EMPLOYER STATEMENT: Mfinite Consulting is an Equal Opportunity Employer. We value diversity and are committed to creating an inclusive environment for all employees and applicants. We do not discriminate based on race, color, religion, sex, national origin, age, disability, marital status, sexual orientation, gender identity or expression, veteran status, or any other legally protected status. All qualified candidates are encouraged to apply.