Lead Data Engineer

Project Overview

This project is a high‑impact business process engine designed to optimize customer pharmacy procurement. The system analyzes the purchase ratio between preferred and non‑preferred suppliers. We need a Senior Solution Architect who can command a high‑pressure environment, architect a robust technical roadmap, and provide immediate direction to a team of developers.

• Design and guide the implementation of new features.
• Be hands on with development, using the required technical skills listed above.
• Give clear coding guidance to offshore team, review code, and help unblock technical issues for the team.
• Choose the smart and quick path over over‑engineering, balancing immediate business needs with long‑term platform stability.

• 7+ years of software development experience with 3+ years in a lead/senior role
• Expert-level proficiency in Python and PySpark for big data processing
• Strong experience with Azure Databricks and Azure cloud ecosystem (ADF, ADLS Gen2, Key Vault)
• Deep understanding of distributed computing concepts and Spark optimization technique.
• Hands-on experience with Mongo
  
  DB and SQL databases.
• Proficiency in Git, CI/CD pipelines, and Dev Ops practices
• Experience with data modeling, ETL design patterns, and data warehousing concepts

All our positions are Remote and are available as Full Time Employment or B2B Contracts