Senior Azure Databricks

Job Description

We are seeking a Data Engineer with strong hands‑on experience in Azure Cloud, Azure Databricks, PySpark, Azure Data Factory (ADF), Delta Lake, and Unity Catalog. This role requires designing, developing, and optimizing scalable data pipelines and cloud-based data solutions, with expertise in ETL/ELT processing, data modeling, performance tuning, and data governance. Proficiency in Python, SQL, Git Hub, and CI/CD practices is required, along with experience working with large‑scale datasets in enterprise environments.

This individual‑contributor position demands strong analytical and problem‑solving skills, the ability to work independently, and ownership of end‑to‑end solution delivery while collaborating effectively with cross‑functional teams and business stakeholders.

• Azure Databricks, PySpark, Delta Lake
• Azure Data Factory (ADF) and ADLS Gen2

• Exposure to AI/LLM or agentic frameworks (Databricks AI/ML, Codex, Claude, etc.)
• Strong experience building REST or GraphQL APIs

• Understanding of API security, contracts, error handling, and performance
• Strong understanding of data governance, security, and CI/CD practices
• Primary skill for the API role with AI Builder

$100,000 - $120,000 a year

• Discretionary Annual Incentive
• Comprehensive Medical Coverage:
  Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans
• Family Support:
  Maternal & Parental Leaves
• Insurance Options:
  Auto & Home Insurance, Identity Theft Protection
• Convenience & Professional Growth:
  Commuter Benefits & Certification & Training Reimbursement
• Time Off:
  Vacation, Time Off, Sick Leave & Holidays
• Legal & Financial Assistance:
  Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing

Bachelor of Computer Science