Associate Director, Engineering
Listed on 2026-06-04
-
Software Development
Data Engineer
Overview
We are seeking an experienced and highly skilled Associate Director, Engineering to join our dynamic team. The ideal candidate will have a minimum of three years of hands‑on experience in the Azure Cloud ecosystem and a strong foundation in building, deploying, and optimizing robust data pipelines.
This role requires technical expertise in modern data warehousing, data lake management, and leveraging cutting‑edge AI services to drive process automation and efficiency. The successful candidate will be a proactive, innovative thinker with excellent communication skills, dedicated to continuous improvement of our data platform.
Responsibilities- Design and deploy robust Azure Data Factory pipelines for scalable data ingestion and transformation.
- Develop and optimize data workflows across Azure SQL Managed Instance
, Azure Fabric Data Warehouse
, and ADLS / One Lake storage. - Work extensively with Parquet files
, including integration with Azure Databricks
, and configure Delta Sharing for secure data exchange. - Manage data in Azure Data Lake
, ensuring performance, security, and governance best practices. - Collaborate across teams to implement AI-enabled tools and services for process automation and operational efficiency.
- Develop clean, maintainable code in Python for data processing and automation tasks.
- Participate in architectural discussions, mentor junior engineers, and contribute to engineering best practices.
- Suggest and implement process improvements proactively to enhance system reliability and development efficiency.
- 3+ years of hands‑on experience with Azure Cloud data services.
- Expertise in Azure Data Factory
, Azure SQL Managed Instance
, and Azure Data Lake Storage (ADLS). - Experience working with Azure Fabric Data Warehouse and managing data in One Lake
. - Strong skills in Python for data engineering and scripting.
- Proficient in Databricks
, including configuration for external Parquet files and Delta sharing setup. - Strong understanding of Parquet file formats
, distributed processing, and big data pipelines. - Strong understanding of T‑SQL and ability to optimize queries for cloud‑native execution.
- Knowledge of Fabric notebooks (Python/Spark) for data transformation.
- Experience with dataflows Gen2 in Fabric for ETL/ELT workloads.
- Understanding of Fabric workspace management, capacity planning, and cost optimization.
- Familiarity with Entra (formerly Azure AD) authentication and security principals.
- Design and implement medallion architecture (Bronze/Silver/Gold layers) in One Lake for data quality and governance.
- Excellent communication skills with a proactive, innovative approach to problem‑solving and continuous improvement.
- Exposure to media or entertainment industry data workflows is a plus.
- Experience with on‑prem SQL Server and SSIS is beneficial.
- Familiarity with AI/ML-powered data tools and real‑time data processing pipelines.
- Azure certification (e.g.,
Azure Data Engineer Associate
) is a plus. - Experience working in Agile teams with Dev Ops practices.
- Direct experience migrating from SQL Servers/SSIS to Azure Fabric is highly valued.
- Experience with Power BI and understanding of Fabric’s integration with Power BI Premium.
- Knowledge of lakehouse vs data warehouse architecture tradeoffs in Fabric.
- Familiarity with Git integration in Fabric for version control and CI/CD.
- Understanding of shortcuts in One Lake for data virtualization.
Starcom is an Equal Opportunity Employer. Our employment decisions are made without regard to actual or perceived race, color, ethnicity, religion, creed, sex, sexual orientation, gender, gender identity, gender expression, pregnancy, childbirth and related medical conditions, national origin, ancestry, citizenship status, age, disability, medical condition as defined by applicable state law, genetic information, marital status, military service and veteran status, or any other characteristic protected by applicable federal, state or local laws and ordinances.
The Power of One starts with our people! To do powerful things, we offer powerful resources. Our best‑in‑class wellness and benefits offerings include:
- Paid Family…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).