Fabric Developer​/Sr. Data Engineer

Position: Fabric Developer / Sr. Data Engineer
Position Title:

Fabric Developer / Sr. Data Engineer

Location:

Phoenix, AZ (Onsite 5 days)
Years of

Experience:

8+ years
Max Bill Rate: $80 - $85

Responsibilities:

• Builds and maintains ELT/ETL pipelines using Microsoft Fabric tools, enabling efficient data ingestion from multiple resources.

• Applies transformations, cleanses, and enriches data to ensure it is ready for analyzing and reporting

• Handles large datasets, optimizing storage and retrieval for performance.

• Implements automation for data processing and integration workflows, reducing manual intervention

• Works with Platform Architects to ensure infrastructure supports data requirements.

• Partners with Report developers to ensure that data is in a usable format and ready for analysis.

• Ensuring code reusability and parameterization

• Focuses on creating interactive, intuitive reports and dashboards using Microsoft Fabric's reporting tools.

Qualifications:

• Data Factory (in Fabric):
Designing and orchestrating data ingestion and transformation pipelines (ETL/ELT).

• Data Engineering Experience (Spark):
Using Notebooks (PySpark, Spark SQL, Scala) and Spark Job Definitions for complex data processing, cleansing, enrichment, and large-scale transformations directly on One Lake data.

• Lakehouse Items:
Creating and managing Lakehouse structures (Delta tables, files) as the primary landing and processing zone within One Lake.

• One Lake / ADLS Gen2:
Understanding storage structures, Delta Lake format, partitioning strategies, and potentially managing Shortcuts.

• Monitoring Hubs:
Tracking pipeline runs and Spark job performance.

• Core Responsibilities (Fabric Context):
Building ingestion pipelines from diverse sources; implementing data cleansing and quality rules; transforming raw data into curated Delta tables within Lake houses or Warehouses; optimizing Spark jobs and data layouts for performance and cost; managing pipeline schedules and dependencies; ensuring data security and governance principles are applied to pipelines and data structures.

• Excellent Communicator and collaboration skills

• Bachelor's degree in Computer Science, Engineering, or a relevant field

• Azure/AWS Cloud Certifications will be a plus

• Experience with Manufacturing domain will be a plus.

• Should be self-driven and be able to drive the projects to delivery