Data Engineer II

Data Engineer IIThe Data Engineer II is a member of the Technology & Solutions department at ASU Enterprise Partners (ASUEP). This role supports the integrity, augmentation, integration, security, and stewardship of all ASUEP data assets. This position works closely with other teams at ASUEP and ASU to support technologies and processes to ensure data is available in an accurate, complete, and timely manner to support business decisions, processes, and reporting.

This position reports to the Associate VP of Technology & Solutions.

What you’ll do Develop and manage data solutions using Microsoft Fabric, Microsoft Azure Cloud, AWS, Google Cloud Platform, Alteryx, Fivetran and other related technologies

Develop and manage integrations between multiple data sources and environments across the ASU Enterprise Partners and ASU data ecosystems

Develop and manage data ingestion into bronze and silver medallion layers within ASUEP’s data ecosystems

Perform advanced configuration in Microsoft Fabric, Microsoft Azure Cloud, AWS, Google Cloud Platform, Fivetran, and other related systems to support evolving business and technical requirements

Provide cross-training to team members

Perform migration of systems, code, data sources, and processes to Microsoft Fabric to support the ongoing digital transformation of ASUEP’s data architecture

Monitor pipelines, jobs, and other scheduled events within organization’s data warehouses/lake houses/cloud environments and related systems to ensure uptime, performance, and data integrity

Provide rapid response and resolution of system incidents, job failures, and operational disruptions; this may include nights and weekends

Load new data sources into Salesforce to augment existing constituent records (including non-degreed alumni records, student organization data, study abroad data, alumni stories data, etc.)In collaboration with and at direction of data and technology leadership, implement Fabric workspace hierarchy, RBAC, and CI/CD for pipelines

Migrate on premises SQL Server data systems and processes to Microsoft Fabric Migrate ETL packages from SSIS to Microsoft Fabric Pipelines in the cloud

Create processes to manage capacity and performance of data solutions in the cloud

Develop SQL stored procedures, tables and views, including complex SQL queries to investigate data for end users

Validate and clean existing data using SQL; debug complex database processes and implement fixes in a timely manner

Coordinate with data and technology leadership to classify, tag, and manage data stored throughout the data ecosystem

Manage multiple projects and assignments concurrently

Participate in agile project management, including documentation of progress using project management applications/methods and participation in sprint ceremonies

Complete tasks in a timely manner; identify, communicate, and resolve barriers in a productive and positive manner

Collaborate with other institutional parties to ensure consistency, accuracy, and availability of data Establish and maintain effective communications with other team members

Document system architecture, troubleshooting steps, system changes, and process improvements.

Perform other duties and projects as required

What you'll need Expertise with designing, managing, and troubleshooting pipelines, jobs, services, and solutions in Microsoft Fabric and Microsoft Azure Expertise with integrating data from various sources into data warehouses, lake houses, and other environments

Experience with database technologies in a hybrid multi-cloud/on-premises model

Experience working within an agile team, or willingness to do so Competency with ETL tools such as Alteryx, Microsoft Azure Data Factory, Microsoft Fabric pipelines and SSISCompelling interest…