Staff Engineer II – Data Engineer

Responsibilities

• design, build, and support secure, scalable cloud data solutions
• develop ETL pipelines, reusable PySpark patterns, and integrated data flows
• ensure compliance with IT policies, procedures, and industry standards
• design transaction specific application performance monitoring metrics
• implement Azure Dev Ops CI/CD practices and apply test-driven development where appropriate
• collaborate with stakeholders and provide technical guidance
• lead the strategic planning of a project as it relates to technical solution design
• design and implement engineering principles aimed at reliability practices and sound recovery procedures
• develop and maintain technical documentation, including system configurations and procedures

• 7+ years of data engineering experience with ETL, Enterprise Data Warehousing, database concepts, cloud data platforms, and query languages such as T-SQL, PL/SQL, or Spark SQL
• experience with Azure Data Factory, Azure Synapse Analytics, Microsoft Fabric, Databricks, Azure Data Lake, and Azure Dev Ops
• Bachelor's degree in related field required
• Previous leadership experience preferred
• Intermediate to advanced knowledge of general Financial Services or Banking is preferred
• Advanced proven experience in leading cross-functional teams and managing multiple projects simultaneously
• Additional experience with pipeline development and leveraging Azure Dev Ops while working on multiple projects simultaneously
• Advanced ability to see the big picture and align projects with organizational goals
• Capable of leading and motivating cross-functional teams
• Expertise in resolving conflicts and addressing challenges as well as skilled at identifying and mitigating risks at the project level
• Proficient in governance patterns tied to intake, technical reviews and architectural compliance
• Experience designing reusable PySpark frameworks, shared libraries, and parameter-driven ingestion and transformation patterns
• Preferred experience supporting cloud data platform modernization, including migration from Azure Synapse to Microsoft Fabric
• Experience with conceptual, logical, and physical data design, including architecture and data flow diagrams using tools such as Visio or Lucidchart
• Preferred experience with analytics, multi-cloud data platforms, Agile, SAFe, or Scrum delivery, data quality, data catalog, data lineage tools, and relevant Azure certifications
• Advanced speaking and writing communication skills
• May require up to 25% travel.

Demonstrates expertise in designing and implementing secure, scalable cloud data solutions, with a strong focus on ETL pipeline development and compliance with industry standards. Proven ability to lead cross-functional teams and manage multiple projects while aligning technical solutions with organizational goals.

• Data Engineering Experience
• ETL Development
• Azure Data Factory
• Leadership in Cross-Functional Teams
• Cloud Data Platform Modernization

• ETL
• Enterprise Data Warehousing
• T-SQL
• PL/SQL
• Spark SQL
• Py Spark
• Data Design
• Data Flow Diagrams
• Governance Patterns
• Test-Driven Development

• Communication Skills
• Conflict Resolution
• Risk Mitigation
• Team Motivation
• Strategic Planning

• Azure Certifications

• Financial Services
• Banking
• Agile
• SAFe
• Scrum

• Azure Synapse Analytics
• Microsoft Fabric
• Databricks
• Azure Data Lake
• Azure Dev Ops
• Visio
• Lucidchart