Senior Data Engineer

Paul Hastings is a leading international law firm that provides innovative legal solutions to many of the world’s top financial institutions and Fortune Global 500 companies. With a strong presence throughout the U.S., Asia, Europe, Latin America, and the Middle East, we have the global reach and extensive capabilities to provide personalized service wherever our clients’ needs take us. As one of the world’s leading law firms, we seek dynamic individuals who share our commitment to service, innovation, and professional growth.

Senior Data Engineer

Boston, Chicago, Dallas, Houston, Los Angeles, New York, San Francisco, Washington, D.C.

Regular

We have an opening for a Senior Data Engineer.

The Senior Data Engineer is responsible for designing, building and maintaining modern data pipelines and data integration solutions in the Azure Cloud. This role enables enterprise analytics by delivering clean, timely and well-structured data to platforms such as Power BI. The Senior Data Engineer collaborates closely with architects, analysts, and business stakeholders to deliver scalable, secure and efficient data solutions using Azure Databricks, and Azure Dev Ops.

In this capacity, the Senior Data Engineer will:

• Design, build and manage scalable data pipelines using Azure Databricks;
• Develop ELT frameworks for ingesting and transforming structured and semi-structured data from on-prem and cloud sources – including cloud based API’s;
• Implement robust Dev Ops pipelines for code versioning, testing, deployment and monitoring using
  
  Azure Dev Ops;
• Ensure pipeline performance, reliability and observability using tools like Azure Monitor and Log Analytics;
• Collaborate with BI teams to support Power BI datasets and ensure optimal data model performance;
• Automate environment setup, configuration and permissions using infrastructure-as-code where possible;
• Write modular, testable code inSQL, Python or PySpark and manage version control with Git;
• Support production operations, root cause analysis and performance tuning;
• Understand data sources and data relationship models.
• Maintain technical documentation for pipelines, data mappings and deployment processes;
• Work as part of an Agile delivery team, participating in sprints, retrospectives and code review; and
• Mentor junior data engineers and promote best practices in CI/CD, version control, and release management.

Proficiencies:

• Advanced proficiency in Azure Databricks;
• Experience building and managingCI/CD pipelines in Azure Dev Opsfor data solutions;
• Strong SQL and ELT experience; familiarity with schema design (e.g., star, snowflake, denormalized);
• Hands-on expertise with
  
  Py Sparkand Databricks  notebooks, including Delta Lake workflows;
• Familiarity with
  
  Git, branching strategies and repository management within
  
  Azure Repos;
• Understanding of data security and privacy best practices in Azure (RBAC, managed identities, encryption);
• Experience with Power BI dataflows, datasets and refresh configuration (preferred);
• Familiarity with data cataloging and governance tools (e.g.,Microsoft Purview) a plus; and
• Experience with Agile tools such as Azure Boards or JIRA.

Qualifications:

• Bachelor’s degree in Computer Science, Engineering or related field (required);
• 7+ years of data engineering or BI development experience;
• 3+ years building data solutions in Microsoft Azure Cloud;
• 2+ years using
  
  Azure Dev Opsfor automated builds, releases and pipeline orchestration;
• Proven experience working with structured and semi-structured data (Parquet, JSON, Avro); and
• Experience in professional services, legal, or financial environments preferred.

The salary wage range for Boston that we expect to pay for this position is a minimum of…