Sr. Data Engineer

About Allworth Financial

Allworth Financial () is an independent investment financial advisory firm that specializes in retirement planning, investment advising, and 401(k) management with a direct approach to financial planning. Allworth delivers long‑term and short‑term investment planning solutions and advice to help clients achieve their goals and plan strategically for retirement.

Allworth is a high‑growth, private‑equity‑backed, multi‑branch Registered Investment Advisor founded in Sacramento, California, in 1993. The firm is fee‑based, employee‑centric, and prides itself on emphasizing client well‑being and education. It is a multi‑billion‑dollar organization on track for continued growth through acquisitions and organic expansion. Allworth has been recognized as a Barr’s Top 40 RIA (2024) and received the Circle of Excellence award for employee and client satisfaction (2021).

This is an opportunity to join a high‑growth business as a Senior Data Engineer. You will work with the Analytics & Insights team to optimize the company’s existing data infrastructure and support a robust data analytics and reporting structure.

We are seeking a senior‑level data engineering professional to guide the next stage of our data platform evolution, modernizing legacy SQL‑based processes into scalable, maintainable cloud data pipelines, improving engineering standards, and maturing our data governance practices.

A full‑time exempt position located in Addison, with a hybrid work schedule, requires travel within the Sacramento area.

• Design, build, and optimize data pipelines using PySpark, Delta Lake, SQL, and cloud‑based tools.
• Improve data pipeline reliability, observability, logging, error handling, and restartability.
• Review existing notebooks, SQL scripts, data models, and orchestration workflows for maintainability and performance.
• Guide best practices for Azure Synapse, Spark, Delta Lake, data lake storage, and related cloud data services.
• Identify architectural gaps, technical debt, and modernization risks.
• Design and implement data quality checks, reconciliation processes, and validation frameworks.
• Support development of canonical IDs, master data patterns, and entity resolution processes.
• Assist with data cataloguing, lineage, metadata management, and governance practices.
• Partner with business stakeholders to understand reporting, analytics, and data product requirements.
• Help structure scalable data models for BI tools such as Thought Spot or Power BI.
• Mentor data team members and raise the overall engineering maturity of the team.
• Provide guidance on security, performance, cost, governance, orchestration, testing, and long‑term maintainability.

• Five or more years of professional experience in data engineering, analytics engineering, or data architecture.
• Strong SQL skills, including stored procedures, joins, window functions, CTEs, merge logic, and performance tuning.
• Hands‑on experience with PySpark or other distributed data processing frameworks.
• Experience designing and maintaining ETL/ELT pipelines in a cloud environment.
• Experience with data lake or lakehouse architecture, including Delta Lake or equivalent formats.
• Strong understanding of data modeling concepts: dimensional modeling, staging layers, curated layers, and semantic/reporting models.
• Experience with pipeline orchestration, scheduling, dependency management, and failure recovery.
• Ability to troubleshoot data quality issues, pipeline failures, schema drift, performance bottlenecks, and source system inconsistencies.
• Familiarity with modern data governance concepts: cataloging, lineage, ownership, access control, data definitions, and quality monitoring.
• Excellent communication skills with both technical and non‑technical stakeholders.
• Experience reviewing systems and recommending incremental improvements.
• Experience with Azure Synapse Analytics, Azure Data Lake Storage, Microsoft Fabric, Azure Data Factory, or related Azure data services.

• Medical:
  Blue Shield PPOs, HDHP with HSA, and Kaiser HMO plans for California associates.
• Dental insurance (Met Life) and vision insurance (VSP).
• Optional…