More jobs:
Data Engineer Lead
Job in
Richmond, Henrico County, Virginia, 23214, USA
Listed on 2026-09-09
Listing for:
Bitwise
Full Time
position Listed on 2026-09-09
Job specializations:
-
IT/Tech
Data Engineering, Azure
Job Description & How to Apply Below
Role
- Data Engineer Lead Location
- Richmond, VA Fulltime / Hybrid
Job Description
Qualifications:
- 8-10 years of experience as a Lead Data Engineer with a strong focus on Databricks & Azure Data Factory.
- Strong experience leading the Data Engineering teams working on ADF & Databricks. Work with the teams providing technical approaches and solutions.
- Proven experience with data warehousing concepts and best practices.
- Strong SQL skills, ability to perform effective querying involving multiple tables and subqueries.
- Strong understanding of data modeling and data quality principles.
- Strong communication & collaboration skills, should be able to work closely with customer driving technical conversations.
- Experience with Agile development methodologies.
- Ability to work independently and as part of a team.
- Lead team and drive through technical challenges and solutions. Drive technical calls with customer
- Focus on continuous value additions and innovations
- Experience with any other ETL tool (Talend, Informatica or similar)
- Good to have Insurance domain knowledge
- Good to have exposure to Gen AI concepts
- Hands-on experience with Databricks features such as delta lake, clusters, notebooks, jobs, and work spaces.
- Design, develop, and deploy data pipelines using Databricks, including data ingestion, transformation, and loading (ETL) processes.
- Develop and maintain high-quality, scalable, and maintainable Databricks notebooks using Python.
- Work with Delta Lake and other advanced features.
- Leverage Unity Catalog for data governance, access control, and data discovery.
- Experience working with Parquet files & Delta files for data storage and processing.
- Integrate with various data sources, including but not limited to databases and cloud storage (Azure Blob Storage, ADLS, Synapse), and APIs.
- Perform data quality checks and validation to ensure data accuracy and integrity.
- Strong working Knowledge and experience in Microsoft Azure, Azure Data Factory, Synapse Analytics, Azure SQL, Data Pipelining, Data Transformation, ETL, copy activity, custom Azure development.
- Develop and optimize data pipelines for performance and cost-effectiveness.
- Sound skills and hands on experience with Azure Data Lake, SQL Data Warehouse Azure Blob, Azure Storage Explorer
• Sound knowledge on Azure Dev Ops, CICD Processes, Release Processes - Sound Knowledge of Azure Data Catalog, Event Grid, Service Bus, SQL and Synapse
- Troubleshoot and resolve data pipeline issues effectively.
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×