More jobs:
Senior Data Engineer
Job in
Bellevue, King County, Washington, 98009, USA
Listed on 2025-12-03
Listing for:
Compunnel, Inc.
Full Time
position Listed on 2025-12-03
Job specializations:
-
IT/Tech
Data Engineer, Cloud Computing
Job Description & How to Apply Below
Client is looking for a Sr. Data Engineer with extensive experience in Azure, Databricks, Power Shell, and SQL to contribute to building scalable data engineering solutions. This role involves working within an Azure + Databricks Lakehouse environment, utilizing a variety of tools and technologies to optimize data pipelines, implement Dev Ops practices, and improve the performance and efficiency of data applications.
Key Responsibilities- Develop, maintain, and optimize data pipelines leveraging Azure Data Factory (ADF), Databricks, and Py Spark
- Design and implement CI/CD pipelines using Azure Dev Ops
- Utilize SQL (TSQL, Postgre
SQL) and Power Shell for scripting and automation - Optimize code for performance, including reading DAGs and resolving CBO issues
- Ensure consistency and repeatability in code deployment using custom SQL frameworks
- Develop and maintain data lakes and data warehouses using ADLS, Delta Lake, and Parquet formats
- Participate in peer code reviews and maintain adherence to SDLC, including Dev Ops practices
- Advise and support the team on data modeling, performance tuning, and system scalability
- Collaborate with cross-functional teams and clarify technical requirements with customers
- Manage defect tracking and resolution, providing proactive measures to improve code quality
- Estimate time and resources required for developing/debugging data features/components
- 8+ years of experience in Azure, Databricks, and related data engineering technologies
- Strong proficiency with Azure Data Factory (ADF), ADLS, and Azure Dev Ops
- Experience with Databricks, PySpark, and SparkSQL
- Proficiency with SQL (TSQL, Postgre
SQL) and Power Shell scripting - Familiarity with data formats like Parquet and Delta Lake
- Deep understanding of SDLC and CI/CD practices
- Expertise in optimizing code for performance and scalability
- Strong problem-solving skills and ability to break down complex challenges
- Excellent communication and collaboration skills in an Agile environment
- Experience with big data tools and technologies (e.g., Hadoop, Kafka, etc.)
- Experience with cloud-based data solutions and architecture design
- Familiarity with Agile methodologies (Scrum, Kanban)
- Strong experience with performance tuning, indexing, and partitioning
- Certification in Azure Data Engineering or related domain
- Databricks Certified Associate Developer for Apache Spark (preferred)
Position Requirements
10+ Years
work experience
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×