Information Technology_USA - USA_Developer
Listed on 2026-06-27
-
IT/Tech
Data Engineering, Azure, Cloud Computing: Infrastructure & Operations, Data Warehousing
Azure Databricks Data Engineer
Location:
USA
Duration: 6 months
Design and develop scalable data pipelines using Azure Databricks
Build and manage data ingestion frameworks from multiple data sources
Implement data transformation logic using PySpark and Delta Lake
Collaborate with business and technical teams to understand data requirements
Support data architecture design aligned with enterprise standards
Manage and maintain data workflows in Azure ecosystem
Contribute to CI/CD processes using Azure Dev Ops
Ensure data quality, consistency, and availability across systems
Optimize data processing jobs for performance and cost efficiency
Participate in agile ceremonies and sprint planning
Develop end-to-end data pipelines using Azure Data Factory and Databricks
Ingest structured and unstructured data from multiple sources into data lake
Transform and process large datasets using PySpark and Delta Lake
Troubleshoot and resolve data-related issues through analysis
Implement integration solutions within Microsoft Azure ecosystem
Manage code repositories, stories, and deployments using Azure Dev Ops
Perform data cleansing and validation to ensure data integrity
Monitor, maintain, and optimize existing pipelines and workflows
Ensure compliance with data security and governance standards
Document technical processes, workflows, and best practices
Strong experience with Azure Databricks
Hands-on experience with PySpark for data processing
Knowledge of Delta Lake architecture and implementation
Experience with Azure Data Factory for data ingestion
Proficiency in SQL for data querying and transformations
Experience in Azure Dev Ops for CI/CD and task management
Understanding of data lake and data warehouse concepts
Experience in handling large-scale data processing
Knowledge of data modeling and schema design
Strong debugging and troubleshooting skills
Databricks-based data engineering
Distributed data processing using Py Spark
Delta Lake implementation and optimization
Data ingestion and pipeline orchestration
Cloud data engineering on Microsoft Azure
Data transformation and cleansing techniques
Performance tuning of big data workloads
Integration of multiple data sources
Data governance and compliance practices
Agile development and collaboration
Experience
Required:
8-10 years or above
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).