Azure Data Engineer
-
Software Development
Job Description & How to Apply Below
US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other
Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other
Job Description:We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based data solutions using Microsoft Azure technologies. The ideal candidate should have strong expertise in data integration, ETL/ELT development, big data processing, and modern data architecture.
Key Responsibilities :- Design, develop, and maintain scalable data pipelines using Azure data services.
- Build and optimize ETL/ELT workflows using Azure Data Factory.
- Develop data processing solutions using Azure Databricks and PySpark.
- Work with Azure Synapse Analytics for data warehousing and analytical workloads.
- Develop complex SQL queries, stored procedures, and performance optimization strategies.
- Implement data lake and lakehouse architectures using Azure Data Lake Storage Gen
2. - Integrate data from multiple sources, including relational databases, APIs, and cloud platforms.
- Implement data quality, validation, transformation, and governance processes.
- Develop and maintain batch and real-time data processing solutions.
- Optimize data pipelines for performance, scalability, and cost efficiency.
- Implement monitoring, logging, and error-handling mechanisms.
- Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.
- Follow security best practices for data access, encryption, and compliance.
- Programming:
Python, PySpark, SQL - Data Architecture:
Lakehouse, Delta Lake, Medallion Architecture - Data Governance:
Microsoft Purview
We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction