More jobs:
Azure Databricks Engineer
Job in
Parsippany-Troy Hills, Morris County, New Jersey, USA
Listed on 2025-12-01
Listing for:
Tata Consultancy Services
Full Time
position Listed on 2025-12-01
Job specializations:
-
IT/Tech
Data Engineer, Cloud Computing
Job Description & How to Apply Below
Job Description
Tata Consultancy Services is seeking a highly skilled Data Engineer to design, develop, and manage end-to-end data pipelines on the Azure Cloud Platform. The role requires strong expertise in Azure Databricks, Azure Data Factory, Azure Data Lake Storage, PySpark, SQL and Python for large‑scale data processing.
Key Responsibilities- Design and implement scalable ELT/ETL pipelines using Medallion architecture and Delta Lake.
- Configure and maintain Azure Databricks work spaces and clusters, including access control.
- Monitor, troubleshoot, and tune performance of data pipelines; validate data quality and investigate failures.
- Integrate CI/CD and Dev Ops practices with Azure Dev Ops for pipeline deployment.
- Apply data governance and security principles (data lineage, RBAC).
- Collaborate with business stakeholders to translate requirements into technical solutions.
- • Azure Services:
Azure Data Factory, Azure Databricks, Azure Data Lake Storage - • Programming:
PySpark, SQL (expert), Python - • Data Engineering: ELT/ETL pipeline design, ingestion framework, orchestration
- • Architecture:
Medallion Architecture, Delta Lake design - • Monitoring & Troubleshooting:
Performance tuning, data quality validation, pipeline/job failure analysis - • Azure Administration: cluster configuration, access management
- • CI/CD & Dev Ops:
Integration with Azure Dev Ops for ADF pipeline development - • Data Governance & Security:
Knowledge of data lineage, RBAC - • Additional: API, FTP/SFTP, automation & scripting
USD 100,000 – 140,000 per year
Benefits- Discretionary annual incentive
- Comprehensive medical coverage (medical, health, dental, vision, disability, pet insurance)
- Family support (maternal & parental leaves)
- Insurance options (auto & home insurance, identity theft protection)
- Convenience & professional growth (commuter benefits, certification & training reimbursement)
- Time off (vacation, sick leave, holidays)
- Legal & financial assistance (legal assistance, 401K, performance bonus, college fund, student loan refinancing)
Mid-Senior level
Employment TypeFull‑time
Job FunctionEngineering and Information Technology – IT Services & Consulting
#J-18808-LjbffrTo View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×