Data Engineer – Technical Lead; Databricks & AWS

Data Engineer – Technical Lead (Databricks & AWS)

Location :
Bangalore / Hyderabad (Hybrid, 2–3 days onsite
)Budget :
Up to 40 LP
AExperience : 10+ Year
sJoiners :
Immediate / within 15 day

s
About the Ro
leWe are seeking an experience d Data Engineer – Technical Le ad to drive end-to-end architecture, solutioning, and client engagement for large-scale cloud data platforms. The ideal candidate will combine deep technical expertise with strong leadership and communication skills to deliver scalable, secure, and high-performance solution

s.
Key Responsibilit
iesLead technical solution design, ensuring scalability, reliability, and performan
ce.

Establish coding standards, conduct code reviews, and mentor team membe
rs.

Develop optimized Spark jobs (PySpark/Scala) with performance tuni
ng.

Build ETL/ELT pipelines using Databricks notebooks, Workflows, and AWS Gl
ue.

Integrate data into ADLS/S3 with robust security and metadata manageme
nt.

Define IAM roles, ACLs, and storage permissions for secure operatio
ns.

Collaborate with stakeholders, architects, and Dev Ops teams for deployment readine

ss.
Must-Have Sk
ills8+ years in Data Engineering / Big Data / Cloud Data Platfo
rms.
6+ years hands-on w ith Databricks (PySpark/Scala, Delta Lake, Lakehouse, RBAC/A C
Ls).5+ years designing Spark-based ingestion & transformation pipeli
nes.
4+ years w ith AWS Glue (ETL jobs, Workflows, Crawlers, Glue Cata l
og).Strong expertise  in Athena, Spark, Python scrip t

ing.
Soft S
kills

Excellent communication (verbal, email, instant messag
ing).Strong interpersonal skills for stakeholder and team collabora
tion.

Analytical mindset with proven problem-solving abi
lity.

Agile/Scrum experience with tools like Jira/Azure De

vOps.