Big Data Lead

Work Arrangement:
Hybrid: 3 Days/Week WFO
Domain: BFSI
Final date to receive applications:
October 15th, 2026
About the Role  We are looking for an experienced  Big Data Lead  to design, develop, and maintain scalable data solutions using  PySpark, Spark SQL, Python, and distributed computing technologies .

Job Description:

-  Required Skills & Experience
8+ years of experience in  Big Data / Data Engineering .
Strong hands-on experience with  PySpark and Apache Spark .
Strong programming skills in  Python .
Excellent knowledge of  Spark SQL  and distributed data processing.
Experience designing and developing  ETL/ELT data pipelines .
Strong understanding of distributed computing and big data concepts.
Experience working with  Hadoop/HDFS, Hive, cloud storage, or data lake platforms .
Strong understanding of Spark performance tuning, including partitioning, caching, joins, shuffles, and resource optimization.
Experience writing  unit tests and data validation frameworks .
Strong SQL skills and experience working with large datasets.

Experience with data pipeline monitoring, troubleshooting, and production support.
EEOC Compliance:  We are an equal opportunity employer, and all qualified applicants will receive consideration for employment.
DISCLAIMER  AI Usage Policy:
Pacer Group uses AI to assist in screening applications. Final hiring decisions are made by human recruiters based on qualifications and experience.