More jobs:
Spark Engineer
Job in
Jacksonville, Duval County, Florida, 32290, USA
Listed on 2026-05-07
Listing for:
Tata Consultancy Services Limited
Full Time
position Listed on 2026-05-07
Job specializations:
-
Software Development
Data Engineer
Job Description & How to Apply Below
Job Description
We are looking for an experienced Apache Spark Developer with strong expertise in large‑scale data processing and performance optimization. The role involves designing, building, and optimizing scalable ETL pipelines using Spark in cloud environments.
Key Skills- Strong hands‑on expertise in Apache Spark 3.5.x or later
- Solid experience with Spark Data Frames, Datasets, and RDDs
- Strong proficiency in Spark SQL
- Experience working in cloud environments (AWS and/or Azure)
- Hands‑on experience with cloud storage solutions such as Amazon S3 and Azure Data Lake Storage (ADLS)
- Strong understanding of ETL pipeline design and data modeling
- Proven experience in Spark job performance tuning and query optimization
- Experience with Snowflake for data warehousing and analytics
- Exposure to real‑time/streaming data processing
- Familiarity with distributed systems and large‑scale data architectures
- Design, develop, and maintain large‑scale batch and real‑time data processing solutions using Apache Spark (v3.5.x or later)
- Work extensively with Spark Data Frames, Datasets, and RDDs for high‑volume data processing
- Develop and optimize queries using Spark SQL
- Build and manage ETL pipelines to support analytics and downstream data consumption
- Perform Spark job tuning and performance optimization to improve efficiency and scalability
- Collaborate with data engineers, architects, and analytics teams to deliver end‑to‑end data solutions
- Ensure data quality, reliability, and adherence to best practices across pipelines
- Strong hands‑on experience with Spark
- In‑depth knowledge of Apache Spark architecture, internals, and execution model
- Experience working with Spark Data Frames, Datasets, and RDDs (batch & real‑time)
- Strong SQL skills for data analysis and transformation
- Familiarity with ETL pipelines and data modeling (Snowflake preferred)
- Experience with Linux/Unix environments
- Good understanding of distributed computing principles
- Bachelor of Computer Science
$80,000 - $100,000 per year
Employee Benefits Summary- Discretionary annual incentive
- Comprehensive medical coverage: medical & health, dental & vision, disability planning & insurance, pet insurance plans
- Family support: maternal & parental leaves
- Insurance options: auto & home insurance, identity theft protection
- Convenience & professional growth: commuter benefits & certification & training reimbursement
- Time off: vacation, sick leave & holidays
- Legal & financial assistance: legal assistance, 401(k) plan, performance bonus, college fund, student loan refinancing
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×