Data Engineer; Pyspark
Listed on 2026-07-10
-
Software Development
Data Engineering
Location: New York
Job Location
Jersey City
Required Skills and Responsibilities- Design, build, and optimise scalable data pipelines and ETL/ELT workflows using Databricks (Unity Catalog, Delta Live Tables, Workflows, Asset Bundles), Apache Spark, and Scala to process large volumes of structured and unstructured data.
- Architect and manage data lakehouse solutions that leverage Apache Iceberg and Delta Lake for table format management, versioning, time‑travel, and efficient data storage and retrieval at scale.
- Build and maintain robust backend data services and APIs, integrating Databricks with downstream systems to enable real‑time and batch data consumption across enterprise platforms.
- Collaborate with data architects, analysts, and engineering teams to define data models, establish best practices, and drive continuous improvement across the data platform.
The base compensation range for this role in the posted location is $80,420 to $106,050. Additional variable incentives, bonuses, or commissions may be included based on applicable laws.
Benefits- Flexible work
- Healthcare including dental, vision, mental health, and well‑being programs
- Financial well‑being programs such as 401(k) and Employee Share Ownership Plan
- Paid time off and paid holidays
- Paid parental leave
- Family‑building benefits such as adoption assistance, surrogacy, and cryopreservation
- Social well‑being benefits such as subsidised back‑up child/elder care and tutoring
- Mentoring, coaching and learning programmes
- Employee Resource Groups
Capgemini is an Equal Opportunity Employer encouraging inclusion in the workplace. Capgemini also participates in the Partnership Accreditation in Indigenous Relations (PAIR) program which supports meaningful engagement with Indigenous communities across Canada by promoting fairness, accessibility, inclusion and respect. All qualified applicants will receive consideration for employment without regard to race, national origin, gender identity or expression, age, religion, disability, sexual orientation, genetics, veteran status, marital status or any other characteristic protected by law.
Capgemini is committed to providing reasonable accommodations during our recruitment process. If you need assistance or accommodation, please reach out to your recruiting contact.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).