Sr. Data Engineer IV

Description

Sr. Data Engineer IV

Contract through 12/31/26 with ongoing extensions

* REMOTE BUT MUST BE ABLE TO INTERVIEW ONSITE IN PHILADELPHIA, PA
* We are seeking a Senior Data Engineer to support enterprise data modernization initiatives focused on inventory, supply, and yield analytics. This role will be responsible for designing, building, and enhancing scalable data pipelines within a modern cloud-based data ecosystem. The ideal candidate brings strong hands-on expertise in Databricks, Python, PySpark, and AWS, along with experience supporting migration efforts, modernizing legacy platforms, and delivering reliable data assets for analytics and reporting environments.

Responsibilities:

+ Design, develop, test, and maintain scalable ETL processes and data pipelines using Databricks, Python, PySpark, AWS, and Snowflake.

+ Build and enhance data engineering solutions supporting inventory, supply, and yield analytics initiatives.

+ Develop core data assets and pipelines that support enterprise reporting and analytics platforms, including Tableau.

+ Modernize legacy data engineering jobs and contribute to cloud migration and technical debt reduction efforts.

+ Create and maintain technical documentation, specifications, testing artifacts, and quality assurance processes.

+ Provide post-deployment support, troubleshoot production issues, and ensure reliable pipeline operations.

+ Identify and mitigate risks, including single points of failure (SPOF), to improve platform stability and resiliency.

+ Develop and manage infrastructure using Terraform.

+ Implement and maintain CI/CD pipelines using tools such as Git Hub Actions or Concourse.

+ Collaborate with engineering teams, stakeholders, and Agile Release Train (ART) members to define requirements and deliver scalable solutions.

+ Participate in code reviews, knowledge sharing, and continuous improvement initiatives.

Requirements

+ Strong Data Engineering experience with a focus on ETL development and data pipeline engineering.

+ Hands-on experience with Databricks, Python, PySpark, and SQL.

+ Strong AWS experience, including S3, EMR, Lambda, and Event Bridge.

+ Experience building, testing, and maintaining cloud-based data pipelines and data platforms.

+ Experience supporting cloud migration and modernization initiatives.

+

Experience with Snowflake.

+ Experience using Terraform for infrastructure provisioning and management.

+ Experience implementing and supporting CI/CD pipelines using Git Hub Actions or Concourse.

+ Strong troubleshooting, testing, and production support experience.

+ Ability to work collaboratively in an Agile development environment.

Preferred Qualifications:

+ Approximately 8+ years of Data Engineering experience.

+

Experience with Kafka.

+ Familiarity with Tableau and/or Looker environments.

+ Experience supporting analytics and reporting data platforms.

Technology Doesn't Change the World, People Do.®

Robert Half is the world's first and largest specialized talent solutions firm that connects highly qualified job seekers to opportunities at great companies. We offer contract, temporary and permanent placement solutions for finance and accounting, technology, marketing and creative, legal, and administrative and customer support roles.

Robert Half works to put you in the best position to succeed. We provide access to top jobs, competitive compensation and benefits, and free online training. Stay on top of every opportunity - whenever you choose - even on the go. Download the Robert Half app ()  and get 1-tap apply, notifications of AI-matched jobs, and much more.

All applicants applying for U.S. job openings must be legally authorized to work in the United States. Benefits are available to contract/temporary professionals, including medical, vision, dental, and life and disability insurance. Hired contract/temporary professionals are also eligible to enroll in our company 401(k) plan. Visit  for more information.

© 2025 Robert Half. An Equal Opportunity Employer. M/F/Disability/Veterans. By clicking "Apply Now," you're agreeing to Robert Half's Terms of Use ()  and Privacy Notice () .