Data Engineer - Cloud- Solutions

Position: Data Engineer - Cloud-Based Solutions
Join Veeva as a Data Engineer and leverage cloud-based technologies to revolutionize healthcare data management. Focus on designing effective data processing systems utilizing Python and Spark on AWS.

In this role, you’ll be integral to managing data life cycles and implementing the Medallion Architecture to enhance data accessibility and quality. Work directly with cross-functional teams to translate business needs into actionable data pipelines and workflows, ensuring compliance and governance throughout.

Key Responsibilities:

• Develop distributed data systems using Python and Spark

• Implement comprehensive ETL/ELT pipelines from various sources

• Manage data through Bronze, Silver, and Gold layers

• Build libraries for data validation and pipeline optimization

• Monitor system performance and address bottlenecks

Requirements:

• Over 4 years in data engineering with hands-on platform experience

• Advanced knowledge of Python and Apache Spark

• Experienced in AWS or GCP including Hive or Databricks

• Familiarity with orchestration tools like Airflow

• CI/CD tools proficiency for automation tasks

Drive data innovation with Veeva and contribute significantly to the healthcare ecosystem.
#J-18808-Ljbffr