Enterprise Analytics Data Engineer II

Job Summary
:

VCU Health is a large academic health system that values data as a critical asset for driving patient care and innovation. The Data Engineer will build scalable data solutions, optimize cloud-based platforms, and ensure data quality while collaborating with various stakeholders to turn complex data into actionable insights.

Responsibilities
:

• Designs and implements scalable data pipelines for ingesting, transforming, and loading multi-format, batch or streaming data from various sources into enterprise Data Lakehouse.

• Ensures data quality and integrity through data cleansing, validation, and transformation techniques.

• Automates data processing workflows using scripting languages and orchestration tools.

• Builds and deploys RESTful API’s and web services for data access and data requests.

• Helps define the data management strategy and roadmap for the organization.

• Collaborates with data architects, data engineers, and product managers to align data solutions with business strategy.

• Stays current with industry trends, vendor product offerings, and evolving data technologies to ensure the organization leverages the best modern data engineering tools.

• Develops and maintains technical design documents, coding best practices and standards to ensure consistent and reliable data management processes are in place.

• Responsible for maintaining legacy technologies and processes as new ones are adopted.

• Mentors junior Data Engineers.

Qualifications
:
Required
:

• Bachelor’s Degree in Business, IT, Math, Data Analytics, Engineering, or related discipline

• 5+ years of experience in Data Engineering, Data Management or Data Warehouse/Lakehouse design and development.

• 3+ years of experience in Python/PySpark for building and maintaining data pipelines.

• 1+ years of experience with cloud based modern data platforms and services (e.g., Azure, GCP or AWS).

• Strong knowledge of database systems, data modeling techniques, and SQL proficiency.

• Experience creating and enhancing ETL and ELT processes.

• Experience working with JSON/YAML/XML/Parquet and other open-source data interchange and storage formats.

• Experience working with big data technologies like Spark, Kafka, No

SQL DB, Splunk etc.

• Experience with agile development processes and concepts.

• Knowledge of Dev Ops practices and CI/CD processes.

• Knowledge of Microservices architecture, Data Product and Data Mesh concepts.

Preferred
:

• Master’s degree in Business, IT, Math, Data Analytics, Engineering or related discipline

• Displays intellectual curiosity and integrity.

Company
:

VCU Medical Center is a school. It is a sub-organization of Virginia Commonwealth University. Founded in 1838, the company is headquartered in Richmond, USA, with a team of 10001+ employees. The company is currently Late Stage.