Data Engineer

Job Description

Job Description

Summary

The Data Engineer role is to design, develop, and maintain scalable data architecture and pipelines that empower business analytics, reporting, and data-driven decision making. The Data Engineer will partner with cross-functional teams to deliver high-quality, reliable data solutions.

Essential Duties and Responsibilities

This list of duties and responsibilities is not all inclusive and may be expanded to include other duties and responsibilities as management may deem necessary from time to time.

• Build, deploy, and monitor scalable data pipelines for ingesting, processing, and storing large-scale data from diverse sources.
• Design and optimize ELT/ETL processes incorporating automated testing and validation for accuracy, integrity and consistency.
• Develop and refine data models, warehouses, and lakes metadata-driven frameworks for dynamic schema evolution and automated onboarding.
• Partner with data analysts, data scientists, stakeholders, and other teams to translate business needs into technical specs, troubleshoot ingestion issues, and create actionable data products.
• Ensure data governance, quality monitoring, security, and compliance (GDPR, HIPAA, SOC2) through documentation of flows, pipelines, and decisions. Contributing to the knowledge base for operational support.
• Maintain and optimize platform performance (cost, scalability, reliability) by identifying/remediating bottlenecks at query, pipeline, or infrastructure levels.
• Implement Azure cloud data services and support CI/CD, automation, and monitoring best practices.
• Maintains confidentiality of information processed
• Follows company policies and procedures.

Qualifications

Requires three (3) to five (5) years of data engineering, data architecture, or related field. Bachelor’s degree in Computer Science, Engineering, Information Systems, or related field, or equivalent professional experience.

To perform this job successfully, an individual must be able to perform each essential duty satisfactorily. The requirements listed below are representative of the knowledge, skill, and/or ability required. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.

Other qualifications include:

• Advanced SQL proficiency for querying/optimization, with hands-on SQL server experience.
• Proficiency in Python or scripting languages for automation and data processing.
• Experience with orchestration frameworks like Azure Data Factory, Synapse Pipelines, or equivalents.
• Strong knowledge of data warehousing and data lakes
• Hands-on with Azure data services (AWS/GCP familiarity a plus)

Experience in the following areas are a plus:

• Pharmacy Benefit Management or Healthcare industry knowledge
• Experience in data governance/metadata tools
• Competence with Dev Ops/CI-CD practices
• Machine learning infrastructure and support workflows
• Regulatory exposure (HIPAA, SOC2) and PBM/pharmacy data workflows
• Experience with Alteryx

Language Skills

Ability to read, analyze, and interpret common scientific and technical journals, manuals, financial reports, and legal documents. Ability to prepare reports and correspondence. Ability to communicate effectively with vendors, clients, board members and/or other employees of the organization. Effective project management skills a must. Basic Microsoft Outlook, Project, Excel, Word and Power Point skills required with a basic knowledge and understanding of IT networking principles.

Physical Demands

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions. (The phrases “occasionally,” “regularly,” and “frequently” correspond to the following definitions: “Occasionally” means up to 1/3 of working time, “regularly” means between 1/3 and 2/3 of working time, and “frequently” means 2/3 and more working time.)

While performing the duties of this job, the employee is frequently required to sit; talk or hear; and use hands to handle, or touch objects or controls. The…