Senior Data Engineer

An exciting career awaits you At MPC, we’re committed to being a great place to work – one that welcomes new ideas, encourages diverse perspectives, develops our people, and fosters a collaborative team environment.

As a Senior Data Engineer, you will design, develop, and optimize scalable data pipelines and cloud-based data solutions using modern data architecture, Azure data services, including Data Lake, Synapse Analytics, Azure Functions, and Databricks. This role also includes close collaboration with analytics, product, architecture, governance, and business teams to translate requirements into scalable data solutions. The ideal candidate brings strong technical depth (strong proficiency in Python, SQL, Spark, and orchestration tools such as Azure Data Factory and/or Databricks Workflows), a continuous improvement mindset, and the ability to mentor while contributing to engineering standards, reusable patterns, and solution design reviews.

This position belongs to a family of jobs with increasing responsibility, competency, and skill level. Actual position title and pay grade will be based on the selected candidate’s experience and qualifications.

• Conducts the design, innovation and optimization of data extraction, ingestion and transformation processes.
• Facilitates the development and design of complex data architecture to process and store high-volume data sets.
• Enables the development of complex data pipelines; advocates for and implements data security and privacy measures.
• Conducts complex data quality and processing tasks using open source and cloud services.
• Provide technical expertise during critical incidents.
• Facilitates the adoption of best practices for data security and privacy and collaborates with other departments to ensure seamless data integration.
• Facilitates the implementation of continuous improvements in data processing methods and drives consistency and best practices across data engineering projects.
• Solves complex problems; takes a new perspective on existing solutions; participates in strategic planning sessions for data infrastructure.
• Oversee quality assurance and testing for data solutions.
• Mentors less experienced data engineers.

• Bachelor’s Degree in Information Technology or related field required.
• 5+ years of relevant data engineering experience required.

• Big Data Technologies
  - Familiarity with big data technologies and frameworks, such as Hadoop, Spark, and distributed computing, for processing and analyzing large volumes of data.
• Cloud Platform
  - Knowledge of cloud-based data platforms, such as AWS, Azure, or GCP, and their associated services for data storage, processing, and analytics.
• Data Governance
  - Ability to establish and oversee a set of procedures, policies, and standards that ensure the effective and efficient management of an organization’s data assets. This includes ensuring data quality, compliance with relevant laws and regulations, and secure data handling practices. It also involves the coordination between different departments to ensure that data is accurate, accessible, and used responsibly and ethically.
• Data Integration
  - Proficiency in integrating data from various sources, including structured and unstructured data, using technologies such as ETL (Extract, Transform, Load) processes, data pipelines, and data ingestion frameworks.
• Data Lifecycle
  - The data lifecycle refers to the sequential stages that data goes through from its creation or acquisition to its eventual disposal. These stages typically include data creation, storage, processing, analysis archival, and eventual deletion or destruction, with each phase governed by specific policies and practices.
• Data Modeling
  -…