Principal Data Engineer

Job Title:

Principal Data Engineer

Job Description

The Principal Data Engineer leads the design, development, and evolution of an enterprise data architecture and data platform strategy that powers advanced research, simulation, testing, and engineering environments. This role builds and maintains scalable, cloud-based data pipelines and infrastructure that provide scientists, engineers, and machine learning teams with reliable, high-quality data for analytics, modeling, and technology development. The Principal Data Engineer establishes robust data governance standards, optimizes platform performance and cost, and serves as a hands-on technical leader who drives innovation, scalability, and continuous improvement across the data ecosystem while partnering closely with research, engineering, IT, and business stakeholders.

Responsibilities

+ Lead the design, implementation, and roadmap of the enterprise data architecture and data platform strategy to support research, simulation, testing, and engineering environments.

+ Build, maintain, and optimize scalable data pipelines that integrate data from multiple scientific, engineering, and operational sources.

+ Develop and manage cloud-based data infrastructure that supports analytics, modeling, and technology development for scientists, engineers, and machine learning teams.

+ Establish and maintain data governance standards, including data security, lineage, metadata management, data quality, and lifecycle controls across complex data environments.

+ Optimize the performance, reliability, scalability, and cost efficiency of cloud-based data systems and distributed data processing platforms.

+ Partner with research, engineering, IT, and business stakeholders to align data architecture and platform capabilities with organizational objectives.

+ Support the integration of AI and machine learning workflows, high-performance computing environments, simulation platforms, and advanced research systems into the data platform.

+ Define and enforce architecture standards, best practices, and patterns for data engineering and data platform development.

+ Document architecture decisions, data models, and technical designs, and communicate complex concepts clearly to both technical and non-technical audiences.

+ Serve as a hands-on technical leader by contributing to code, reviewing implementations, and mentoring other engineers in data engineering best practices.

+ Drive continuous improvement initiatives across the data ecosystem, including automation, observability, and reliability enhancements.

+ Collaborate with cross-functional teams to design and support large-scale, data-intensive engineering and scientific environments.

+ Enable AI/ML data pipelines and MLOps practices that support machine learning experimentation, training, and deployment.

+ Ensure data platforms effectively support machine learning, simulation, modeling, experimental research, and high-performance computing workflows.

+ Influence technical strategy and lead cross-functional initiatives that shape the future of the research data ecosystem and data strategy.

Essential Skills

+ Strong hands-on development experience using Python to build, maintain, and optimize enterprise-scale data solutions.

+ Proven experience designing and implementing scalable data pipelines that integrate data from multiple scientific, engineering, and operational sources.

+ Expertise with Azure Databricks, Apache Spark, and distributed cloud-based data processing environments.

+ Deep understanding of data architecture, including data lakes, data modeling, metadata management, and platform scalability.

+ Experience establishing and managing data governance, including data quality, lineage, security, and access control standards within complex data environments.

+ Strong expertise in cloud-based data platforms and distributed systems, with practical experience in modern data technologies.

+ Experience designing and supporting large-scale, data-intensive engineering or scientific environments.

+ Experience working with research, simulation, instrumentation, sensor, or high-performance computing generated data.

+ Familiarity with AI and machine learning data pipelines, MLOps practices, or machine learning enablement.

+ Deep knowledge of data governance, security, metadata management, lineage, and data quality frameworks.

+ Ability to lead cross-functional initiatives and influence technical strategy across multiple stakeholder groups.

+ Strong communication skills with the ability to translate complex technical concepts into clear business value.

+ Bachelor's degree in Computer Science, Data Engineering, Data Science, Mathematics, or a related technical field.

+ 10+ years of experience in data engineering, data architecture, or enterprise data platform development.

Job Type & Location

This is a Contract position based out of San Diego, CA.

Pay and Benefits

The pay range for this position is $60.00 - $100.00/hr.

Eligibility requirements apply to some benefits and…