Data Engineer Principal
-
IT/Tech
Job Description & How to Apply Below
The Data Engineer Principal plays a pivotal role within Dataworks and provides dynamic leadership at the enterprise level. S/he is focused on fundamentally creating and driving engineering innovation within Dataworks, helping to define and build the Dataworks organization and overseeing the delivery of key business initiatives. S/he acts as a "universal translator" between IT, business, software engineers and data scientists, collaborating with these multi-disciplinary teams.
The Data Engineer Principal will champion the creation and adherence of technical standards for data engineering, including the selection and refinements of foundational technical components. S/he will work on those aspects of the Dataworks platform that govern the ingestion, transformation, and pipelining of data assets, both to end users within Fed Ex and into data products and services that may be externally facing.
Day‑to‑day, s/he will be deeply involved in code reviews, large‑scale deployments and general oversight. S/he will also mentor junior engineers to support the continued up‑skilling of the Data Engineering team.
Takes end‑to‑end ownership and responsibility over critical data engineering initiatives. Advances Dataworks' broad capabilities to use and deploy cutting edge data engineering tools and methods in Dataworks projects, platforms and products. Anchors current best practices by championing the design and build of reusable data engineering assets. Simultaneously works to keep Dataworks on the bleeding edge by disseminating the very latest and most sophisticated methods and tools for grappling with extremely large scale and complex data engineering problems.
Oversees the design, build, test and maintenance of data pipelines at big data scale. Leads batch processing of collected data to ensure data is ready for analysis. Instantiates processes for keeping the ecosystem and pipeline optimized and efficient, troubleshooting standard performance, data related problems and providing expert guidance. Independently implements parsers, validators, transformers and correlators to reformat, update and enhance the data.
Combines knowledge of data engineering methods, CI/CD, statistics, and machine learning practices to provide recommendations on the most organizationally critical and complex data‑related problems. Advises junior data engineers, managers, and those in less senior positions.
Skills:
- 1. Design and implement data pipelines to collect, process, and store data efficiently.
- 2. Ensure data quality, integrity, and accessibility.
- 3. Create data models to support business analytics and reporting.
- 4. Work with data scientists, analysts, and other stakeholders to understand data needs, and design schemas.
- 5. Build and manage ETL (Extract, Transform, Load) processes for data integration and automate data ingestion and transformation tasks.
- 6.Administer and optimize databases (both SQL and No
SQL). Monitor database performance and troubleshoot issues. - 7. Collaborate with software engineers to integrate data systems with applications.
- 8. Utilize big data tools for processing large datasets, such as Hadoop or Spark.
- 9. Implement distributed systems for real‑time data processing.
- 10. Ensure data governance and security through compliance with data governance policies and data security standards.
- 11. Implement data access controls and encryption techniques.
- 12. Document data architecture, pipelines, and processes.
- 13. Provide reports and insights based on data analysis.
- 14. Working knowledge of Data Bricks, Big Query, and GCP
- Understanding in depth both the business and technical problems Dataworks aims to solve
- Building tools, platforms and pipelines to…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction