Data Engineer II

About Fed Ex Dataworks:

Born out of Fed Ex, a pioneer that ships nearly 20 million packages a day and manages endless threads of information, Fed Ex Dataworks is an organization rooted in connecting the physical and digital sides of our network to meet today's needs and address tomorrow's challenges.

We are creating opportunities for Fed Ex, our customers, and the world at large by:

• Exploring and harnessing data to define and solve true problems
• Removing barriers between data sets to create new avenues of insight
• Building and iterating on solutions that generate value
• Acting as a change agent to advance curiosity and performance

At Fed Ex Dataworks, we are making supply chains work smarter for everyone.

Summary:

The Data Engineer II plays an important role within Dataworks, focused on delivering engineering innovation within Dataworks, helping to execute the delivery of key business initiatives. S/he acts as a “universal translator” between IT, business, software engineers and data scientists, collaborating with these multi-disciplinary teams. The Data Engineer II will contribute to the adherence of technical standards for data engineering, including the selection and refinements of foundational technical components.

S/he will work on those aspects of the Dataworks platform that govern the ingestion, transformation, and pipelining of data assets, both to end users within Fed Ex and into data products and services that may be externally facing. Day-to-day, s/he will be deeply involved in code development and medium-scale deployments.

Under general supervision, supports the design, build, test, and maintenance of data pipelines at big data scale. Assists with updating data from multiple data sources. Other functionalities under general supervision include working on batch processing of collected data and matching its format to the stored data, making sure that the data is ready to be processed and analyzed. Assists with keeping the ecosystem and the pipeline optimized and efficient, troubleshooting standard performance, data related problems and providing L3 support.

Provides recommendations to moderately complex issues.

Job Description / Responsibilities

• Understanding in depth both the business and technical problems Dataworks aims to solve
• Building tools, platforms and pipelines to enable teams to clearly and cleanly analyze data, build models and drive decisions
• Scaling up from “laptop-scale” to “cluster scale” problems, in terms of both infrastructure and problem structure and technique
• Delivering tangible value very rapidly, collaborating with diverse teams of varying backgrounds and disciplines
• Following best practices for future reuse in the form of accessible, reusable patterns, templates, and code bases
• Interacting with peer technologists from the broader enterprise and outside of Fed Ex (partner ecosystems and customers) to create synergies and ensure smooth deployments to downstream operational systems

Skills / Abilities

• Technical background in computer science, software engineering, database systems, distributed systems
• Experience with distributed and cloud environments and an adequate understanding of how to balance computational considerations with theoretical properties
• Detailed knowledge of the Microsoft Azure tooling for large-scale data engineering efforts and deployments is highly preferred
• Experience with designing and deploying large scale technical solutions, which deliver tangible, ongoing value
• Direct experience having built and deployed robust, complex production systems that implement modern, data scientific methods at scale
• Ability to context-switch, to provide support to dispersed teams which may need an “expert hacker” to unblock an especially challenging technical obstacle, and to work through problems as they are still being defined
• Demonstrated ability to deliver technical projects with a team, often working under tight time constraints to deliver value
• An ‘engineering’ mindset, willing to make rapid, pragmatic decisions to improve performance, accelerate progress or magnify impact
• Comfort with working with distributed teams on code-based deliverables, using version control systems and…