Data Engineer - Craft Education

Position: Staff Data Engineer - Craft Education
## Staff Data Engineer - Craft Education
* Supervise work on cloud technologies and architect scalable and performant Data Warehouse/Lake systems
* Establish design and methodology for database build processes.
* Supervise the architecture and design of complete data model solutions.
* Supervise necessary data protection and security processes.
* Create and design extract processes for data access layer.
* Translate business problems/information requirements accurately to logical/physical data models aligning with customers’ data architecture standards.
* Supervise and perform research and analysis to find solutions for complex business problems.
* Monitor job performance and fine tune Spark SQL queries as appropriate on a regular basis.
* Supervise the profiling of data, the publishing of data profiles and corrective actions if required to ensure data quality.
* Supervise and perform documentation / reverse engineering / analysis of data mapping using data integration code/tools.
* Work with APIs for data wrangling and integrations with other systems data in the EDW.
* Perform impact analysis using Data Integration/Data Virtualization tool repositories, DB data dictionary, UNIX scripts and frontend code on versioning systems.
* Analyze / research data on multiple platforms as wells as multiple heterogeneous databases including custom developed databases.
* Positively impact projects by completing tasks assigned on time.
* Communicate technical and domain knowledge as it relates to work, to both technical and non-technical audiences.
* Ingest and transform structured, semi-structured, and unstructured data from sources including relational databases, No

SQL, external APIs, JSON, XML, delimited files, and more.
* Support business and functional requirements and translate these requirements into robust, scalable, solutions.
* Collaborate with engineers to help adopt best practices in data system creation, data integrity, test design, analysis, validation, and documentation.
* Help continually improve ongoing reporting and analysis processes, automate, or simplify self-service modelling and production support for customers.
* Performs other related duties as assigned.
* Solid design skills for creating non-competing processes for data transfer between OLTP and OLAP sources/sinks
* Expertise with analytical reporting tools, preferably Metabase
* Mastery in code based ETL/ ELT tools for importing and exporting data across disparate systems.
* Expertise in analytic skills related to working with unstructured datasets.
* Use of industry best practices for code development, testing, implementation and documentation.
* Ability to evaluate and prioritize work based on the organization’s needs.
* Ability to supervise cross team projects to accomplish data integrations and pipelines.
* Supervisory abilities for data engineering team with respect to technical design and architecture.
* Excellent verbal & written communication, along with technical documentation
* Ability to work and deliver in a team environment
* Ability to manage the use of tools like Jira, Confluence, Git Hub
* Architect and Develop processes for audit of Data Integrity
* Ability to mentor Associate/Senior/Data Engineer in data pipeline architecture and coding standards
* Supervise Validation and testing to analyze and debug issues
* Mastery of AWS cloud technologies and REST APIs
* Mastery of relational SQL and No

SQL databases
* Mastery with object-oriented/object function scripting languages:
Python, Java, Scala
* Mastery of big data tools:
Hadoop, Spark, Kafka, Databricks, etc.
* Communicates with parties within and outside of their job function and typically has responsibilities for communicating with parties external to the organization.
* Works to influence others to accept and understand new concepts, practices, and approaches. Requires ability to communicate with executive leadership regarding matters of significant importance to the organization.
* This individual may conduct briefings with senior leaders within the technical function.
* M. S. in Business, Management Information Systems, Computer Science, or a related field, or an equivalent combination of experience and training.
* Six or more years of experience as a Data Engineer, Data Integration, Big Data, or Business Intelligence, Software Engineer
* Prior experience acting as a Team Lead, where you run the team from a technical perspective, creating ownership and accountability for high performance delivery.  You will be a partner with your manager and will be the primary point of contact for team activities/deliveries
* The individual is acknowledged within the group as a subject matter expert.
* Typically requires a University Degree or equivalent experience.
* Strong experience with early stage companies distance education and distance learning students is preferred.
* 6 years of prior relevant  1997, a coalition of 19 U.S. governors founded Western Governors University with a singular vision: to make higher education more…