Data Engineer, Senior

Job Title:

Data Engineer, Senior Work Place Flexibility:
Hybrid Legal Entity:
Entergy Services, LLC
*** The referred location for position is New Orleans, The Woodlands, Texas will be considered
*** Job Summary/Purpose The Data Engineer Senior is an integral member of the data platform team, assisting the solution architect to drive end-to-end technical design. The Data Engineer Senior interacts with the solution architect to understand the business stakeholder’s business and functional requirements and leads with the data engineers within the product team to design and deliver technical solutions, leveraging the data analytics platform where possible. 

The Data Engineer Senior’s key knowledge set includes system agile development life cycle, integration architectures, technology tools, database architectures, data management principles, data modelling techniques and methodologies, communication and problem solving.  The Data Engineer Senior will assist the solution architect to design and implement large scale, enterprise-wide data processing solutions, database schemas and interfaces to relational and non-relational databases. The Data Engineer Senior will also implement and test the overall architectural solution by ingesting, cleaning, and organizing data into information used by analytics product.  

The goal is to provide data that is reliable, predictable, cost effective and secure to internal stakeholders within our data platform. The Data Engineer Senior will work with other team members on the data analytics platform team to create plans and strategies for adopting new tools, technologies, and alternative solution architectures including leveraging the cloud.

Job Duties /Responsibilities  
1. Understand the complexity of data and design systems and models to handle different data sources/formats, which includes structured, semi-structured, and unstructured, as well as stream processing.
2. Address governance and security challenges associated with solutions.
3. Analyze data sources, design and evaluate feasible data pipeline solutions. The solutions might include database modeling and design, relational database architecture, metadata and repository creation and configuration management.  4. Design and develop data pipelines or ETL processes.
5. Support and adhere to the development of data management policies, standards and procedures.
6. Define integrated views of data drawing together data from across the enterprise, both in real-time and as extracts.
7. Package deployments and collaborate with IT to migrate code between Development, Quality Assurance (QA), and Production environments.
8. Support test automation, troubleshooting ETL job functionality, validating data, as well as create test data and table structures through use of SQL. 9. Must be able to work in an agile, rapid delivery environment.

Minimum Requirements Minimum education required of the position Bachelor's or Master’s degree in a data-centric field:  Computer Science, Mathematics, Information Systems, Information Processing, Engineering, etc. Minimum experience required of the position 6+ years of experience as a data engineer utilizing standard data management principles. The Data Engineer should have experience on AWS Gov Cloud, the isolated AWS environment serving U.S. federal agencies and housing export controlled data, as well as the AWS Commercial cloud.

Minimum knowledge, skills and abilities required of the position Technical Capabilities ETL experience Cloud Based Computing such as AWS or Azure Big data technologies Data warehousing, mining, analysis, self-service, or machine learning Data Governance Structured and Unstructured Data SQL and No

SQL database technologies Data Modelling Python, SQL,…