Data Engineer, Senior

• The referred location for position is New Orleans, The Woodlands, Texas will be considered***

Data Engineer, Senior

Hybrid

Entergy Services, LLC

The Data Engineer Senior is an integral member of the data platform team, assisting the solution architect to drive end-to-end technical design. The Data Engineer Senior interacts with the solution architect to understand the business stakeholder’s business and functional requirements and leads with the data engineers within the product team to design and deliver technical solutions, leveraging the data analytics platform where possible.

The Data Engineer Senior’s key knowledge set includes system agile development life cycle, integration architectures, technology tools,database architectures, datamanagementprinciples,data modelling techniques and methodologies, communication and problem solving. The Data Engineer Senior will assist the solution architect to design and implement large scale, enterprise-wide data processing solutions, database schemas and interfaces to relational and non-relational databases.

The Data Engineer Senior will also implement and test the overall architectural solution by ingesting, cleaning, and organizing data into information used by analytics product. The goal is to provide data that is reliable, predictable, cost effective and secure to internal stakeholders within our data platform.

The Data Engineer Senior will work with other team members on the data analytics platform team to create plans and strategies for adopting new tools, technologies, and alternative solution architectures including leveraging the cloud.

• Understand the complexity of data and design systems and models to handle different data sources/formats, which includes structured, semi-structured, and unstructured, as well as stream processing.
• Address governance and security challenges associated with solutions.
• Analyze data sources, design and evaluate feasible data pipeline solutions. The solutions might include database modeling and design, relational database architecture, metadata and repository creation and configuration management.
• Design and develop data pipelines or ETL processes.
• Support and adhere to the development of data management policies, standards and procedures.
• Define integrated views of data drawing together data from across the enterprise, both in real-time and as extracts.
• Package deployments and collaborate with IT to migrate code between Development, Quality Assurance (QA), and Production environments.
• Support test automation, troubleshooting ETL job functionality, validating data, as well as create test data and table structures through use of SQL.
• Must be able to work in an agile, rapid delivery environment.

Bachelor's or Master’s degree in a data-centric field:
Computer Science, Mathematics, Information Systems, Information Processing, Engineering, etc.

6+ years of experience as a data engineer utilizing standard data management principles. The Data Engineer should have experience on AWS Gov Cloud, the isolated AWS environment serving U.S. federal agencies and housing export controlled data, as well as the AWS Commercial cloud.

• ETL experience
• Cloud Based Computing such as AWS or Azure
• Big data technologies
• Data warehousing, mining, analysis, self-service, or machine learning
• Data Governance
• Structured and Unstructured Data
• SQL and No
  
  SQL database technologies
• Data Modelling
• Python, SQL, Spark
• Airflow

Skills and abilities

required of the position

• Requires conceptual and practical expertise in own discipline and basic knowledge of related disciplines.
• Strong communicator at the technical levels.
• Strong, demonstrated writing and presentation skills.

• Has knowledge of best practices and how own area integrates with others; is aware of the competition and the factors that differentiate them in the market.

• Acts as a resource for colleagues…