Senior Data Engineer

The Data Engineer’s role is to work with the stake holders and project teams to ensure data needs/requirements are captured and fulfilled. This role would require a service-oriented mentality, high sense of ownership of the problems and requests assigned, focus on managing and resolving issues and establishing and maintaining communications with stake holders to keep them updated.

Essential Functions
Responsibilities

Assembles and architects large, complex sets of data that meet business and technical requirements
Identifies, designs and implements well-architected, data-centric solutions including:
Re-designs infrastructure for greater scalability
Optimizes data delivery
Automates manual processes
Develops and maintains strategies on data consolidation
Builds data models and defines the structure, attributes and nomenclature of data elements
Maintains a strong grasp of ETL process and development
Manages, Architects and builds Data ODS, Warehouse, and standard systems
Builds required infrastructure for optimal extraction, transformation and loading of data from various data sources
Builds analytical tools to utilize the data pipeline, providing actionable insight into key business performance metrics
Works with stakeholders including data, design, product and executive teams and assists them with maximizing the impact of their data
Addresses requests and needs on data analysis and report management
Collaborates with application development, product owners, and business stake holders to achieve business results
Participates in development and creation of Data warehouses
Conducts Performance Tuning and Query Optimization, using Performance Monitor, SQL Profiler and other related monitoring and troubleshooting tools
Demonstrates a strong knowledge of how indexes, index management, integrity checks, configuration, patching
Writes and troubleshoots SQL Code (stored procs, functions, tables, views, triggers, indexes, constraints)
Evaluates new data sources for adherence to the organization's quality standards and ease of integration
Maintains database performance by identifying and resolving production and application development problems; calculating optimum values for parameters; evaluating, integrating, and installing new releases; completing maintenance; answering user questions
Provides database support by coding utilities, responding to user questions, and resolving problems
Updates job knowledge by participating in educational opportunities; reading professional publications; maintaining personal networks; participating in professional organizations
Accomplishes information systems and organization mission by completing related results as needed
Creates functions to provide custom functionality as per the requirements
Develops best practices around database reporting and Business Intelligence tools

Qualifications

Bachelor’s in business MIS, or Computer Science (or equivalent work experience)
4+ years’ experience in database administration of development
4+ years’ experience in technology or finance fields
Certifications in SQL or other database technology

Required Skills

Experience with database design and architecture – both SQL and No

SQL experience in the Cloud (AWS or Azure in particular)

Experience with data warehousing – leverage big data in a meaningful manner, Snowflake experience a plus

Experience with data transformation and ingestion – unifying large datasets into usable/accessible destinations (AWS Glue, Azure Data Factory)
Knowledge of data processing/buffering – proven experience dealing with high volumes of business-critical data
Knowledge of operational automation tooling – data deployment automation tools
Knowledge of high availability architecting – focus on redundancy, fail-over, and resilience
Good understanding of estimation techniques
Strong understanding of database structures, theories, principles, and practices
Hands-on database tuning and troubleshooting experience

Experience with data processing flowcharting techniques
Good understanding of the organization’s goals and objectives
Knowledge of applicable data privacy practices and laws
Good written and oral communication skills
Strong technical documentation…