Sr. Data Engineer to lead delivery of data data and analytics platform Job Victoria British Columbia Canada,IT/Tech

Position: Sr. Data Engineer to lead the delivery of data on data and analytics platform
Location: Victoria

Our valued client is looking for a Sr. Data Engineer to lead the delivery of data on data and analytics platform
.

This is a Remote position (Eastern Time Zone).

The Senior Data Engineer Service Provider will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of building out data engineering practice cloud-native technologies.

Tasks include:

Proven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards.

Develop and propose design patterns that conform to requirements. Responsible to ensure the proposed design, optimally addresses access and query patterns; data consumption and adheres to internal architecture standards.

Collaborate and work with various stakeholders across the business, data scientists and IT. Working closely building relationships, refining data requirements to meet various data and analytics initiatives and data consumption requirements

Increase the overall speed in which data is onboarded to the Data and Analytics platform.

Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform

Increase the overall quality of data pipeline development through Dev Sec Ops

Must have:

Eligible for Reliability clearance

Experience in leading, designing, implementing, and collaborating with stakeholders

Programming experience in Spark using modern languages such as Python, Scala

Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes

Experience leading Data Engineering principles within an organization/team

Experience working with Integration patterns and technologies such as Azure Event Hub, Function App and C#

Knowledge and expertise of database modeling techniques:
Data Vaults, Star, Snowflake, 3NF, etc.

Experience working with streaming data architecture and technologies for real-time:
Spark Streaming, Kafka, Flink, Storm

Experience working with relational and non-relational database technologies: SQL Server, Oracle, Cassandra, Mongo

DB, Cosmos

DB, HBase

Experience working with source code and configuration management environments such as Azure Dev Ops, Git, Maven, Nexus

Nice to have:

Experience with in Azure environment

Strong Python, Scala and Spark experience

Experience modernizing data platforms.

Experience with Azure Functions and C#

2 to 3 projects developing Data Vault


Increase/decrease your Search Radius (miles)



Job Posting Language