VDOT Cloud ETL Developer

Overview

Join to apply for the VDOT Cloud ETL Developer (752580) role at Meta Sense Inc
.

• Develop ETL to extract business data and spatial data and load it into a data warehousing environment.
• Design and test the performance of the system.
• Consult with various teams to understand the company s data storage needs and develop data warehousing options.
• Deep knowledge of coding languages, such as Python, Java, XML, and SQL.
• Work with the Project team members and business stakeholders to understand business processes and pain points.
• Develop expertise in source system datasets and data lifecycle.
• Profile source data which may contain a spatial component; review source data and compare content and structure to dataset requirements; identify conflicts and determine recommendations for resolution.
• Conduct entity resolution to identify matching and merging and semantic conflicts.
• Elicit, record, and manage metadata.
• Diagram current processes and proposed modifications using process flows, context diagrams and data flow diagrams.
• Decompose requirements into Epics and Features and create clear and concise user stories that are easy to understand and implement by technical staff.
• Utilize progressive elaboration; map stories to data models and architectures to be used by internal staff to facilitate master data management.
• Identify and group related user stories into themes, document dependencies and associated business processes.
• Assist Product Owner in maintaining the product backlog.
• Create conceptual prototypes and mock-ups.
• Collaborate with staff, vendors, consultants, and contractors as engaged on tasks to formulate, detail and test potential and implemented solutions.
• Perform Quality Analyst functions such as defining test objectives, test plans, and test cases, and executing test cases.
• Coordinate and facilitate User Acceptance Testing with Business and ensure Project Managers/Scrum Masters are informed of progress.
• Designs and develops systems for the maintenance of the Data Asset Program (Data Hub), ETL processes, ETL processes for spatial data, and business intelligence.
• Develop a new data engineering process that leverages a new cloud architecture and will extend or migrate existing data pipelines to this architecture as needed.
• Design and supports the DW database and table schemas for new and existent data sources for the data hub and warehouse. Design and development of Data Marts.
• Work closely with data analysts, data scientists, and other data consumers within the business to populate data hub and data warehouse table structure, optimized for reporting.
• Partner with Data modeler and Data architect to refine the business s data requirements for building and maintaining Data Assets.

• Minimum of 10 years of experience delivering business data analysis artifacts.
• 5+ years of experience as an Agile Business Analyst; strong understanding of Scrum concepts and methodology.
• Experience organizing and maintaining Product and Sprint backlogs.
• Experience translating client and product strategy requirements into dataset requirements and user stories.
• Proficient with defining acceptance criteria and managing acceptance process.
• Exceptional experience writing complex SQL queries for SQL Server and Oracle.
• Experience with Azure Databricks, Azure Data Factory, Snowflake.
• Experience with ESRI ArcGIS.
• Experience with enterprise data management.
• Excellent written and oral communication skills and ability to work with diverse peers and customers.
• Experience with reporting systems, operational data stores, data warehouses, data lakes, data marts.
• Advanced understanding of data integrations and database architectures.
• Strong analytical and problem-solving skills; ability to build relationships internally and externally; ability to negotiate and resolve conflicts; ability to prioritize and manage multiple tasks and projects.
• Desire to learn, innovate and evolve technology.

• Data Factory v2, Data Lake Store, Data Lake Analytics, Azure Analysis Services, Azure Synapse
• IBM Data Stage, Erwin, SQL Server (SSIS, SSRS, SSAS), Oracle, T-SQL, Azure SQL Database, Azure SQL Data Warehouse.
• Operating System Environments (Windows, Unix).
• Scripting experience with Windows and/or Python, Linux Shell scripting.

• Entry level

• Contract

• Information Technology
• Industries:
  Human Resources Services