Cloud ETL Developer

Role:
Cloud ETL Developer – Richmond, VA (Hybrid)

Job
Interview Mode:
Both Phone and In Person

Local Richmond, VA candidates ONLY required due to onsite requirement. This position requires onsite 3 days a week with 2 remote.

The Virginia Department of Transportation (VDOT) IT Division is seeking a Master Data Analyst with experience in data analytics to work as a key member of the Enterprise Data Asset team. This analyst will support teams in Agile (Sprint) to analyze datasets to be made available in a cloud-based data management platform that will support the agency’s production of master data with data governance.

Responsibilities include analyzing source systems which contain a spatial component for candidate datasets; documenting business processes and data lifecycle; developing data requirements, user stories and acceptance criteria; and testing strategies. Develop ETL to extract business data and spatial data and load it into a data warehousing environment. Design and test the performance of the system. Consult with various teams to understand the company’s data storage needs and develop data warehousing options.

Deep knowledge of coding languages, such as python, Java, XML, and SQL. Well‑versed in warehousing architecture techniques such as MOLAP, ROLAP, ODS, DM, and EDW.

VDOT is a fast‑paced organization with very high standards for work quality and efficiency. This position is expected to handle multiple projects and remain flexible and productive, despite changing priorities and processes. Ongoing improvement and efficiency are part of our culture, and each team member is expected to proactively contribute to process improvements.

• Work with the Project team members and business stakeholders to understand business processes and pain points
• Develop expertise in source system datasets and data lifecycle
• Profile source data which may contain a spatial component; review source data and compare content and structure to dataset requirements; identify conflicts and determine recommendations for resolution
• Conduct entity resolution to identify matching and merging and semantic conflicts
• Elicit, record, and manage metadata
• Diagram current processes and proposed modifications using process flows, context diagrams and data flow diagrams
• Decompose requirements into Epics and Features and create clear and concise user stories that are easy to understand and implement by technical staff
• Utilize progressive elaboration; map stories to data models and architectures to be used by internal staff to facilitate master data management
• Identify and group related user stories into themes, document dependencies and associated business processes
• Discover and document requirements and user stories with a focus on improving both business and technical processing
• Assist Product Owner in maintaining the product backlog
• Create conceptual prototypes and mock‑ups
• Collaborate with staff, vendors, consultants, and contractors as they are engaged on tasks to formulate, detail and test potential and implemented solutions
• Perform Quality Analyst functions such as defining test objectives, test plans and test cases, and executing test cases
• Coordinate and facilitate User Acceptance Testing with Business and ensure Project Managers/Scrum Masters are informed of the progress
• Design and develop systems for the maintenance of the Data Asset Program (Data Hub), ETL processes for spatial data, and business intelligence
• Develop a new data engineering process that leverages a new cloud architecture and will extend or migrate our existing data pipelines to this architecture as needed
• Design and support the DW database and table schemas for new and existing data sources for the data hub and warehouse. Design and development of Data Marts
• Work closely with data analysts, data scientists, and other data consumers within the business to populate data hub and data warehouse table structure, which is optimized for reporting
• Partner with Data modeler and Data architect to refine the business’s data requirements, which must be met for building and maintaining Data Assets

• The candidate must…