Data Engineer

Overview

Account Manager at Insight Global | International Talent + Professional Services Provider | The University of Georgia Alum

Base pay range

$/yr - $/yr

Note:

This range is provided by Insight Global. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

KEY ACCOUNTABILITIES INCLUDE:

• Design and develop scalable data pipelines to collect, process, and store large volumes of data.
• Collaborate with data scientists and analysts to drive scope & requirements as well as deliver strong technical design of data analytics solutions.
• Ensure data quality and integrity through cleansing processes, validation, and automated testing.
• Develop and maintain requirements, design documentation and test plans.
• Implement data integration solutions to combine data from various sources.
• Optimize data workflows for performance and reliability and reduce cloud consumption.
• Monitor and troubleshoot data pipeline issues to ensure smooth operation.
• Establish release management & CI/CD for data solutions.
• Provide direction and coordination for development and support teams including globally located resources.
• Participate in the development of a safe and healthy workplace. Comply with instructions given for safety and health and that of others, in adhering to safe work procedures. Co-operate with management in fulfilment of its legislative obligations.
• Other duties as assigned by management.

Must Haves:

• Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent work experience).
• 5 years’ experience in a data engineering role –
  Python, Spark, and Object Oriented Programming
• Microsoft Architecture – need to have experience with MS Fabric
• 3 years’ experience building and supporting data lakehouse architectures using delta lake and change data feeds.
• 3 years’ experience designing data warehouse table architecture such as star schema or Kimball method
• Experience developing and installing wheelhouse packages for managing dependencies and distributing code.
• Experience creating CI/CD pipelines for analytics solutions.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Industries
• Transportation, Logistics, Supply Chain and Storage

Note:

Other listings and benefits shown on the page have been removed to focus on the core role and qualifications.