Sr. Lead Data Engineer

Job Description

Sr. Lead Data Engineer positions offered by Cox Automotive Corporate Services, LLC (Atlanta, Georgia). Oversee design, deployment, and operation of technology architecture, solutions, and software to capture, manage, store, and utilize structured and unstructured data from internal and external sources. Establish structures based on business and technical requirements to channel data from multiple inputs and store using distributed (cloud) structures, local databases, and other storage forms.

Supervise development of tools and programming leveraging artificial intelligence, machine learning, and big data techniques to cleanse, organize, and transform data. Lead creation and governance of design standards and assurance processes for software, systems, and applications. Provide senior guidance and leadership to engineering teams through design, development, and execution of data acquisition, aggregation, and warehousing infrastructure. Collaborate with senior management, Product Management, and other engineers in design and development of data products.

Manage design of complex automated pipelines for optimal extraction, transformation, and loading of data from diverse data sources. Lead development of architectural standards, tools, and methodologies to ensure technical consistency and quality across the company's data management applications. Ensure development of reliable, accurate, and up-to-date batch data pipelines that make data easily consumable by end-users and other systems. Monitor database and infrastructure development metrics to identify performance issues and develop resolution strategies.

Provide senior oversight of design and implementation of scalable data schemas and models. Research, analyze, and recommend database and data pipeline solutions after analyzing costs, benefits, and end-use. Demonstrate ownership of initiatives and drive them to completion. Lead and develop team capability through ongoing coaching and mentorship. Position reports to Atlanta, GA office. Telecommuting is permitted in accordance with company policy but must live within commuting distance of the stated office.

• Must have 8 years of experience in each of the following:
  • Defining data architecture and infrastructure roadmaps to deliver scalable, secure, and reliable data platforms supporting analytics, AI or Business Intelligence;
  • Working with relational and No
    
    SQL databases, including Amazon RDS SQL Server, Azure SQL Instances, or Amazon DynamoDB;
  • Using application lifecycle methodologies;
  • Working with business intelligence tools and platforms;
  • Implementing and maintaining data cataloging platforms including AWS Glue or Collibra to support data discoverability, lineage and compliance initiatives.
• In lieu of a bachelor’s or foreign equivalent degree in the aforementioned fields and 8 years of experience as stated, employer will accept a master’s or foreign equivalent degree in the aforementioned fields and 6 years of experience as stated, or a Ph.D. or foreign equivalent degree in the aforementioned fields and 3 years of experience as stated.
• Must have 3 years of experience:
  • Using database systems, ETL processes, or cloud platforms, including AWS Database Migration Service, Amazon RDS SQL Server, AWS Data Pipeline, or AWS Transfer for SFTP or Simple Storage Service;
  • Building and maintaining software running in a CI/CD pipeline, including Git Lab CI/CD or AWS Code Pipeline.
• Position reports to Atlanta, GA office. Telecommuting is permitted in accordance with company policy but must live within commuting distance of the stated office.
• Experience may be, but need not be, acquired concurrently.

Compensation includes a base salary of $205,323. Position may be…