Sr Data Engineer Assortment and Space Planning Job Atlanta area,Georgia USA,IT/Tech

Position

Purpose:

Data Engineers within the Assortment and Space Planning Data Science team translate business requirements and build the infrastructure needed to structure and deliver the data that powers self-service analytics and hardened business applications. They acquire datasets that align with business needs and develop pipelines to transform data into useful, actionable information. Additionally, they build, test, and maintain data pipeline architectures, create data validation methods and data quality tooling, and develop, host, and maintain data products to improve reliability and confidence through monitoring, testing, and validation.

These associates use modern data engineering techniques to cleanse, organize, and transform data, and to maintain, defend, and update data structures and integrity on an automated basis.

The Sr. Data Engineer position creates and establishes design standards and assurance processes for data pipelines and applications to ensure compatibility and operability of data connections, flows, and storage, and reviews internal and external business and product requirements to recommend changes and upgrades to systems and storage. Beyond this technical ownership, the role mentors and coaches less experienced engineers, partners closely with data science, analytics, and application engineering teams to align on pipeline design, and communicates pipeline decisions and data quality tradeoffs clearly to both technical and non-technical partners.

These responsibilities require strong technical judgment, effective communication at all levels, and the ability to balance durable design standards with the business's near-term data needs.

Key Responsibilities:

40% Data Validation, ETL, Infrastructure Development:
Coding validation and ETL to ensure successful data integration
30% Data Infrastructure Maintenance:
Backup and optimization activities to maintain performance; code, configure, test, etc data to ensure integrity
20% Data Architecture Design and Analysis:
Create and maintain optimal data pipeline architecture;
Develop data architecture to meet business requirements
10% Planning/Requirements Analysis:
Collaborate with team leads and cross functional partners to assess business requirements and communicate opportunities

Direct Manager/Direct Reports:

This position reports to the Technology Leader.
This position has 0 direct reports.

Travel Requirements:

Typically requires overnight travel less than 10% of the time.

Physical Requirements:

Most of the time is spent sitting in a comfortable position and there is frequent opportunity to move about. On rare occasions there may be a need to move or lift light articles.

Working Conditions:

Located in a comfortable indoor area. Any unpleasant conditions would be infrequent and not objectionable.

Minimum Qualifications:

Must be eighteen years of age or older.
Must be legally permitted to work in the United States.

Preferred Qualifications:

Bachelor's or Master's in a quantitative or technical field (Computer Science, Engineering, Statistics, etc.) or relevant work experience
6+ years of relevant work experience
Demonstrated experience in data architecture, data warehousing, and dimensional modeling
Demonstrated experience developing and testing ETL/ELT jobs and pipelines, configuring orchestration, automated CI/CD, writing automation scripts, and supporting pipelines in production
Experience with Dataform or dbt for data transformation and pipeline orchestration
Experience in high-level programming languages such as Python
Experience defining and capturing metadata and rules associated with ETL processes
Experience building batch and streaming pipelines
Prior direct experience writing analytical SQL queries and performance-tuning queries…