Data Engineer

Purpose

The Data Engineer is responsible for developing data pipelines for the Data Platforms and Data Insights teams. This includes various pipelines to and from databases, applications, and APIs to ingest data into Save A Lot’s Databricks Enterprise Data Warehouse, any downstream applications, as well as any data quality or metadata solutions. In addition, the Data Engineer will be responsible for data profiling, creating ETL scripts within the data warehouse, designing data models using Entity Relationship modeling tools, and loading data into various data platforms using batch, stream, and bulk utilities.

The Data Engineer will also be responsible for scheduling jobs and workflows as well as versioning and documenting their designs and data flows. The Data Engineer will use agile, iterative, and waterfall methodologies and will provide the highest level of support.

Department:
Information Technology
FLSA Status:
Exempt
Category: 5 (IC)

• Develop ETL (Extract, Transform, and Load) jobs within Databricks
• Follow templates and engineering patterns to reduce the time-to-deploy new data assets or changes to an existing data model or analytics solution
• Leverage programming languages like SQL and Python to build and maintain pipelines
• Assist in optimizing and tuning existing pipelines
• Partner with key business teams to understand their data needs and assist them in building the appropriate data solutions to meet their business needs
• Partner with the security and risk teams to build appropriate security and compliance into the data platforms
• Partner with the enterprise technology function to ensure effective and efficient operation of all data environments
• Foster continuous process improvement within the data & insights organization and functions
• Cultivate strong relationships with all stakeholders of the data & insights team

• Enjoys learning and excels in environments that require problem solving unknowns
• A curious attitude and willingness to explore out-of-the-box ideas
• Strong organizational skills
• Detail oriented
• Experience working within deadlines
• Excellent communication skills, both written and verbal, with ability to communicate effectively at all levels of the organization
• Experience working with Databricks preferred
• 1-3 years of IT experience
• 1-3 years of experience with Python
• 1-3 years of experience with SQL
• 1-3 years of experience delivering projects in a complex enterprise environment
• 1-3 years developing and delivering data engineering solutions in data warehousing
• 1-3 years developing with Multi-Parallel Processing databases like Databricks, Teradata, Azure SQL DW, Big Query, or Snowflake
• Bachelor's degree in computer science, engineering or related field of study

• Ability to travel up to ~10% of the time, which may include weekends and evenings, as needed
• Most work is performed in a temperature-controlled environment
• Incumbent may sit for long periods of time at a desk or computer terminal
• Incumbent may use calculators, keyboards, telephone and other office equipment in the course of a normal workday
• Stooping, bending, twisting and reaching may be required in completion of job duties

Ability to demonstrate, understand and apply our workplace values.

Simplicity (operate) – the drive to identify root cause and innovate to remove complexity to deliver the best outcome

Heart (emotion) – the passion that drives you to get up every day and work hard to strive for excellence

Performance Excellence (mindset) – clearly defining high expectations, driving ownership of key roles and responsibilities, executing with integrity and emphasis while creating a culture of accountability

Respect (philosophy) – taking pride in being inclusive and treating everyone who comes through the doors with respect

• 401K company match up to 4%
• Paid Time Off
• Medical Insurance options including FSA & HSA
• Vision Insurance
• Dental insurance
• Employee Assistance Programs
• Team Member Referral Program
• Tuition Reimbursement Wellbeing Program
• Career development opportunities

The above statements are intended to describe the general nature of the work performed by the employees assigned to this job. All employees must comply with Company policy and applicable laws. The responsibilities, duties and skills required of personnel so classified may vary within each department and /or location.