Sr. Solution Engineer

Data Engineer II

Job Description

Location:

5000 Kansas Avenue Kansas City, KS 66106 (preferred); or can be remote

Department:
Information Technology

Associated Wholesale Grocers (AWG) is transforming our business intelligence, analytics, and data automation capabilities. The goal is to level up data warehousing and data management capabilities, including curated and cleansed data sets, certified data models and sources. We are adapting to cloud-based data automation for data cleansing, extraction, loading, transformations and visualizations. Another goal is to expand storage and compute capacity for ingestion of structured and unstructured data.

In addition, we are hardening security constraints, in the areas of role-based access, anonymized data sets and intrusion prevention constraints.

As a Data Engineer on the Data Analytics Team, you will be integral to this journey. Your primary area of responsibility will be building a strong data ecosystem which supports a new company-wide business intelligence and analytics environment. You will assist in the design and development of standardized datasets derived from multiple systems of record, using ETL/ELT and developing scalable solutions.

A key area of success for this role is developing or applying existing development and scripting skills in process automation to orchestrate data pipelines from business systems, data lakes and third-party data repositories. You will be creating and loading dimensional models that will be used for analysis and reporting. As you work on projects and enhancements you will assist in refining data governance within business processes and the technical tool chain.

A key to success in this role is to quickly learn the meaning of business data and understand the business domain. This role includes hands‑on development experience and participation in regular on‑call duties.

This role works independently to deliver assignments on time and budget. You will receive assignments from team leadership or more senior members of the team, follow defined project approaches, and help ensure delivery. You will participate in research to find solutions and use data to complete metrics and corrective actions.

• Troubleshoot and develop solutions to problems and provide permanent fixes (being proactive).
• Collaborate with other developers and support engineers to resolve issues.
• Participate in an on‑call rotation for integration and transformation pipelines, legacy systems, and modern data platforms that may involve occasional off‑hours and weekend support.
• Take ownership of following on‑call procedures and demonstrate ownership.
• Maintain documentation for legacy systems, pipelines, and modernization implementation.
• Provide training as needed.

• Build real‑time and batch data integrations from disparate source systems into the data lake/data warehouse/delta lake.
• Build and maintain scalable ETL processes using workflow automation tools such as Azure Data Factory, Azure Databricks, Cawa and Cleo Harmony.
• Provide documentation (including Technical Design Documents) for installations and deliverables.
• Design dimensional models and be able to cleanse and transform raw data into structured formats.
• Administer and maintain data pipelines used for loading data into the data warehouse or Lakehouse.
• Scale and tune data pipelines, data sets, and SQL queries.
• Responsible for Unit testing, support of Integration testing, and User Acceptance Testing.
• Implement proper security mechanisms for data solutions using Azure Key Vault, Entra IDs etc.
• Execute Azure Dev Ops CI/CD processes, DABs, create RFCs and present in CAB.
• Required
  
  Basic Skills:
  
  Develops timely and proper change documentation (RFC). Proactively communicates status to key stakeholders to diagnose and ensure delivery is on track. Takes ownership of assignments. Proactively drives results and seeks support when hitting barriers. Exhibits curiosity to understand how changes fit into the overall scope.

• Collaborate with business partners to understand their business problems or needs and…