Come join Pattison Food Group Ltd., a Jim Pattison business, and Canada’s largest Western-based provider of food and health products.
Pattison Food Group Ltd. consists of Save‑On‑Foods and other well-known grocery banners. With nearly 300 retail locations, we proudly employ more than 30,000 team members.
We have an exciting prospect for a full‑time QA Data Engineer to join our IT team in Langley, BC. Reporting to the Manager, Data & Analytics, you will work closely with Data Scientists, Data Engineers, and Machine Learning Engineers to help extract value from our data by supporting validation of data processes across ingestion, transformation, and delivery, ensuring robustness for machine learning and analytics use cases.
Responsibilities- Build test and validation cases on data engineering and occasionally data science code changes to ensure standards and quality is maintained.
- Design, monitor, and maintain QA reports, KPIs & quality trends for the internal data systems.
- Create test automation frameworks that are used to validate data engineering pipelines throughout the end‑to‑end life cycles of large‑scale, distributed machine learning systems using the latest open source and cloud technologies.
- Scripting and automating tests and validating the data pipelines used for machine learning models, dashboards, and reports.
- Define data quality and unit testing best practices, and ensure all work meets those requirements.
- Develop scalable tools and services for conducting peer reviews and unit testing.
- Collaborate with data scientists and data engineers to test and deploy data pipelines and data solutions at scale.
- Identify project requirements, track and communicate project progress with peers, and drive projects to completion.
- Share knowledge through the creation of development, support documentation and presentations to peers and senior leaders.
- Identify and address unexpected pipeline production issues related to data tables and pipelines.
- Bridge the gap between the project team and production team to ensure smooth roll‑out changes and transition of ownership.
- A bachelor’s degree in computer science, applied mathematics, or engineering.
- 3+ years of experience in conducting Quality Assurance.
- Experience in QA for data pipelines within large‑scale data solutions.
- Experience in thorough peer reviews for code changes and defining and implementing unit tests.
- Experience building systems with scalable data processing technologies using Spark, Python, SQL.
- Experience with data modeling concepts and best practices.
- Experience in CI/CD and ability to follow standard workspace branching practices.
- Exposure to Databricks and associated tools like MLflow and Delta Lake.
- Familiarity with data‑oriented workflow orchestration frameworks (Databricks Jobs, Azure Data Factory, Airflow, etc.).
- Experience developing in cloud computing environments (Azure, AWS, GCloud).
- Commitment to maintaining high code quality, automated testing, and other best practices in data engineering.
- Experience working with cloud computing and database systems.
- Fluency in Python and potentially other programming languages (Scala, etc.).
- Experience with version control tools such as Git and Git workflows.
In addition to a highly competitive salary, we offer a great range of benefits, a company pension plan, free parking, exclusive team member offers, and opportunities for development and career progression.
CompensationCompensation Details: $94,552.00 - $. The compensation offered for this position will take into consideration location, education, skills, experience and other factors.
#J-18808-LjbffrTo Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search: