Information Technology Specialist; Data Quality Engineer

Job Title

This is the job title provided above.

The following are the duties of this position at the full working level. If this vacancy includes more than one grade and you are selected at a lower grade level, you will have the opportunity to learn to perform these duties and receive training to help you grow in this position.

• Designs and runs automated data quality checks. Design and implement strategies to ensure data meets quality standards across the organization. Write and automate tests using SQL and Python to check for accuracy, completeness, and consistency.
• Track data pipelines for anomalies, errors, and performance issues, and resolve incidents as they arise. Analyze datasets to understand their structure, content, and quality issues, such as inconsistencies or duplicates. Implements validation and cleansing logic in Databricks and SQL.
• Tracks data quality metrics and reports anomalies to stakeholders. Coordinates with ingestion and ontology teams to address data defects. Work with data engineers, product owners, and business teams to understand requirements and implement best practices. Create documentation for test plans, cases, and results. Monitor and report on quality trends and KPIs. Gathers data quality requirements from relevant stakeholders. Data consumers could include business executives, developers, or even other data teams.