Data Engineer Council

Key Responsibilities

• Design, develop and maintain robust ETL pipelines to ingest, transform and load data from diverse sources into a central data warehouse.
• Collaborate with data scientists, analysts and stakeholders to understand data requirements and deliver high‑quality, reproducible datasets.
• Implement data quality checks, monitoring and alerting to ensure accuracy and reliability of data assets.
• Optimize query performance and storage costs using AWS services such as Redshift, S3, Glue and Athena.
• Document data models, pipeline logic and best practices for future maintainability.

• Proven experience building data pipelines with Python and SQL.
• Strong knowledge of ETL concepts and data warehousing principles.
• Hands‑on experience with AWS data services (Redshift, Glue, S3, Athena).
• Excellent problem‑solving skills and ability to work collaboratively in a hybrid environment.
• Good communication skills and a passion for using data to improve public services.