Junior Data Engineer – Custom Solutions

Overview

Design, build, and maintain data pipelines using Airflow and Big Query. This includes design, development through testing, deployment, and ongoing monitoring and maintenance.

• Design, build, and maintain pipelines using Airflow and Big Query; develop, test, deploy, and monitor data pipelines.
• Data Modeling & Optimization:
  Collaborate with data analysts and stakeholders to define data requirements, and design efficient data models within Big Query. Optimize queries and pipeline/dashboard performance for maximum efficiency.
• Custom Solutions:
  Serve as the dedicated data engineering resource for Custom Solutions, partnering with Data, Product, and Customer Success teams to translate bespoke client requests from validated proof-of-concept through to production; communicate technical details and project progress to stakeholders.
• Continuous Improvement:
  Contribute to the ongoing improvement of data infrastructure and processes, including suggesting and implementing new technologies and best practices. Comfortable leveraging AI tools to boost productivity and help build faster and better.
• Other duties as assigned.

• Proficiency in Python and SQL.
• Proven experience (2+ years) building and maintaining data pipelines using Airflow/Cloud Composer.
• Strong understanding of data warehousing principles and experience working with Big Query.
• Understanding of data engineering fundamentals, like ETL/ELT, data modeling, and building idempotent, reliable pipelines.
• Experience with Git and cloud platforms (GCP preferred).
• Experience building and deploying interactive dashboards or data apps (e.g., Dash on Cloud Run) is a plus.
• Excellent problem-solving skills and a proactive approach to identifying and resolving issues.
• Excellent communication and collaboration skills – you'll be working closely with analysts and other stakeholders.
• Comfort and enthusiasm for using AI tools in daily workflow.

Below are skills and terms extracted directly from this job posting to improve Applicant Tracking System (ATS) visibility. This unique feature helps candidates tailor their applications more effectively.

Hard Skills

• Python
• SQL
• Airflow
• Cloud Composer
• Big Query
• ETL
• ELT
• data modeling
• Git
• data warehousing

Soft Skills

• problem-solving
• communication
• collaboration
• proactive approach
• technical translation
• stakeholder communication
• continuous improvement
• adaptability
• creativity
• enthusiasm