Lead Data Platform Engineer - Astronomer​/Airflow

Position: Lead Data Platform Engineer - Astronomer / Airflow
CTG is seeking to fill a Lead Data Platform Engineer - Astronomer / Airflow position for our client.

Location:

Atlanta, GA Duration: 12 months Duties:
Lead L2/L3 support for enterprise Astro (Astronomer-managed Apache Airflow) environments. Own Incident, Problem, and Change Management processes for the Data Orchestration Platform. Perform advanced root cause analysis (RCA) for pipeline failures, scheduler issues, worker instability, and infrastructure bottlenecks. Improve DAG reliability, SLA adherence, and reduce MTTR across critical data workflows. Establish and maintain operational standards, including support playbooks, runbooks, and escalation procedures.

Design and maintain dynamic DAG frameworks (Factory pattern) to enable scalable pipeline onboarding. Enable automated onboarding of new data domains, data sources, and transformation workloads. Support and optimize complex ETL/ELT workflows across Data Lakes (S3-based architectures) and Data Warehouses (e.g., Snowflake, Amazon Redshift). Collaborate with data engineering, platform, and Dev Ops teams to ensure stable, scalable orchestration services. Provide technical guidance and support on open-source platform implementation, customization, and integration.

Skills:

Deep expertise in Astronomer-managed Apache Airflow (Astro) environments. Strong Python development skills for DAGs, operators, plugins, and automation frameworks.

Experience with ETL/ELT pipeline design and distributed data processing patterns. Proficiency with AWS cloud services including EKS, S3, RDS, IAM, Cloud Watch, and VPC. Kubernetes operational experience (Airflow on EKS or equivalent). Infrastructure-as-Code experience (Terraform or Cloud Formation preferred). Strong knowledge of CI/CD pipelines, Git-based workflows, and deployment automation. Familiarity with data platforms such as Snowflake and Amazon Redshift. Strong analytical and troubleshooting skills for distributed systems.

Experience:

Proven experience supporting and operating enterprise-scale Airflow/Astro environments. Experience leading production incident response, RCA, and operational reliability improvements. Hands-on experience building scalable DAG frameworks and reusable pipeline templates. Background in cloud-native data engineering and platform operations. Experience optimizing performance, scaling workloads, and improving orchestration efficiency. Prior experience in enterprise data platform support or SRE/Data Ops roles strongly preferred.

Education:

Bachelor's degree in Computer Science, Information Systems, Engineering, or related field, or equivalent experience. Excellent verbal and written English communication skills and the ability to interact professionally with a diverse group are required. CTG does not accept unsolicited resumes from headhunters, recruitment agencies, or fee based recruitment services for this role.

To Apply:

To be considered, please apply directly to this requisition using the link provided. Kindly forward this to any other interested parties. Thank you! About CTG CTG, a Cegeka company, delivers IT and business solutions that enhance clients' digital agility, empowering them to seize new opportunities and overcome any challenge. Backed by more than 60 years' experience and a commitment to being a reliable, results-driven partner, we work shoulder to shoulder with clients to shape digital together.

Our vision is to be an indispensable partner to our clients and the preferred career destination for digital and technology experts. With more than 9,000 team members in over 15 countries, we combine global expertise with local insight to deliver innovative solutions. We operate across the Americas, Europe, and India, working with over 3,000 clients in many of today's highest-growth industries.

Together, we shape what's next-working shoulder to shoulder to deliver impactful solutions for our clients and society. Our culture is built by the people who work at CTG, the values we hold, and the actions we take. It's a living, breathing thing that is renewed every day through the ways we engage with each other, our clients, and our communities.

At CTG, you'll find a workplace where you are encouraged to grow, supported in your ambitions, and empowered to shape your own career journey. For more information, visit  CTG will consider for employment all qualified applicants including those with criminal histories in a manner consistent with the requirements of all applicable local, state, and federal laws. CTG is an Equal Opportunity Employer.

CTG will assure equal opportunity and consideration to all applicants and employees in recruitment, selection, placement, training, benefits, compensation, promotion, transfer, and release of individuals without regard to race, creed, religion, color, national origin, sex, sexual orientation, gender identity and gender expression, age, disability, marital or veteran status, citizenship status, or any other discriminatory factors as required by law. CTG is fully…