More jobs:
Apache Airflow Technical SME
Job in
Raleigh, Wake County, North Carolina, 27601, USA
Listed on 2026-01-01
Listing for:
Compsciprep LLC
Full Time
position Listed on 2026-01-01
Job specializations:
-
IT/Tech
Cloud Computing, Data Engineer
Job Description & How to Apply Below
Experience requested: 7 to 10 Yrs
Description:
Apache Airflow Technical SME
Strong Python and SQL proficiency, a deep understanding of workflow orchestration and DAG design, and experience with cloud platforms, version control systems (like Git), and monitoring tools. Other essential skills are knowledge of ETL/ELT processes, data modeling, distributed systems, and CI/CD principles.
Airflow Expertise- Possessing deep knowledge of Airflow’s architecture, including schedulers, executors (Celery, Kubernetes), and plugin development.
- Designing and developing complex, modular, and reusable DAGs (Directed Acyclic Graphs) to automate data pipelines.
- Identifying and addressing performance bottlenecks in Airflow environments and implementing best practices for orchestration and scheduling.
- Integrating Airflow with cloud-native services like Azure Data Factory, Azure Databricks, Azure Storage, and others.
- Developing and maintaining CI/CD pipelines for Airflow DAG deployment, testing, and version control, often using tools like Azure Dev Ops.
- Implementing monitoring, alerting, and logging standards for Airflow jobs to ensure operational excellence and rapid incident response.
- Creating and maintaining documentation for Airflow configurations, deployment processes, and operational procedures. Mentoring other engineers and leading knowledge‑sharing sessions.
- Providing expert‑level troubleshooting support for Airflow‑related issues and contributing to incident response efforts.
- May require strong knowledge of cloud platforms like Azure (including services like Azure Synapse, Azure Functions, and Azure API Management) or AWS.
- Experience with Docker and Kubernetes for deploying and managing Airflow in containerized environments.
- Proficiency in Python/Java for developing Airflow DAGs and other related components. “
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×