Sr. Batch Operations Lead; INTL

Job Description

We are looking for an experienced Senior Batch Operations Lead with a strong background in Data Engineering, GCP, and Python, who has predominantly worked on large-scale batch data processing ecosystems.

• Lead and manage enterprise-scale batch data operations and production support.
• Monitor, troubleshoot, and optimize critical batch workflows and pipelines.
• Drive incident management, RCA, and operational excellence for data platforms.
• Collaborate with engineering, platform, and business teams to ensure SLA adherence.
• Automate operational workflows using Python and cloud-native tooling.
• Improve reliability, scalability, and observability of batch processing systems.
• Participate in release management, deployment coordination, and change governance.
• Mentor junior engineers and establish operational best practices.

We are a company committed to creating diverse and inclusive environments where people can bring their full, authentic selves to work every day. We are an equal opportunity/affirmative action employer that believes everyone matters. Qualified candidates will receive consideration for employment regardless of their race, color, ethnicity, religion, sex (including pregnancy), sexual orientation, gender identity and expression, marital status, national origin, ancestry, genetic factors, age, disability, protected veteran status, military or uniformed service member status, or any other status or characteristic protected by applicable laws, regulations, and ordinances.

If you need assistance and/or a reasonable accommodation due to a disability during the application or recruiting process, please send a request to  To learn more about how we collect, keep, and process your private information, please review Insight Global's Workforce Privacy Policy:

• Strong experience in Data Engineering / Data Platform Operations
• Hands-on expertise in:
  Google Cloud Platform (Big Query, Cloud Composer, Pub/Sub, Cloud Function, Cloud Run, GCS, Dataflow, etc.)
• Python scripting and automation
• SQL and ETL orchestration
• Extensive experience supporting and managing batch-oriented data pipelines
• Experience with production support, monitoring, alerting, and incident handling
• Familiarity with workflow orchestration tools like Airflow / Cloud Composer
• Understanding of data reliability, scheduling, dependency management, and recovery handling
• Infrastructure as Code (Terraform preferred)
• Exposure to CI/CD and Dev Ops practices is preferred Experience handling high-volume enterprise batch systems
• Knowledge of observability and monitoring tools
• Exposure to hybrid cloud or multi-environment deployments
• Strong stakeholder communication and leadership skills