Senior Data Engineer

Overview

Tech Specialist Database Admin role at CME Group

We are seeking a hands-on Technology Specialist to lead our database modernization efforts as we migrate from legacy on-premise databases to strategic cloud platforms. This role requires deep expertise in Google Cloud Platform - specifically Cloud SQL, Alloy

DB, and Bigtable - alongside advanced proficiency in Python for building scalable data pipelines and automation. You will be responsible for tackling systemic performance challenges, managing our database fleet programmatically, and serving as the go-to expert for our development and reliability teams. Your technical leadership will directly ensure our new cloud infrastructure is performant, stable, and built for scale.

• Cloud Architecture:
  Design robust, scalable, and cost-effective data architectures on Google Cloud Platform (GCP), focusing on Cloud SQL, Alloy
  
  DB, and Bigtable.
• Database Performance & Optimization:
  Lead performance tuning and optimization efforts for Postgre
  
  SQL, diagnosing and resolving complex issues stemming from our legacy Oracle Exadata environment.
• Data Pipeline Development:
  Build and maintain resilient, cloud-native data pipelines (ETL/ELT) using Python and GCP services such as Dataflow, Big Query, and Pub/Sub.
• Automation & Infrastructure as Code (IaC):
  Develop and implement automation in Python for performance monitoring, remediation, and infrastructure management using IaC tools like Terraform.
• Migration & Modernization:
  Guide the technical execution of migrating large, complex databases from Oracle to Postgre
  
  SQL on GCP, ensuring data integrity and performance.
• Mentorship & Guidance:
  Serve as a subject matter expert and mentor for development and data reliability teams on Postgre
  
  SQL and GCP best practices, helping to elevate the team s technical capabilities.

• Experience:
  
  7-10 years of professional experience in a data engineering or database specialist role, with a proven track record of building and maintaining production-grade cloud data systems.
• Google Cloud Platform (GCP) Expertise:
  Deep, hands-on expertise with GCP, including architecting solutions with Big Query, Dataflow, Cloud Storage, Pub/Sub, Cloud SQL, and Alloy
  
  DB.
• Python Proficiency: 6+ years of advanced Python development experience for data processing, automation, and building ETL/ELT pipelines.
• Database Expertise:
  • Expert-level knowledge of Postgre
    
    SQL internals (query planner, indexing, vacuuming, locking mechanisms) and performance tuning.
  • Proven experience migrating large, complex databases from Oracle (ideally Exadata) to Postgre
    
    SQL.
  • Strong professional experience with other enterprise databases like MS SQL Server.
• Dev Ops & IaC:
  Demonstrable experience building CI/CD pipelines (e.g., Git Lab CI, Jenkins) and managing infrastructure as code (IaC) with Terraform.
• Experience with data orchestration tools such as Apache Airflow or Cloud Composer.
• Experience with other GCP data services like Bigtable and Memory Store (Redis).
• Experience with enterprise database monitoring and administration tools (e.g., IDERA, SCOM, Oracle OEM).
• Understanding of data privacy and compliance standards (e.g., HIPAA, GDPR).

CME Group is committed to offering a competitive total rewards package for our employees that recognizes their contributions to the business and reflects our long-term investment in their future. The pay range for this role is $135,000-$225,000. Actual salary offered will be dependent on a wide array of factors including but not limited to: relevant experience, skills, education and comparison to internal employees (where relevant).

Our compensation program also includes an annual target bonus opportunity for all employees, as well as the opportunity to become an owner in the company through our broad-based equity program. Through our benefits program, we strive to offer flexibility, value and choice. From comprehensive health coverage, to a retirement package that includes both a 401(k) and an active pension plan, to highly competitive education reimbursement provisions, paid time off and a mental health benefit, CME Group offers a holistic benefits package for…