Sr Data Engineer - Databricks

Job order - J - Permanent Full Time

Title Sr Data Engineer - Databricks

Category Software Development/ Engineering

City Miami, Florida, United States

We're looking for a Data Engineer who thrives on designing scalable data systems and turning complex data into high-quality, consumable assets. If you're passionate about Databricks, Spark, and building robust pipelines that power real business decisions, this role puts you right at the center of it. You'll play a critical role in shaping our data ecosystem, engineering high-performance ETL/ELT pipelines, designing clean and reliable data models, and enabling seamless data access through APIs.

This is not just pipeline work; this is about building production-grade data products that fuel analytics, reporting, and advanced data science. This position is located in Miami, FL in a hybrid working environment.

• Design, develop, and maintain ETL/ELT pipelines using Databricks (Spark) for batch and incremental data processing
• Implement robust data ingestion patterns from multiple source systems (files, databases, APIs, streaming where applicable)
• Optimize Spark jobs for performance, scalability, and cost efficiency
• Ensure data quality, reconciliation, and observability across pipelines

• Develop complex SQL transformations for data cleansing, enrichment, and aggregation
• Design and maintain analytical data models (fact/dimension, curated layers, reporting views)
• Support downstream reporting, analytics, and data science use cases with well-structured datasets

• Configure and manage data exposure through APIs for internal and external consumers
• Partner with application and integration teams to define API contracts and data payloads
• Ensure secure, scalable, and performance data access patterns
• Support versioning and backward compatibility for published data services

• 5+ years of experience in data engineering or related roles
• Strong hands‑on experience with Databricks and Apache Spark
• Advanced SQL proficiency (complex joins, window functions, performance tuning)
• Experience building and managing ETL/ELT pipelines
• Experience configuring and supporting data exposure via APIs
• Solid understanding of data warehousing and analytics concepts

• Strong problem solving and analytical skills
• Ability to work independently on complex data problems
• Clear communication with both technical and non‑technical stakeholders
• Comfortable working in an agile / product‑oriented environment
• Excellent communication (verbal and written) skills to work effectively with cross‑functional teams; ability to document processes and frameworks clearly for future reference
• Timeliness, accuracy, and professionalism
• Self‑starter and capable of working without close supervision

Estimated range: $89,600.00 - $

• Competitive compensation
• Comprehensive insurance options
• Matching contributions through the 401(k) plan and the share purchase plan
• Paid time off for vacation, holidays, and sick time
• Paid parental leave
• Learning opportunities and tuition assistance
• Wellness and Well‑being programs

Qualified applicants will receive consideration for employment without regard to their race, ethnicity, ancestry, color, sex, religion, creed, age, national origin, citizenship status, disability, pregnancy, medical condition, military and veteran status, marital status, sexual orientation or perceived sexual orientation, gender, gender identity, and gender expression, familial status or responsibilities, reproductive health decisions, political affiliation, genetic information, height, weight, or any other legally protected status or characteristics to the extent required by applicable federal, state, and/or local laws where we do business.

CGI provides reasonable accommodations to qualified individuals with disabilities. All CGI offers of employment in the U.S. are contingent upon the ability to successfully complete a background investigation.