Senior Data Engineer

Senior Data Engineer

Category:
Software Development/ Engineering

Main location:
United States, Georgia, Atlanta

Employment Type:

Full Time

Do you want to take your career to the next level? Are you ready for the responsibility of working with high-profile clients? CGI is looking for a talented, driven, and experienced Senior Data Engineer to join our team in Atlanta, GA. At CGI, you will solve challenging business and technical problems as a full-time consultant serving local, enterprise clients. You'll be part of a team of smart, dedicated people like yourself and make an impact with both internal and client stakeholders.

You also can work on cutting edge technologies and cloud native development. Tired of the same old thing? Take your talents to a world class consulting firm that inspires personal and professional growth and values your ideas.

• Play key role in establishing and implementing migration patterns for the Data Lake Modernization project.
• Actively migrate use cases from our on premises SQL Server to Databricks.
• Using Databricks, ensure proper data lineage and data sourcing to support Regulatory Reports for financial services clients.
• Leverage Delta Live Tables, Autoloader, Lakehouse Architecture, and the latest techniques in the Databricks space.
• Collaborate with Product Management and business partners to understand use case requirements and reporting.
• Support staging of data to Axiom for final reporting on regulatory matters.
• Adhere to internal development best practices/lifecycle (e.g. Testing, Code Reviews, CI/CD, Documentation).
• Document and showcase feature designs/workflows.
• Participate in team meetings and discussions around product development.
• Stay up to date on industry latest industry trends and design patterns.
• Ability to guide and provide oversight to offshore team members, serving as their primary liaison to ensure effective communication, alignment, and successful project delivery.

• Bachelor's in Computer Science, Computer Engineering or related field
• 8+ years of relevant work experience
• 6+ yrs. Development experience with Spark (PySpark), Python and SQL.
• 4+ Hands on experience with Databricks Development
• Hands on experience with deploying to an Azure environment
• Extensive knowledge building data pipelines
• Experience with scheduling and orchestration (e.g. Databricks Workflows, airflow, prefect, control-m).
• Solid understanding of distributed systems, data structures, design principles.
• Comfortable communicating with teams via showcases/demos.

• Financial Services experience
• 3+ years experience with GIT.
• 3+ years experience with CI/CD (e.g. Azure Pipelines).
• Experience with streaming technologies, such as Kafka, Spark.
• Experience building applications on Docker and Kubernetes.

CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit-based performance, CGI typically does not hire individuals at or near the top of the range for their role.

Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $79,600.00 - $.

• Competitive compensation
• Comprehensive insurance options
• Matching contributions through the 401(k) plan and the share purchase plan
• Paid time off for vacation, holidays, and sick time
• Paid parental leave
• Learning opportunities and tuition assistance
• Wellness and Well-being programs

This position is located onsite in Atlanta, GA.

CGI anticipates accepting applications for this position through January 31, 2025.

• Apache Spark
• Azure Dev Ops
• Python

Together, as owners, let’s turn meaningful insights into action.

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s…