Lead Cloud Data Engineer

We are seeking a highly skilled Lead Cloud Data Engineer to join our team. The ideal candidate will have extensive experience with AWS Glue, PySpark, and Amazon Redshift. You will be responsible for designing, implementing, and optimizing data pipelines, ensuring data quality, and collaborating with cross‑functional teams to meet business needs.

This position will follow our hybrid work model. We expect the selected candidate to be in office 2-3 days a week (10-12 days a month) at the following office locations:
St. Petersburg, FL;
Memphis, TN;
Denver, CO;
Southfield, MI.

• Design and develop scalable ETL pipelines using AWS Glue and PySpark.
• Integrate data from various sources into Amazon Redshift, ensuring data quality and consistency.
• Optimize the performance of data processing jobs and Redshift queries.
• Deploy infrastructure as code (IaC) with Terraform.
• Monitor and troubleshoot data pipelines to ensure reliability and efficiency.
• Collaborate with data scientists, analysts, and other stakeholders to understand data requirements.
• Ensure compliance with security policies and regulations.
• Document data workflows and best practices.
• Mentor and guide junior engineers on the team.
• Continuously explore new AWS services and technologies to improve existing solutions.

• Expert level experience with AWS Cloud Services is preferred; knowledge of other Cloud Providers is a plus.
• Experience with AWS Cloud Services components like Redshift, S3, Kafka, Glue, Air Flow, Sage Maker, EMR, Athena, Lake Formation, Dynamo
  
  DB, Aurora, VPC, IAM, and other modules.
• Working experience in Python is preferred;
  Java and other languages are a plus.
• Terraform or other Infrastructure as Code experience is a nice to have.
• Knowledge and experience with analytics, data warehouse and big data concepts across both batch and streaming patterns.
• Solid understanding of networking, infrastructure, cost management, and SRE concepts.
• Capability to create patterns for adoption from scratch and document and articulate coding and architecture standards for others to follow.
• Performance tuning and optimization of code and infrastructure.
• Creation of a culture of continuous improvement, performing code reviews and making recommendations for improvement or streamlining patterns.
• Relevant experience in various database platforms, ETL solutions/products, infrastructure, ETL architecture, and on‑prem or cloud services.
• Financial services industry knowledge is a plus.

• Identify and understand issues, problems and opportunities for automation.
• Communicate and organize information and ideas clearly to individuals or groups.
• Choose a course of action or develop appropriate solutions using effective approaches.
• Maintain a satisfactory level of technical and professional skill or knowledge related to the position.
• Develop collaborative relationships to facilitate the achievement of work goals.
• Focus on internal and external client needs and sustain productive client relationships.

• AWS Certified Solutions Architect
• AWS Certified Big Data
• AWS Certified Data Analytics
• AWS Certified Developer
• AWS Certified Machine Learning

Bachelor’s:
Computer and Information Science (Required)

General

Experience:

6 to 10 years

Hybrid

The total compensation for this position includes base salary or wages and may include components such as additional compensation (cash or equity), discretionary bonuses, or commissions. The position is eligible for a benefits package that may include medical, dental, and vision; life insurance; critical illness and accident insurance; disability benefits; retirement savings; paid time off (including vacation, holidays, and sick leave);

and parental leave. Eligibility for benefits and specific offerings may vary based on position and employment status. To view more details of the benefits offered, visit

The Company is an equal opportunity employer and makes all employment decisions on the basis of merit and business needs.