Sr. Data Engineer - Cloud & AI Platform On-Site

Job Description

At Regions, the Cloud Data Engineer supports the Data and Analytics organization by assisting in the design, optimization, and development of data pipelines and machine learning models. The Cloud Data Engineer works on cross‑functional teams to develop reusable Infrastructure as Code (IaC) to build data pipelines, create new Cloud Infrastructure, and support feature engineering and deployment of machine learning and Artificial Intelligence (AI) models.

This role supports software developers, database architects, data analysts, and data scientists on data initiatives and ensures optimal data delivery architecture is consistent throughout ongoing projects.

• Partners with Regions Technology partners to design, build, and maintain data‑based structures and systems in support of Data and Analytics and Data Product use cases
• Builds data pipelines to collect and arrange data and manage data storage in Regions’ big data environments
• Builds robust, testable programs for moving, transforming, and loading data using cloud‑based Big Data tools such as Glue, Step‑Functions, Snowflake, Kafka, and Sage Maker
• Builds applications that integrate with AI, including knowledge base management and document processing
• Designs and implements event‑based architectures for streaming data
• Coordinates design and development with Data Products Partners, Data Scientists, Data Management, Data Modelers, and other technical partners to construct strategic and tactical data stores
• Ensures data is prepared, arranged and ready for each defined business use case
• Designs and deploys frameworks and micro services to serve data assets to data consumers
• Collaborates and aligns with technical and non‑technical stakeholders to translate customer needs into data design requirements, and work to deliver world‑class visualizations, data stories while ensuring data quality and integrity
• Provides consultation to all areas of the organization that plan to use data to make decisions
• Supports any team members in the development of such information delivery and aid in the automation of data products
• Acts as trusted adviser and partner to business leaders; assists in the identification of business needs & data opportunities, understanding key drivers of performance, interpreting business case data drivers, turning data into business value, and participating in the guidance of the overall data and analytics strategy
• Ensures compliance with risk management programs, rules and regulations, and cybersecurity practices; identifies opportunities for and supports process improvements; applies disciplined change management practices
• Identifies opportunities for and supports process improvements
• Applies disciplined change management practices

• Ph.D. and four (4) years of experience in a quantitative/analytical/STEM field
• Or Master’s degree and six (6) years of experience in a quantitative/analytical/STEM field or technical related field
• Or Bachelor's degree and eight (8) years of experience in a quantitative/analytical/STEM field or technical related field
• Five (5) years of working programming experience in Python/PySpark, Scala, SQL, and Terraform
• Five (5) years of working experience in cloud‑based Big Data Technology such as Elastic Map Reduce (EMR), AWS Glue, Big Query, or Snowflake

• Background in Big Data Engineering and Advanced Data Analytics
• Experience developing solutions for the financial services industry
• Experience in Agile Software Development
• Experience or exposure to cloud technologies and migrations
• Prior banking or financial services experience

• Ability to interpret and ensure compliance with applicable rules, regulations, and industry guidance
• Experience building data solutions at scale
• Experience designing and building relational data structures in multiple environments
• Experience with cloud technologies and migrations
• Experience with cloud‑based orchestration tools
• Experience with Dev Ops principles, CI/CD, and Software Development Lifecycle
• Experience with No‑SQL databases
• Experience working with cloud services at an enterprise scale, including data engineering with private…