Senior Manager Data Engineering

JOB SUMMARY

The contractor will be responsible for supporting and maintaining the data pipeline platform that powers performance reporting data staging capabilities.

• Manage and maintain Amazon Redshift consumer cluster infrastructure, ensuring platform stability, performance, scalability, and operational reliability.
• Design, develop, enhance, and support data pipelines built using PySpark and AWS Glue to ingest, transform, and deliver data across the platform.
• Monitor, troubleshoot, and optimize ETL/ELT workflows, data processing jobs, and cloud infrastructure to meet service level expectations.
• Perform data analysis, root cause investigation, and data validation activities to identify and resolve data quality, performance, and operational issues.
• Collaborate with product, engineering, and business teams to support data integration, reporting, and modernization initiatives.
• Implement engineering best practices related to automation, monitoring, performance tuning, and cloud-native data processing.
• Support production releases, incident resolution, and continuous improvement of the AWS-based data platform.

• AWS Glue
• Py Spark
• Amazon Redshift
• SQL
• Data pipeline development
• Cloud data engineering
• Data analysis
• Troubleshooting
• Operational support