Temp to - Redshift Dynamo data analytics AI subject matter expert senior data engineer

The Consortium, Inc.

-null, United States

Contract to Perm

Remote

Team:
Team is Intel delivery platform and Cumulus – lots of data exchanges: AWS platform using Redshift as data warehouse – Dynamo of meta-data. They are working on evolving code for digital products and need a dynamic Senior Data Engineer who will also design, build and write test automation.

Profile:
Senior Data Engineer with SME in data analytics end AI work within our tech stack; 5+ years of experience.

Must Have

• AWS - Cloud Formation
• AWS - Dynamo
• AWS - Lambda
• AWS - S3
• AWS - SNS/SQS
• AWS Step Function
• BI Tool
• Gen AI
• Node.js Development
• Python
• Red Shift/SQL

Tech Stack Grid

Red Shift/SQL, BI Tool, AWS - Dynamo, Gen AI, AWS Step Function, AWS - Lambda, AWS - S3, AWS - SNS/SQS, AWS - Cloud Formation, Python, node.js Development, JavaScript (ES6)

Data Engineer must be a skilled engineer with an unwavering passion for excellence in Software Engineering and drive to transform that passion into consistent excellence in product development. The candidate must be customer-obsessed, have strong analytical and communication skills, enjoy working with native AWS services, and thrive on solving challenging business problems. The candidate will partner with Product Owners/Architects, Developers, and other Software Engineers to design, define, implement functional features, perform system level validation and verify features of product development.

Qualified candidates will show an aptitude for learning and implementation of advanced software engineering practices in Data Analytics, AWS, Microservices environments to solve complex problems with a mission to release high quality software that is resilient and optimally performing. Candidates will be engaged in both data and analytics reports development and quality engineering, testing and automation as a data engineer.

Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies.

Build, test, deploy and maintain production code for complex transactional applications using event-driven microservices, node.js, Python languages. Incorporate cloud technologies in new application development to include micro-services, SQL, and AWS services such as Lambda, S3, SQS, SNS, Dynamo

DB, Quicksight, AWS Redshift, and Open search.

Perform unit tests and conduct reviews with other team members to ensure code is rigorously designed, elegantly coded, and effectively tuned for performance.

• Expert in writing and optimizing complex SQL queries for data extraction, transformation, and reporting (e.g., SELECT, JOIN, GROUP BY, HAVING, WINDOW functions).
• Expert integrating Redshift Serverless with AWS services such as S3, Glue, Lambda, Athena, and Kinesis; and with BI tools like Tableau, Quicksight, or Looker for real-time analytics and dashboards.
• Expert in building serverless ETL pipelines with Lambda to automate data ingestion and transformation into Redshift.
• Experience of NodeJS and Python.
• Working knowledge of any AI technologies.
• Experience in working with AWS services and deploying applications to AWS.
• Exposure to Dev Ops tools and automation.
• Effective communication skills and a strong customer service orientation, and the ability to clearly discern client needs.