Data Engineer

Get AI-powered advice on this job and more exclusive features.

As a Data Engineer, you will be part of a talented team of engineers responsible for the deployment and configuration of cloud resources to meet client business needs in AWS. Client engagements cover a wide variety of business requirements and require engineers to adapt quickly and stay on top of recent cloud technology trends. Candidates should be able to identify and remediate issues within cloud-based systems, based on knowledge of industry standards and best practices.

• Work with the team to evaluate business needs and priorities, liaise with key business partners and address team needs related to data systems and management
• Translate business requirements into technical specifications; establish and define details, definitions, and requirements of applications, components and enhancements
• Participate in project planning; identify milestones, deliverables and resource requirements; track activities and task execution
• Generate design, development, test plans, detailed functional specifications documents, user interface design, and process flow charts for execution of programming
• Develop data pipelines / APIs using tools including Python, SQL, Spark and various AWS services
• Use an analytical, data-driven approach to drive a deep understanding of fast changing business
• Build large-scale batch and real-time data pipelines with data processing frameworks in AWS
• Move data from on-prem to cloud and perform cloud data conversions

• Experience in data engineering with emphasis on data pipelines, analytics and reporting
• Exposure to the AWS Cloud Platform
• Experience in SQL, data transformations, and troubleshooting across databases (e.g., Redshift, Amazon RDS, Cassandra, Snowflake, Postgre
  
  SQL, Databricks, etc.)
• Experience in design and build of data extraction, transformation, and loading processes by writing custom data pipelines
• Experience in Python or other scripting languages
• Experience designing and building solutions utilizing Cloud services such as EC2, S3, EMR, Kinesis, RDS, Redshift/Spectrum, Lambda, Glue, Athena, API Gateway, etc.

• AWS Certification - Solutions Architect Pro or Data Specialty
• Machine Learning experience
• Advanced GenAI experience

• Seniority level:
  Mid-Senior level
• Employment type:
  
  Full-time
• Job function:
  Information Technology
• Industries:
  Internet Publishing

Note:

Referrals increase your chances of interviewing at Protagona.