Senior Data Engineer - AWS

Fractal is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets. An ecosystem where human imagination is at the heart of every decision. Where no possibility is written off, only challenged to get better. We believe that a true Fractalite is the one who empowers imagination with intelligence.

Fractal has been featured as a Great Place to Work by The Economic Times in partnership with the Great Place to Work Institute and recognized as a ‘Cool Vendor’ and a ‘Vendor to Watch’ by Gartner.

Please visit Fractal | Intelligence for Imagination for more information about Fractal

Note:

This position is not eligible for Immigration Sponsorship at this time.

Fractal is looking for an expert, hands‑on Senior Data Engineer to serve as a technical subject‑matter expert and trusted advisor to our clients. You will design and build scalable, end‑to‑end data pipelines on AWS from ingestion all the way through to a curated semantic layer in Snowflake while guiding client engineering teams and stakeholders through modern data platform best practices. This is a 100% hands‑on role for someone who combines deep AWS and Snowflake engineering expertise with the communication skills to act as a true technical consultant, helping clients solve complex data challenges and elevate the capability of the teams around them.

• Expert‑level data engineer with extensive, hands‑on experience designing and building production data platforms on AWS.
• Proven ability to build end‑to‑end data pipelines from the ground up—ingestion, transformation, and delivery—not just maintain existing ones.
• Hands‑on experience designing and building semantic layers in Snowflake.
• Track record of acting as a technical subject‑matter expert or consultant, advising and upskilling client teams and engineering stakeholders.
• Comfortable being the most senior technical voice in the room and translating complex engineering concepts for both technical and business audiences.
• Excellent problem‑solving skills and the ability to collaborate effectively across cross‑functional teams.
• Self‑directed and proactive, able to balance multiple work streams with a focus on quality and delivery.

• Deep, hands‑on expertise with core AWS data services: S3, Lambda, Step Functions, Glue (Serverless), Glue Catalog, Glue Crawlers, Athena, SNS, Event Bridge, and Lake Formation.
• Strong proficiency in PySpark and building production ETL/ELT workflows, including with columnar and open table formats such as Parquet and Apache Iceberg.
• Hands‑on Snowflake experience, including designing and building semantic layers.
• Practical knowledge of infrastructure‑as‑code and CI/CD tooling:
  Cloud Formation, Terraform, CDK, uDeploy, and Git Hub.
• Experience with large‑scale data migrations (e.g., migrating from Teradata to S3).
• Strong understanding of cost management, monitoring, and reporting in AWS environments.
• Working knowledge of data lake architectures, metadata management, and data governance.

• Design, build, and maintain scalable data pipelines using AWS services such as S3, Lambda, Step Functions, Glue (Serverless), and Event Bridge, landing curated data in Snowflake.
• Develop and optimize ETL/ELT workflows using PySpark, Parquet file formats, and Apache Iceberg table formats.
• Build and maintain semantic layers in Snowflake to enable consistent, governed, business‑ready analytics.

• Manage metadata and data discovery using AWS Glue Catalog and Glue Crawlers, and enable analytics through Athena.
• Implement event‑driven architectures with SNS and Event Bridge for data processing and notifications.
• Enable secure data lake operations using AWS Lake Formation for access control and governance.
• Support data ingestion and migration initiatives, including migrating data from Teradata to S3.
• Ensure reliable deployments and infrastructure automation using uDeploy, Cloud Formation, Terraform, CDK, and Git Hub.
• Collaborate on cost reporting, monitoring,…