PySpark & AWS Data Engineer - Forward Deployed
Listed on 2026-10-28
-
Software Development
Data Engineering, AWS
Mactores is the agent-native AWS modernization firm built to ship production-ready systems, retire legacy infrastructure, and measure real outcomes. Delivery at Mactores is built on Aedeon—an agent platform that automates up to 70% of repetitive discovery, dependency mapping, schema mapping, and test validation work—allowing engineers to focus on architecture, judgment, data modeling, and cutovers.
As an Associate Data Engineer in the Data Platform Modernization pillar, you will consolidate and migrate client data platforms on AWS in weeks, not quarters. Working alongside senior forward-deployed engineers, business leads, analysts, and data scientists, you will construct trusted production data products, robust pipelines, and high-performance analytical models.
Key Responsibilities- Production Pipeline Development: Write efficient PySpark and Amazon Glue code to build, deploy, and maintain scalable ETL/ELT pipelines in production environments.
- SQL Engineering: Write and optimize SQL queries, views, and data structures in Amazon Athena and Amazon Redshift.
- Cross-Functional Collaboration: Partner with cross-functional engineering, analytics, and business domain leads to build data products that support active business decision-making.
- Data Quality & Reliability: Establish data quality, validation rules, and schema transformations using automated platform harnesses.
- Delivery Commitments: Work in an agile, forward-deployed model to meet project delivery dates and customer migration milestones.
- 1 to 3 years of professional experience working with Apache Spark, PySpark, and Amazon Glue.
- 2+ years of hands-on experience building production ETL jobs using PySpark and SparkSQL.
- 2+ years of experience writing complex SQL queries and stored procedures.
- Deep technical understanding of the Data Frame API and transformation functions supported by Spark 2.7+.
- Curiosity and eagerness to quickly master new technologies and apply them directly to customer problems.
- Strong problem-solving abilities with a commitment to writing clean, production-grade code.
- Comfort embedding directly within client ecosystems and collaborating alongside senior engineers.
- Prior hands-on experience with AWS EMR and workflow orchestration platforms like Apache Airflow.
- Active AWS or Big Data Certifications (e.g., AWS Certified Data Engineer / Big Data Specialty, Cloudera Certified Big Data Engineer, or Hortonworks Certified Big Data Engineer).
- Practical understanding of Data Ops Engineering principles, continuous integration, and automated deployments.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).