Sr. Data Engineer

Technology Partners is currently seeking a talented Senior Data Engineer.

Do you have experience executing ETL migrations using Matillion and building Redshift reference tables while implementing CDC strategies?

As a senior member of our data engineering team, you will lead the hands‑on development of ETL processes using Matillion and Redshift. You will partner closely with the Senior Data Architect to develop and validate data patterns, and work alongside the Dev Sec Ops  Engineer on environment integration. Your responsibilities include migrating legacy ETLs into consolidated patterns, building validation frameworks to ensure data integrity, and implementing reference tables and crosswalks for downstream consumption.

You will also manage the migration of Qlik ETLs to Matillion, create strategies for CDC data consumption, and build processes for historical data reprocessing. The role involves working with complex source systems in a regulated environment, delivering high‑quality, reliable data pipelines, and ensuring compliance with security standards. This is a full‑time, senior‑level position supporting critical data modernization initiatives.

• Develop and optimize Matillion ETL jobs, including orchestration and transformation workflows.
• Analyze existing fragmented ETL logic, identify patterns, and consolidate into reusable components.
• Build and maintain Redshift reference tables and views that expose site‑to‑enterprise data mappings.
• Implement and validate CDC data ingestion strategies from SQL Server and other sources.
• Create automated frameworks for parallel validation of data outputs comparing current and new platform results.
• Design and execute reprocessing patterns for approximately 10 years of historical data.
• Support the implementation of data integrity checks, including row count, primary key, null thresholds, and checksum validations.
• Collaborate with architecture and operations teams to surface integration issues and improve platform stability.
• Ensure all data pipelines and processes adhere to security, compliance, and best practice standards.

• 7+ years of data engineering experience, with at least 3–5 years of hands‑on work in cloud data warehouses.
• Recent, practical experience developing with Matillion ETL, including orchestration, transformation, shared libraries, and environment configuration.
• Strong proficiency in Redshift, with expertise in SQL query tuning, distribution key, sort key, materialized views, and query optimization.
• Experience consolidating fragmented ETL logic into standardized, reusable patterns without supervision.
• Hands‑on experience with CDC strategies in SQL Server or equivalent data ingestion mechanisms.
• Deep understanding of SQL and data modeling for master data, crosswalks, and hierarchical view exposure.
• Familiarity with source systems such as SQL Server (CDC‑enabled), JDE ERP, MES, and cloud storage techniques.
• Ability to work effectively in environments with sparse or outdated documentation.
• Bachelor’s degree in Computer Science, Data Science, or related field. Valid compliance or security certifications (e.g., NIST SP 800‑171, CMMC Level
  2) are a plus.

• Prior aerospace, defense, or ITAR‑regulated industry experience.
• Active certifications in Matillion (Associate or Professional) and AWS (Data Analytics Specialty or Solutions Architect).
• Experience with Qlik Sense or Qlik View ETL development for migration projects.
• Knowledge of JDE (JD Edwards) data extraction processes.
• Familiarity with manufacturing or shop‑floor data systems, MES, and production analytics.
• Consulting experience at a Big 4 or top‑tier data practice.

$63.00 – $90.00/hr

Matillion ETL, Redshift, CDC, SQL Server, data migration, cloud data warehouse, data validation, reference tables, data pipeline, ETL developer

All offers of employment at Technology Partners are contingent upon clear results of a thorough background check and drug screening that meet corresponding laws and regulations at the city, state and federal level.

Pay ranges are influenced by candidate qualifications, experience, and role specifics, with the actual rate determined considering skills, market conditions, and are subject to change by the employer; pay negotiations follow all state and federal legal guidelines.