Ab Initio Developer

Ab Initio Developer

Location: Charlotte, NC (Hybrid)
Duration: 24-Month Contract

We are seeking an experienced Ab Initio Developer to join the Home Lending Data & Insights team. This role focuses on designing, developing, and modernizing enterprise data pipelines across both legacy on-premises platforms and Google Cloud Platform (GCP). The ideal candidate has strong expertise in ETL development, cloud data engineering, and enterprise-scale data modernization, with experience supporting highly available, production-grade data environments.

You will help migrate legacy Teradata and Ab Initio solutions to cloud-native architectures while ensuring data quality, operational excellence, security, and scalability.

• Design, develop, and maintain scalable batch and near real-time data pipelines using Ab Initio, Python, PySpark, PL/SQL, and SQL
  .
• Build and optimize Google Big Query datasets, transformations, and data models using partitioning, clustering, and query optimization techniques.
• Support migration initiatives from Teradata and Ab Initio to Google Cloud Platform
  , including data validation, reconciliation, parallel processing, and production cutovers.
• Develop and maintain workflow orchestration using Autosys
  , while driving modernization to Google Cloud Composer (Apache Airflow).
• Implement metadata management, governance, and data discovery using Google Dataplex
  .
• Build and maintain enterprise data quality controls using Informatica Data Quality
  , including profiling, validation rules, exception handling, and quality monitoring.
• Monitor production pipelines, troubleshoot failures, perform root cause analysis, and implement continuous improvements to system reliability and performance.
• Apply secure data engineering practices including PII protection, data masking, access controls, retention policies, and audit documentation.
• Partner with Product Owners, Architects, Analysts, and Engineering teams to define technical solutions and deliver curated, trusted datasets.
• Create and maintain technical documentation including data dictionaries, reconciliation documents, operational runbooks, and technical specifications.
• Utilize AI-assisted development tools such as Git Hub Copilot, Devin, or similar to improve engineering productivity while maintaining secure coding practices, code reviews, and testing standards.
• Provide technical leadership and mentor junior engineers by promoting engineering best practices and scalable solution design.
• Analyze complex business requirements and translate them into robust ETL and data engineering solutions.

• 4+ years of professional Data Engineering experience.
• 4+ years of experience with PL/SQL and SQL
  , including complex query development, optimization, and troubleshooting.
• Hands-on experience with Oracle, Teradata, Python, and/or Google Big Query
  .
• 4+ years of experience developing enterprise ETL solutions using Ab Initio
  , including graph development, Psets, and performance tuning.
• 3+ years of experience programming in Python with hands-on Py Spark development.
• 3+ years of experience with ETL architecture, data warehousing concepts, dimensional modeling, and data integration best practices.
• Experience building scalable batch and near real-time data processing solutions.
• Strong understanding of enterprise data governance, metadata management, and data lifecycle management.
• Must-have:
  Use AI-assisted coding tools (e.g., Git Hub Copilot, Devin, or similar) to accelerate development while maintaining strong code review discipline, testing, and secure coding standards

• Experience with Google Cloud Platform (GCP) services including:
  • Big Query
  • Dataplex
  • Google Cloud Composer (Apache Airflow)
• Experience migrating enterprise data platforms from on-premises environments to cloud-native architectures.
• Experience with Informatica Data Quality (IDQ).
• Familiarity with Autosys scheduling and workload automation.
• Experience implementing secure data engineering practices for regulated environments.
• Experience using AI-assisted software development tools such as Git Hub Copilot or Devin.
• Experience working in Agile/Scrum environments.
• Financial services or mortgage/lending industry experience is a plus.

• Languages: Python, PySpark, SQL, PL/SQL
• ETL: Ab Initio
• Databases: Oracle, Teradata, Big Query
• Cloud: Google Cloud Platform (Big Query, Dataplex, Cloud Composer)
• Scheduling: Autosys, Apache Airflow (Cloud Composer)
• Data Quality: Informatica Data Quality
• Development Tools: Git Hub Copilot, Devin, Git