ETL Test Automation Engineer

About Position:

We are looking for a skilled ETL Test & Automation Engineer to design, develop, and maintain automated test frameworks for data pipelines, ETL workflows, XML/JSON payloads, and MDM systems. The ideal candidate has deep hands-on experience in Python-based test automation, data quality validation, and cloud-native data platforms such as Azure Databricks, AWS Redshift, and Informatica.

Role: ETL Test & Automation Engineer

Location:

All Persistent Locations

Experience:

6 to 12 Years
Job Type: Full Time Employment

What You'll Do:

ETL Pipeline Testing
Design and execute test strategies for ETL pipelines built on DBT ,Informatica , Databricks
Validate data transformation logic across Bronze, Silver, and Gold layers of Medallion Architecture
Perform source-to-target (STT) mapping validation for migrations (Informatica to Databricks, Redshift to Delta Lake)
Validate incremental and full-load ETL pipelines including CDC (Change Data Capture) scenarios
Test DLT (Delta Live Tables) pipelines including DLT Expectations and data quality rules
Test Automation Framework
Build and maintain Python-based test automation frameworks using pytest, Py Spark
Develop reusable test utilities for schema validation, null checks, duplicate detection, and row count reconciliation
Integrate automated test suites into CI/CD pipelines (Azure Dev Ops / Git Hub Actions)
Automate regression testing for pipeline deployments across DEV, QA, and PROD environments
Implement data diff and checksum-based validation for large-scale table migrations
XML & API Validation
Validate XML payloads against XSD schemas using lxml and xmlschema libraries
Test REST API integrations (Jira, Service Now, ADO, SFTP) for data ingestion pipelines
Perform business rule validation on XML-based customer, order, and product feeds
Validate JSON schema contracts and API response structures for event-driven pipelines
MDM & Domain Validation
Validate MDM golden records for Customer, Product, and Vendor domains
Test deduplication logic, survivorship rules, and cross-system data consistency
Validate row-level and column-level security rules in Unity Catalog (masking functions, row filters)
Test SCD Type 1 and Type 2 implementations in Delta Lake
Data Quality & Reporting
Define and enforce DQ rules using Great Expectations, dbt tests, or custom pytest assertions
Build automated data quality dashboards and test result reports
Track test metrics: pass rate, coverage, defect density across pipeline stages
Raise and manage defects using Jira / Azure Dev Ops with detailed root cause analysis

Expertise you will bring:

Bachelor's Computer Science, Information Technology, or related field
6 to 12 years of experience in ETL testing, data quality, or test automation roles
Hands-on experience with Informatica Power Center / IICS and cloud data platforms (Azure / AWS)
Strong understanding of data warehousing concepts:
Star Schema, SCD, CDC, Medallion Architecture
Experience testing large-scale data migration projects (source system to cloud data lake)
Excellent analytical and debugging skills for identifying root cause of data discrepancies
ISTQB / CSTE certification preferred but not mandatory

Benefits:

Competitive salary and benefits package
Culture focused on talent development with quarterly growth opportunities and company-sponsored higher education and certifications
Opportunity to work with cutting-edge technologies
Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
Annual health check-ups
Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

We support hybrid work and flexible hours to fit diverse lifestyles.
Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let’s unleash your full potential at Persistent
- “Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”