IT Software Quality Engineer (ETL ​/ Big Data)

IT Software Quality Engineer (ETL / Big Data)

We are working with a leading company seeking an experienced IT Software Quality Engineer to drive quality assurance across complex data platforms and cloud-based ecosystems. The role requires strong expertise in ETL and Big Data testing, data validation, SQL, and test automation, with a focus on ensuring data accuracy, integrity, and reliability across end-to-end data pipelines.

• Perform end-to-end testing of ETL and data workflows
• Validate data extraction, transformation, and loading processes
• Conduct data reconciliation and cross-system validation
• Ensure data quality, completeness, consistency, and accuracy across source and target systems

• Analyze business requirements and create detailed test scenarios and test cases
• Develop comprehensive test strategies aligned with business and technical requirements
• Execute functional, integration, system, and regression testing
• Ensure adequate test coverage and quality across releases

• Perform advanced SQL-based data validation and analysis
• Validate complex data transformations, aggregations, joins, and business rules
• Investigate and troubleshoot data-related defects and inconsistencies

• Develop and maintain automated data validation frameworks using Python, PySpark, and Pandas
• Create reusable automation utilities to improve testing efficiency
• Support continuous improvement of test automation capabilities

• Validate data pipelines built on Azure Data Factory (ADF)
• Test data processing and storage solutions on Azure Databricks and Azure Data Lake
• Ensure seamless integration between cloud-based data services

• Validate data exchange across integrated applications and services
• Perform API testing using tools such as Postman

• Manage the complete defect lifecycle, from identification through closure
• Collaborate closely with development and integration teams to resolve issues effectively

• Track and report testing progress, quality metrics, risks, dependencies, and blockers
• Provide regular status updates to project stakeholders
• Work closely with developers, business analysts, product owners, and business users

• Identify quality risks proactively and drive mitigation plans
• Ensure compliance with organizational QA standards, processes, and governance practices

Bachelor's or Master's Degree in Computer Science, Information Technology, Data Engineering, or a related technical discipline

Strong analytical and problem-solving skills

Attention to detail and quality focus

Ownership and accountability

Effective stakeholder management

Excellent verbal and written communication skills

Proactive risk identification and mitigation

Strong experience in data-centric testing environments

Exposure to cloud-based data platforms and modern data architectures

Ability to independently lead testing activities and coordinate with stakeholders

Interest in emerging AI-driven testing approaches

#Quality Engineer #ETLTesting #Big Data #Azure Jobs #SQLJobs #Data Validation #Hiring Now #Test Automation #PySpark #Databricks #Tech Careers