Quality Data Engineer; IDMC

Overview

In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.

• Design, develop, and execute test plans and test cases for data pipelines and workflows built with IDMC.
• Perform data validation and transformation testing to verify completeness, consistency, and accuracy between source and target.
• Develop and maintain automated data validation frameworks using Python, SQL, and IDMC’s built-in tools and APIs.
• Implement data quality rules and support continuous integration through CI/CD pipelines.
• Collaborate with development, operations, and infrastructure teams to identify and resolve data quality issues.
• Document test plans, results, and findings in a structured and traceable manner.
• Support testing activities related to data migration, profiling, analysis, and transformation.
• Manage defect tracking and reporting, ensuring timely resolution and clear communication.
• Contribute to process improvements and testing best practices within an Agile environment.
• Apply IDMC coding skills, including creating end-to-end mappings with Filters, Routers, and Joiners.
• Work with JSON structures, filters, and parsers to validate and transform data.
• Apply basic Java knowledge to support custom code requirements.
• Use Python to read and process data from various file formats, leveraging functions and libraries such as Pandas.

• Associate’s Degree or College Diploma.
• Strong background in Informatica Intelligent Data Management Cloud (IDMC).
• Solid expertise in SQL for data validation and transformation.
• Proven ability to design and execute data test plans, scenarios, and cases with clear documentation of results.
• Experience with Azure Cloud technologies such as ADF and PySpark.
• Proficiency in Python and data libraries (e.g., Pandas).
• Ability to interpret and create System & Architecture diagrams.
• Strong collaboration skills and ability to work effectively in cross‑functional teams.
• Background in Agile methodologies and continuous improvement practices.
• Minimum 6+ years of software product development and delivery experience.
• Minimum 5+ years of SQL experience.
• Minimum 3+ years of IDMC tool or related experience.
• Minimum 3+ years of experience overseeing the development of data test plans, test scenarios, test cases, and documentation of test results.
• Minimum 2+ years of experience with Azure Cloud tools (ADF, PySpark).
• Experienced with Python and libraries like Pandas.
• Familiar with latest cloud technologies.
• Familiarity with Java basics for writing simple code.

• Experience in reading files and processing data from various file formats.

• Job Title:
  
  Quality Data Engineer
• Job
• City / Township / Village:
• State / Province:
• Country:
• Work arrangement:
  Hybrid
• Area of work:
  Software Engineering
• Employment type:
  
  Regular
• Contract type:
  Regular
• Position type:
  Professional
• No Travel
• Company:
• Shift: General (daytime)
• Is this role a commissionable/sales incentive based position?:

IBM is proud to be an equal‑opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, neurodivergence, age, or other characteristics protected by the applicable law. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.