SDET, Data Engineering, AWS

Skills: Java, Groovy, Spock (preferred), JUnit, TestNG, AWS (Glue, S3, DynamoDB, Redshift), SQL databases, Data Lake concepts, Git, Git Lab, Agile/Scrum, with a continuous improvement mindset.

Education: Bachelor's degree or Master's in Information Technology, Computer Science, Information Systems, Computer Engineering.

Posted Date: 12/05/2024

Tentative Project

Start Date:

01/02/2025

Job Summary : We are seeking a senior SDET to own and drive end-to-end quality for our cloud-based data ingestion and processing pipelines. This role combines test strategy, automation development, and collaboration with engineering and delivery teams to ensure robust, scalable, and highly reliable data services built on AWS. The ideal candidate is hands-on, technically strong in Java/Groovy, proficient with AWS data services, and adept at designing maintainable test frameworks.

• 1. Develop and implement comprehensive test strategies for data ingestion, transformation, and analytics workflows in an AWS environment.
• 2. Design, build, and maintain automated test suites (API, end-to-end, integration, data validation, performance) using Java and Groovy.
• 3. Collaborate with product owners, software engineers, and data engineers to understand requirements and translate them into test plans and acceptance criteria.
• 4. Validate data quality and integrity across multiple data stores (S3, DynamoDB, Redshift) and data processing pipelines (AWS Glue jobs, ETL workflows).
• 5. Create and maintain test data management practices, including synthetic data generation and seed data provisioning.
• 6. Write, optimize, and maintain complex SQL queries for data validation and reconciliation tasks.
• 7. Implement and maintain automated CI/CD pipelines (Git Lab) to enable rapid and reliable test execution in CI environments.
• 8. Contribute to the design and improvement of test frameworks (preferably Spock-based or equivalent Groovy/Java testing frameworks).
• 9. Perform exploratory testing and risk-based testing to identify edge cases and potential failures early in the SDLC.
• 10. Participate in code reviews, triage defects, and provide clear, actionable defect reports with reproducible steps.
• 11. Monitor and report test results, create dashboards, and communicate quality status to stakeholders.
• 12. Ensure compliance with security, privacy, and data handling standards relevant to cloud data platforms.

• 1.
  
  Experience:
  
  8 years in IT with a strong focus on Testing and Automation.
• 2. Programming:
  Proficient in Java and Groovy for test automation and framework development.
• 3. Cloud Platform:
  Strong experience testing in AWS environments; practical knowledge of AWS Glue, S3, DynamoDB, Redshift, and related services.
• 4. Data Testing:
  Expertise in data validation, data quality checks, schema validation, and end-to-end data pipelines.
• 5. Frameworks:
  Hands-on experience with Spock framework; familiarity with other JVM testing tools is a plus.
• 6. SQL:
  Advanced SQL skills for data verification, joins, aggregations, window functions, and performance considerations.
• 7. Version Control & CI/CD:
  Git Lab or similar CI/CD tooling; experience with pipelines, artifacts, and test automation integration.
• 8.
  
  Collaboration:
  
  Proven ability to work with cross-functional teams (developers, data engineers, product, operations) and drive quality decisions.
• 9. Communication:
  Strong written and verbal communication; ability to articulate test results, risks, and recommendations to stakeholders.

• 1. Experience with Redshift performance testing and data lakehouse concepts.
• 2. Familiarity with data modeling concepts and ETL/ELT patterns.
• 3. Experience with BDD/TDD approaches and test design techniques.
• 4. Knowledge of security testing practices related to data at rest/in transit.
• 5. Experience with containerization (Docker) and orchestration (Kubernetes) for test environments.

• 1. Build and maintain automated test suites (API, data, UI if applicable) using Java/Groovy.
• 2. Implement data validation checks across S3, DynamoDB, and Redshift; integrate with Glue job outcomes.
• 3. Design test data scenarios that cover typical, boundary, and failure modes.
• 4. Review user stories and acceptance criteria for testing implications; contribute to test plan and risk assessments.
• 5. Execute tests in CI pipelines, analyze failures, and drive root cause analysis.
• 6. Create and maintain test reports, metrics, and quality gates for…