Engineer, Data Engineer

Join to apply for the Engineer role at Tata Consultancy Services.

Salary Range - $100,000-$115,000 a year.

• Apache Kafka:
  Deep understanding of Kafka's architecture, components, and functionality.
• SQL:
  Experience with SQL for data validation and debugging.
• ETL:
  Experience with ETL processes and data warehousing concepts.
• Test Automation:
  Experience in developing and maintaining automated tests for data pipelines.
• Data Analysis:
  Ability to analyze data, identify issues, and propose solutions.
• Communication:
  Strong communication and collaboration skills are essential for working with development teams.
• Data Pipeline Testing:
  Designing and executing test cases for ETL (Extract, Transform, Load) workflows and data validation, focusing on both batch and streaming data.
• Data Validation:
  Validating data ingestion, transformation, and loading processes within Kafka, ensuring data quality, consistency, and completeness across systems.
• Kafka Expertise:
  Hands‑on experience with Apache Kafka for data streaming validation, including working with producers, consumers, and understanding Kafka's architecture and concepts.
• Scripting and Automation:
  Proficiency in Python or other scripting languages for automating testing of data pipelines and maintaining test scripts.
• Issue Resolution:
  Collaborating with developers to identify, analyze, and resolve data issues, performing root‑cause analysis, and proposing solutions.
• Performance Testing:
  Evaluating the performance and scalability of Kafka-based systems, ensuring they can handle the expected data volume and throughput.
• Agile/Scrum:
  Understanding and working within Agile/Scrum methodologies and participating in testing activities within the development lifecycle.
• Data Warehousing:
  Familiarity with data warehousing concepts and cloud data platforms is often a plus.

• Designing and executing test cases for ETL workflows and data validation, focusing on both batch and streaming data.
• Validating data ingestion, transformation, and loading processes within Kafka, ensuring data quality, consistency, and completeness across systems.
• Hands‑on experience with Apache Kafka for data streaming validation, including working with producers, consumers, and understanding Kafka's architecture and concepts.
• Proficiency in Python or other scripting languages for automating testing of data pipelines and maintaining test scripts.
• Collaborating with developers to identify, analyze, and resolve data issues, performing root‑cause analysis, and proposing solutions.
• Evaluating the performance and scalability of Kafka‑based systems, ensuring they can handle the expected data volume and throughput.
• Understanding and working within Agile/Scrum methodologies and participating in testing activities within the development lifecycle.
• Familiarity with data warehousing concepts and cloud data platforms is often a plus.

BACHELOR OF COMPUTER SCIENCE

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage:
  Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support:
  Maternal & Parental Leaves.
• Insurance Options:
  Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth:
  Commuter Benefits & Certification & Training Reimbursement.
• Time Off:
  Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance:
  Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

• Seniority level:
  Entry level
• Employment type:
  
  Full-time
• Job function:
  Engineering and Information Technology
• Industries: IT Services and IT Consulting