Engineer, Data Engineer

Skill:
Java/Hadoop/Python Developer

Must Have Technical/Functional

Skills:

* Part of a full stack agile team supporting Pega, Java, ETL, Data Engineers, VB (.NET), and Mainframe development.

* Actively participate in all Agile ceremonies, including daily stand-ups, sprint planning, and retrospectives.

Flex/Nice-to-Have

Skills:

* Experience with Medallion Architecture a plus.

* Experience in Containerization (Kubernetes / Docker) a plus.

* Experience with Marketing applications (Pega, Salesforce, Adobe, Zafin, Naehas) is a plus.

* Experience with Visual Basic (.NET) a plus.

* Experience with SaaS based solutions a plus.

* Financial Services industry knowledge.

Roles & Responsibilities :

* Design, develop, and optimize scalable big data solutions using Hadoop and related technologies to support business analytics and data processing requirements.

* Write and maintain complex SQL queries for data extraction, transformation, and reporting across multiple large datasets.

* Develop, test, and deploy data pipelines utilizing Python, PySpark, and Informatica to automate data ingestion, transformation, and integration processes.

* Leverage Git Hub for version control and collaborative development, ensuring code quality and adherence to best practices.

* Implement and manage data streaming and messaging solutions using Kafka for real-time data processing and integration.

* Troubleshoot and resolve issues in big data environments, optimizing performance and reliability of data platforms.

* Collaborate with cross-functional teams to gather requirements, design data models, and support advanced analytics initiatives.

* Ensure data security, governance, and compliance standards are met within all data engineering processes.

* Familiarity with tools like Jira, Confluence, Alation.

Salary Range - $115,000-$120,000 a year

TCS Employee Benefits

Summary:

* Discretionary Annual Incentive.

* Comprehensive Medical Coverage:
Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.

* Family Support:
Maternal & Parental Leaves.

* Insurance Options:
Auto & Home Insurance, Identity Theft Protection.

* Convenience & Professional Growth:
Commuter Benefits & Certification & Training Reimbursement.

* Time Off:
Vacation, Time Off, Sick Leave & Holidays.

* Legal & Financial Assistance:
Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.