Engineer, Data Engineer

Join to apply for the Engineer role at Tata Consultancy Services
.

• Maintain robust data pipelines for ingesting and processing data from various sources, including SFTP servers.
• Implement and manage automated SFTP data transfers, ensuring data security, integrity, and timely delivery.
• Configure and troubleshoot SFTP connections, including handling authentication, key management, and directory structures.
• Develop and maintain scripts or tools for automating SFTP-related tasks, such as file monitoring, error handling, and data validation.
• Collaborate with external teams and vendors to establish and maintain secure SFTP connections for data exchange.
• Ensure compliance with data security and governance policies related to SFTP transfers.
• Monitor and optimize SFTP performance, addressing any bottlenecks or issues.
• Document SFTP integration processes, configurations, and best practices.
• Responsible for providing monthly SOC controls.
• Experience with Solimar software.
• Responsible for period software updates and patching.
• Manage open incidents.
• Responsible for after-hours and weekends on-call duties.
• Minimum (3-5) years related work experience.
• Experience with Microsoft Software and associated server tools.
• Experience with Go Anywhere managed file transfer (MFT) solution.
• Experience with WinSCP.
• Experience with Azure Cloud.
• Proven experience in data engineering, with a strong emphasis on data ingestion and pipeline development.
• Demonstrated expertise in working with SFTP for data transfer and integration.
• Proficiency in scripting languages (e.g., Python, Shell) for automating SFTP tasks.
• Familiarity with various SFTP clients, servers, and related security protocols.
• Understanding of data security best practices, including encryption and access control for SFTP.
• Experience with cloud platforms (e.g., AWS, Azure, GCP) and their SFTP integration capabilities is a plus.
• Strong problem-solving and troubleshooting skills related to data transfer and integration issues.

Salary Range: $80,000-$95,000 a year

BACHELOR OF COMPUTER SCIENCE

Mid-Senior level

Full-time

Engineering and Information Technology

IT Services and IT Consulting