Data Engineer

Overview

Responsible for creating reliable software programs for building highly scalable data pipelines to collect a large amount of data from different sources and transform it into a usable format for analysis.

• Construct, deploy, test and maintain highly scalable and optimized data pipelines with state-of-the-art monitoring and logging practices.
• Develop software programs or use tools to bring together large, complex and sparse data sets to meet functional and non-functional business requirements and use a variety of languages, tools and frameworks to marry data.
• Design and implement data tools for analytics and data scientist team members to help them in building, optimizing and tuning of use cases.
• Develop and manage data warehouses to ensure the availability, performance, scalability and security of production data warehouse.
• Develop software programs or use tools for cleansing and harmonization of data from a variety of data sources.

• Bachelor’s Degree in IT with minimum 4 years of job-related experience.
• Hands-on experience in working with big data using Google Cloud, cloud-based data engineering solutions.
• Hands-on experience with data ingestion tools, data modelling, data visualization, and pipeline design & development.
• Hands-on experience with Big Query data warehouse platforms.
• Strong technical knowledge of performance tuning and query optimization on large data sets.
• Experience with ETL tools, data virtualization, semantic layer tools.
• Experience with visualization tools - Tableau, Power BI.