Data Engineer

The Data Engineer should possess a strong background in INCORTA Data Warehouse Platform, data integration, various ETL Platforms and processes (Informatica, Collibra, Data Sentinel, ERWIN), and business intelligence to deliver scalable and efficient data solutions. The candidate preferred to have Techno-Functional skillsets and the ability to collaborate cross-functionally with other members in the Data Management Office Team and with IT and Business Teams to gather requirements, leveraging skills and experience to create end-to-end solutions, from data acquisition and modeling to reporting and visualization.

• Design, develop, and maintain robust ETL processes to extract, transform, and load data from various sources into our INCORTA data warehouse.
• Monitor and optimize ETL jobs for performance, reliability, and scalability, implementing best practices for data processing.
• Ensure high level of data quality and integrity through data validation, cleansing, and transformation processes.
• Follow and apply data quality and governance best practices to maintain data accuracy and compliance with organizational standards.
• Troubleshoot and resolve ETL job failures and data quality issues, documenting solutions and maintaining technical documentation.
• Participate in business meetings to gather requirements and translate them into technical specifications for ETL/data pipelines and data models.
• Ensure proper configuration management and change controls are implemented.
• Work closely with offshore team(s) and participate in scrum calls.
• Understand Data Sources and Data Modeling concepts to develop and enhance the existing Data Warehouse.
• Troubleshoot data issues and performance bottlenecks in systems.
• Understand normalized and star-schema physical models and logical modeling concepts
• Participate in full Software Development Life Cycle (SDLC).
• Collaborate with cross-functional teams and Business Data Stewards to understand data requirements and deliver solutions.
• Provide support as required to ensure the availability and performance of developed reports and dashboards for both external and internal users.
• Stay updated on industry trends and emerging technologies in data engineering.

• Bachelor's in Computer Science, Engineering, or related field.
• Professional certifications in Data Engineering, ML Languages, BI and Analytics are a plus.

• Minimum 3 years of experience in data engineering or related fields.
• Proven experience in data engineering, ETL development, or database management.
• Strong understanding of data modeling, database design, and data warehousing concepts.
• Proficiency in SQL and experience working with relational and non-relational databases.
• Familiarity with big data technologies such as Spark, Hadoop, or Kafka.
• Experience with cloud platforms like GCP, AWS, Azure or OCI.
• Understanding of software engineering principles and version control systems.

• Proficient in programming languages such as Python, R, Java, or Scala.
• Hands-on experience with data processing frameworks like Apache Spark.
• Knowledge of data integration tools like INCORTA ETL, Informatica, Collibra, or Data Sentinel.
• Ability to work with both structured, semi-structured, and unstructured data.
• Experience in implementing data security, protection and compliance measures.

• Strong analytical and problem-solving skills.
• Excellent communication and teamwork abilities.
• Attention to detail and a proactive approach to identifying and resolving issues.
• Ability to work in a fast-paced, dynamic environment and handle multiple priorities.

• Detail-oriented and data-driven.
• Ability to work independently and take initiative.
• Continuous learning mindset to adapt to evolving technologies and best practices.
• Strong ethical standards and integrity.