Senior Data Engineer IRC

Description

Role description provided by client includes requirements, responsibilities, and benefits for a Big Data Platform Architect/Engineer.

• Total of 7+ years of development/design experience with a minimum of 5 years of experience in Big Data technologies on-prem or on cloud.
• Experience with architecting, building, implementing, and managing Big Data platforms On Cloud, covering ingestion (Batch and Real-time), processing (Batch and Real-time), Polyglot Storage, Data Analytics, and Data Access
• Good understanding of Data Governance, Data Security, Data Compliance, Data Quality, Meta Data Management, Master Data Management, Data Catalog
• Proven understanding and demonstrable implementation experience of big data platform technologies on cloud (AWS and Azure), including surrounding services like IAM, SSO, Cluster monitoring, Log Analytics etc
• Experience working with Enterprise Data Warehouse technologies, Multi-Dimensional Data Modeling, Data Architectures or other work related to the construction of enterprise data assets
• Strong Experience implementing ETL/ELT processes and building data pipelines, including workflow management, job scheduling, and monitoring
• Experience building stream-processing systems, using solutions such as Apache Spark, Databricks, Kafka etc.
• Experience with Spark/Databricks technology is a must
• Experience with Big Data querying tools
• Solid skills in Python
• Strong experience with data modelling and schema design
• Strong SQL programming background
• Excellent interpersonal and teamwork skills
• Experience to drive solution/enterprise-level architecture, collaborate with other tech leads
• Strong problem-solving, troubleshooting, and analysis skills
• Experience working in a geographically distributed team
• Experience with leading and mentoring other team members
• Good knowledge of Agile Scrum
• Good communication skills

• Work directly with the Client teams to understand the requirements/needs and rapidly prototype data and analytics solutions based upon business requirements
• Design, implement and manage large scale data platform/applications including ingestion, processing, storage, data access, data governance capabilities and related infrastructure
• Support Design and development of solutions for the deployment of data analytics notebooks, tools, dashboards and reports to various stakeholders
• Communication with Product/Dev Ops/Development/QA team
• Architect data pipelines and ETL/ELT processes to connect with various data sources
• Design and maintain enterprise data warehouse models
• Take part in the performance optimization processes
• Guide on research activities (PoC) if necessary
• Manage cloud based data & analytics platform
• Establishing best practices with CICD under Big Data scope

• Culture of caring. At Global Logic, we prioritize a culture of caring. Across every region and department, at every level, we consistently put people first. From day one, you ll experience an inclusive culture of acceptance and belonging, where you ll have the chance to build meaningful connections with collaborative teammates, supportive managers, and compassionate leaders.
• Learning and development. We are committed to your continuous learning and development. You ll learn and grow daily in an environment with many opportunities to try new things, sharpen your skills, and advance your career h our Career Navigator tool as just one example, Global Logic offers a rich array of programs, training curricula, and hands-on opportunities to grow personally and professionally.
• Interesting & meaningful work. Global Logic is known for engineering impact for and with clients around the world. As part of our team, you ll have the chance to work on projects that matter. Each is a unique opportunity to engage your curiosity and creative problem-solving skills as you help clients reimagine what s possible and bring new solutions to market.
  
  In the process, you ll have the privilege of working on some of the most cutting-edge and impactful solutions shaping the world today.
• Balance and flexibility. We believe in the importance of balance and flexibility. With many functional career areas, roles, and work arrangements, you can explore ways of achieving the perfect balance between your work and life. Your life extends beyond the office, and we always do our best to help you integrate and balance the best of work and life, having fun along the way!
• High-trust organization. We are a high-trust organization where integrity is key. By joining Global Logic, you re placing your trust in a safe, reliable, and ethical global company. Integrity and trust are a cornerstone of our value proposition to our employees and clients. You will find truthfulness, candor, and integrity in everything we do.

Global Logic, a Hitachi Group Company, is a trusted digital engineering partner to the world s largest and most forward-thinking companies. Since 2000, we ve been at the forefront of the digital revolution - helping create…