Data Engineer IV

Overview

About The Role:

It’s a great time to join us at Airlines Reporting Corporation (ARC)! ARC accelerates the growth of global air travel by delivering forward-looking travel data, flexible distribution services and other innovative industry solutions. We are a leading travel intelligence company with the world’s largest, most comprehensive global airline ticket dataset, including more than 15 billion passenger flights. By working here, you can contribute to solutions and expertise that strengthen economies and enrich lives.

We think big, embrace challenges and explore new ideas to lead the way for the travel industry.

• Technical Leadership:
  Provide expert-level guidance and technical leadership to the development and platform engineering teams. Act as a subject matter expert in your domain. Demonstrate many of the skills associated with people leadership – communication, influence, relationship building, providing direction and coaching. Review table/object structures, queries, and performance. Be on call for incident response and production issues. Perform forensic analysis when necessary for breach and data loss situations.
• Design:
  Lead the design and software development process of complex data systems, ensuring scalable, efficient, and robust solutions. Ensure that data platforms and pipelines operate efficiently for ARC products, systems, and services. Understanding of multi-region database/data platform architectures (e.g., Aurora RDS, Redshift) and supporting performance, resiliency, and high availability in collaboration with Ops teams.
• Technology Evaluation:
  Explore, investigate, and recommend innovative tools, technologies, and platforms to enhance data infrastructure.
• Data Stra tegy:
  Define and implement data strategies, best practices, and standards across the organization.
• Data Governance:
  Develop and enforce data governance and compliance policies.
• Innovation:
  Stay up to date with emerging technologies, trends, and best practices in software engineering and data engineering. Recommend and implement new tools and technologies.
• Optimization:
  Continuously optimize data platform, data processes, data storage, codebase, and database performance.

• Bachelor’s Degree or equivalent work experience preferred; equivalent experience considered.
• 7+ years of experience designing and developing solutions for large-scale data systems, services, and platforms.
• 7+ years of experience with full cycle development (Full SDLC experience: design, development, delivery, etc.)
• 5+ years with Agile, Scrum, Dev Ops, and Continuous Integration and Continuous Delivery
• 7+ years of experience implementing modern data solutions using Cloud-based solutions and technologies - AWS developer environment including, but not limited to, Lambda, API Gateway, Security Groups, IAM Roles, Aurora (mySQL/Postres), S3, Cloudwatch, Secrets Manager
• Expert in implementing modern data and infrastructure design patterns, stream processing, building data pipelines, etc.
• Deep knowledge and experience with modern database technologies, platforms, and solutions including, but not limited to S3, Aurora, Python, Postgres, RDS, RDS Proxy, Red Shift, No
  
  Sql databases, DynamoDB, etc.
• Deep knowledge and experience with data warehouse platforms (such as Redshift, Snowflake, and Teradata).
• Deep knowledge and experience with SQL, database design/structures, ETL/ELT design patterns, and data mart structures
• Expertise level experience with ETL Tools such as Glue, Kenesis, Athena, Ab Initio (preferred), Informatica or Talend.
• Experience with data lake and data lakehouse concepts and design patterns
• Experience in data profiling and data analysis to investigate and validate data accuracy.
• Experience with BI Technologies (such as AWS Quick, PowerBI, Tableau, Jasper, Cognos, Qlik, Looker, Metabase, and others)
• Deep knowledge and experience with monitoring tools such as Datadog, Cloud Health, and the Atlassian Suite
• Experience in data management and data governance
• Excellent leadership skills and experience leading projects with other engineers.
• Proven ability to lead a group through an architectural development process and collaborate with…