Staff Engineer, Big Data

Overview

Company Description

We are a Digital Product Engineering company that is scaling in a big way! We build products, services, and experiences that inspire, excite, and delight. We work at scale — across all devices and digital mediums, and our people exist everywhere in the world (15000+ experts across 26 countries, to be exact). Our work culture is dynamic and non-hierarchical. We are looking for great new colleagues.

That is where you come in!

Job Description

Lead Consultant - Azure Data Platform Engineering & Ops

You will be responsible for architecting, implementing, and managing robust data solutions on the Microsoft Azure platform.

• Technical Leadership:
  Lead and mentor a team of data engineers and operations specialists, providing technical guidance, fostering skill development, and promoting a culture of excellence.
• Azure Data Architecture:
  Collaborate with stakeholders to design scalable and efficient data architectures using Azure services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Cosmos DB.
• Data Engineering:
  Oversee the development of data pipelines, ETL/ELT processes, and data integrations, ensuring data quality, optimal performance, and adherence to best practices.
• Platform Operations:
  Manage the day-to-day operation and maintenance of the Azure Data Platform, including monitoring, troubleshooting, and performance optimization.
• Automation and Dev Ops:
  Implement automation strategies and Dev Ops practices to streamline deployment, monitoring, and management of data solutions, ensuring efficient operations and rapid response to issues.
• Data Security and Compliance, Capacity Planning and Scalability, Collaboration and Communication, Performance Monitoring and Optimization.

• Must have
  
  Skills:
  
  Apache Spark, Azure Data Factory, Databricks.
• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• Extensive experience in data engineering, data architecture, and cloud platform operations, with a focus on the Microsoft Azure ecosystem.
• In-depth knowledge of Azure services such as Azure SQL Database, Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and Azure Cosmos DB.
• Proficiency in designing and optimizing data pipelines, ETL/ELT processes, and data integrations.
• Strong understanding of data governance, security best practices, and compliance standards in a cloud environment.
• Hands-on experience with automation, infrastructure as code (IaC), and Dev Ops principles.
• Excellent leadership and team management skills, with a proven ability to guide and inspire technical teams.
• Azure certifications such as Microsoft Certified:
  Azure Solutions Architect Expert or equivalent are highly desirable.