Principal Architect - Databricks

Job Summary

We are seeking a highly skilled Principal Data Architect to design and implement our next-generation data ecosystem. You will lead the technical strategy for end-to-end data management, data warehousing, and IoT ingestion pipelines. The ideal candidate brings mastery in cloud data platforms (Azure or AWS) and advanced data governance.

Data Architecture: Design Databricks-driven enterprise data warehousing (EDW), lakehouse, and business intelligence (BI) systems.

IoT & Stream Ingestion: Build scalable pipelines using Azure Hub, Device SDK, DPS, and Stream Analytics.

Data Management: Implement information lifecycle management (ILM) from data ingestion to archiving.

Data Strategy: Define, build, and enforce global data governance and master data management practices.

Dataset Creation: Extract and manipulate unstructured data into connected datasets for advanced analytics.

• Core Cloud Data Platform (Must Have)
  • Databricks: Strong proficiency in building optimized spark pipelines, delta lakes, and lake houses.
• Cloud Ecosystem (Option A: Azure Suite)
  • IoT Infrastructure: Azure Hub, Device SDK, Device Provisioning Services (DPS), and Device Twins.
  • Compute & Storage: Azure Functions, Cosmos DB, and Azure Stream Analytics.
• Cloud Ecosystem (Option B: AWS Alternative)
  • IoT Infrastructure: AWS IoT Core, IoT Device Management, and IoT Device Defender.
  • Compute & Storage: AWS Lambda, DynamoDB, Amazon Kinesis, and EMR.
• Data Engineering & Governance
  • BI & EDW: Deep expertise in enterprise data warehousing and business intelligence tools.
  • Data Modeling: Proven ability to manage both structured and unstructured data assets.
• Qualifications & Soft Skills
  • Communication: Ability to translate complex technical concepts clearly to diverse technical teams.
  • Collaboration: Demonstrated teamwork skills with a proven track record in cross‑functional environments.
  • Experience: Extensive background in end-to-end data management principles and data lifecycle execution.

Good to have-Experience in architecting and building Azure IoT platforms/apps with good exposure to containerization and server less architecture.

Significant career development opportunities exist as the company grows. The position offers a unique opportunity to be part of a small, challenging, and entrepreneurial environment, with a high degree of individual responsibility.

Tiger Analytics provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity/expression, pregnancy, national origin, ancestry, marital status, protected veteran status, disability status, or any other basis as protected by federal, state, or local law.