Platform Architect

ROLE OVERVIE

WWe are seeking an experienced Data Platform Lead for designing and implementation of an enterprise grade, AI-ready data platform — spanning cloud storage, data engineering pipelines, governance-ready data products, and GenAI / RAG workloads. The ideal candidate brings deep expertise with AWS-native services, Databricks, and modern data stack tools, with a strategic mindset to architect platforms delivering governed, AI consumable datasets at scale

• ES1. Storage & Platform Foundati
• on Architect the AWS Data Platform:
  Amazon S3, Athena, Redshift, and AWS Lake Formation for governed acce
• ss Design and operate Databricks Lakehouse (Delta Lake, Unity Catalog, Databricks Comput
• e)
  Ensure secure, scalable, and cost-optimized foundational infrastructure aligned to enterprise SL
• erLead data engineering pipelines using dbt (transformations & modeling) and Databricks (ML Runtime, Notebook
• s)
  Implement Data Quality & Testing using SODA; design Workflow Orchestration with monitoring and alerti
• ng Drive a shift-left engineering culture with reusable, well-documented pipeline

• ts Define and build domain-owned, AI-ready Data Products (Customer 360, Patient 360, Clinical, Commercial, Feature-Ready, and RAG-Ready dataset
• s)
  Champion a Data Mesh / Data Product mindset with clear ownership, SLAs, and discoverabili

• er Implement unified data governance using Atlan (Governance & Catalog) for discoverability, lineage, trust, and contr
• ol Establish end-to-end Data Lineage tracking (data to production) using classification taggi
• ng Define and enforce Policies & Access controls: RBAC/ABAC, PII/PHI tagging, sensitive data classification, and policy enforceme
• nt Drive AI Governance practices: AI data usage policies, model lineage, bias detection, and audit readine
• ss Ensure Quality & Trust standards: data quality SLAs, certification workflows, and DQ dashboar

• nt Architect data infrastructure supporting ML Models (predictive, prescriptive, optimization) and GenAI/RAG pipelin
• es Design pipelines for LLM apps, copilots, and knowledge search; support real-time Decision Syste
• ms Collaborate with domain teams to build Domain-Owned AI & ML models on governed, trusted da

• es Security & Compliance:
  End-to-end data security, IAM, encryption, and audit-ready regulatory compliance (HIPAA, GDPR, SOC
• 2)
  Monitoring & Observability:
  Platform-level data and model observability, pipeline health dashboar
• ds
  
  Collaboration:
  
  Tools and practices to connect people, knowledge, and data across the organizati

• rage
  10+ years of experience in data architecture and cloud platf
• orms
  
  Deep expertise with AWS services: S3, Athena, Redshift, Lake Formation, Glue,
• IAMProficiency in Databricks:
  Delta Lake, Unity Catalog, Databricks Workflows, ML
• flow Experience with data lakehouse architecture patterns and medallion architecture (Bronze / Silver / G
• ation
  
  Strong hands-on expertise with dbt (data build tool) for SQL-based transformations and data modeling
  
  Pipeline orchestration experience:
  Apache Airflow, Databricks Workflows, or equiv
• alent
  
  Data quality tooling: SODA, Great Expectations, or Monte
• Carlo Proficiency in Python, SQL, and
• Spark

• atalog
  
  Experience implementing data catalogs and governance tools (Atlan, Collibra, Alation, or equiv
• alent)
  Knowledge of data lineage, metadata management, classification fram
• eworks
  
  Understanding of RBAC/ABAC, PII/PHI regulations, and policy enforcement at the platform

• adiness
  
  Experience building Feature Stores and ML-ready datasets for model training and inf
• erence.
  
  Familiarity with RAG (Retrieval-Augmented Generation) architecture: chunking, embedding generation, vector
• stores
  
  Understanding of LLMOps, model observability, and AI governance fra
• meworks
  
  Experience with vector databases (Pinecone, Weaviate, pgvector, or Databricks Vector
• adership
  
  Proven ability to design and document enterprise data architecture using frameworks like TOGAF or
• Zachman Strong stakeholder engagement skills — ability to translate business needs into technical…