Databricks AWS Platform Architect; Onsite

Databricks On AWS Platform Architect (Onsite)

Location:

Dallas, TX

Duration: 7 Months

Interview Type:
Virtual / In-Person

Note:

Local to client site preferred within about an hour drive;
San Antonio is the first preference, with Lexington, KY or Princeton, IN also noted

Job Description:

Architect and manage a secure, scalable, and highly available Databricks Lakehouse Platform on AWS. Design data platforms leveraging AWS S3, Delta Lake, Unity Catalog, and Databricks Work spaces for enterprise analytics and AI. Define networking architecture including VPC, Private Link, IAM roles, security groups, and encryption standards. Establish multi-environment strategies (Dev, Test, UAT, Prod) with automated provisioning through Terraform and Infrastructure as Code (IaC).

Implement enterprise-wide data governance, lineage, metadata management, and compliance controls using Unity Catalog. Design high-performance data ingestion and processing architectures supporting batch, streaming, and real-time analytics workloads. Enable AI and GenAI capabilities through Mosaic AI, Vector Search, Model Serving, AI/BI Dashboards, and Genie Spaces. Define CI/CD, monitoring, logging, and observability frameworks using Git Hub, Jenkins, Cloud Watch, and Databricks Workflows.

Optimize platform performance, reliability, scalability, and cloud costs through Fin Ops and workload optimization practices. Provide architectural leadership and best practices for Lakehouse modernization, advanced analytics, AI governance, and enterprise data platform adoption.

Core Technologies:
Databricks, AWS S3, Delta Lake, Unity Catalog, Spark/PySpark, Terraform, Git Hub, CI/CD, Cloud Watch, Mosaic AI, Genie, Vector Search, MLflow, Kafka, Airflow, Kubernetes.

Certification:
Data Bricks Platform Administrator /Databricks Certified Data Engineer/AWS Certification (Dev Ops/Solution Architect) Terraform

Deliverables:

• Process Flows
• Mentor and Knowledge transfer to client project team members
• Participate as primary, co and/or contributing author on any and all project deliverables associated with their assigned areas of responsibility
• Participate in data conversion and data maintenance
• Provide best practice and industry specific solutions
• Advise on and provide alternative (out of the box) solutions
• Provide thought leadership as well as hands on technical configuration/development as needed.
• Participate as a team member of the functional team
• Perform other duties as assigned.

Top Skills & Years of

Experience:

• Databricks on AWS Platform Engineering and Platform Architecture experience.
• Architect and manage secure, scalable, and highly available Databricks Lakehouse platforms on AWS.
• Design enterprise data platforms leveraging AWS S3, Delta Lake, Unity Catalog, and Databricks Work spaces for analytics and AI.
• Define networking architecture including VPC, Private Link, IAM roles, security groups, and encryption standards.
• Establish multi-environment strategies across Dev, Test, UAT, and Production using Terraform and Infrastructure as Code (IaC).
• Implement enterprise data governance, lineage, metadata management, and compliance controls using Unity Catalog.
• Design high-performance data ingestion and processing architectures supporting batch, streaming, and real-time analytics workloads.
• Enable AI and GenAI capabilities through Mosaic AI, Vector Search, Model Serving, AI/BI Dashboards, and Genie Spaces.
• Define CI/CD, monitoring, logging, and observability frameworks using Git Hub, Jenkins, Cloud Watch, and Databricks Workflows.
• Optimize platform performance, reliability, scalability, and cloud costs through Fin Ops and workload optimization practices.
• Provide architectural leadership for Lakehouse modernization, advanced analytics, AI governance, and enterprise data platform adoption.