Senior Specialist - Data Engineering

AWS Databricks Platform Support Architect Location :
Raritan, New Jersey Work Mode : 4 days work from office

Role Summary Lead the administration support governance and optimization of enterprise Databricks platforms on AWS Responsible for platform reliability security automation performance and production support

Key Responsibilities Architect and support AWS Databricks environments across Dev QA UAT and Prod Manage Databricks work spaces clusters jobs workflows Unity Catalog and access controls

Provide L2 L3 production support incident management and root cause analysis

Implement governance security IAM RBAC monitoring and compliance controls

Optimize platform performance scalability and cloud costs

Automate deployments using Terraform CICD and Infrastructure as Code Collaborate with Data Engineering Cloud and Security teams on platform enhancements

Required Skills Databricks Workspace Administration Unity Catalog Delta Lake Cluster Management Jobs Workflows AWS S3 IAM EC2 Lambda Glue Cloud Watch VPC Secrets Manager Data Technologies Spark PySpark SQL Data Lake Lakehouse Architecture Dev Ops  Terraform Git Hub Jenkins Azure Dev Ops CICDProgramming Python PySpark Shell Scripting Qualifications
10 years in IT with 4 years of Databricks administration support

Hands-on experience with AWS cloud platforms and enterprise production support

Strong troubleshooting stakeholder management and leadership skills

Preferred Certifications AWS Solutions Architect Professional AWS Data Engineer Associate Databricks Certified Professional Admin Terraform Associate