AWS Databricks Engineer C2C Raritan, NJ

Role – AWS Databricks Engineer (AWS Databricks not Azure Databricks)

Location:

Raritan, NJ

Contract

We are looking for an experienced AWS Databricks Platform Administrator with 5+ years of experience in cloud Databricks on AWS. This role is responsible for managing, securing, automating and optimizing the Databricks Platform and governance needs. The ideal candidate should have hands‑on experience in AWS Infrastructure, IAM, Unity Catalog Support.

• Administer and manage Databricks work spaces in AWS environments.
• Configure, implement, and maintain secure Unity access to data stored in Amazon S3 using IAM roles, instance profiles, and trust policies.
• Define and enforce Catalog including catalogs, schemas, tables, storage credentials, and external locations.
• Monitor cluster performance, cluster policies, access controls and workspace standards to ensure security and compliance.
• Automate platform provisioning usage trends and platform health, and drive cost optimization through autoscaling tags.
• Troubleshoot and configure infrastructure using Infrastructure as Code tools such as Terraform; handle production issues related to clusters, permissions, storage access, networking, and job failures.
• Support and collaborate with data engineering, security, cloud infrastructure, and support teams to ensure platform reliability, release management, upgrades, new feature enablement, and platform best practices adoption.
• Create and maintain operational documentation, SOPs and runbooks for platform administration.

• 5–7 years of overall IT experience with strong hands‑on experience in Databricks administration on AWS.
• Good understanding of AWS services including IAM, S3, EC2, VPC, Cloud Watch and related security controls.
• Hands‑on experience with Unity Catalog and enterprise data governance practices.
• Strong knowledge of Databricks cluster management, workspace administration, job monitoring and access management.
• Experience in Infrastructure as Code using Terraform and scripting using Python, Shell, or Bash.
• Knowledge of CI/CD release management and environment migration processes for platform changes.