Azure Databricks Admin

Azure Databricks Administrator

Location:

United States (Remote)

Cognizant (Nasdaq: CTSH) engineers modern businesses. We help our clients modernize technology, reimagine processes, and transform experiences so they can stay ahead in a rapidly changing world. Together, we deliver digital solutions that drive measurable business outcomes across industries.

At Cognizant, you'll work with industry-leading professionals, cutting-edge technologies, and some of the world's most recognized organizations while advancing your career in a collaborative and inclusive environment.

Cognizant is seeking a highly skilled Azure Databricks Administrator to join our growing Cloud, Data & AI practice. This role is responsible for the administration, governance, security, optimization, and operational support of enterprise-scale Azure Databricks environments.

The ideal candidate will possess deep expertise in Azure Databricks, Unity Catalog, Azure networking, security, data governance, and platform operations. This individual will serve as a technical leader and trusted advisor, partnering with engineering, infrastructure, security, and operations teams to ensure a scalable, secure, and high-performing data platform.

Remote - United States

• Design, deploy, and administer Azure Databricks work spaces utilizing VNet injection, private endpoints, and secure cluster connectivity.
• Configure and maintain cluster policies, Databricks Runtime versions, autoscaling, and workload management standards.
• Optimize platform performance through cluster tuning, Spark configuration management, and Delta Lake best practices.
• Perform capacity planning and resource forecasting to support enterprise growth.
• Drive cost optimization initiatives including right-sizing, auto-termination policies, reserved instances, and spot instance utilization.
• Troubleshoot and resolve complex platform, cluster, job execution, and connectivity issues.

• Design, implement, and administer Unity Catalog metastores, catalogs, schemas, external locations, and volumes.
• Establish and enforce fine-grained access controls across enterprise data assets.
• Support data lineage tracking, auditing, and governance requirements.
• Govern managed and external data assets while promoting best practices for data management.

• Integrate Azure Databricks with Microsoft Entra  authentication and Single Sign-On (SSO).
• Configure and manage SCIM provisioning for automated user and group lifecycle management.
• Implement secure secret management using Azure Key Vault-backed secret scopes.
• Define and manage access controls across Unity Catalog, Databricks work spaces, and Azure Data Lake Storage Gen
  2.
• Support security audits, compliance reviews, and governance initiatives.

• Architect and maintain secure networking solutions utilizing VNets, NSGs, private endpoints, and firewall controls.
• Ensure secure connectivity between Databricks, Azure services, and on-premises environments.
• Manage DNS resolution, routing configurations, and network security best practices.

• Design and implement Azure Data Factory (ADF) integration patterns with Azure Databricks.
• Support orchestration of enterprise data pipelines and notebook execution workflows.
• Partner with Dev Ops teams to establish and maintain CI/CD pipelines.
• Utilize Databricks REST APIs and automation frameworks to streamline platform administration.

• Provide guidance on Azure Data Lake Storage Gen2 architecture and configuration.
• Implement secure access patterns using service principals, credential passthrough, and Microsoft Entra n.
• Troubleshoot storage connectivity and access management issues.

• Implement monitoring and alerting using Azure Monitor, Log Analytics, and Databricks native monitoring tools.
• Monitor service availability, platform health, resource utilization, and job performance.
• Support disaster recovery, business continuity, and resiliency planning efforts.
• Plan and coordinate Databricks Runtime upgrades and platform maintenance activities.
• Communicate service impacts and operational risks to stakeholders.

• Develop and maintain architecture documentation, diagrams, standards, and operational runbooks.
• Establish best practices for platform governance, security, cost optimization, and performance management.
• Provide technical guidance, training, and knowledge transfer to internal teams.

• Collaborate with data engineering, data science, infrastructure, networking, security, and operations teams.
• Act as the subject matter expert for Databricks platform administration and governance.
• Participate in architecture reviews and provide technical leadership for strategic initiatives.

• Bachelor's degree in Computer Science, Information Technology,…