Databricks Administrator

Who We Are:

At Avnet, relationships matter. We are a global, FORTUNE 500 technology distributor and solutions company that delivers design, supply chain and logistics expertise to customers at every stage of a product’s lifecycle. Our employees have a front row seat to the latest innovations shaping the world we live in and the future we share. We’re driven to help our customers around the world succeed and we do so by earning the trust of some of the biggest names in technology.

Working at Avnet means being a part of a global team. We work collaboratively and with integrity, doing business the right way. For more than a century, we have partnered together to help our customers, suppliers and teammates realize the transformative possibilities of technology. Experience what’s next at Avnet!

Develops, maintains, and enhances cloud-based data platform solutions and business applications with a focus on Databricks, Apache Spark, Delta Lake, and modern data engineering practices. Collaborates with data engineers, data scientists, analysts, business stakeholders, and technology teams to validate requirements, assess available technologies, and recommend scalable, secure, and cost-effective platform solutions. Designs and supports Databricks work spaces, clusters, job workflows, data pipelines, governance controls, and automation capabilities to meet business and technical objectives.

• Designs, deploys, configures, and manages Databricks work spaces, clusters, jobs, workflows, and related platform components in a cloud environment such as AWS, Azure, or GCP.
• Builds, maintains, and optimizes scalable data pipelines using Apache Spark, PySpark or Scala Spark, Delta Lake, SQL, and medallion architecture patterns including Bronze, Silver, and Gold layers.
• Uses data engineering methodologies, programming languages, infrastructure tools, and solution design techniques to develop reliable, secure, and performant data platform solutions that meet business specifications.
• Implements and enforces data platform governance standards, including workspace administration, access controls, Unity Catalog, data lineage, security policies, and platform best practices.
• Validates functional requirements, builds technical specifications, and develops application, platform, architecture, and operational documentation.
• Performs analysis, design, development, testing, deployment, and support of data pipelines, platform workflows, and application components to solve business and technical requirements.
• Integrates new or enhanced Databricks platform capabilities, data processing components, orchestration tools, CI/CD pipelines, and cloud services into existing data environments.
• Optimizes Spark jobs, cluster configurations, storage patterns, and workflow designs for performance, reliability, scalability, and cost efficiency.
• Monitors platform health, troubleshoots production issues, supports incident resolution, and recommends corrective actions to improve platform stability and operational performance.
• Automates infrastructure provisioning and platform configuration using Terraform or similar infrastructure-as-code tools.
• Contributes to CI/CD processes for data workflows and platform deployments using tools such as Git Hub Actions, Azure Dev Ops, Git, or similar development workflow technologies.
• Collaborates with data engineers, data scientists, analysts, architects, and business stakeholders to understand platform needs and deliver appropriate solutions.
• Develops conversion, migration, and system implementation plans for new or enhanced data platform capabilities.
• Supports change readiness initiatives, release planning, platform adoption, and communication of standards or best practices as needed.
• Other duties as assigned.

• Applies advanced knowledge of data engineering, cloud platforms, Databricks administration, Spark-based processing, Delta Lake, and platform engineering practices. May serve as a subject matter resource for Databricks platform capabilities, standards, and best practices.
• Develops solutions to complex technical and business problems involving data pipelines,…