More jobs:
Databricks Architect
Job in
Hackensack, Bergen County, New Jersey, 07601, USA
Listed on 2026-05-19
Listing for:
UnivEdge Consulting LLC
Full Time
position Listed on 2026-05-19
Job specializations:
-
IT/Tech
Data Engineer, Cloud Computing
Job Description & How to Apply Below
We are seeking a highly skilled Databricks Architect to lead the design and implementation of next-generation data platforms built on the Lakehouse paradigm.
This role goes beyond pipeline development—you will own the Databricks platform architecture end-to-end, driving scalability, governance, performance, and cost optimization across enterprise data ecosystems.
Architect and implement enterprise-scale Databricks environments (dev/test/prod)
Design secure, scalable Lakehouse architecture using Delta Lake
Build and optimize high-performance data pipelines using Apache Spark (PySpark / Scala)
Implement Medallion Architecture (Bronze, Silver, Gold)
Develop batch and real-time streaming pipelines using Structured Streaming
Governance, Security & Compliance- Implement fine-grained access control using Unity Catalog
- Define enterprise-wide data governance, lineage, and auditing
- Optimize workloads using partitioning, caching, and Photon engine
- Design cost-efficient cluster strategies (autoscaling, spot instances, DBU optimization)
- Monitor and improve query and pipeline performance at scale
- Integrate with cloud-native services (AWS S3/Glue, Azure ADLS/ADF, etc.)
- Experience with Agent bricks and AI agents at scale to build use cases
- Production and establish guardrails with AI use cases
- Advanced proficiency in SQL and Python
- Hands-on experience with Delta Lake, Medallion Architecture, and Unity Catalog
- Strong experience with at least one cloud platform (AWS / Azure / GCP)
- Experience with CI/CD tools (Azure Dev Ops, Jenkins, Git Hub Actions)
- Knowledge of workflow orchestration tools (Airflow or equivalent)
- Databricks certifications (Associate / Professional)
- Experience with Databricks SQL & dashboards
- Exposure to ML pipelines (MLflow)
- Experience with Kafka or event-driven architectures
- Domain experience in Finance / Retail / Healthcare
- Strong architectural mindset with ability to design scalable data platforms
- Deep understanding of performance tuning and cost optimization
- Ability to balance technical depth with business impact
- Excellent communication and stakeholder management skills
To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
Search for further Jobs Here:
×