Azure Databricks Architect

Job Title

Azure Databricks Architect

Ap Task

About Client:
The Client is a leading global IT services and consulting company, providing a wide range of services to clients in various industries, including banking, financial services, retail, manufacturing, and healthcare. It is one of the largest employers in the IT industry and has a diverse workforce. The company places a strong emphasis on employee training and development and is known for its commitment to innovation and research and development.

It offers a comprehensive set of services, including:

• IT Services:
  Application development, maintenance, and testing.
• Consulting:
  Business consulting, IT strategy, and digital transformation.
• Business Process Outsourcing (BPO):
  Outsourcing of business processes to improve efficiency.
• Enterprise Solutions:
  Implementation and support of enterprise-level software solutions.
• Digital Services:
  Services related to digital technologies, such as analytics, cloud, and IoT.

• Proven experience as a Data Architect or similar role with extensive experience in designing and implementing solutions on Azure Databricks.

• Proficiency with Azure Databricks, Apache Spark, and data processing frameworks.
• Strong experience with Azure services (e.g., Azure Data Lake, Azure Synapse, Azure SQL).
• Familiarity with data modeling, ETL processes, and data warehousing concepts.
• Knowledge of programming languages such as Python, Scala, or SQL.

• Excellent problem‑solving and analytical skills.
• Strong communication and collaboration skills.
• Ability to manage multiple projects and prioritize tasks effectively.

• Azure Data Engineer or Azure Solutions Architect certifications.

• Architecture Design:
  Design and architect scalable and high‑performance data solutions on Azure Databricks, including data pipelines, data lakes, and real‑time processing systems.
• Implementation:
  Lead the implementation of Azure Databricks solutions, ensuring best practices for performance, security, and data governance.
• Integration:
  Integrate Azure Databricks with other Azure services such as Azure Data Lake Storage, Azure Synapse Analytics, and Azure SQL Database, as well as third‑party tools and data sources.
• Optimization:
  Monitor and optimize data workflows and queries for performance and cost efficiency.
• Collaboration:
  
  Work closely with data engineers, data scientists, and business stakeholders to understand requirements and deliver effective solutions.
• Governance:
  Ensure data governance and security policies are implemented and adhered to within the Databricks environment.
• Documentation:
  Create and maintain documentation for architecture, processes, and best practices.
• Mentorship:
  Provide guidance and mentorship to junior team members and help them with technical challenges.

$140 000 – $150 000 per year

Oakland, CA

Apply for this job now!