Databricks Sr. Developer​/Lead​/Architect

We are seeking a skilled and experienced Databricks Developer / Architect to join our dynamic team. The ideal candidate will have a strong background in data engineering, analytics, and cloud computing. You will be responsible for designing, implementing, and maintaining data pipelines and analytics solutions using Databricks.

• Data Pipeline Development:
  Design, develop, and maintain scalable data pipelines using Databricks and Apache Spark.
• Data Integration:
  Integrate data from various sources, including databases, APIs, and cloud storage, into Databricks.
• Data Transformation:
  Perform data cleaning, transformation, and aggregation to prepare data for analysis and reporting.
• Performance Optimization:
  Optimize data processing workflows for performance and scalability.
• Collaboration:
  
  Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver high-quality solutions.
• Monitoring and Troubleshooting:
  Monitor data pipelines and workflows to ensure reliability and troubleshoot issues as they arise.
• Documentation:
  Create and maintain comprehensive documentation for data pipelines, processes, and best practices.

• Experience:
  
  3-10 years of experience in data engineering, data analytics, or a related field.
• Experience with data visualization tools (e.g., Tableau, Power BI).
• Familiarity with machine learning and data science workflows.

• Proficiency in Databricks and Apache Spark.
• Strong programming skills in Python, Scala, or Java.
• Experience with SQL and relational databases.
• Knowledge of cloud platforms (AWS, Azure, GCP) and their data services.
• Familiarity with data warehousing concepts and ETL processes.
• Understanding of big data technologies and frameworks.

• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Ability to work independently and as part of a team.
• Attention to detail and a commitment to quality.

• Bachelor’s degree in Computer Science, Information Technology, Data Science, or a related field (or equivalent experience).
• Certifications in Databricks or cloud platforms (e.g., Databricks Certified Associate Developer, AWS Certified Big Data – Specialty).

• Mid-Senior level

• Full-time

• Engineering and Information Technology

• IT Services and IT Consulting