Databricks Data Engineer - Senior - Consulting

Position: Databricks Data Engineer - Senior - Consulting - Location Open 1

Databricks Data Engineer - Senior - Consulting

Location: Anywhere in Country

Company: EY

Overview

We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. The ideal candidate will have strong client management and communication skills, along with a proven track record of successful end‑to‑end implementations in data engineering projects.

Opportunity

In this role, you will design and build analytics solutions that deliver significant business value. You will collaborate with other data and analytics professionals, management, and stakeholders to ensure that technical requirements align with business needs. Your responsibilities will include creating scalable data architecture and modeling solutions that support the entire data asset lifecycle.

Key Responsibilities

• Design, build, and operate scalable on‑premises or cloud data architecture.
• Analyze business requirements and translate them into technical specifications.
• Optimize data flows for target data platform designs.
• Design, develop, and implement data engineering solutions using Databricks on cloud platforms (e.g., AWS, Azure, GCP).
• Collaborate with clients to understand their data needs and provide tailored solutions that meet their business objectives.
• Lead end‑to‑end data pipeline development, including data ingestion, transformation, and storage.
• Ensure data quality, integrity, and security throughout the data lifecycle.
• Provide technical guidance and mentorship to junior data engineers and team members.
• Communicate effectively with stakeholders, including technical and non‑technical audiences, to convey complex data concepts.
• Manage client relationships and expectations, ensuring high levels of satisfaction and engagement.
• Stay updated with the latest trends and technologies in data engineering and cloud computing.

Skills and Attributes for Success

• Strong analytical and decision‑making skills.
• Proficiency in cloud computing and data architecture design.
• Experience in data integration and security.
• Ability to manage complex problem‑solving scenarios.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or a related field required (4‑year degree). Master’s degree preferred.
• 2‑4 years of relevant experience in data engineering with a focus on cloud data solutions (5+ years total in related roles).
• Expertise in Databricks and experience with Spark for big data processing.
• Proven experience in at least two end‑to‑end data engineering implementations.
• Strong programming skills in Python, Scala, or SQL.
• Experience with data modeling, ETL processes, and data warehousing concepts.
• Excellent problem‑solving skills and the ability to work independently and as part of a team.
• Strong communication and interpersonal skills, with a focus on client management.

Additional Expertise for Senior Consulting Projects

• Strategic thinking: align data engineering solutions with business strategies.
• Project management: manage multiple projects simultaneously, ensuring timely delivery.
• Stakeholder engagement: engage with executives to understand needs and present solutions.
• Change management: guide clients through change processes related to data transformation.
• Risk management:
  
  identify potential risks and develop mitigation strategies.
• Technical leadership: lead technical discussions and make architectural decisions.
• Documentation and reporting: create comprehensive documentation and reports to communicate progress.

Ideally You’ll Also Have

• Experience with data quality management.
• Familiarity with semantic layers in data architecture.
• Experience with cloud platforms (AWS, Azure, GCP) and their data services.
• Knowledge of data governance and compliance standards.
• Experience with machine learning frameworks and tools.

Benefits

• Competitive salary range and total rewards package including medical and dental coverage, pension and 401(k) plans, and paid time off options.
• Hybrid model: most external client roles work 40‑60% in person over the course of a year.
• Flexible vacation policy with time off for designated holidays, breaks, personal care, and other leaves.

Equal Employment Opportunity

EY provides equal employment opportunities to applicants and employees without regard to race, color, religion, age, sex, sexual orientation, gender identity, pregnancy, genetic information, national origin, protected veteran status, disability status, or any other legally protected basis, in accordance with applicable law. EY is committed to providing reasonable accommodation to qualified individuals with disabilities.

Application

EY accepts applications for this position on an on‑going basis. If you are ready to shape your future with confidence, apply today.

#J-18808-Ljbffr