Databricks Data Engineer - Senior - Consulting

Position: Databricks Data Engineer - Senior - Consulting - Location Open 1

Databricks Data Engineer - Senior - Consulting

EY is looking for a Senior Data Engineer with expertise in cloud data engineering, specifically Databricks. The role focuses on delivering end-to-end analytics solutions that drive business value and involves client management, technical specification, and data pipeline development.

Key Responsibilities

• Designing, building, and operating scalable on‑premises or cloud data architecture.
• Analyzing business requirements and translating them into technical specifications.
• Optimizing data flows for target data platform designs.
• Developing data engineering solutions using Databricks on cloud platforms (AWS, Azure, GCP).
• Collaborating with clients to understand their data needs and provide tailored solutions.
• Leading end‑to‑end data pipeline development, including ingestion, transformation, and storage.
• Ensuring data quality, integrity, and security throughout the data lifecycle.
• Providing technical guidance and mentorship to junior data engineers and team members.
• Communicating effectively with stakeholders, both technical and non‑technical, to convey complex data concepts.
• Managing client relationships and expectations to ensure high satisfaction and engagement.
• Staying updated with the latest trends and technologies in data engineering and cloud computing.

Skills and Attributes for Success

• Strong analytical and decision‑making skills.
• Proficiency in cloud computing and data architecture design.
• Experience in data integration and security.
• Ability to manage complex problem‑solving scenarios.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, or related field (4‑year degree). Master’s degree preferred.
• 5+ years of experience in data engineering with a focus on cloud solutions.
• Expertise in Databricks and experience with Spark for big data processing.
• Proven experience in at least two end‑to‑end data engineering implementations, including data lake and real‑time pipelines.
• Strong programming skills in Python, Scala, or SQL.
• Experience with data modeling, ETL processes, and data warehousing concepts.
• Excellent problem‑solving skills and ability to work independently and as part of a team.
• Strong communication and interpersonal skills, with a focus on client management.

Required Expertise for Senior Consulting Projects

• Strategic Thinking:
  Align data engineering solutions with business strategies and objectives.
• Project Management:
  Manage multiple projects simultaneously, ensuring timely delivery and scope adherence.
• Stakeholder Engagement:
  Engage with executives and stakeholders to understand needs and present solutions effectively.
• Change Management:
  Guide clients through change related to data transformation and technology adoption.
• Risk Management:
  
  Identify potential risks and develop mitigation strategies.
• Technical Leadership:
  Lead technical discussions and make architectural decisions that impact project outcomes.
• Documentation & Reporting:
  Create comprehensive documentation and reports to communicate project progress to clients.

Desired Additional Experience

• Data quality management.
• Semantic layers in data architecture.
• Familiarity with AWS, Azure, GCP data services.
• Knowledge of data governance and compliance standards.
• Experience with machine learning frameworks and tools.

What We Look For

Top performers who are technically proficient, adaptable, collaborative, and driven to achieve excellence in every project.

Compensation and Benefits

• Competitive base salary (US: $106,900 – $176,500, NYC/CA: $128,400 – $200,600). Total rewards include medical, dental, pension, 401(k), and paid time off.
• Flexible hybrid working model (40–60% onsite).
• Generous vacation policy and multiple leave options.

Equal Employment Opportunity

EY is an equal opportunity employer and provides reasonable accommodation to qualified individuals with disabilities. For more information on accommodations, contact EY Talent Shared Services.

Apply Today

EY accepts applications on an ongoing basis. Apply online to start shaping your future with confidence.

#J-18808-Ljbffr