Senior Architect, Data Engineering

Overview

Are you ready to make an impact? West Monroe is seeking a Senior Architect to join our thriving Technology and Experience Practice. This is an excellent opportunity to work with clients developing Big Data strategy and roadmaps, while gaining exposure to a variety of industries including Healthcare, Financial Services, Insurance, Consumer & Industrial Products, and Energy & Utilities.

Responsibilities

• Provide guidance and platform selection advice for Databricks, Snowflake, and/or Microsoft Fabric
• Design data flow and processing pipelines for analysis using modern toolsets such as Spark on Scala, Storm, Flume, Sqoop
• Design data structures for ingestion and reporting, specific to use case and technology
• Provide data management expertise to our clients in evaluating requirements and developing data architecture and performing platform selection and design. Data management includes appropriate structuring, stewardship of data, semantics/syntax of data attributes, coding structures, and mapping schemes
• Architect and implement scalable AI/ML and Generative AI solutions leveraging modern data platforms such as Databricks, Snowflake, and Microsoft Fabric
• Design data architectures that enable AI/ML workloads through high-quality, governed, secure, and scalable data pipelines and lakehouse environments
• Guide and coach consultants, share best practices, perform code reviews
• Coordinate activities with data source application owners to ensure integration with analytics platform and source systems
• Ensure that data integrity issues are addressed
• Liaise and attend meetings necessary to perform duties and aid business and technical development
• Partner with business development teams to identify client needs, propose tailored solutions, and build long-term relationships with key stakeholders to drive growth opportunities
• Collaborate on crafting compelling proposals, presentations, and technical demonstrations that showcase innovative architecture solutions and align with client objectives to win new business.

Qualifications

• 10+ years of professional experience and 5+ within consulting ecosystem
• Very strong technical expertise in Databricks and/or Snowflake including modern lakehouse architecture, performance optimization, governance, orchestration, and enablement of AI/ML and Generative AI workloads
• Experience with modern AI frameworks and services such as Azure OpenAI, OpenAI APIs, Lang Chain, Semantic Kernel, MLflow, Mosaic AI, or comparable technologies
• Hands-on experience with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures
• Knowledge of standard methodologies, concepts, best practices, and procedures within a Big Data environment
• Development of or architecture of modern distributed architectures using modern messaging patterns and tools
• Strong data engineering experience with the following core competencies:
• Experience with Databricks, Snowflake, and/or Fabric
• Experience working with relational databases (Microsoft SQL Server) and working with large unstructured data sets
• Strong experience with ETL procedures and ideation from scratch
• Experience using cloud platforms such as AWS, Azure, GCP etc.
• Experience with reporting tools such as PowerBI and Tableau
• Working knowledge or experience working with Azure SQL, Azure Data Lake or Azure Data Factory.
• Excellent organizational, verbal and written communication skills
• A commitment to inclusion and diversity, and openness to new ideas and perspectives
• Proven experience in supporting business development efforts, including identifying client needs, crafting technical solutions, contributing to proposals, and participating in pre-sales activities to drive revenue growth.
• Travel to client sites as needed (30% to 50%)

Based on pay transparency guidelines, the salary range for this role can vary based on your proximity to one of our West Monroe offices (see table below). Information on our competitive total rewards package, including our bonus structure and benefits is here. Individual salaries are determined by evaluating a variety of factors including geography, experience, skills, education, and…