Senior Architect, Databricks
Listed on 2026-07-03
-
IT/Tech
AI Engineer (Applied/Software), Data Engineering
Are you ready to make an impact?
West Monroe is seeking a Senior Architect to join our thriving Technology and Experience Practice. This is an excellent opportunity to work with clients developing Big Data strategy and roadmaps with emphasis on Databricks, while gaining exposure to a variety of industries including Healthcare, Financial Services, Insurance, and Utilities.
Responsibilities:
- Design data flow and processing pipelines for analysis using modern toolsets such as Spark on Scala, Storm, Flume, Sqoop
- Design data structures for ingestion and reporting, specific to use case and technology
- Provide data management expertise to our clients in evaluating requirements and developing data architecture and performing platform selection and design. Data management includes appropriate structuring, stewardship of data, semantics/syntax of data attributes, coding structures, and mapping schemes
- Collaborate with data science and engineering teams to product ionise machine learning and Generative AI workloads within modern cloud ecosystems
- Establish best practices for AI data readiness, feature engineering, model monitoring, observability, and governance
- Lead technical discussions around AI‑enabled modernisation strategies including semantic layers, vector databases, AI agents, and knowledge retrieval systems
- Evaluate emerging AI technologies and recommend fit‑for‑purpose tooling aligned to client objectives, scalability, security, and compliance requirements
- Guide and coach consultants, share best practices, perform code reviews
- Coordinate activities with data source application owners to ensure integration with analytics platform and source systems
- Ensure that data integrity issues are addressed
- Liaise and attend meetings necessary to perform duties and aid business and technical development
Qualifications :
- 10+ years of professional experience and 3+ years of experience with Databricks
- 8+ years of prior consulting experience
- Very strong technical expertise in Databricks, including architecture, performance optimisation, Delta Lake, Unity Catalog, workflow orchestration, security, governance, and cloud‑native data engineering best practices
- Experience architecting and deploying AI/ML or Generative AI solutions within enterprise environments
- Hands‑on experience with LLM ecosystems and frameworks such as OpenAI, Azure OpenAI, Lang Chain, Semantic Kernel, MLflow, or Databricks Mosaic AI
- Knowledge of Retrieval‑Augmented Generation (RAG), vector databases, embeddings, prompt engineering, and AI orchestration patterns
- Familiarity with AI governance, model life‑cycle management, responsible AI principles, and enterprise security considerations
- Experience integrating AI capabilities into data platforms, analytics solutions, or customer‑facing applications
- Knowledge of standard methodologies, concepts, best practices, and procedures within a Big Data environment
- A commitment to inclusion and diversity, and openness to new ideas and perspectives
- Travel requirements up to 30‑50%
- Hybrid role: 1 to 2 days a week in office
Based on pay‑transparency guidelines, the salary range for this role can vary based on your proximity to one of our West Monroe offices. Information on our competitive total rewards package, including our bonus structure and benefits can be found in the company resources.
Employees (and their families) are covered by medical, dental, vision, and basic life insurance. Employees are able to enroll in our company’s 401(k) plan, purchase shares from our employee stock‑ownership programme and be eligible to receive annual bonuses. Employees will also receive unlimited flexible time off and ten paid holidays throughout the calendar year. Eligibility for ten weeks of paid parental leave will also be available upon hire date.
SalaryRanges by Location
Seattle or Washington, D.C. – $199,100—$223,400 USD
Los Angeles – $205,400—$234,100 USD
New York City or San Francisco – $215,200—$244,700 USD
A location not listed above – $183,800—$212,800 USD
West Monroe is an Equal Employment Opportunity Employer. We believe in treating each employee and applicant for employment fairly and with dignity. We base our employment decisions on merit,…
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).