Lead Data Engineer; AI & Data Platforms

Our client, a leading investment firm, is seeking a Lead Data Engineer to join their team in El Segundo, CA!

The ideal candidate will design, build, and optimize scalable data platforms that support enterprise analytics, AI/ML initiatives, and data-driven decision making. This role partners with AI Engineers, Application Development teams, and business stakeholders to build secure, scalable, and governed data platforms that enable predictive analytics, intelligent automation, and AI-powered business solutions.

• Design and build scalable enterprise data platforms using Snowflake, Azure, SQL, and Python.
• Lead architecture and implementation of cloud-based data warehouses and data lakes.
• Build and optimize ETL/ELT pipelines supporting analytics and AI workloads.
• Design data platforms that support Machine Learning, Artificial Intelligence, and Generative AI initiatives.
• Develop pipelines for structured and unstructured data used in AI model training, inference, and Retrieval-Augmented Generation (RAG).
• Collaborate with AI Engineers and Data Scientists to build feature stores, vector-ready datasets, and AI data pipelines.
• Implement secure, governed data architectures supporting responsible AI.
• Optimize Snowflake performance, scalability, and cost.
• Mentor engineers and establish best practices for data engineering and Dev Ops.

• 8+ years of Data Engineering experience.
• 2+ years leading technical teams or projects.
• Financial Services, Banking, Insurance, Asset Management, or Fin Tech experience.
• Expertise with Snowflake, SQL, Python, and Microsoft Azure.
• Experience building enterprise ETL/ELT pipelines.
• Experience supporting AI/ML data platforms and advanced analytics.
• Strong understanding of structured and unstructured data.
• Experience integrating APIs and cloud AI services.
• Excellent communication and leadership skills.