Lead Data Engineer; Snowflake

Career Area:

Technology, Digital and Data

Your Work Shapes the World at Caterpillar Inc.

When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live.

Together, we are building a better world, so we can all enjoy living in it.

We are seeking a highly skilled Lead Data Engineer to design, build, and scale modern data solutions within a cloud-based environment, with a strong emphasis on Snowflake. This role combines hands‑on engineering excellence with technical leadership, guiding a small team of data engineers while delivering high‑quality, reliable, scalable, and AI‑ready data products. This individual will play a critical role in enabling data‑driven decision‑making, advanced analytics, machine learning, and generative AI initiatives by building trusted data products, scalable pipelines, reusable semantic models, and governed datasets that support business and technology outcomes.

• Design and build scalable data ingestion pipelines from structured and unstructured data sources into Snowflake.
• Develop and maintain ELT/ETL processes to transform, cleanse, and integrate enterprise data.
• Design reusable dimensional, semantic, and business-ready data models that support analytics and AI use cases.
• Build and maintain consumable data products including curated datasets, data marts, semantic layers, APIs, and AI-ready data assets.
• Design and implement enterprise data architectures that support scalability, interoperability, and future AI adoption.

• Design and curate AI-ready datasets that support machine learning, generative AI, intelligent agents, and advanced analytics.
• Implement metadata, lineage, and semantic modeling capabilities that improve data discoverability and AI readiness.
• Collaborate with AI and analytics teams to establish patterns for retrieval, search, knowledge management, and AI-enabled business solutions.
• Evaluate and adopt emerging Snowflake capabilities, including Cortex AI, semantic models, vectorized data structures, and AI-related platform services.

• Apply Data Product Management principles by establishing ownership, quality standards, service levels, and lifecycle management processes.
• Implement data quality monitoring, automated validation, observability, and governance frameworks.
• Ensure compliance with enterprise security, privacy, regulatory, and data governance requirements.
• Establish and maintain metadata standards, data lineage, business definitions, and cataloging practices.

• Optimize Snowflake performance through query tuning, workload management, storage optimization, and architectural improvements.
• Ensure high availability, reliability, and scalability across data platforms and pipelines. Implementing proactive monitoring, alerting, and observability practices.
• Drive cloud and Snowflake cost optimization through consumption monitoring, capacity planning, and engineering best practices.

• Lead and mentor a team of 3–4 data engineers, providing technical leadership, coaching, and career development.
• Serve as the technical subject matter expert for Snowflake, modern data platforms, and AI-ready data engineering practices.
• Define and enforce enterprise data engineering standards, architectural patterns, and development best practices.
• Collaborate with business stakeholders, product owners, analysts, architects, and data scientists to translate business objectives into scalable data solutions.

• Bachelor’s degree in computer science, Information Systems, Data Engineering, Software Engineering, or related technical field (or equivalent experience)
• 10+ years of experience in data engineering or related disciplines with increasing responsibility
• Expert knowledge of Snowflake architecture,…