Principal Data Engineer

## Principal Data Engineer Apply locations:
Peoria, Illinois time type:
Full time posted on:
Posted Todayjob requisition :
R
** Career Area:
** Technology, Digital and Data
*
* Job Description:

**** Your Work Shapes the World at Caterpillar Inc.
** When you join Caterpillar, you're joining a global team who cares not just about the work we do – but also about each other.  We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here – we make it happen, with our customers, where we work and live.

Together, we are building a better world, so we can all enjoy living in it.

This position will be responsible for building scalable, high performance data pipelines and data driven predictive analytics applications using automation, artificial intelligence (AI) and machine learning (ML) models to provide actionable recommendations and insights. The position will be part of Caterpillar’s Legal, Security and Public Policy team, tackling challenges and problems that are critical to realizing business value and mitigating high impact enterprise risks.

This position will work with data scientists, business analysts, and others as part of a team that assembles large, complex data sets, automates processes and pipelines, builds models and provides insight to key stakeholders.
*
* What You Will Do:

*** Design, build, and maintain scalable Snowflake-based data platform supporting analytics, reporting, and AI/ML workloads
* Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing data pipelines for greater scalability
* Perform debugging, troubleshooting, modification and testing of integration solutions
* Operationalize developed jobs, processes and models
* Create solutions and methods to monitor systems and solutions
* Review and optimize code. Automate code testing and pipelines
* Design, develop, and maintain efficient and scalable AI and ML solutions
* Put in place systems and processes to support data governance capabilities
* Engage with business partners to participate in design and development of data integration/transformation solutions per functional requirements
* Engage and actively seek industry perspectives through, continuous learning, peer groups, etc.
** What

You Will Have:

**
* ** Data Programming** - BS in Computer Science, Computer Engineering, Data Engineering, Data Science, or related field. 5+ years development experience with modern development languages and frameworks, preferably Python, SQL, etc. Understanding of data structures, algorithms, profiling & optimization.
* ** Data Governance, Quality, & Security** - Understanding and appreciation for the data governance standards, the dimensions of data quality, and data security. Familiarity with tools and frameworks to support these standards.
* ** Database/Data Lake Administration** - Experience managing a Snowflake database/environment. Understanding of SQL, ETL/ELT design, data modeling techniques, change data capture techniques. Familiarity with indexing, partitioning, and query optimization.
* ** Cloud Platforms** - Experience building ETL/ELT pipelines using industry platforms (Snowflake, EMR, Glue, Snap Logic or similar). Experience building medallion, data lake, or lake house architectures.
* ** Dev Ops*
* - Experience with version control in Github and devops practices, like continuous integration and continuous delivery (CI/CD)
* ** Communication** - Good communication, interpersonal, and collaboration skills. Ability to communicate difficult or technical concepts in a relatable manner. Ability to collaborate and prioritize cross functionally to achieve results.
* ** Coaching** - Ability to guide and mentor other in coding and design best practice.
** What Will Set You Apart:**
* ** Advanced Programming** - MS in Computer Science, Computer/Data Engineering, Data Science, or related fields. Experience in agent assisted programming.
* ** Machine Learning & Artificial Intelligence** - Experience building and deploying machine learning (ML), artificial intelligence (AI) and/or…