Senior Data Engineer

Senior Data Engineer – Helios Data Engineering team at Caterpillar Inc. You will develop Python data pipelines that build business data objects to support applications.

• Perform all programming, project management, and development assignments without close supervision; normally assigned the more complex aspects of systems work.
• Work directly on complex application/technical problem identification and resolution.
• Interpret design requirements for engineering implementation.
• Build and deploy CI/CD pipelines.
• Implement source to target mapping as pipeline code.
• Perform unit and integration testing.
• Maintain high standards of software quality within the team by establishing good practices and habits.
• Identify and encourage areas for growth and improvement within the team.
• Perform other job duties as assigned by Caterpillar management from time to time.

• Decision Making and Critical Thinking – knowledge of decision-making process and associated tools and techniques; ability to accurately analyze situations and reach productive decisions based on informed judgment.
• Effective Communications – ability to effectively transmit, receive, and accurately interpret ideas, information, and needs through appropriate communication behaviors.
• Software Development – extensive knowledge of software development tools and activities; ability to produce software products or systems in line with product requirements.
• Software Development Life Cycle – knowledge of SDLC; ability to use a structured methodology for delivering and managing new or enhanced software products.
• Software Product Design/Architecture – knowledge of software product design; ability to convert market requirements into software product design.
• Software Product Technical Knowledge – knowledge of technical aspects of a software product; ability to design, configure and integrate technical aspects.
• Software Product Testing – extensive knowledge of software product testing; ability to design, plan, and execute testing strategies and tactics to ensure quality.
• Extensive software development experience and solid working knowledge of OOP principles.
• Knowledge and experience with embedding models and concepts for effectively chunking data.
• Extensive experience designing and developing software applications in Python.
• Extensive experience working with Git version control.
• Extensive experience deploying software using CI/CD tools such as Jenkins, Git Hub Actions, Azure Dev Ops, etc.
• Experience with AWS components such as Bedrock, Lambda, Dynamo, Fargate, S3, Sage Maker, IAM, and RDS.
• Experience with relational and/or No
  
  SQL databases such as PostgreSQL, DynamoDB, MongoDB, Oracle, etc.
• Demonstrated strong learning ability and proactive approach to staying current with the latest technologies and industry trends.

Pay Range: $ – $. Compensation and benefits offered may vary depending on multiple individualized factors, including job level, market location, job‑related knowledge, skills, performance, and experience.

• Medical, dental, and vision benefits*
• Paid time off (Vacation, Holidays, Volunteer, etc.)*
• 401(k) savings plans*
• Health Savings Account (HSA)*
• Flexible Spending Accounts (FSAs)*
• Health Lifestyle Programs*
• Employee Assistance Program*
• Voluntary Benefits and Employee Discounts*
• Career Development*
• Incentive bonus*
• Disability benefits*
• Life Insurance*
• Parental leave*
• Adoption benefits*
• Tuition Reimbursement*
• These benefits also apply to part‑time employees.

All benefits are subject to plan eligibility, terms, and guidelines. This position requires working onsite five days a week. Relocation assistance is NOT available for this position. Visa sponsorship is NOT available for this position. This position requires the candidate to be in Chicago, IL or Peoria, IL.

Caterpillar is an Equal Opportunity Employer, Including Veterans and Individuals with Disabilities. Qualified applicants of any age are encouraged to apply.