Autonomy Engineering Specialist - Perception

Technology, Digital and Data

When you join Caterpillar, you're joining a global team who cares not just about the work we do - but also about each other. We are the makers, problem solvers, and future world builders who are creating stronger, more sustainable communities. We don't just talk about progress and innovation here - we make it happen, with our customers, where we work and live.

Together, we are building a better world, so we can all enjoy living in it.

As the Autonomy Engineering Specialist - Perception
, you will be responsible for developing cutting-edge autonomous and operator-assisted driving systems. You will design, implement, and test modules for sensor fusion, object detection, tracking and classification and be a technical leader on the Perception team. You will also collaborate with other tech leads to integrate your solutions into our software stack and hardware platform.

• Solve challenging perception problems for mobile off-road machines.
• Lead other developers in the design and development of high-quality perception software to solve our customer needs.
• Document architecture specifications, software design, verification plans, test cases, operating procedures, and safety procedures.
• Work with application teams to collect and analyze data on customer experience with robotic and manned platforms. Participate in the iterative ML training cycles to meet perception requirements.
• Use appropriate tools to debug, test and maintain perception software and assist in the verification and validation process.

• Experience with modular perception ML and sensor fusion for autonomous vehicles and robotics. Familiarity with off-road autonomy applications is a plus.
• Hands-on experience working with camera images, lidar and 4D radar point clouds, IMU, GNSS, and machine state data in real perception systems.
• Solid understanding of object detection, drivable area understanding, ground plane segmentation, object tracking and fusion, and 3D mapping.

• Participate in Agile software development from requirements and architecture through validation and deployment.
• Develop software design documentation, verification plans, and test procedures.
• Collaborate with engineering teams to deliver safe, production-quality autonomy solutions

• Excellence in C++
• Fluency in Python
• Experience developing computer vision, machine learning, sensor fusion, object detection, and tracking modules.
• Strong software engineering, debugging, and code quality practices

• Knowledge of debugging and validation tools to analyze and resolve perception software issues.
• Ability to analyze code, logs, sensor data, and machine performance data to troubleshoot complex problems.
• Experience with verification and validation activities for autonomous machine systems.

• Experience developing perception and calibration for autonomous vehicles, robotics, or advanced operator assist systems using lidar, radar, and cameras (typically 7+ years)
• Strong background in computer vision, machine learning, deep learning, sensor fusion, object detection, classification, and tracking.
• Demonstrated ability to lead other developers
• Experience developing production-quality software in C++ and Python.
• Experience with ROS/AIS, OpenCV, Tensor Flow, PyTorch, and modern software development tools including Git, CMake, Docker, and Google Test.
• Experience developing, integrating, or validating complex autonomous systems with a focus on machine safety and productivity.
• Experience working in Agile environments using Azure Dev Ops or Jira and leveraging AWS cloud…