Robotics Testing Engineer

Reliability Engineer

Job Description

The Reliability Engineer plays a key role in ensuring the reliability, availability, and performance of large-scale robotic fleets operating in production environments. This position focuses on diagnosing and resolving complex system-level issues across robotics software, hardware, controls, perception, and infrastructure, while driving continuous improvements in system robustness, fault tolerance, and scalability. The role requires a strong systems engineering mindset, deep experience in robotics or automation, and a data-driven approach to performance optimization and operational excellence.

Responsibilities

+ Identify, triage, and determine root causes of system-level issues impacting large-scale robotic fleets in production environments.

+ Drive improvements in system reliability, availability, and performance across thousands of deployed robots.

+ Define and monitor system performance guardrails tied to customer key performance indicators such as throughput, error rates, recovery time, and uptime.

+ Partner closely with field teams to debug and resolve production issues in live environments.

+ Work across robotics software, hardware, controls, perception, and infrastructure to diagnose complex system interactions.

+ Debug issues spanning embedded systems, distributed services, real-time control loops, and operational workflows.

+ Collaborate with cross-functional teams to implement fixes and long-term solutions that address underlying system issues.

+ Contribute to system design improvements that enhance robustness, fault tolerance, and scalability.

+ Analyze robot logs, telemetry, and diagnostics data to identify failure modes and performance bottlenecks.

+ Build and use tools, including SQL, Python, and dashboards, to investigate trends and validate hypotheses.

+ Develop mechanisms for regression detection, failure trend analysis, and performance monitoring across the fleet.

+ Drive continuous improvement through structured experiments and data-backed decision making.

+ Own key reliability metrics and contribute to improving system observability and debuggability.

+ Document failure modes, lessons learned, and standard operating procedures for efficient issue resolution.

+ Support release validation activities to ensure new changes meet reliability and performance expectations.

+ Act as a technical escalation point for complex system issues requiring deep systems-level investigation.

Essential Skills

+ At least 5 years of experience in robotics, automation, or complex distributed systems.

+ Strong systems engineering mindset with hands-on experience in robotics control software, real-time systems, and hardware-software integration.

+ Demonstrated experience in structured root-cause analysis and failure investigation.

+ Proficiency in data analysis and scripting using tools such as Python and SQL.

+ Experience working with logs, telemetry systems, and large-scale operational data.

+ Familiarity with Linux environments for development, debugging, and operations.

+

Experience with version control systems, including Git.

+ Background in reliability engineering, test engineering, and hardware integration.

+ Hands-on experience with robotics controls and real-time operating systems (RTOS).

+ Proven ability to debug complex systems and perform detailed root cause analysis.

+ Experience in software troubleshooting and system validation in production environments.

+ Strong problem-solving skills and ability to work across ambiguous, cross-functional system boundaries.

+ Experience working in Agile development environments.

Additional

Skills & Qualifications

+

Experience with test equipment and hardware integration in robotics or automation systems.

+ Knowledge of systems engineering practices and methodologies.

+ Familiarity with failure mode and effects analysis (FMEA) or similar structured reliability techniques.

+ Experience developing or using dashboards and monitoring tools for performance and reliability tracking.

+ Background in integration testing and end-to-end systems debugging.

+ Exposure to operational workflows for large-scale deployed systems, beyond lab prototypes.

+ Ability to collaborate effectively with cross-functional and field teams to resolve complex issues.

Work Environment

This role operates in a highly technical, production-focused environment centered around large-scale robotic fleets and complex distributed systems. You will work closely with live deployed systems rather than purely lab prototypes, frequently interacting with field teams and cross-functional engineering groups. The environment involves extensive use of Linux-based systems, version control tools such as Git, and data analysis technologies including Python, SQL, logs, telemetry, and dashboards.

Work typically aligns with an Agile development framework, emphasizing iterative improvements, structured experiments, and continuous delivery of reliability enhancements. The position requires comfort with real-time control…