Senior Machine Learning Test Engineer

Company Overview

Metropolis is an artificial intelligence company that uses computer vision technology to enable frictionless, checkout‑free experiences in the real world. Today, we are reimagining parking to enable millions of consumers to just "drive in and drive out." We envision a future where people transact in the real world with a speed, ease and convenience that is unparalleled, even online. Tomorrow, we will power checkout‑free experiences anywhere you go to make the everyday experiences of living, working and playing remarkable – giving us back our most valuable asset, time.

We are seeking a Senior Machine Learning Test Engineer with a passion for quality, automation, and real‑world impact. In this role, you will be responsible for designing, developing, and executing robust test strategies for cutting‑edge perception systems. At Metropolis, we build complex, distributed computer vision systems that span a wide range of platforms, from cameras and embedded edge devices to large‑scale cloud infrastructures.

These systems power critical, real‑time decisions across parking and new verticals. As a Senior Test Engineer, you’ll play a pivotal role in verifying that each component in this ecosystem functions correctly in isolation and as part of an integrated system. You’ll collaborate closely with engineers across software, hardware, and machine‑learning teams to define test coverage, develop test harnesses, and identify edge cases that impact performance in production.

You will also help shape and improve our continuous integration pipelines and automated validation frameworks to support fast iteration and robust releases.

• Design and implement test plans, test cases, and test automation frameworks for computer vision and machine learning pipelines
• Validate the end‑to‑end performance of CV applications such as object detection, classification, and tracking under diverse scenarios and edge cases
• Analyze system‑level behavior and KPIs (latency, accuracy, robustness) using metric‑driven methodologies
• Develop tools for test data generation, synthetic validation, and visualization of perception outputs
• Collaborate with software, ML, hardware, and QA teams to ensure end‑to‑end system validation and release readiness
• Investigate, root‑cause, and document bugs and issues across the perception stack
• Drive continuous improvement in test coverage, test automation, and system reliability

• Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, Robotics, or a related field
• 5+ years of hands‑on experience in software or system testing, with at least 2 years focused on computer vision (CV), perception, or machine‑learning systems in production
• Proficiency in Python and C++ for test automation and strong experience with unit testing frameworks such as GTest or Py Test
• Experience designing and implementing end‑to‑end test strategies for distributed systems, including using version control like Git and CI/CD pipelines like Jenkins or Git Hub Actions
• Solid understanding of computer vision concepts such as detection, tracking, segmentation, and 2D/3D geometry
• Demonstrated experience testing perception or computer vision systems in real‑world or hardware‑in‑the‑loop (HIL) environments
• Familiarity with common ML frameworks like PyTorch and Tensor Flow, and CV libraries like OpenCV
• Strong debugging, profiling, and log analysis skills, especially in embedded or real‑world deployment environments
• Experience with containerization tools like Docker and simulation platforms such as CARLA or NVIDIA Drive Sim
• Excellent communication skills with a strong ownership mindset and the ability to work independently

The anticipated base salary for this position is $ USD to $ USD annually. The actual base salary offered is determined by a number of variables, including, as appropriate, the applicant's qualifications for the position, years of relevant experience, distinctive skills, level of education attained, certifications or other professional licenses held, and the location of residence and/or place of employment. Base salary is one component of…