Evaluation Lead. San Francisco LilyLifestyle

Responsibilities

• Lead and build a cross‑functional team of software engineers, data analysts, and data scientists supporting automated workflows that provide high signal on autonomy performance.
• Design scalable production frameworks for sampling evaluation sets, developing and improving metrics, and systematically measuring the performance of both autonomy and the evaluation ecosystem itself.
• Design pipelines, tools, and dashboards to characterize autonomy performance for technical teams and executive leadership, collaborating closely with platform teams on implementation, and with autonomy, systems, safety, and product teams on requirements.
• Work closely with simulation and software teams to build solutions that leverage our data, metrics, and simulation platforms effectively.
• Lead technical projects; contribute as an individual contributor while also managing the team.
• Participate and share ideas in technical and architecture discussions, collaborating with researchers and engineers.
• Conduct regular one‑on‑one meetings to offer guidance and constructive feedback to direct reports.

• Minimum of 6+ years of autonomous vehicle industry experience, including at least 2+ years managing high‑performing teams.
• Experience evaluating AI or machine learning models, ideally in self‑driving or related fields.
• MS/PhD or bachelor’s degree in Computer Science, Data Science, Robotics, or a related technical field.
• Strong statistical background.
• Experience working with internal cross‑functional partners and stakeholders.
• Experience with system design/architecture and algorithms.
• Open‑minded and collaborative team player willing to help others.
• Passionate about self‑driving technologies, solving hard problems, and creating innovative solutions.

• Previous experience leading autonomy evaluation teams.
• Experience with large‑scale databases and analytics.

The US yearly salary range for this role is $159,000 – $260,000 USD, supplemented by competitive perks, equity awards, and an annual performance bonus.

• Competitive compensation and equity awards.
• Health and wellness benefits encompassing medical, dental, and vision coverage (for full‑time employees only).
• Unlimited vacation.
• Flexible hours and work‑from‑home support.
• Daily drinks, snacks and catered meals (when in office).
• Regularly scheduled team building activities and social events both on‑site, off‑site, and virtually.
• Continuous evolution of benefits as the company grows.

Waabi is an equal‑opportunity employer. We celebrate diversity and are committed to creating a supportive, inclusive, and accessible workplace for all employees. We seek applicants of all backgrounds and identities across race, color, ethnicity, national origin or ancestry, age, citizenship, religion, sex, sexual orientation, gender identity or expression, military or veteran status, marital status, pregnancy or parental status, caregiver status, disability, or any other characteristic protected by law.

We provide workplace accommodations for qualified individuals with disabilities as required by applicable law.

We may use artificial intelligence tools to support parts of the hiring process. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you need more information about how your data is processed, please contact us.