Skip to content
×

Applied Scientist, LLM Evaluation & Optimization Lead

Job in Austin, Travis County, Texas, 73301, USA
Listing for: robotsandpencils
Full Time position Listed on 2026-11-15
Job specializations:
Salary/Wage Range or Industry Benchmark: 120000 - 160000 USD Yearly USD 120000.00 160000.00 YEAR

Job Description & How to Apply Below

robotsandpencils is seeking a senior role to lead the evaluation framework for production planner-executor agents. You will blend applied research with hands-on engineering to determine model choices and optimization strategies that meet quality goals while reducing cost and latency.

The role spans experiment design, simulation, analysis, and delivering a dashboard to guide rollout decisions for customers. Strong statistical methods and tooling in Python are essential.

This Full Time opening is for the Applied Scientist, LLM Evaluation & Optimization Lead role at robotsandpencils.

This posting is for the Applied Scientist, LLM Evaluation & Optimization Lead role at robotsandpencils, based in United States.

We are looking to fill the Applied Scientist, LLM Evaluation & Optimization Lead position at robotsandpencils in United States.

The Applied Scientist, LLM Evaluation & Optimization Lead role at robotsandpencils is now open for applications in United States.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
View / Apply for Jobs
Matching My Jurisdiction

Search for further Jobs Here:

SEARCH JOBS: 10+ Million Listings
(Try combinations for better Results! Or enter less keywords for broader Results)
Education Level
Experience Level (years)
Posted in last:
Salary