×
Register Here to Apply for Jobs or Post Jobs. X

Machine Learning Engineer

Job in San Francisco, San Francisco County, California, 94199, USA
Listing for: Nyotta AI Inc.
Full Time position
Listed on 2026-10-13
Job specializations:
  • Software Development
    AI Engineer (Applied/Software), Machine Learning/ ML Engineer, AI QA / Validation Engineer
Salary/Wage Range or Industry Benchmark: 150000 - 230000 USD Yearly USD 150000.00 230000.00 YEAR
Job Description & How to Apply Below

Build and evaluate agents that reason over complex information, use tools, and complete multi-step tasks. Turn experiments into behavior we can measure and improve.

Nyotta builds AI agents for complex engineering and business workflows. Our work brings together reasoning over technical information, tool use, and human review so teams can move from source material to decisions and completed work. We apply these systems to engineering and commercial processes where accuracy, traceability, and control matter.

About the role

You will work on the decisions an agent makes: what information to retrieve, which tool to use, how to interpret a result, and when to ask a person for help. The work combines applied ML, experimentation, and software engineering. You will partner with software engineers to test new approaches, investigate failures, and bring useful improvements into the product.

In this role, you will
  • Experiment with models, prompts, retrieval, and context management to improve agent task completion.
  • Build evaluations that test reasoning, tool selection, and output quality across complete workflows.
  • Investigate failed runs and distinguish problems in the model, available context, tools, and execution logic.
  • Compare approaches using task success, latency, and cost; build regression checks before rolling out changes.
  • Develop feedback loops that turn user corrections and observed failures into better datasets and evaluations.
Your background
  • You have built an ML or AI project and can explain how you tested it, where it failed, and what you changed. Research, coursework, personal projects, and professional work all count.
  • You write Python and are comfortable building experiments, working with data, and debugging model behavior.
  • You can define a useful success measure and investigate results that disagree with your assumptions.
  • You enjoy working with engineers to turn an experimental approach into maintainable software.
Level and scope
  • Engineer:
    Work on a scoped agent capability or evaluation problem, with guidance and code review. Early-career applicants are welcome.
  • Senior:
    Own an agent capability from experimental design through evaluation, release, and follow-up. Bring experience shipping and maintaining applied ML systems.
Helpful experience

Experience with LLM agents, tool use, retrieval, multimodal models, evaluation frameworks, or experimentation on production AI systems.

What makes this work hard

A run can look convincing while missing a necessary step. Model changes can fix one failure and introduce another. You will need evaluations that reveal those tradeoffs and the patience to understand individual failures.

A problem you might work on

An agent repeatedly chooses an unhelpful tool. Reproduce the behavior, test whether the problem is context or tool selection, and measure whether your fix improves complete tasks without increasing cost unnecessarily.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary