×
Register Here to Apply for Jobs or Post Jobs. X

Applied Research — Evaluations & Data

Job in New York, New York County, New York, 10261, USA
Listing for: Human Intuition Inc.
Full Time position
Listed on 2026-10-07
Job specializations:
  • Software Development
Salary/Wage Range or Industry Benchmark: 120000 - 180000 USD Yearly USD 120000.00 180000.00 YEAR
Job Description & How to Apply Below

Building the autonomous company

Human Intuition is building the autonomous company. Businesses run on accumulated judgment: how to interpret a situation, choose an action, and learn from its consequences. Much of that knowledge lives in people, even when the decisions they make leave traces in software.

We are working to make that judgment learnable. A business has defined systems, tools, permissions, histories, and objectives. Those boundaries create an opportunity to build agents that learn from how work is done, act within clear constraints, and improve through feedback. Our ambition is to turn the knowledge inside institutions into software that compounds.

The role

Build the evidence that tells us whether an agent is ready to do useful work. You will turn business workflows, decision histories, and operational outcomes into datasets and evaluations that distinguish a plausible response from a correct action. Your work will define what progress means for the autonomous company.

What you’ll do
  • Work with domain experts to identify the decisions, constraints, and outcomes that matter in a workflow.

  • Design tasks, evaluation environments, rubrics, and verifiers that test complete workflows, including ambiguous inputs and failure recovery.

  • Build data pipelines that preserve the relationship between context, decisions, actions, and outcomes, with clear provenance and appropriate access controls.

  • Create evaluation splits and review processes that limit leakage, expose distribution shifts, and catch regressions.

  • Study agent traces to identify recurring failures and turn the findings into better training data, tools, and reward signals.

  • Build repeatable evaluation reports that let researchers and engineers compare quality, reliability, latency, and cost.

What you’ll bring
  • Strong Python and practical experience building data or machine learning systems.

  • Evidence of designing useful evaluations, experiments, or datasets for models or complex software.

  • Sound statistical judgment and the ability to explain what a metric establishes and what it misses.

  • Care with data quality, reproducibility, and the handling of business information.

  • The ability to learn an unfamiliar domain and communicate clearly with both technical and operational colleagues.

Useful experience

Agent evaluation, reward modeling, human feedback systems, synthetic data, process mining, or research involving sequential decisions. Published work and open-source contributions are welcome; concrete examples of careful measurement matter just as much.

What success looks like

The team can tell whether a change improves real task outcomes, reproduce the result, and trace failures back to actionable causes.

Apply

Show us something you have built, investigated, or improved, and tell us what you learned. That might be a product, a research result, an open-source contribution, or work you can describe without disclosing confidential information. We welcome strong evidence of ability from a range of backgrounds.

To View & Apply for jobs on this site that accept applications from your location or country, tap the button below to make a Search.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)
0
200
Filters
Education Level
Experience Level (years)
Posted in last:
Salary