Web Researcher; AI Benchmarking
Listed on 2026-09-25
-
Business
AI Evaluation
Location: Indianapolis
About Us
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Role overview
Our client is building advanced evaluation benchmarks for frontier AI browsing agents
.
We are looking for highly skilled investigative researchers who can design research problems that remain difficult even for state-of-the-art AI systems with full web access. This is not a traditional subject-matter or content-writing role. The work is centered on open-web investigation, evidence tracing, source validation, and benchmark construction
.
You will begin from a verifiable fact, work backwards to construct a difficult research question, and document a complete, auditable evidence trail showing how the answer can be independently verified.
CONTRACT: Short-term freelance/contractor assignment, 8 weeka
COMMITMENT: 40 hours per week, at least 4 hours per day, including 4 hours overlap with PST
LOCATIONS: Remote, GLOBAL
Responsibilities- Design challenging open-web research problems for evaluating advanced AI browsing agents.
- Start from objectively verifiable facts and construct questions that make those facts difficult to discover.
- Build multi-step clue structures involving dates, people, places, organizations, works, events, records, and quantities.
- Ensure every clue is independently verifiable and subject to clear constraints.
- Research across government databases, institutional sources, archives, registries, and PDF documents.
- Produce complete evidence trails citing exact pages, tables, sections, or records.
- Record validation searches and document what obvious search approaches return.
- Test whether research questions remain difficult across multiple search attempts.
- Refine questions to eliminate ambiguity while preserving difficulty.
- Deliver structured, reproducible research documentation.
- Background in reference librarianship, archives, or special collections
. - Experience in investigative journalism or professional fact-checking.
- Experience with OSINT, due diligence, KYC, or investigative research
. - Background in patent, prior-art, or legal-discovery research.
- Experience with genealogy or historical records research.
- Experience with competitive quizzing, puzzle design, or puzzle-hunt construction.
- Familiarity with JSON or structured data formats
.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).