LLM Power User & World AI Evaluator
Listed on 2026-10-20
-
IT/Tech
AI Evaluation, AI Engineer (Applied/Software), AI Business & Operations, Data Annotation/ AI Labeling
Obsidian, a leading AI research organization, is seeking advanced LLM power users to evaluate how well AI systems handle personalized, real-world life tasks. You will judge usefulness, personalization, and realism of AI responses across daily activities.
Ideal candidates use AI tools heavily in personal life and can explain why outputs are good, bad, or unsafe. This role emphasizes practical judgment, attention to detail, and clear written feedback to improve AI assistants.
As a LLM Power User & Real-World AI Evaluator, you will play an important part at Mercor in San Francisco, CA, United States.
The position is based in San Francisco, CA, United States.
This opportunity is part of our work in IT & Technology.
The advertised compensation is 34.000 - 83.000.
This role offers the option to work remotely.
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).