Business Analyst/Researcher/Operations Specialist
Listed on 2026-10-04
-
Business
AI Evaluation, Data Analyst, AI Business & Operations, Business Systems & Technology Analysis -
IT/Tech
AI Evaluation, Data Analyst, AI Business & Operations, Business Systems & Technology Analysis
Location: New York
Business Analyst / Researcher / Operations Specialist is a remote review track for evaluating AI outputs across business analyst / researcher / operations specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.
Category:
Enterprise Workflow & Tool Use
· Pay: $85 / hr
·
Location:
Remote — US-eligible
· Contractor
Business Analyst / Researcher / Operations Specialist is a remote review track for evaluating AI outputs across business analyst / researcher / operations specialist operations workflows.
About the roleBusiness Analyst / Researcher / Operations Specialist is a remote review track for evaluating AI outputs across business analyst / researcher / operations specialist operations workflows. Reviewers grade workflow correctness, policy adherence, and stakeholder fit; flag operational risk; and document the right next step so the modeling team can train on it.
Business Analyst / Researcher / Operations specialist operations AI has to fit into an actual day aOne uses experienced operators to grade outputs the way a senior peer would - checking workflow, policy, and the unwritten rules that decide whether a task actually gets done.
Judge tool-use tasks and enterprise agent behavior. Operational judgment is the skill.
- Review AI outputs against current business analyst / researcher / operations specialist operations workflows, playbooks, and firm policy for Business Analyst / Researcher / Operations Specialist assignments.
- Grade tone, escalation logic, and stakeholder fit on a structured rubric.
- Flag operational risk, missed escalations, and policy-adherence gaps with severity tags.
- Capture the right next step so the modeling team can train on it.
Track Operations & business review Work model Remote
· Independent specialist contractor Compensation Hourly rate confirmed after the interview process. Eligible from US
- Direct working experience in business analyst / researcher / operations specialist operations on real teams for Business Analyst / Researcher / Operations Specialist work.
- Comfort applying multi-page rubrics consistently across long batches.
- Clear written reasoning that names the policy or workflow being applied.
- Strong attention to detail and the ability to flag when a prompt itself is the problem.
- Reliable async availability for at least 10 hours per week.
- Grade a model's response to a real business analyst / researcher / operations specialist operations ticket and rate workflow, tone, and escalation.
- Flag a missed escalation with the right severity tag and corrected next step.
- Adjudicate a disputed playbook call between two reviewers using firm guidance.
- Audit a 25-row batch for rubric consistency and report drift to the program lead.
- Prior experience training, calibrating, or QA-ing operations teams.
- Familiarity with AI-assisted workflow tooling and its failure modes.
- Bilingual experience for cross-region operations.
Hourly rate confirmed after the interview process.
Expected arrangement: contractor , with program-defined task volume and review pacing. Placement depends on current program demand and reviewer confirmation.
- Operational review
- Policy adherence
- Workflow judgment
- Stakeholder communication
- Business Analyst / Researcher / Operations specialist operations
- AI model evaluation
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).