Sales Agent, AI Evaluation

IMPORTANT: after you apply, please check your email.  We send you a link to complete your application - it is not considered until that last step is done. If you do not see it, check your spam folder.

This is a fully remote position , open to candidates based in Canada.

Pay:  $30-$80/hr

Role

Title:

Sales Agent (Securities & Commodities)

Role Type:
Contractor

Location:

Remote

We are engaging Sales Agent (Securities & Commodities) experts to participate in a cutting-edge project geared toward advancing frontier AI benchmarks. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required - your domain knowledge is what matters.

You will be designing and producing expert-authored evaluation tasks that reflect the authentic complexity of securities and commodities markets. This includes engaging with substantial and varied datasets such as CSVs, PDFs, spreadsheets, and technical documentation to pose rigorous, multi-step problems that challenge how AI interprets, reasons, and acts in genuine market scenarios.

Scope of Work

Develop realistic evaluation tasks for AI agents, simulating complex activities in securities and commodities trading, client advisory, and compliance reasoning.

Source, compile, and curate authentic supporting materials, including market data, client documentation, and relevant regulatory references.

Define and justify correct market decisions or advisory actions, explicitly considering compliance and regulatory frameworks.

Author comprehensive rubrics of 35+ items to systematically assess agent performance in market judgment, compliance sensitivity, and client communication accuracy.

Ensure the complexity and authenticity of tasks reflect true-to-life, day-to-day operations rather than simplified scenarios.

Collaborate with technical teams to clarify task intent and refine benchmarking standards.

Preferred Qualifications

Active Series 7/63 license or international equivalent demonstrating regulatory proficiency.

Minimum of 4 years’ experience at a brokerage, banking, or trading platform with significant compliance-driven workflow exposure.

Direct involvement in executing trades and providing client advisory within securities and commodities markets.

Strong fluency in reviewing and interpreting market data, technical documentation, and regulatory materials.

Exceptional written and verbal communication skills, with a focus on producing clear, precise, and comprehensive technical documentation.

Proven ability to design nuanced tasks and grading rubrics relevant to real-world financial operations.

Experience working remotely and independently on complex deliverables is a plus.

Compensation Structure
Compensation is output-based; experts are paid per task that meets the project specifications. The time required to complete work may vary depending on the expert’s experience and workflow. Minimum submission requirements apply. Experts must submit a minimum of tasks per week.

Start Timeline & Availability
We typically fill roles within 48 hours and are looking for experts ready to jump in right away. If selected, we expect you to start your first tasks within 24-48 hours of completing onboarding.