Cyber Threat Intelligence AI Evaluation SME
New York, New York City, Richmond County, New York, USA
Listed on 2026-10-30
-
IT/Tech
AI Evaluation
Evaluate AI responses to advanced cyber threat scenarios, including nation-state operations, surveillance, attribution, and intrusion-adjacent cases. This part-time contractor role pays $70 to $110 per hour.
Remote Hourly · $70–$110/hr
$70–$110/hr
Compensation
Contract, part-time
Engagement
Remote
Open in 52 countries
India + more
- Algeria
- Argentina
- Austria
- Bahrain
- Bangladesh
- Belgium
- Brazil
- Canada
- Chile
- Colombia
- Denmark
- Egypt
- France
- Germany
- Ghana
- Greece
- India
- Indonesia
- Italy
- Japan
- Jordan
- Kazakhstan
- Kenya
- Kuwait
- Kyrgyzstan
- Lebanon
- Malaysia
- Mexico
- Morocco
- Netherlands
- Nigeria
- Oman
- Pakistan
- Palestine
- Peru
- Philippines
- Portugal
- Qatar
- Saudi Arabia
- Singapore
- South Africa
- Spain
- Sri Lanka
- Switzerland
- Taiwan
- Thailand
- Tunisia
- United Arab Emirates
- United Kingdom
- United States
- Uzbekistan
- Vietnam
You will help evaluate AI systems that assess advanced cyber threat scenarios. The work focuses on setting clear boundaries between legitimate defensive analysis and impermissible surveillance, attribution, or intrusion-related requests.
You will create evaluation cases, grade model responses, document difficult edge cases, and give clear written and verbal feedback.
- Map cyber threat intelligence cases to established taxonomies, especially for surveillance and privacy evaluation.
- Write boundary cases involving prohibited surveillance, attribution, and intrusion-adjacent requests.
- Evaluate responses for source reliability, analytic reasoning, stated limitations, and actionable value.
- Identify over-refusal when an AI system unnecessarily declines legitimate threat analysis.
- Document edge cases involving nation-state operations and advanced threats.
- Give concise written and verbal feedback to improve AI threat assessment.
This is part-time contractor work for specialists who can apply practical cyber threat intelligence expertise to structured AI evaluation and feedback tasks.
- $70 to $110 per hour.
- Part-time contractor role.
- Open to candidates in the listed countries across the Americas, Europe, Asia, Africa, and the Middle East.
- Professional fluency in English, with clear structured writing and verbal communication.
- Substantial professional experience in cyber threat intelligence involving nation-state operations or advanced threats.
- Strong judgment about defensive or analytic activity versus offensive or surveillance-focused requests.
- Experience with threat-actor attribution, APT tracking, or adversary tactics and techniques.
- Experience mentoring, teaching, or leading threat intelligence professionals is valuable.
- Experience level:
Entry level listing. - Prior AI evaluation, red-teaming, or related quality assurance experience is helpful but not required.
AI training is the human work behind systems that learn from examples, including reviewing model answers and rating their quality. In this role, cyber threat intelligence expertise helps assess whether AI responses are accurate, useful, and appropriately limited.
Requirements- Experience:
Entry level
Evaluate large language model behavior in complex data pipelines, write structured test cases, and improve analytic methods as a remote contractor earning $60 to $100 per hour.
Review military scenarios and AI-generated responses using hands-on fires and targeting expertise. This part-time contract role pays $60 to $110 per hour and is open to candidates in several countries.
Create demanding questions, review AI-generated responses, and explain errors using authoritative sources. This part-time contract pays $30 to $60 per hour equivalent, paid per task that meets the project specifications.
Review AI conversations, identify missing context, and assess whether recommendations use enough information. This remote project runs for about three weeks, requires 20+ hours per week, and pays per task.
Remote
· Albania, Algeria, Angola +128 more
(If this job is in fact in your jurisdiction, then you may be using a Proxy or VPN to access this site, and to progress further, you should change your connectivity to another mobile device or PC).