Economics AI Benchmarking Expert– Complex Problem Creation

Economics AI Benchmarking Expert About the Project

Truelancer AI is looking for exceptional Economics domain experts, researchers, and Ph Ds to contribute to an advanced AI Benchmarking Project
.

The project focuses on creating and evaluating highly complex economics problems designed to assess the reasoning, analytical, quantitative, and problem-solving capabilities of modern AI systems.

You will use your expertise in economics to design challenging problems that may require several hours or more for a qualified economist or researcher to solve. You will also develop structured solution approaches and evaluate whether current AI systems can successfully reason through these problems.

This is an opportunity to work at the intersection of advanced economics, complex problem solving, and Artificial Intelligence evaluation
.

Engagement Details

• Engagement Type: Project-based / Freelance Contract

• Work Mode: Remote

• Location: India

• Preferred Time Zones: CST & EST availability preferred

• Domain: Economics

What You Will Do

As an Economics AI Benchmarking Expert
, you will:

• Design highly complex and challenging economics problem statements requiring advanced domain expertise, quantitative analysis, and multi-step reasoning.

• Create problems that may require several hours or more for a qualified economist or researcher to solve.

• Develop structured, logically sound, and defensible solution approaches.

• Clearly define assumptions, constraints, variables, data requirements, and expected outcomes.

• Incorporate appropriate economic models, theories, frameworks, and quantitative methodologies into problem design.

• Explain why a problem is challenging, reasoning-intensive, computationally demanding, or difficult for current AI systems.

• Estimate the approximate effort required for a qualified economics expert to solve the problem.

• Review problems for ambiguity, correctness, consistency, solvability, and uniqueness of the expected answer.

• Adapt and refine problem statements based on project-specific AI benchmarking requirements.

• Evaluate problems using available AI tools and LLMs to determine whether AI systems can solve them successfully.

• Analyse incorrect or incomplete AI responses and identify where and why the reasoning fails.

• Distinguish between genuine reasoning challenges and problems that are simply ambiguous, poorly defined, or lacking sufficient information.

• Ensure that benchmark problems have a clearly defensible solution or evaluation methodology.

Key Skills Required
1. Advanced Economics & Problem Design

Strong ability to formulate sophisticated economics problems involving areas such as:

• Microeconomics

• Macroeconomics

• Econometrics

• Game Theory

• Development Economics

• International Economics

• Financial Economics

• Labour Economics

• Public Economics

• Industrial Organisation

• Behavioural Economics

• Environmental Economics

• Monetary Economics

• Economic Policy

• Applied Economics

Experience in quantitative or mathematical economics is highly valuable.

2. Complex Analytical Thinking

Ability to work through problems involving:

• Multi-step economic reasoning

• Quantitative and mathematical analysis

• Economic modelling

• Causal reasoning

• Data interpretation

• Statistical or econometric analysis

• Trade-offs and competing economic incentives

• Counterfactual analysis

• Policy impact assessment

3. Structured Problem Solving

Ability to break down complex economics problems into clearly defined steps and develop a rigorous solution methodology.

You should be comfortable identifying:

• Relevant economic theories and models

• Key assumptions

• Variables and parameters

• Constraints

• Appropriate analytical methods

• Expected outputs

• Alternative interpretations

4. Attention to Detail

Strong attention to detail, including the ability to:

• Identify hidden assumptions

• Define constraints explicitly

• Detect inconsistencies

• Validate calculations and economic reasoning

• Identify edge cases

• Check mathematical or statistical logic

• Ensure sufficient information is provided to solve the problem

• Ensure the expected outcome is well-defined and defensible

5. Research & Critical Thinking

Ability to evaluate complex economic scenarios, research relevant concepts, and determine whether a proposed problem genuinely tests advanced reasoning rather than simple knowledge recall.

6. AI Familiarity

Basic familiarity with modern AI tools and Large Language Models (LLMs).

You should be able to:

• Test complex economics problems using AI tools.

• Determine whether an AI system can correctly solve a problem.

• Identify incorrect, incomplete, or hallucinated AI responses.

• Analyse errors in economic…