×
Register Here to Apply for Jobs or Post Jobs. X

LLM Evaluation Specialist – Mathematics

Job in 110006, Delhi, Delhi, India
Listing for: Aceolution
Full Time position
Listed on 2026-03-05
Job specializations:
  • Science
    Mathematics, Data Scientist
Job Description & How to Apply Below
MUST HAVE:
PhD (completed) in Maths domain

Role Overview :

In this role, you will be working on projects to help fine-tune large language models (like ChatGPT) using your strong analytical and English comprehension skills. The ideal candidate should have a solid foundation in mathematics, particularly at the level expected in engineering entrance exams, as well as graduate or PhD-level programs. You should be able to break down complex mathematical concepts into simple, clear explanations and work efficiently.

The projects will also help you learn how to leverage AI to be a better analyst. This is your chance to future-proof your career in an AI-first world!

What does day-to-day look like:

Design and solve challenging math problems to probe the limitations of large language models. Develop high-quality, step-by-step solutions with clear and rigorous reasoning. Collaborate with LLM researchers to align problem types with evaluation goals, particularly in areas where models commonly struggle (e.g., abstraction, multi-step reasoning, symbolic manipulation). Contribute to defining new evaluation benchmarks based on Mathematics curricula spanning early undergraduate to PhD-level topics.

Requirements:

Analytical

Skills:

Good research and analytical skills
Feedback

Skills:

Ability to provide constructive feedback and detailed annotations. Creative Thinking:
Creative and lateral thinking abilities.
Communication:
Excellent structured communication and collaboration skills in a remote setting.
Independence:
Self-motivated and able to work independently in a remote setting. Technical Setup:
Desktop/Laptop set up with a good internet connection.

Preferred Qualifications:

Candidates completed Ph.D./Postdoctoral degree in Mathematics , Applied Mathematics, Statistics, or a related field are eligible and encouraged to apply. Ability to analyze and solve complex math problems with a structured and logical approach. Ability to explain math concepts clearly using simple language, visuals, and examples.
Note that applications are not being accepted from your jurisdiction for this job currently via this jobsite. Candidate preferences are the decision of the Employer or Recruiting Agent, and are controlled by them alone.
To Search, View & Apply for jobs on this site that accept applications from your location or country, tap here to make a Search:
 
 
 
Search for further Jobs Here:
(Try combinations for better Results! Or enter less keywords for broader Results)
Location
Increase/decrease your Search Radius (miles)

Job Posting Language
Employment Category
Education (minimum level)
Filters
Education Level
Experience Level (years)
Posted in last:
Salary