Russian Music Expert - Song Evaluation

Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab.

You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Russian and English.

• Compare AI-generated lyrics with published songs to identify similarities

• Rate lyrics based on quality, creativity, prompt adherence, and originality

• Evaluate whether lyrics sound natural, including word choice, slang, and regional expressions.

• Native or near-native proficiency in Russian, and the ability to follow detailed written instructions in English

• Experience as a songwriter, lyricist, performer, composer, or music journalist, with knowledge of the Russian music scene

• Headphones or studio monitors suitable for critical listening

• Formal training in music performance, theory, or composition

• Credited or published songwriting work

• Broad familiarity with contemporary Russian genres, sub-genres, and artists

• Start date:
  
  immediate

• Duration: up to 6 months

• Commitment: flexible. Most experts work around 20 hours per week; there is no cap

• Compensation: this role is currently paid hourly. The pay structure may move to per-task during the project; if it does, your effective hourly rate will stay the same.

We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.