Electrical Engineering AI Model Evaluator

Data Annotation is looking for an Electrical Engineering AI Model Evaluator to evaluate how frontier AI models handle real electrical and electronics engineering work. You bring the judgment you have already built over years of designing, debugging, and shipping hardware. We bring engineering problems the models cannot yet solve on their own.

This is a new and growing area for our company, focused on teaching AI to reason correctly about circuits, systems, and physical constraints. Your engineering judgment, your standard for what counts as a correct answer, and the written rationale behind them become the signal that shapes the next generation of engineering tools.

• You will be able to choose which projects you want to work on and when
• You work on your own schedule, on your own computer, from the comfort of your own home
• Projects are paid hourly up to $40-$125 USD per hour, with bonus rates available on some projects

• Design challenging, realistic engineering problems from your own practice: a circuit to specify, a control loop to stabilize, a power stage to size
• Run those problems through frontier AI models and judge the output against your professional standard
• Compare two model versions on identical prompts and call which performed better, and where each fell short
• Critique model-generated derivations, schematics, component selections, and calculations, and write the reasoning behind your call
• Flag concrete failures with evidence: wrong assumptions, sign and unit errors, unphysical results, invalid topologies, fabricated datasheet values, off-brief interpretation
• Contribute across analog, RF and mixed-signal circuits, electromagnetics and antennas, control and systems, devices and materials, signal processing, photonics, and power and energy systems

• Fluency in English (native or bilingual level)
• 2+ years of industry experience in circuit or electronics engineering
• Background in electrical engineering, electronics engineering, or a closely related discipline
• Strong command of circuit analysis and design tradeoffs, and the ability to defend component-level and system-level decisions
• The ability to articulate why an answer is wrong, not only that it is
• Working comfort with AI tools, or the ability to pick them up quickly
• A current, in progress, or completed Bachelor’s is preferred but not required
• Note:
  
  Payment is made via Pay Pal. We will never ask for any money from you. Pay Pal will handle any currency conversions from USD. Only applicants in Australia, Canada, Ireland, New Zealand, the United Kingdom, and the United States will be considered for this role. This is an independent contractor position.