AI training & evaluation · Ongoing application opportunity
Legal Expert
DataAnnotation
Review AI output for invented citations, misapplied precedent, and jurisdictional errors, and rate the reasoning.
- Work arrangement & location
- Remote
- Compensation
- Up to $40 – $125+/hr
Track this job
Employer description and requirements
Overview
Models produce fluent legal analysis that is often subtly wrong: invented citations, misapplied precedent, and jurisdictional confusion. A plausible wrong answer in law has real consequences.
As a legal expert you'll grade AI legal reasoning against the standard of a careful practitioner and write the analysis the model should have produced.
What you’ll actually do
- Draft prompts that test how models handle contracts, statutes, procedure, and case analysis.
- Review AI output for invented citations, misapplied precedent, and jurisdictional errors, and rate the reasoning.
- Write the correct analysis when the model falls short, with the clarity of a well-drafted memo.
Roles this fits
Common backgrounds: Corporate Counsel, Associate General Counsel.
What we look for
- JD or equivalent, with practice experience or strong academic background.
- Sharp legal research and writing skills across at least one practice area.
- Clear written English: your explanations are the training signal.
How it works
Apply
Qualify
Work & get paid
Compensation
Up to $40 – $125+/hr depending on task difficulty and specialization. Many contributors add $10k–$100k+ a year; some make it their full-time income.
About DataAnnotation
DataAnnotation is where 100k+ experts train the world’s leading AI models. $150M+ paid to contributors to date, and the average contributor stays 5+ years. Flexible, remote, and always project-available.
Work details
- Commitment: Flexible hours
- Type: Independent contractor
- Payouts: Weekly