AI training & evaluation
HR Expert
Mercor
Mercor is hiring experienced HR professionals to build and review evaluation tasks for AI agents.
- Work arrangement & location
- Remote
- Compensation
- $95/hour
Track this job
- Engagement
- hourly
Employer description and requirements
Role Overview
- Mercor is hiring experienced HR professionals to build and review evaluation tasks for AI agents.
- Each task is set in a realistic simulated company, with the policies, employee records, case files, emails and HR systems a people team really uses.
- You make sure each task reads like a real request, the reference answer holds up against the source records, and the grading rubric checks what a senior HR leader would check.
Key Responsibilities
- Refine AI-drafted task prompts so they read like a real request from an HR director or manager, without giving the answer away.
- Check the reference answer against the world's files and app records, and correct what is wrong.
- Write and tighten grading rubrics: pass/fail criteria with exact values, plus the judgment calls a generalist would miss.
- Read how leading AI models attempt each task and confirm they fail for fair, defensible reasons.
- Work across talent acquisition and onboarding, performance management and succession, compensation, benefits and leave, employee relations and workplace investigations, separations, HR policy and employment-law compliance, people analytics, and organization design.
Ideal Qualifications
- 3+ years of HR experience. A leadership title or major-company background is a plus, but time in the field matters more.
- Bachelor's degree in human resources, business or a related field.
- Ownership of talent programs, employee-relations matters or compensation design, and working knowledge of employment law (Title VII, FLSA, ADA, or UK / EU equivalents).
- SHRM-SCP, SPHR or an international equivalent strongly preferred. Prior experience on a Mercor RL project is a plus.
Details
- Pay: $95/hour.
- You start with a short onboarding session and a paid skills assessment. Once you pass, you can claim your first task right away.
- Strong performers can move into reviewer and world lead roles.