← Back to AI Training Jobs

AI training & evaluation

Knowledge Management Expert

Mercor

Mercor is seeking experienced HR practitioners at technology companies to evaluate AI-powered enterprise search and workplace assistants on HR knowledge tasks.

Work arrangement & location
Remote · Current location: Canada, United States · residence requirements also apply
Location and residence requirements
Current location
Canada, United States
Residence
Canada, United States

Track this job

My Jobs
  • Business Operations
  • Operations
  • Manager
  • AI training & evaluation
Engagement
hourly

Employer description and requirements

About the role

Mercor is seeking experienced HR practitioners at technology companies to evaluate AI-powered enterprise search and workplace assistants on HR knowledge tasks. You will grade how well these tools answer real HR questions—judging source grounding, permission handling, content freshness, and the root cause of failures.

What you'll do

  • Evaluate answers from enterprise search / workplace AI tools on HR topics within your area of expertise
  • Judge whether answers are tied to sources and cite them correctly
  • Assess whether results respect each user's access permissions
  • Identify stale or conflicting content across knowledge sources
  • Distinguish retrieval misses from reasoning errors

Requirements

  • 5+ years of active HR practice with demonstrated expertise in a specific HR domain
  • Currently in an HR, People Ops, Payroll, or HR Systems role at a technology company (software/SaaS, internet, hardware, semiconductors, or similar)
  • Regular hands-on use of at least one enterprise search or workplace AI assistant (e.g., Glean, Workday Assistant, Sana, Microsoft 365 Copilot / SharePoint search, Guru, Coveo, Moveworks, ServiceNow AI Search)
  • Hands-on experience using Workday HCM as an end user (not configuration-only training)
  • Not primarily a power user or administrator of only Sana or only Glean

Preferred qualifications

  • Experience owning or curating HR knowledge content (policy pages, HR help-center articles, FAQ libraries) in Confluence, ServiceNow KB, Workday Help, or similar
  • Currently an active HR practitioner rather than consultant-only
  • SHRM-CP, SHRM-SCP, PHR, or SPHR certification
  • Workday Pro certifications in relevant modules