← Back to jobs

AI training & evaluation

Andromeda Sadiradra - Audio Rater - Generalist - English (Australia)

Welocalize

Overview: We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents.

Work arrangement & location
Remote · Australia
Compensation
$27.30/hour
Hours
10 hours per week
  • AI Service General Application
  • Audio Speech

Employer description and requirements

Overview: We're looking for detail-oriented Audio Raters to evaluate conversations between users and AI voice agents. You'll listen to recorded interactions and assess the quality of the AI agent's responses across two key dimensions. Project Details: Start Date: ASAP Duration: 10 hours/week Job Type: Freelance Location: Remote (Australia) Language: Australian English Pay Rate: $27.30/hour

Responsibilities

Listen carefully to recorded conversations between a person and an AI voice agent

Rate each of the agent's turns on two independent 1–5 scales:

Content – Was the response helpful, relevant, and appropriate?

Prosody – Did the voice sound natural, well-paced, and expressive?

Write a short, specific, and clear justification for each score given

What We're Looking For

Strong listening and attention-to-detail skills

Ability to give consistent, well-reasoned ratings

Clear, concise written communication

Reliable availability for ~10 hours/week

Thank you for your interest in joining Welo Data’s community and contributing to this exciting project. We look forward to collaborating with you!

#L1-CC1