← Back to jobs

AI training & evaluation

Project Perseus | Data Quality Analyst - Multilingual (English + Additional Languages) - (Human-in-the-Loop AI)

Welocalize

Experience in AI/ML data workflows or human-in-the-loop evaluation environments

Compensation
$38/hour
Engagement
Full Time
Hours
40 hours per week
  • Data Annotation
  • Research & analysis

Employer description and requirements

Project Details Job Title: Data Quality Analyst Hiring Locations: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston Hours: Full-time, 40 hours per week Employment Type: W2 Full-Time Employee Work Authorization: Must be authorized to work in the U.S. (no visa sponsorship) Pay Rate: $38/hour Contract Duration: 1-year contract with possibility of extension Location Policy: 100% onsite position — remote work is not available. To be considered, candidates must be located in or able to commute to one of the target cities listed above. Important: This is a 100% onsite position — remote work is not available for this role. To be considered, candidates must be located in or able to commute to one of the following cities: NYC, Seattle, Bellevue, Redmond, San Francisco, Sunnyvale, Burlingame, Austin, Los Angeles, Washington DC, Chicago, Boston. Please only apply if you meet this location requirement.

What You’ll Do

Support quality and execution across DLA teams, ensuring work meets defined standards at scale

Audit DLA outputs and provide structured, actionable feedback to improve accuracy and consistency

Act as the first line of support for DLAs — answering questions and helping interpret guidelines

Help DLAs navigate ambiguity and apply evolving instructions effectively

Support onboarding and training of new DLAs through hands-on guidance and coaching

Monitor workflows, queues, and blockers — escalating risks and gaps to Team Leads

Identify patterns, recurring issues, and edge cases in both human and model outputs

Participate in calibrations, team discussions, and stakeholder syncs

Contribute to improving guidelines, processes, and overall team performance

Document findings and feedback in a clear, concise, and actionable way

What We’re Looking For

Language Requirements: Fluency in English plus two or more additional languages:

Primary Language (Must have at least one): French, Italian, Spanish, or German.

Secondary Language (Must have at least one): Portuguese, Russian, Polish, Turkish, or Vietnamese.

University degree (Bachelor’s or higher)

2–4 years of experience in data annotation, content quality, QA, or related fields

Strong ability to interpret and apply complex guidelines with consistency

Excellent attention to detail with a high bar for quality

Ability to stay consistent while working with evolving guidelines and priorities

Experience in AI/ML data workflows or human-in-the-loop evaluation environments

Prior experience auditing or reviewing the work of others

Familiarity with safety, compliance, or policy-driven content evaluation

Benefits

Paid Vacation: 6 days

Paid Company Holidays: 2 days (Memorial Day and Labor Day)

Paid Sick Leave: accrued per applicable state law and company policy

Medical, Dental, and Vision Insurance (eligibility applies)

Health Savings Account (HSA)

401(k) Retirement Plan

Employee Assistance Program

Additional voluntary benefits (life, accident, critical illness, etc.)

Free Gourmet Food: Free breakfast, lunch, and dinner are provided, featuring a wide variety of cuisines in multiple cafes.

Micro-kitchens & Snacks: Offices are stocked with free snacks and beverages, including premium coffee and La Croix.

Unique Campus Features: Some locations include roof-top nature parks

Commuter Benefits: Free transport, shuttles, and sometimes bike-to-work perks.