← Back to AI Training Jobs

AI training & evaluation

Software Engineer - QC

Turing

We're staffing a frontier AI data initiative that builds the training data and evaluations used to develop and measure AI agents.

Work arrangement & location
Remote

Track this job

My Jobs
  • Software development
  • Software Engineering
  • Technical
  • AI training & evaluation
Hours
20 hours per week

Employer description and requirements

About Turing

Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems.

Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.

Role Overview

We're staffing a frontier AI data initiative that builds the training data and evaluations used to develop and measure AI agents. You'll join the QC team, the quality bar for the initiative — the last line of defense ensuring every task and rubric that ships is realistic, correct, and unambiguous.

What you'll do

  • Review long-horizon agent tasks authored by the mining team for realism, correctness, and scope — catching flawed assumptions, ambiguity, and missing edge cases before tasks ship.
  • Pressure-test rubrics: confirm they define completion precisely, grade consistently, and can't be gamed or misread.
  • Validate tasks end-to-end against the connector environments they run in, verifying that stated objectives are actually achievable and that expected outcomes hold.
  • Reproduce and debug failures, then feed clear, specific findings back to task authors and connector engineers.
  • Define and improve QC standards, checklists, and processes as the initiative scales.

What we're looking for

  • Strong backend software engineering, primarily in Python — you can read others' code, run it, and debug it independently.
  • Working knowledge of GCP, Docker, virtual machines, and Harbor.
  • Exceptional attention to detail and a high bar for correctness; you find the failure others missed.
  • Sharp written communication — precise, actionable feedback on tasks and rubrics is the core of the role.
  • Ability to reason about real-world workflows and judge whether a task faithfully represents one.
  • High daily proficiency with AI coding tools (e.g., Claude Code, Cursor, Copilot) — a hard requirement.

Nice to have

  • Experience in QA, evaluation design, red-teaming, or data quality at scale.
  • Experience building or evaluating agentic/LLM systems.
  • Familiarity with the SaaS tools being replicated (Slack, Linear, Jira, Notion, Gmail, wikis) at an API/data-model level.
  • Candidates may specialize in QC, but the strongest profiles are excellent generalist backend engineers who can move across mining and connectors when needed.

Offer Details:

  • Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST.
  • Employment type : Contractor assignment (no medical/paid leave)
  • Duration of contract : 35 week [expected start date is next week]
  • Location : India, Pakistan, Nigeria, Egypt, Ghana, Bangladesh, Turkey, Mexico