AI training & evaluation
Software Engineer - QC
Turing
We're staffing a frontier AI data initiative that builds the training data and evaluations used to develop and measure AI agents.
- Work arrangement & location
- Remote
Track this job
- Hours
- 20 hours per week
Employer description and requirements
About Turing
Turing is one of the world’s fastest-growing AI companies, accelerating the advancement and deployment of powerful AI systems.
Turing helps customers in two ways: Working with the world’s leading AI labs to advance frontier model capabilities in thinking, reasoning, coding, agentic behavior, multimodality, multilinguality, STEM and frontier knowledge; and leveraging that work to build real-world AI systems that solve mission-critical priorities for companies.
Role Overview
We're staffing a frontier AI data initiative that builds the training data and evaluations used to develop and measure AI agents. You'll join the QC team, the quality bar for the initiative — the last line of defense ensuring every task and rubric that ships is realistic, correct, and unambiguous.
What you'll do
- Review long-horizon agent tasks authored by the mining team for realism, correctness, and scope — catching flawed assumptions, ambiguity, and missing edge cases before tasks ship.
- Pressure-test rubrics: confirm they define completion precisely, grade consistently, and can't be gamed or misread.
- Validate tasks end-to-end against the connector environments they run in, verifying that stated objectives are actually achievable and that expected outcomes hold.
- Reproduce and debug failures, then feed clear, specific findings back to task authors and connector engineers.
- Define and improve QC standards, checklists, and processes as the initiative scales.
What we're looking for
- Strong backend software engineering, primarily in Python — you can read others' code, run it, and debug it independently.
- Working knowledge of GCP, Docker, virtual machines, and Harbor.
- Exceptional attention to detail and a high bar for correctness; you find the failure others missed.
- Sharp written communication — precise, actionable feedback on tasks and rubrics is the core of the role.
- Ability to reason about real-world workflows and judge whether a task faithfully represents one.
- High daily proficiency with AI coding tools (e.g., Claude Code, Cursor, Copilot) — a hard requirement.
Nice to have
- Experience in QA, evaluation design, red-teaming, or data quality at scale.
- Experience building or evaluating agentic/LLM systems.
- Familiarity with the SaaS tools being replicated (Slack, Linear, Jira, Notion, Gmail, wikis) at an API/data-model level.
- Candidates may specialize in QC, but the strongest profiles are excellent generalist backend engineers who can move across mining and connectors when needed.
Offer Details:
- Commitments Required: At least 4 hours per day and minimum 20 hours per week with overlap of 4 hours with PST.
- Employment type : Contractor assignment (no medical/paid leave)
- Duration of contract : 35 week [expected start date is next week]
- Location : India, Pakistan, Nigeria, Egypt, Ghana, Bangladesh, Turkey, Mexico