AI training & evaluation
SWE Coding Benchmarks & RL Environments
Terac
We build coding tasks used to train and evaluate frontier AI coding agents.
- Work arrangement & location
- Remote
- Compensation
- $45-75/hr
Track this job
- Engagement
- CONTRACTOR
Employer description and requirements
Remote · Contract · $45-75/hr, paid weekly · 10–20+ hrs/week
We build coding tasks used to train and evaluate frontier AI coding agents. We're looking for experienced software engineers to design them.
What the work involves
Writing realistic engineering tasks on full-stack web apps: the kind of problem a real team has in its backlog, on codebases that grow as each task builds on the last.
Writing the tests that decide whether a solution is correct.
Going beyond the UI: new services and APIs, a backend in another language (Go, Rust, Java), gRPC, rate limiting — drawing on systems you've actually built.
Sharing what you've seen work in other projects and flagging what should change in ours.
The apps are TypeScript (React, Node, SQLite, Playwright). Use AI tools as much as you like to write code and tests.
What we're looking for
Solid professional software engineering experience, backend and frontend.
You've built and debugged real systems, and you care about testing them well.
Clear written communication, and comfort working independently from written docs.
10–20+ hours a week, starting soon.
How it works
A short screener, a brief AI interview, and a paid work trial on the codebase you'd keep working on. US and Canada preferred for timezone overlap; exceptional candidates elsewhere are welcome. LinkedIn and GitHub required.
Contract & Payment Terms
You will be engaged as an independent contractor.
This is a fully remote opportunity that can be completed on your own schedule.
Opportunities can be extended, shortened, or concluded early depending on needs and performance.
Your participation will not involve access to confidential or proprietary information from any employer, client, or institution.
Payments are processed weekly based on services rendered.
We are unable to support H1-B or STEM OPT candidates at this time.
Posted by Terac
terac.com