Software Engineer
You will review code an agent wrote and decide whether it works, whether it would survive review, and whether the tests that passed actually tested anything.
- up to $120 / hr
- Remote
- Contract · flexible hours
- Engineering & ML
- Feeds SWE-Forward
What we are looking for
Production experience, any stack
- Shipping experience — You have maintained code other people depended on
- Review judgment — You can tell a passing test from a meaningful one
- Debugging skill — Finding the bug rather than the symptom
- Clarity — Writing a review comment that explains the failure
Work you might do
- Reviewing and ranking model-generated solutions with technical rationale
- Writing reference implementations a model should have produced
- Designing tests that catch the edge cases a model missed
- Flagging patches that pass CI and break production
How it works
Apply now, or join the list.
- 01
Apply or join the waitlist
Apply for this role in a minute, or leave your email and field below.
- 02
Get invited when your world opens
We invite experts in waves, as environments in each field go live.
- 03
Define what correct means
Paid, remote contract work: set the rules agents are graded against and review their runs.
Not ready to apply? Join the expert waitlist and we will write when a world in your field opens.