Generalist Reviewer
You will review agent runs and flag where the output looks right and the work was not done. No domain licence required — careful reading and clear writing are the qualification.
- up to $40 / hr
- Remote
- Contract · flexible hours
- Language & writing
- For upcoming worlds
What we are looking for
Degree-level, fluent English
- Careful reading — You notice when a conclusion does not follow from what came before
- Clear writing — Complete sentences, specific objections
- Consistency — Comfort applying the same standard across many runs
- Honesty — Willingness to say you are unsure
Work you might do
- Reviewing agent trajectories against a written standard
- Flagging outputs that satisfy the format and miss the task
- Writing short, specific notes on why a run failed
- Helping calibrate difficulty across a task set
How it works
Apply now, or join the list.
- 01
Apply or join the waitlist
Apply for this role in a minute, or leave your email and field below.
- 02
Get invited when your world opens
We invite experts in waves, as environments in each field go live.
- 03
Define what correct means
Paid, remote contract work: set the rules agents are graded against and review their runs.
Not ready to apply? Join the expert waitlist and we will write when a world in your field opens.
More roles in general & writing