ML Research Expert
You will judge whether an agent did machine-learning research or only produced a score. Data handling, experiment design and results that hold on held-out answers.
- up to $160 / hr
- Remote
- Contract · flexible hours
- Engineering & ML
- Feeds SimReal-MLBench
What we are looking for
Published author with benchmark or competition work
- Publications — First-author papers or top competition finishes
- Experiment design — You know what a fair baseline is
- Leakage instinct — You find the split that leaked
- Clarity — You can write a task an agent cannot misread
Work you might do
- Authoring research tasks graded by the platform that holds the answers
- Reviewing agent experiments for leakage and cherry-picking
- Writing reference solutions and baselines
- Designing tasks where overfitting the public split fails
How it works
Apply now, or join the list.
- 01
Apply or join the waitlist
Apply for this role in a minute, or leave your email and field below.
- 02
Get invited when your world opens
We invite experts in waves, as environments in each field go live.
- 03
Define what correct means
Paid, remote contract work: set the rules agents are graded against and review their runs.
Not ready to apply? Join the expert waitlist and we will write when a world in your field opens.