Archive · retired editions
Legacy results.
Edition
Full 1500 · 1,500 trials
Reply budget
published trial caps
Status
frozen · superseded
Results here ran against suite 1adbc0d3703acf03 and cannot be mixed with the current boards: the tests, oracle rules, and family mix all changed. To rank a model today, strike it on the current suite.
Current leaderboardThe record
4 models · Full 1500
Models measured
4
Best pass@1
41.5%
rustlean
Median pass@1
31.1%
Spread
18%–41%
lowest to highest
Archive · Full 1500
All 4 models
Every model with a complete run, in its original order. Open a row for its per-family and per-grade results and run settings.
Rank follows the original pass@1 ordering; headers re-sort without changing it. Time, tokens, and heap are per-trial means; tok/s is derived. Raw evidence lives in runs/legacy/, and the retired suites in suites/slmb/legacy/.
How scores are computed