SLMB 0.1.0 · Full 2500 · gate GREEN · fp b8c02463 · 2,500 trials

Archive · retired editions

Legacy results.

Every model measured on the original SLMB suites, kept exactly as it was struck: the 1,500-trial Full edition and the 100-trial Fast cohort. These suites were replaced by 2,500 and 250 newly authored tests, so these scores are a historical record, not a comparison point.
56preserved runs

Edition

Full 1500 · 1,500 trials

Reply budget

published trial caps

Status

frozen · superseded

Results here ran against suite 1adbc0d3703acf03 and cannot be mixed with the current boards: the tests, oracle rules, and family mix all changed. To rank a model today, strike it on the current suite.

Current leaderboard

The record

4 models · Full 1500

Models measured

4

Best pass@1

41.5%

rustlean

Median pass@1

31.1%

Spread

18%–41%

lowest to highest

Archive · Full 1500

All 4 models

Every model with a complete run, in its original order. Open a row for its per-family and per-grade results and run settings.

Rank follows the original pass@1 ordering; headers re-sort without changing it. Time, tokens, and heap are per-trial means; tok/s is derived. Raw evidence lives in runs/legacy/, and the retired suites in suites/slmb/legacy/.

How scores are computed