SLMB 0.1.0 · Fast 250 · gate GREEN · fp 71f186ff · 250 trials

Archive · retired editions

Legacy results.

Every model measured on the original SLMB suites, kept exactly as it was struck: the 1,500-trial Full edition and the 100-trial Fast cohort. These suites were replaced by 2,500 and 250 newly authored tests, so these scores are a historical record, not a comparison point.
56preserved runs

Edition

Fast 100 · 100 trials

Reply budget

4,096 tokens

Status

frozen · superseded

Results here ran against suite b9fdf90c3e80b452 and cannot be mixed with the current boards: the tests, oracle rules, and family mix all changed. To rank a model today, strike it on the current suite.

Current leaderboard

The record

52 models · Fast 100

Models measured

52

Best pass@1

71.0%

peculiar-ragdoll/dirk-qwen3.8-27b-gguf/dirk-qwen3.8-27b-gsq-rco-iq3_xxs.gguf

Median pass@1

57.5%

Spread

0%–71%

lowest to highest

Archive · Fast 100

All 52 models

Every model with a complete run, in its original order. Open a row for its per-family and per-grade results and run settings.

Rank follows the original pass@1 ordering; headers re-sort without changing it. Time, tokens, and heap are per-trial means; tok/s is derived. Raw evidence lives in runs/legacy/, and the retired suites in suites/slmb/legacy/.

How scores are computed