The measured field · Full 2500 · 01 / 30
The SLMB leaderboard.
Fast 250 · a fixed 250-test run drawn unchanged from Full 2500 — standard reply allowance 3,750 tokens. Full 2500 · the complete 2,500-test run — standard reply allowance published trial caps. Separate leaderboards and evidence; a Fast score is never a Full score or estimate. Provider-time figures reflect each run's recorded conditions — shared-GPU or concurrent timing is not standalone tok/s.
Cohort
Full 2500 · 2,500 gated trials
Ranking
pass@1 · 2,500-test run only
Reply budget
standard published trial caps
Ranking awaits verified evidence.
A complete, current Full 2500 provider strike is needed to enter this board.
slmb strike --mode full --model MODEL_ID · slmb sync
Looking for earlier scores? The retired 1,500-trial and Fast 100 editions measured 56 models. See the Legacy results.
Current · Full 2500
Top 30 results
0 real results qualify today. The board expands as new complete strikes are synced; no scores are simulated to fill the remaining positions.
No ranked model matches that search.
Rank always follows pass@1 — column headers re-sort the board without changing official position. Tier T1, T2, … groups models whose 95% intervals overlap the tier leader, so positions inside a tier are not statistically separated. Time, tokens, and heap are per-trial means; tok/s is derived. Oracle heap is the checker's memory, not the model's. Wilson uses trial rows; independent answer-shape clusters are shown on each model profile.
Inspect run provenance