SLMB 0.1.0 · Full 2500 · gate GREEN · fp b8c02463 · 2,500 trials

The measured field · Full 2500 · 01 / 30

The SLMB leaderboard.

Actual local-model strikes. One current, complete Full 2500 run per model. Pass@1 decides the order; grade-weighted pass breaks ties. Every score links back to its run contract and trial evidence.
0 / 30published

Fast 250 · a fixed 250-test run drawn unchanged from Full 2500 — standard reply allowance 3,750 tokens. Full 2500 · the complete 2,500-test run — standard reply allowance published trial caps. Separate leaderboards and evidence; a Fast score is never a Full score or estimate. Provider-time figures reflect each run's recorded conditions — shared-GPU or concurrent timing is not standalone tok/s.

Cohort

Full 2500 · 2,500 gated trials

Ranking

pass@1 · 2,500-test run only

Reply budget

standard published trial caps

Ranking awaits verified evidence.

A complete, current Full 2500 provider strike is needed to enter this board.

slmb strike --mode full --model MODEL_ID · slmb sync

Looking for earlier scores? The retired 1,500-trial and Fast 100 editions measured 56 models. See the Legacy results.

Current · Full 2500

Top 30 results

0 real results qualify today. The board expands as new complete strikes are synced; no scores are simulated to fill the remaining positions.

No ranked model matches that search.

Rank always follows pass@1 — column headers re-sort the board without changing official position. Tier T1, T2, … groups models whose 95% intervals overlap the tier leader, so positions inside a tier are not statistically separated. Time, tokens, and heap are per-trial means; tok/s is derived. Oracle heap is the checker's memory, not the model's. Wilson uses trial rows; independent answer-shape clusters are shown on each model profile.

Inspect run provenance