Provider evidence · synced Full 2500 runs
The record behind the score.
Fast 250 · a fixed 250-test run drawn unchanged from Full 2500 — standard reply allowance 3,750 tokens. Full 2500 · the complete 2,500-test run — standard reply allowance published trial caps. Separate leaderboards and evidence; a Fast score is never a Full score or estimate. Provider-time figures reflect each run's recorded conditions — shared-GPU or concurrent timing is not standalone tok/s.
Synced models
0
one newest strike per model
Ranked
0
complete current Full 2500 cohort
Suite fingerprint
b8c02463
b8c024631971e34e
Published contracts
2,500 trials in Full 2500 coverage
No provider runs synced yet.
Run a real model against the Full 2500 cohort, then sync its JSONL evidence.
slmb strike --mode full --model MODEL_ID · slmb sync
Publication rule
A Full 2500 rank is earned on the whole cohort.
This leaderboard accepts a current engine and oracle fingerprint, the complete unfiltered Full 2500 cohort, no sampling or limit, and one deduplicated result for every trial. Partial runs remain inspectable here and on the trial browser; they never compete against complete runs.
See the Full 2500 top 30