SLMB 0.1.0 · Full 2500 · gate GREEN · fp b8c02463 · 2,500 trials

Provider evidence · synced Full 2500 runs

The record behind the score.

SLMB publishes the newest valid provider strike for each model on this cohort. Every contract below carries its suite, rules, filter, sample plan, and source file. Coverage determines whether it can enter the Full 2500 leaderboard.

Fast 250 · a fixed 250-test run drawn unchanged from Full 2500 — standard reply allowance 3,750 tokens. Full 2500 · the complete 2,500-test run — standard reply allowance published trial caps. Separate leaderboards and evidence; a Fast score is never a Full score or estimate. Provider-time figures reflect each run's recorded conditions — shared-GPU or concurrent timing is not standalone tok/s.

Synced models

0

one newest strike per model

Ranked

0

complete current Full 2500 cohort

Suite fingerprint

b8c02463

b8c024631971e34e

Published contracts

2,500 trials in Full 2500 coverage

Published contracts

No provider runs synced yet.

Run a real model against the Full 2500 cohort, then sync its JSONL evidence.

slmb strike --mode full --model MODEL_ID · slmb sync

Publication rule

A Full 2500 rank is earned on the whole cohort.

This leaderboard accepts a current engine and oracle fingerprint, the complete unfiltered Full 2500 cohort, no sampling or limit, and one deduplicated result for every trial. Partial runs remain inspectable here and on the trial browser; they never compete against complete runs.

See the Full 2500 top 30