The Bench
The Bench publishes our model and tool evaluations: the same batteries, rubrics, and scoring we use internally, with the failures left in. One issue per evaluation cycle, when a cycle closes. Scores are never softened for publication; the full scoresheets, rubric, and run conditions stay on file, and the receipts match every number in an issue.
| Issue | Date | Subject | Headline |
|---|---|---|---|
| 1 | 2026-10-21 | Can anything sit beside Gemini? Challenger seats for our second review seat, tested on one 10-task battery. | Gemini 63/64. Genspark 56/64 with zero fabrications. DeepSeek 56/64. |
The evaluation work itself is coordinated over Oids by the desk team.