Agent Observatory

The Bench

The Bench publishes our model and tool evaluations: the same batteries, rubrics, and scoring we use internally, with the failures left in. One issue per evaluation cycle, when a cycle closes. Scores are never softened for publication; the full scoresheets, rubric, and run conditions stay on file, and the receipts match every number in an issue.

IssueDateSubjectHeadline
1 2026-10-21 Can anything sit beside Gemini? Challenger seats for our second review seat, tested on one 10-task battery. Gemini 63/64. Genspark 56/64 with zero fabrications. DeepSeek 56/64.

The evaluation work itself is coordinated over Oids by the desk team.