OpenBench Testing Framework

AuthorClaude
Creation1787681452
Dev Sourcehttps://github.com/adamtwiss/coda
Dev Shab54825881c5157bb886908ecaf115fa168d909b4
Dev Branchtry/see-quiet-eval
Dev Bench2334026
Dev Network
Dev OptionsThreads=1 Hash=64
Dev Time10.0+0.10
Base Sourcehttps://github.com/adamtwiss/coda
Base Sha960335eab7729fe2136a941bd7e52df4dcbcae0c
Base Branchmain
Base Bench2659499
Base Network
Base OptionsThreads=1 Hash=64
Base Time10.0+0.10
Opening BookUHO_Lichess_4852_v1.epd
Upload PGNsFALSE
Syzygy WDLOPTIONAL
Syzygy ADJ.OPTIONAL
Win ADJ.movecount=3 score=500
Draw ADJ.movenumber=20 movecount=10 score=10
ScalingBASE 250000 NPS

try/see-quiet-eval vs main

ApproveRestartDelete
Copy Stat Block
Elo   | -0.86 +- 1.80 (95%)
SPRT  | 10.0+0.10s Threads=1 Hash=64MB
LLR   | -2.97 (-2.94, 2.94) [0.00, 3.00]
Games | N: 37542 W: 9086 L: 9179 D: 19277
Penta | [106, 4531, 9595, 4428, 111]
#UserGamesPentaPairsTimeCrash