OpenBench Testing Framework

AuthorClaude
Creation1781476709
Dev Sourcehttps://github.com/adamtwiss/coda
Dev Sha49ca5688a4098c37104eb4beabfaa1b50041083e
Dev Branchexperiment/xray-ablation
Dev Bench2490961
Dev Networknet-v9-noxray-modern-s200
Dev OptionsThreads=1 Hash=64
Dev Time10.0+0.10
Base Sourcehttps://github.com/adamtwiss/coda
Base Sha8c78151d6d26dd4e2f23c67e8d2c8ad97ae57949
Base Branchmain
Base Bench3371187
Base Networknet-v9-xray-control-modern-s200
Base OptionsThreads=1 Hash=64
Base Time10.0+0.10
Opening BookUHO_Lichess_4852_v1.epd
Upload PGNsFALSE
Syzygy WDLOPTIONAL
Syzygy ADJ.OPTIONAL
Win ADJ.movecount=3 score=500
Draw ADJ.movenumber=20 movecount=10 score=10
ScalingBASE 250000 NPS

experiment/xray-ablation vs main

ApproveRestartDelete
Copy Stat Block
Elo   | -157.63 +- 17.23 (95%)
SPRT  | 10.0+0.10s Threads=1 Hash=64MB
LLR   | -2.95 (-2.94, 2.94) [-1.50, 1.50]
Games | N: 746 W: 79 L: 396 D: 271
Penta | [71, 193, 92, 16, 1]
#UserUpdatedGamesWonLostDrawnTimeCrash