Dev Builds » 20221208-1943

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:59:32 584692 4000 1142 912 1946 +20.0 ± 5.26 6 352 1051 588 3 +40.66 ± 10.48
ncm-dbt-02 07:01:04 586159 4000 1125 899 1976 +19.65 ± 5.27 6 355 1048 589 2 +40.13 ± 10.5
ncm-dbt-03 07:00:05 585403 4000 1150 881 1969 +23.4 ± 5.25 7 326 1065 595 7 +47.01 ± 10.4
ncm-dbt-04 07:01:29 568817 4010 1116 872 2022 +21.17 ± 5.13 4 329 1095 573 4 +42.49 ± 10.23
ncm-dbt-05 07:02:13 577478 3990 1114 911 1965 +17.69 ± 5.21 5 353 1075 558 4 +35.65 ± 10.35
20000 5647 4475 9878 +20.38 ± 2.34 28 1715 5334 2903 20 +41.19 ± 4.65

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
431296 ncm-dbt-04 568434 10 4 3 3 +34.8 ± 62.53 0 0 4 1 0 +70.35 ± 134.03
431295 ncm-dbt-05 578588 490 136 122 232 +9.93 ± 15.2 3 44 134 64 0 +24.15 ± 29.34
431294 ncm-dbt-02 586477 500 145 102 253 +29.95 ± 13.84 0 33 141 76 0 +60.36 ± 28.36
431293 ncm-dbt-01 583824 500 131 109 260 +15.3 ± 15.09 2 45 132 71 0 +33.46 ± 29.64
431292 ncm-dbt-03 585379 500 146 106 248 +27.85 ± 15.74 0 46 121 80 3 +51.8 ± 31.04
431291 ncm-dbt-04 570388 500 145 109 246 +25.06 ± 14.42 0 39 137 73 1 +48.96 ± 28.96
431290 ncm-dbt-05 574135 500 149 101 250 +33.46 ± 14.99 0 38 128 82 2 +64.66 ± 30.12
431289 ncm-dbt-02 585379 500 141 111 248 +20.87 ± 15.5 1 48 121 80 0 +43.3 ± 31.03
431288 ncm-dbt-01 584790 500 132 114 254 +12.51 ± 15.48 1 53 123 73 0 +26.46 ± 30.78
431287 ncm-dbt-04 566454 500 147 111 242 +25.06 ± 14.42 0 39 137 73 1 +48.96 ± 28.96
431286 ncm-dbt-03 587749 500 152 116 232 +25.06 ± 13.89 0 36 142 72 0 +50.38 ± 28.27
431285 ncm-dbt-05 578712 500 134 106 260 +19.48 ± 14.13 0 41 140 69 0 +39.08 ± 28.58
431284 ncm-dbt-01 585674 500 142 119 239 +15.99 ± 15.62 1 51 123 74 1 +32.05 ± 30.78
431283 ncm-dbt-02 587707 500 141 123 236 +12.51 ± 15.72 2 52 122 74 0 +27.85 ± 30.9
431282 ncm-dbt-03 583028 500 141 113 246 +19.48 ± 14.65 2 39 138 71 0 +41.89 ± 28.84
431281 ncm-dbt-04 568474 500 131 109 260 +15.3 ± 14.06 1 40 145 64 0 +32.05 ± 27.93
431280 ncm-dbt-05 574175 500 139 114 247 +17.39 ± 14.62 0 46 133 71 0 +34.86 ± 29.51
431279 ncm-dbt-01 585843 500 152 114 234 +26.45 ± 14.52 0 39 135 75 1 +51.8 ± 29.22
431278 ncm-dbt-02 583908 500 136 104 260 +22.27 ± 15.11 1 43 130 75 1 +44.72 ± 29.89
431277 ncm-dbt-04 568156 500 140 96 264 +30.65 ± 15.06 1 39 125 85 0 +63.23 ± 30.52
431276 ncm-dbt-03 585843 500 142 106 252 +25.06 ± 14.68 0 42 130 78 0 +50.38 ± 29.88
431275 ncm-dbt-05 576088 500 140 113 247 +18.78 ± 14.6 0 44 136 69 1 +36.26 ± 29.12
431274 ncm-dbt-01 582068 500 153 103 244 +34.86 ± 14.57 0 36 128 86 0 +70.44 ± 30.11
431273 ncm-dbt-04 570869 500 133 115 252 +12.51 ± 13.83 1 39 152 57 1 +25.06 ± 26.98
431272 ncm-dbt-03 584664 500 134 116 250 +12.51 ± 14.49 1 45 139 65 0 +26.46 ± 28.74
431271 ncm-dbt-02 585211 500 137 109 254 +19.48 ± 14.78 2 40 136 72 0 +41.89 ± 29.11
431270 ncm-dbt-05 581652 500 145 121 234 +16.69 ± 14.44 0 44 139 66 1 +32.05 ± 28.73
431269 ncm-dbt-01 585337 500 150 116 234 +23.66 ± 14.05 0 37 143 69 1 +46.13 ± 28.15
431268 ncm-dbt-04 568792 500 139 95 266 +30.65 ± 15.56 0 45 117 87 1 +60.36 ± 31.55
431267 ncm-dbt-02 584076 500 127 120 253 +4.86 ± 15.47 0 61 121 68 0 +9.73 ± 31.02
431266 ncm-dbt-03 586139 500 143 119 238 +16.69 ± 15.44 3 43 132 71 1 +36.26 ± 29.64
431265 ncm-dbt-05 578506 500 143 123 234 +13.9 ± 14.73 0 49 132 69 0 +27.85 ± 29.65
431264 ncm-dbt-04 567720 500 131 110 259 +14.6 ± 14.0 0 43 143 64 0 +29.25 ± 28.2
431263 ncm-dbt-01 585548 500 131 128 241 +2.09 ± 14.99 2 53 135 60 0 +6.95 ± 29.28
431262 ncm-dbt-02 588174 500 143 115 242 +19.48 ± 14.26 0 41 141 67 1 +37.67 ± 28.45
431261 ncm-dbt-03 584453 500 153 103 244 +34.86 ± 14.31 0 33 135 81 1 +68.99 ± 29.16
431260 ncm-dbt-01 584453 500 151 109 240 +29.25 ± 14.46 0 38 132 80 0 +58.93 ± 29.6
431259 ncm-dbt-02 588345 500 155 115 230 +27.85 ± 14.23 0 37 136 77 0 +56.07 ± 29.07
431258 ncm-dbt-04 570068 500 146 124 230 +15.3 ± 14.71 1 45 135 69 0 +32.05 ± 29.26
431257 ncm-dbt-03 585970 500 139 102 259 +25.76 ± 15.35 1 42 128 77 2 +50.38 ± 30.14
431256 ncm-dbt-05 577971 500 128 111 261 +11.82 ± 15.06 2 47 133 68 0 +26.46 ± 29.52

Commit

Commit ID cb0c7a98485fbef4e5d6ed5f5b08201113ce0b4e
Author Guenther Demetz
Date 2022-12-08 19:43:21 UTC
Correctly output lowerbound/upperbound scores fixes the lowerbound/upperbound output by avoiding scores outside the alpha,beta bracket. Since SF search uses fail-soft we can't simply take the returned value as score. closes https://github.com/official-stockfish/Stockfish/pull/4259 No functional change
Copyright 2011–2025 Next Chess Move LLC