Dev Builds » 20250112-2018

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:50:42 584366 4016 1558 537 1921 +90.31 ± 4.82 1 85 828 1080 14 +191.77 ± 11.78
ncm-dbt-02 06:50:45 585661 4008 1598 546 1864 +93.38 ± 4.94 2 95 772 1119 16 +199.27 ± 12.25
ncm-dbt-03 06:49:18 586905 4000 1564 531 1905 +91.8 ± 4.83 1 86 804 1097 12 +195.98 ± 11.97
ncm-dbt-04 06:49:31 571116 4002 1575 539 1888 +92.03 ± 4.8 5 74 810 1104 8 +198.46 ± 11.91
ncm-dbt-05 06:50:13 584613 3974 1549 557 1868 +88.6 ± 5.07 5 109 774 1087 12 +188.87 ± 12.24
20000 7844 2710 9446 +91.23 ± 2.19 14 449 3988 5487 62 +194.86 ± 5.38

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
395463 ncm-dbt-04 570348 2 1 0 1 +189.7 ± 55.98 0 0 0 1 0 +1129.65 ± 376.02
395462 ncm-dbt-02 588600 8 4 0 4 +190.56 ± 13.88 0 0 0 4 0 +1199.83 ± 250.99
395461 ncm-dbt-01 584579 16 7 2 7 +112.26 ± 65.75 0 0 3 5 0 +254.61 ± 287.37
395460 ncm-dbt-05 585590 474 183 74 217 +81.35 ± 14.78 1 14 98 123 1 +172.75 ± 34.54
395459 ncm-dbt-03 589155 500 196 61 243 +96.19 ± 14.56 1 14 85 149 1 +209.91 ± 37.16
395458 ncm-dbt-04 570268 500 196 70 234 +89.48 ± 14.59 2 10 101 134 3 +190.85 ± 33.97
395457 ncm-dbt-01 585126 500 192 65 243 +90.22 ± 12.91 0 8 107 135 0 +194.57 ± 32.69
395456 ncm-dbt-02 586604 500 195 60 245 +96.19 ± 14.41 0 15 87 146 2 +206.01 ± 36.74
395455 ncm-dbt-05 586266 500 196 70 234 +89.48 ± 13.69 0 12 101 136 1 +190.85 ± 33.97
395454 ncm-dbt-01 582652 500 199 60 241 +99.2 ± 13.67 0 6 105 133 6 +206.01 ± 32.92
395453 ncm-dbt-03 585169 500 191 71 238 +85.04 ± 14.78 0 20 91 138 1 +179.9 ± 35.84
395452 ncm-dbt-04 569869 500 190 66 244 +88.0 ± 14.12 1 12 100 136 1 +189.0 ± 34.18
395451 ncm-dbt-02 587494 500 199 57 244 +101.46 ± 13.37 0 7 97 143 3 +217.85 ± 34.53
395450 ncm-dbt-05 582945 500 192 64 244 +90.97 ± 14.47 1 14 92 142 1 +196.45 ± 35.72
395449 ncm-dbt-01 581610 500 189 68 243 +85.78 ± 13.46 0 12 105 133 0 +183.51 ± 33.24
395448 ncm-dbt-03 586097 500 197 70 233 +90.22 ± 13.39 0 10 104 135 1 +192.71 ± 33.34
395447 ncm-dbt-04 570669 500 191 62 247 +91.71 ± 14.49 2 11 94 142 1 +200.24 ± 35.32
395446 ncm-dbt-02 585253 500 205 79 216 +89.48 ± 13.22 0 9 107 133 1 +190.85 ± 32.75
395445 ncm-dbt-05 583992 500 200 74 226 +89.48 ± 13.69 0 10 107 130 3 +187.16 ± 32.81
395444 ncm-dbt-01 583489 500 190 68 242 +86.52 ± 13.63 0 10 111 126 3 +179.9 ± 32.11
395443 ncm-dbt-03 587792 500 199 78 223 +85.78 ± 14.07 0 14 103 131 2 +179.9 ± 33.65
395442 ncm-dbt-04 573284 500 201 74 225 +90.22 ± 12.91 0 8 107 135 0 +194.57 ± 32.69
395441 ncm-dbt-02 586139 500 192 75 233 +82.83 ± 15.14 1 18 97 131 3 +172.78 ± 34.76
395440 ncm-dbt-05 582277 500 199 66 235 +94.7 ± 14.09 1 11 93 144 1 +206.01 ± 35.51
395439 ncm-dbt-04 569270 500 195 63 242 +93.95 ± 13.45 0 10 99 140 1 +202.15 ± 34.28
395438 ncm-dbt-01 587409 500 195 65 240 +92.45 ± 14.05 0 15 90 145 0 +200.24 ± 36.12
395437 ncm-dbt-03 589240 500 194 63 243 +93.2 ± 12.95 0 6 109 133 2 +198.34 ± 32.19
395436 ncm-dbt-02 585084 500 204 77 219 +90.22 ± 14.31 1 12 98 137 2 +192.71 ± 34.55
395435 ncm-dbt-05 585632 500 194 71 235 +87.26 ± 13.95 1 11 103 134 1 +187.16 ± 33.6
395434 ncm-dbt-04 572276 500 196 71 233 +88.74 ± 12.88 0 7 112 130 1 +189.0 ± 31.75
395433 ncm-dbt-01 582152 500 199 67 234 +93.95 ± 13.92 0 11 99 137 3 +198.34 ± 34.31
395432 ncm-dbt-03 584874 500 189 57 254 +93.95 ± 13.13 0 7 106 135 2 +200.24 ± 32.81
395431 ncm-dbt-02 586054 500 190 58 252 +93.95 ± 13.77 0 10 101 136 3 +198.34 ± 33.9
395430 ncm-dbt-05 581943 500 194 75 231 +84.31 ± 15.85 1 23 85 138 3 +176.33 ± 36.85
395429 ncm-dbt-04 571873 500 201 71 228 +92.45 ± 13.11 0 9 102 139 0 +200.24 ± 33.67
395428 ncm-dbt-01 585506 500 199 74 227 +88.74 ± 14.13 0 14 99 135 2 +187.16 ± 34.38
395427 ncm-dbt-02 583614 500 206 81 213 +88.74 ± 13.98 0 14 98 137 1 +189.0 ± 34.56
395426 ncm-dbt-03 586393 500 200 67 233 +94.69 ± 13.14 0 7 105 136 2 +202.15 ± 32.99
395425 ncm-dbt-04 572195 500 204 62 234 +101.46 ± 13.04 0 7 95 147 1 +221.9 ± 34.93
395424 ncm-dbt-05 588260 500 191 63 246 +90.96 ± 14.02 0 14 95 140 1 +194.57 ± 35.13
395423 ncm-dbt-01 586774 500 188 68 244 +85.04 ± 13.44 1 9 109 131 0 +183.51 ± 32.46
395422 ncm-dbt-03 586520 500 198 64 238 +95.44 ± 13.15 0 8 101 140 1 +206.01 ± 33.8
395421 ncm-dbt-02 582110 500 203 59 238 +102.97 ± 13.54 0 10 87 152 1 +226.0 ± 36.75

Commit

Commit ID ea71a088435d4f1e51433c0a321f2afdff7814b1
Author Disservin
Date 2025-01-12 20:18:08 UTC
Improve Instrumented Python Testing Script For betting debugging and earlier stop in case of termination, like in https://github.com/official-stockfish/Stockfish/pull/5754#issuecomment-2576120357 closes https://github.com/official-stockfish/Stockfish/pull/5755 No functional change
Copyright 2011–2025 Next Chess Move LLC