Dev Builds » 20180307-2151

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:23:51 584844 4000 26 2905 1069 -315.17 ± 8.38 914 1051 35 0 0 -821.66 ± 59.74
ncm-dbt-02 06:24:36 591952 4000 34 2935 1031 -319.16 ± 8.57 938 1025 37 0 0 -811.92 ± 57.98
ncm-dbt-03 06:25:32 586754 4000 27 2928 1045 -319.16 ± 8.53 935 1031 34 0 0 -826.74 ± 60.69
ncm-dbt-04 06:25:28 568665 4000 34 2934 1032 -318.98 ± 8.68 944 1013 42 1 0 -781.52 ± 54.14
ncm-dbt-05 06:25:51 582700 4000 33 2894 1073 -311.94 ± 8.37 904 1053 43 0 0 -785.55 ± 53.5
20000 154 14596 5250 -316.87 ± 3.8 4635 5173 191 1 0 -804.5 ± 24.8

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
476582 ncm-dbt-05 582235 500 3 368 129 -322.66 ± 24.16 118 129 3 0 0 -887.58 ± 222.18
476581 ncm-dbt-04 566138 500 6 375 119 -328.69 ± 26.27 126 117 7 0 0 -739.05 ± 163.27
476580 ncm-dbt-02 593586 500 5 381 114 -339.62 ± 26.83 131 114 5 0 0 -798.18 ± 231.48
476579 ncm-dbt-01 584159 500 4 353 143 -299.96 ± 22.26 104 141 5 0 0 -798.18 ± 231.48
476578 ncm-dbt-03 586266 500 2 361 137 -313.9 ± 23.18 112 135 3 0 0 -887.58 ± 222.18
476577 ncm-dbt-03 587113 500 2 366 132 -321.18 ± 23.64 116 132 2 0 0 -958.31 ± 196.57
476576 ncm-dbt-05 582945 500 2 356 142 -306.83 ± 22.05 106 142 2 0 0 -958.31 ± 196.57
476575 ncm-dbt-01 583405 500 2 371 127 -328.69 ± 24.47 121 127 2 0 0 -958.31 ± 196.57
476574 ncm-dbt-02 592547 500 4 360 136 -309.64 ± 23.37 111 134 5 0 0 -798.18 ± 231.48
476573 ncm-dbt-04 568395 500 3 371 126 -327.17 ± 24.67 121 126 3 0 0 -887.58 ± 222.18
476572 ncm-dbt-05 584664 500 5 351 144 -295.93 ± 22.43 103 140 7 0 0 -739.05 ± 163.27
476571 ncm-dbt-02 592979 500 3 366 131 -319.71 ± 23.83 116 131 3 0 0 -887.58 ± 222.18
476570 ncm-dbt-01 584076 500 2 355 143 -305.44 ± 23.22 109 135 6 0 0 -766.17 ± 188.02
476569 ncm-dbt-03 586858 500 3 361 136 -312.47 ± 23.7 113 132 5 0 0 -798.18 ± 231.48
476568 ncm-dbt-04 568951 500 3 369 128 -324.16 ± 25.04 121 124 5 0 0 -798.18 ± 231.48
476567 ncm-dbt-05 585337 500 5 375 120 -330.22 ± 26.8 128 114 8 0 0 -715.51 ± 146.53
476566 ncm-dbt-01 586477 500 2 365 133 -319.71 ± 23.83 116 131 3 0 0 -887.58 ± 222.18
476565 ncm-dbt-02 590138 500 4 358 138 -306.83 ± 22.72 108 138 4 0 0 -837.28 ± 240.94
476564 ncm-dbt-04 569709 500 4 366 130 -318.24 ± 24.7 118 126 6 0 0 -766.17 ± 188.02
476563 ncm-dbt-03 586901 500 0 374 126 -336.44 ± 24.55 124 126 0 0 0 -1199.83 ± 0.0
476562 ncm-dbt-02 589582 500 8 361 131 -305.44 ± 23.85 111 131 8 0 0 -715.51 ± 146.53
476561 ncm-dbt-01 586097 500 6 371 123 -322.66 ± 25.22 121 123 6 0 0 -766.17 ± 188.02
476560 ncm-dbt-05 581985 500 5 356 139 -302.69 ± 22.58 106 139 5 0 0 -798.18 ± 231.48
476559 ncm-dbt-03 585843 500 6 364 130 -312.47 ± 24.36 115 128 7 0 0 -739.05 ± 163.27
476558 ncm-dbt-04 570268 500 2 362 136 -315.34 ± 23.34 113 134 3 0 0 -887.58 ± 222.18
476557 ncm-dbt-02 594019 500 2 372 126 -330.22 ± 24.64 122 126 2 0 0 -958.31 ± 196.57
476556 ncm-dbt-01 585211 500 3 359 138 -309.64 ± 22.7 109 138 3 0 0 -887.58 ± 222.18
476555 ncm-dbt-04 569111 500 2 363 135 -316.79 ± 23.85 115 131 4 0 0 -837.28 ± 240.94
476554 ncm-dbt-05 578753 500 3 364 133 -316.79 ± 24.19 116 129 5 0 0 -798.18 ± 231.48
476553 ncm-dbt-03 588260 500 4 367 129 -319.71 ± 24.87 119 125 6 0 0 -766.17 ± 188.02
476552 ncm-dbt-01 585000 500 3 366 131 -319.71 ± 24.87 119 125 6 0 0 -766.17 ± 188.02
476551 ncm-dbt-02 592245 500 2 369 129 -325.66 ± 24.14 119 129 2 0 0 -958.31 ± 196.57
476550 ncm-dbt-04 567997 500 9 371 120 -318.24 ± 26.02 122 118 10 0 0 -676.04 ± 124.55
476549 ncm-dbt-03 584874 500 7 372 121 -322.66 ± 25.56 122 121 7 0 0 -739.05 ± 163.27
476548 ncm-dbt-05 582945 500 5 361 134 -309.64 ± 23.7 112 132 6 0 0 -766.17 ± 188.02
476547 ncm-dbt-01 584327 500 4 365 131 -316.79 ± 23.85 115 131 4 0 0 -837.28 ± 240.94
476546 ncm-dbt-05 582736 500 5 363 132 -312.47 ± 24.36 115 128 7 0 0 -739.05 ± 163.27
476545 ncm-dbt-02 590524 500 6 368 126 -318.24 ± 25.37 120 122 8 0 0 -715.51 ± 146.53
476544 ncm-dbt-03 587919 500 3 363 134 -315.34 ± 23.69 114 132 4 0 0 -837.28 ± 240.94
476543 ncm-dbt-04 568752 500 5 357 138 -304.07 ± 23.38 108 137 4 1 0 -766.23 ± 273.11

Commit

Commit ID 82697f1193cc8c99c99c282361a3ada25c758243
Author IIvec
Date 2018-03-07 21:51:31 UTC
Simplification: use Arctan for the optimism S-curve This was an idea of Gontran Lemaire (gonlem), but the graphs he published did not seem accurate to me. I did my own graphs, got my own constants and here is the result: STC: LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 42179 W: 8704 L: 8622 D: 24853 http://tests.stockfishchess.org/tests/view/5a9db6270ebc590297cb611b LTC: LLR: 2.96 (-2.94,2.94) [-3.00,1.00] Total: 17737 W: 2702 L: 2577 D: 12458 http://tests.stockfishchess.org/tests/view/5a9eb5b20ebc590297cb61b2 Note: we are now back to 70% draw rate in selfplay mode! Bench: 5544908
Copyright 2011–2026 Next Chess Move LLC