[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: computer-go: Live or Die, test problems



At 12:09 PM 11/26/99 +0900, you wrote:
>
>>	Are Thomas Wolf's papers available on the internet or in books ?
>>
>http://www.maths.qmw.ac.uk/~tw/public2.html#3
>
>	Martin

Thomas Wolf's set of 64 problems looks like a reasonable test set.  It
has a good mix of very easy to very hard problems.  I entered the
problems (attached as an sgf file on 13x13 board), and tried them
against Many Faces.

The wolftest.prb file contains each of the 64 problems in sgf format,
concatenated together.  The first 8 are in a different order than in
Wolf's paper, Forward pruning and other heuristic search techniques in
tsume go.
The correct answer is indicated by the TE[2] property.

Many Faces here is running at the top playing level, but treating each
problem as a full board find the best move.  There is no special problem
solving mode in use, so it is spending as much time on each problem as
it would spend in a game.

Many Faces gets 34 of the 64 problems correct, using 158 seconds total,
and 6213 total evaluations, on a Pentium II-450.  I'm attaching the
results file.  

I'd like to see the results from other programs for comparison.  Thomas'
program solves all 64 correctly in 484 seconds on a Pentium-133, and
gets 46 correct using a total of ony 15 seconds.

David


Attachment: wolftest.prb
Description: Binary data

Testing on problems from C:\Go\WINGO\wolftest.prb at 11/29/99
Problem 1 - Computer moved C11 - Correct.  evals:52
Problem 2 - Computer moved K11 - Correct.  evals:50
Problem 3 - Computer moved D1 - Correct.  evals:64
Problem 4 - Computer moved M5 - Correct.  evals:85
Problem 5 - Computer moved D8 - Wrong.  evals:107
Problem 6 - Computer moved M10 - Wrong.  evals:102
Problem 7 - Computer moved B3 - Correct.  evals:145
Problem 8 - Computer moved N4 - Wrong.  evals:93
Problem 9 - Computer moved F4 - Wrong.  evals:148
Problem 10 - Computer moved L2 - Correct.  evals:82
Problem 11 - Computer moved H12 - Wrong.  evals:214
Problem 12 - Computer moved B8 - Wrong.  evals:170
Problem 13 - Computer moved C1 - Wrong.  evals:69
Problem 14 - Computer moved J1 - Wrong.  evals:133
Problem 15 - Computer moved G9 - Wrong.  evals:116
Problem 16 - Computer moved F10 - Correct.  evals:86
Problem 17 - Computer moved A4 - Correct.  evals:100
Problem 18 - Computer moved G6 - Correct.  evals:206
Problem 19 - Computer moved K12 - Wrong.  evals:79
Problem 20 - Computer moved G9 - Correct.  evals:76
Problem 21 - Computer moved D6 - Wrong.  evals:160
Problem 22 - Computer moved M1 - Correct.  evals:26
Problem 23 - Computer moved M11 - Correct.  evals:90
Problem 24 - Computer moved B8 - Wrong.  evals:203
Problem 25 - Computer moved B1 - Correct.  evals:160
Problem 26 - Computer moved M4 - Correct.  evals:68
Problem 27 - Computer moved M10 - Correct.  evals:75
Problem 28 - Computer moved C11 - Correct.  evals:112
Problem 29 - Computer moved B4 - Correct.  evals:90
Problem 30 - Computer moved M1 - Wrong.  evals:23
Problem 31 - Computer moved E12 - Wrong.  evals:257
Problem 32 - Computer moved C13 - Correct.  evals:130
Problem 33 - Computer moved C2 - Wrong.  evals:150
Problem 34 - Computer moved N4 - Correct.  evals:89
Problem 35 - Computer moved M10 - Correct.  evals:52
Problem 36 - Computer moved B11 - Correct.  evals:60
Problem 37 - Computer moved C2 - Correct.  evals:57
Problem 38 - Computer moved M2 - Wrong.  evals:68
Problem 39 - Computer moved L13 - Correct.  evals:40
Problem 40 - Computer moved B11 - Correct.  evals:29
Problem 41 - Computer moved D3 - Correct.  evals:119
Problem 42 - Computer moved L3 - Wrong.  evals:53
Problem 43 - Computer moved K11 - Wrong.  evals:117
Problem 44 - Computer moved C11 - Correct.  evals:8
Problem 45 - Computer moved E2 - Wrong.  evals:164
Problem 46 - Computer moved M2 - Correct.  evals:39
Problem 47 - Computer moved M11 - Correct.  evals:92
Problem 48 - Computer moved B12 - Wrong.  evals:38
Problem 49 - Computer moved G1 - Wrong.  evals:7
Problem 50 - Computer moved L6 - Wrong.  evals:84
Problem 51 - Computer moved M12 - Correct.  evals:30
Problem 52 - Computer moved B9 - Wrong.  evals:116
Problem 53 - Computer moved C2 - Wrong.  evals:38
Problem 54 - Computer moved J1 - Wrong.  evals:125
Problem 55 - Computer moved G13 - Correct.  evals:62
Problem 56 - Computer moved D13 - Wrong.  evals:85
Problem 57 - Computer moved B1 - Correct.  evals:182
Problem 58 - Computer moved N6 - Correct.  evals:37
Problem 59 - Computer moved L10 - Wrong.  evals:6
Problem 60 - Computer moved B13 - Correct.  evals:46
Problem 61 - Computer moved A5 - Wrong.  evals:16
Problem 62 - Computer moved N2 - Wrong.  evals:35
Problem 63 - Computer moved E5 - Wrong.  evals:385
Problem 64 - Computer moved F9 - Correct.  evals:213
34 correct answers out of 64 problems.  53%.  6213 life calls