RE: computer-go: Live or Die, test problems

[Martin Mueller <mueller@xxxxxxxxx>]

>The wolftest.prb file contains each of the 64 problems in sgf format,
>concatenated together.  The first 8 are in a different order than in
>Wolf's paper, Forward pruning and other heuristic search techniques in
>tsume go.
>The correct answer is indicated by the TE[2] property.
>
>Many Faces here is running at the top playing level, but treating each
>problem as a full board find the best move.  There is no special problem
>solving mode in use, so it is spending as much time on each problem as
>it would spend in a game.
>
>Many Faces gets 34 of the 64 problems correct, using 158 seconds total,
>and 6213 total evaluations, on a Pentium II-450.  I'm attaching the
>results file.
>
>I'd like to see the results from other programs for comparison.  Thomas'
>program solves all 64 correctly in 484 seconds on a Pentium-133, and
>gets 46 correct using a total of ony 15 seconds.

Thanks David for the test set. For comparison, Explorer gets 31 correct, 33
wrong using a similar setup as you. I gave it 10 seconds average time per
move, but it used 15-20 seconds for some of the problems. Machine is Mac
G3/400. Overall, Explorer seems to do better on the first part of the set
but very badly towards the end. Are these problems sorted by difficulty?

	Martin

Move C11 done 1 of 64, +1/-0
Move K11  done 2 of 64, +2/-0
Move D1 done 3 of 64, +3/-0
Move M5 done 4 of 64, +4/-0
Move A11 done 5 of 64, +4/-1
Move N12 done 6 of 64, +5/-1
Move B3 done 7 of 64, +6/-1
Move M1 done 8 of 64, +7/-1
Move D7 done 9 of 64, +7/-2
Move L2 done 10 of 64, +8/-2
Move H12 done 11 of 64, +8/-3
 Move B11 done 12 of 64, +8/-4
 Move L5 done 13 of 64, +8/-5
 Move L3 done 14 of 64, +8/-6
 Move J7 done 15 of 64, +9/-6
 Move F10 done 16 of 64, +10/-6
 Move A4  done 17 of 64, +11/-6
 Move H7  done 18 of 64, +11/-7
 Move M11 done 19 of 64, +11/-8
 Move C9 done 20 of 64, +11/-9
 Move C11 done 21 of 64, +11/-10
 Move M1 done 22 of 64, +12/-10
 Move D10 done 23 of 64, +12/-11
 Move C8 done 24 of 64, +13/-11
 Move B1 done 25 of 64, +14/-11
 Move L4  done 26 of 64, +14/-12
 Move M10 done 27 of 64, +15/-12
 Move C11 done 28 of 64, +16/-12
 Move D2 done 29 of 64, +16/-13
 Move L2  done 30 of 64, +17/-13
 Move F11 done 31 of 64, +18/-13
 Move C13  done 32 of 64, +19/-13
 Move E2 done 33 of 64, +19/-14
 Move N4  done 34 of 64, +20/-14
 Move M10  done 35 of 64, +21/-14
 Move B11 done 36 of 64, +22/-14
 Move C2 done 37 of 64, +23/-14
 Move N2 done 38 of 64, +24/-14
 Move L13 done 39 of 64, +25/-14
 Move B11 done 40 of 64, +26/-14
 Move K4 done 41 of 64, +26/-15
 Move K10  done 42 of 64, +26/-16
 Move E11  done 43 of 64, +26/-17
 Move C11 done 44 of 64, +27/-17
 Move B2 done 45 of 64, +28/-17
 Move K10 done 46 of 64, +28/-18
 Move M11  done 47 of 64, +29/-18
 Move C5 done 48 of 64, +29/-19
 Move L9 done 49 of 64, +29/-20
 Move K4 done 50 of 64, +29/-21
 Move L12 done 51 of 64, +29/-22
 Move A10 done 52 of 64, +30/-22
 Move D1 done 53 of 64, +30/-23
 Move N2 done 54 of 64, +30/-24
 Move J12 done 55 of 64, +30/-25
 Move L3 done 56 of 64, +30/-26
 Move B1 done 57 of 64, +31/-26
 Move N4  done 58 of 64, +31/-27
 Move L12 done 59 of 64, +31/-28
 Move C5 done 60 of 64, +31/-29
 Move C9 done 61 of 64, +31/-30
 Move E3 done 62 of 64, +31/-31
 Move L3 done 63 of 64, +31/-32
 Move F3 done 64 of 64, +31/-33