[computer-go] GnuGo self testing results

[Don Dailey <drd@xxxxxxx>]

I discovered a  minor but serious bug with the  ruby autotester I made
available a few days ago.  The  bug was that the autotester always set
each program to play on a 9x9 board, no matter how you actually set it
up.  The log file would show  a 19x19 board but the programs were only
playing to the LR 9x9 quadrant.  If anyone want the fix let me know.


So  I  have been  self-play  testing  gnugo  3.3.21 at  various  level
settings with my autotester to make sure it was bug-free at 19x19.

Strangely, the default  level 10 seems to play  a slightly weaker game
than some  of the lower levels,  but the others are  almost in perfect
order.  This of course could change  when more games are played and we
have a larger and probably more representative sample.  There does not
appear to be  a huge difference in levels,  the difference between the
lowest and highest level is approx 200 ELO rating points.




 Rating  Win perc  Tot Gms  Ave Time  Player
-------  --------  -------  --------  ------
 1608.5    63.388      183     338.8  g9
 1589.1    62.304      191     254.7  g8
 1559.7    57.055      163     264.2  g7
 1545.7    55.346      159     207.7  g6
 1543.5    55.135      185     366.3  g10
 1482.6    48.421      190     160.2  g5
 1429.0    38.953      172     136.9  g4
 1426.3    40.000      155     100.2  g2
 1417.0    39.355      155     112.9  g3
 1398.6    35.583      163      87.2  g1

Black wins:      490      57.1 %
White wins:      368      42.9 %

Apparently, I  set the  komi too low  as black  is winning 57%  of the
games.   I'm using 5.5 Komi


The amount of time  it takes to play each game is  pretty much in line
with the level  settings.  Level 10 takes just over  4 times longer on
average to play a move (or a game.)



I used these settings for the registry file of the autotester:

----------[ gnugo_test.reg ]--------
komi 5.5
size 19
games 100

g1   gnugo --boardsize 19 --mode gtp --level 1  --score aftermath --capture-all-dead --chinese-rules
g2   gnugo --boardsize 19 --mode gtp --level 2  --score aftermath --capture-all-dead --chinese-rules
g3   gnugo --boardsize 19 --mode gtp --level 3  --score aftermath --capture-all-dead --chinese-rules
g4   gnugo --boardsize 19 --mode gtp --level 4  --score aftermath --capture-all-dead --chinese-rules
g5   gnugo --boardsize 19 --mode gtp --level 5  --score aftermath --capture-all-dead --chinese-rules
g6   gnugo --boardsize 19 --mode gtp --level 6  --score aftermath --capture-all-dead --chinese-rules
g7   gnugo --boardsize 19 --mode gtp --level 7  --score aftermath --capture-all-dead --chinese-rules
g8   gnugo --boardsize 19 --mode gtp --level 8  --score aftermath --capture-all-dead --chinese-rules
g9   gnugo --boardsize 19 --mode gtp --level 9  --score aftermath --capture-all-dead --chinese-rules
g10  gnugo --boardsize 19 --mode gtp --level 10 --score aftermath --capture-all-dead --chinese-rules


_______________________________________________
computer-go mailing list
computer-go@xxxxxxxxxxxxxxxxx
http://computer-go.org/mailman/listinfo/computer-go