The fluctuations of the test results is related (proportional?) to the variance of the test value. (Also the distribution function. A Gaussian? A Poisson?) The confident level can be calculated from the value of variance. Thus we need to know what's the variance of the outcome of games between two Go programs. For difference handicaps the values of the variance could be different. Is this variance independent of which these two programs are? To approximate one can determine the values of variance between two GnuGo programs for different handicaps. Also the variance between GnuGo and Manyfaces of Go for different handicaps. Since David Doshay's program is the offshoot of GnuGo, these variance values could be good approximations. This way one can obtain the values of variance on any PC through a large number of games. Save the more valuable CPU time for the 72-cpu cluster.
Daniel Liu
_______________________________________________
computer-go mailing list
computer-go@xxxxxxxxxxxxxxxxx
http://www.computer-go.org/mailman/listinfo/computer-go/