[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
RE: [computer-go] future KGS Computer Go Tournaments - two sections?
This is too hard since it takes a hundred games or more to distinguish
between programs of such similar strength. No one has time. I did a series
of 260 test games against handtalk once, and the 40 game moving average win
rate varied from 28% to 63%. I tried using 20 game median score, but that
varied from -25 to +30.
The variance from game to game in computer go is huge.
David
> -----Original Message-----
> From: computer-go-bounces@xxxxxxxxxxxxxxxxx
> [mailto:computer-go-bounces@xxxxxxxxxxxxxxxxx] On Behalf Of
> Christoph Birk
> Sent: Wednesday, May 11, 2005 11:38 AM
> To: computer-go@xxxxxxxxxxxxxxxxx
> Subject: Re: [computer-go] future KGS Computer Go Tournaments
> - two sections?
>
>
> > I think the goal is that you don't want two (or more) basically
> > indistinguishable copies of a program playing in the same
> tournament.
>
> Another simple way to define "sufficiently different" is to
> compare the strength of the program. If 'B' wins agains 'A'
> more than eg. 60% of the time, I would consider 'B' different
> from 'A', whether it's derived from 'A' or not.
>
> Christoph
>
> _______________________________________________
> computer-go mailing list
> computer-go@xxxxxxxxxxxxxxxxx
> http://www.computer-go.org/mailman/listinfo/computer-go/
>
_______________________________________________
computer-go mailing list
computer-go@xxxxxxxxxxxxxxxxx
http://www.computer-go.org/mailman/listinfo/computer-go/