[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

RE: [computer-go] future KGS Computer Go Tournaments - two sections?



This is too hard since it takes a hundred games or more to distinguish
between programs of such similar strength.  No one has time.  I did a series
of 260 test games against handtalk once, and the 40 game moving average win
rate varied from 28% to 63%.  I tried using 20 game median score, but that
varied from -25 to +30.

The variance from game to game in computer go is huge.

David

> -----Original Message-----
> From: computer-go-bounces@xxxxxxxxxxxxxxxxx 
> [mailto:computer-go-bounces@xxxxxxxxxxxxxxxxx] On Behalf Of 
> Christoph Birk
> Sent: Wednesday, May 11, 2005 11:38 AM
> To: computer-go@xxxxxxxxxxxxxxxxx
> Subject: Re: [computer-go] future KGS Computer Go Tournaments 
> - two sections?
> 
> 
> > I think the goal is that you don't want two (or more) basically
> > indistinguishable copies of a program playing in the same 
> tournament.  
> 
> Another simple way to define "sufficiently different" is to 
> compare the strength of the program. If 'B' wins agains 'A' 
> more than eg. 60% of the time, I would consider 'B' different 
> from 'A', whether it's derived from 'A' or not.
> 
> Christoph
>  
> _______________________________________________
> computer-go mailing list
> computer-go@xxxxxxxxxxxxxxxxx 
> http://www.computer-go.org/mailman/listinfo/computer-go/
> 


_______________________________________________
computer-go mailing list
computer-go@xxxxxxxxxxxxxxxxx
http://www.computer-go.org/mailman/listinfo/computer-go/