[erlang-questions] benchmarks game harsh criticism

[Isaac Gouy]

--- Brent Fulgham <bfulg@REDACTED> wrote:

> 
> On Nov 28, 2007, at 10:31 PM, Isaac Gouy wrote:
> >> Another basic mistake is that there is no indication of the
> variation
> >> in timing between benchmark runs. At least, not without digging a
> bit
> >> deeper: the excluded "Haskell GHC #4" result for N=9 on nsieve is
> >> 1.12 s, but in the full results for nsieve-bits, the result for
> N=9
> > on
> >> exactly the same program run by the same language implementation
> is
> >> 0.80 s.
> >
> > Are you sure the basic mistake is not yours?
> >
> > Gentoo : Intel® Pentium® 4
> >
> > nsieve,ghc,4,9, 1.124,
> >
> > nsievebits,ghc,4,9, 1.112
> 
> Oh --- he must have been comparing the runs on the two test machines 
> 
> (the Gentoo Intel Pentium 4
> and the Debian AMD Sempron):
> 
> Debian: AMD Sempron:
> 
> nsieve,ghc,4,9, 0.740
> nsievebits,ghc,4,9,0.744
  

http://shootout.alioth.debian.org/gp4/fulldata.php?test=nsievebits&p1=ghc-0&p2=ghc-4&p3=ghc-0&p4=ghc-0


      ____________________________________________________________________________________
Be a better sports nut!  Let your teams follow you 
with Yahoo Mobile. Try it now.  http://mobile.yahoo.com/sports;_ylt=At9_qDKvtAbMuh1G1SQtBI7ntAcJ