* benchmarks vs racket
@ 2011-10-12 16:24 Andy Wingo
2011-10-12 16:46 ` Andy Wingo
0 siblings, 1 reply; 2+ messages in thread
From: Andy Wingo @ 2011-10-12 16:24 UTC (permalink / raw)
To: guile-devel
Hi all,
I was recently reminded of the following benchmarks:
http://www.cs.utah.edu/~mflatt/benchmarks-20100126/log3/Benchmarks.html
All the caveats I just sent to guile-user still apply, but benchmarks
are fun. I re-ran this one with current Racket (v5.1.3 from Debian) and
Guile (git). The results are here:
fastest guile mzscheme
conform 1433 ms 1 -
cpstack 216 ms 7.62 1
ctak 2143 ms 1 1.01
dderiv 219 ms 5.00 1
deriv 191 ms 4.86 1
destruct 1570 ms 1 -
div 252 ms 5.75 1
dynamic 1423 ms 1 -
dynamic2 1213 ms 1.18 1
earley 323 ms 1.87 1
fft 728 ms 5.53 1
graphs 249 ms 8.90 1
lattice 12290 ms 1 -
lattice2 1584 ms 7.75 1
maze 1440 ms 1 -
maze2 180 ms 8.51 1
mazefun 415 ms 5.64 1
nboyer 4428 ms 1.53 1
nestedloop 333 ms 8.14 1
nfa 491 ms 14.12 1
nothing 0 ms 1 1
nqueens 225 ms 5.73 1
nucleic2 948 ms 5.72 1
paraffins 172 ms 2.67 1
peval 1840 ms 1 -
puzzle 119 ms 5.46 1
sboyer 3911 ms 5.81 1
scheme 647 ms 1 -
scheme2 169 ms 3.86 1
sort1 2443 ms 1 -
tak 169 ms 8.47 1
takl 269 ms 8.81 1
takr 1284 ms 1.16 1
takr2 1352 ms 1.09 1
triangle 439 ms 7.71 1
The dashes indicate tests that use mutable pairs. The benchmarks are
from
http://svn.plt-scheme.org/plt/trunk/collects/tests/mzscheme/benchmarks/common/,
checked out today. I don't know if running racket as mzscheme makes it
slower. I did fix the ms-per-tick when reading Guile's timings.
Anyway, it's clear that Racket is generally about 5 times as fast as
Guile right now, which is to be expected for the difference between
bytecode and native code. So I think that we do have a chance, once we
get native code, whenever that happens.
Andy
--
http://wingolog.org/
^ permalink raw reply [flat|nested] 2+ messages in thread
* Re: benchmarks vs racket
2011-10-12 16:24 benchmarks vs racket Andy Wingo
@ 2011-10-12 16:46 ` Andy Wingo
0 siblings, 0 replies; 2+ messages in thread
From: Andy Wingo @ 2011-10-12 16:46 UTC (permalink / raw)
To: guile-devel
Hi,
I've added some historical numbers as a fifth column here (hah!),
corresponding to our performance at 1.9.7, relative to mzscheme then.
Assuming mzscheme has improved, this is pretty great improvement over
the last 18 months.
On Wed 12 Oct 2011 18:24, Andy Wingo <wingo@pobox.com> writes:
> fastest guile mzscheme guile 1.9.7/mzscheme 4.2.4
> conform 1433 ms 1 - 6.36
> cpstack 216 ms 7.62 1 16.55
> ctak 2143 ms 1 1.01 -
> dderiv 219 ms 5.00 1 6.62
> deriv 191 ms 4.86 1 5.3
> destruct 1570 ms 1 - 17
> div 252 ms 5.75 1 15
> dynamic 1423 ms 1 - 2.57
> dynamic2 1213 ms 1.18 1 4.28
> earley 323 ms 1.87 1 7.54
> fft 728 ms 5.53 1 8.83
> graphs 249 ms 8.90 1 16.96
> lattice 12290 ms 1 - 17.9
> lattice2 1584 ms 7.75 1 17.58
> maze 1440 ms 1 - 8.75
> maze2 180 ms 8.51 1 25.85
> mazefun 415 ms 5.64 1 13.92
> nboyer 4428 ms 1.53 1 8.79
> nestedloop 333 ms 8.14 1 25.7
> nfa 491 ms 14.12 1 32.01
> nqueens 225 ms 5.73 1 14.62
> nucleic2 948 ms 5.72 1 9.48
> paraffins 172 ms 2.67 1 7.22
> peval 1840 ms 1 - 11.16
> puzzle 119 ms 5.46 1 12.99
> sboyer 3911 ms 5.81 1 18.69
> scheme 647 ms 1 - 7.18
> scheme2 169 ms 3.86 1 8.84
> sort1 2443 ms 1 - 9.12
> tak 169 ms 8.47 1 15.45
> takl 269 ms 8.81 1 16.9
> takr 1284 ms 1.16 1 4.23
> takr2 1352 ms 1.09 1 4.46
> triangle 439 ms 7.71 1 12.44
Andy
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2011-10-12 16:46 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2011-10-12 16:24 benchmarks vs racket Andy Wingo
2011-10-12 16:46 ` Andy Wingo
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).