unofficial mirror of guile-user@gnu.org 
 help / color / mirror / Atom feed
From: Neil Jerram <neil@ossau.uklinux.net>
To: Guile Development <guile-devel@gnu.org>,
	Guile User List <guile-user@gnu.org>
Subject: Benchmarks and performance tracking
Date: Wed, 16 Apr 2008 21:50:21 +0100	[thread overview]
Message-ID: <87r6d5o776.fsf@ossau.uklinux.net> (raw)

I think it would be good if we could track Guile's performance better,
and how it changes over time.  But...

1. We don't currently have many benchmarks.  There are just 3 in the
   repo, and they're all pretty trivial.

2. I have no experience in, and no immediate feel for, how we manage
   the output from benchmarks.  I'm thinking of things like

   - needing to run benchmarks multiple times, in order to average out
     effects like the code being cached in memory

   - different people running the benchmarks in different environments
     (architectures, chip speeds etc.), and whether the results from
     those environments can be sensibly merged or collated

   - how best to present results, and show how they change over time
     (i.e. with Guile releases).

(And I imagine there are other problems and subtleties that I haven't
even thought of...)

So, any help or advice on these points would be much appreciated!  If
anyone has some interesting benchmark code that they'd like to
contribute, or wants to write new benchmarks, please do so.  Or if
there are standard Scheme benchmarks that we could incorporate, please
point them out.

And then if anyone has expertise on actually running benchmarks
regularly, and collating and presenting the results, and would like to
contribute that, please go ahead!

Many thanks,
    Neil





                 reply	other threads:[~2008-04-16 20:50 UTC|newest]

Thread overview: [no followups] expand[flat|nested]  mbox.gz  Atom feed

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

  List information: https://www.gnu.org/software/guile/

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=87r6d5o776.fsf@ossau.uklinux.net \
    --to=neil@ossau.uklinux.net \
    --cc=guile-devel@gnu.org \
    --cc=guile-user@gnu.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).