From mboxrd@z Thu Jan  1 00:00:00 1970
Path: news.gmane.org!not-for-mail
From: =?utf-8?Q?Juhani_Viher=C3=A4koski?= <moonshine@kapsi.fi>
Newsgroups: gmane.lisp.guile.devel
Subject: Re: Enormous benchmark speedup
Date: Sun, 26 Jul 2009 04:09:52 +0300 (EEST)
Message-ID: <Pine.LNX.4.64.0907260347570.16144@lakka.kapsi>
References: <Pine.LNX.4.64.0907011729050.2186@lakka.kapsi>
	<Pine.LNX.4.64.0907021507540.13026@lakka.kapsi>
	<m3ab2vgkgk.fsf@pobox.com>
NNTP-Posting-Host: lo.gmane.org
Mime-Version: 1.0
Content-Type: TEXT/PLAIN; charset=US-ASCII; format=flowed
X-Trace: ger.gmane.org 1248570629 2264 80.91.229.12 (26 Jul 2009 01:10:29 GMT)
X-Complaints-To: usenet@ger.gmane.org
NNTP-Posting-Date: Sun, 26 Jul 2009 01:10:29 +0000 (UTC)
Cc: guile-devel@gnu.org
To: Andy Wingo <wingo@pobox.com>
Original-X-From: guile-devel-bounces+guile-devel=m.gmane.org@gnu.org Sun Jul 26 03:10:22 2009
Return-path: <guile-devel-bounces+guile-devel=m.gmane.org@gnu.org>
Envelope-to: guile-devel@m.gmane.org
Original-Received: from lists.gnu.org ([199.232.76.165])
	by lo.gmane.org with esmtp (Exim 4.50)
	id 1MUsFp-0003Rp-Lm
	for guile-devel@m.gmane.org; Sun, 26 Jul 2009 03:10:21 +0200
Original-Received: from localhost ([127.0.0.1]:34939 helo=lists.gnu.org)
	by lists.gnu.org with esmtp (Exim 4.43)
	id 1MUsFo-0000bf-Ml
	for guile-devel@m.gmane.org; Sat, 25 Jul 2009 21:10:20 -0400
Original-Received: from mailman by lists.gnu.org with tmda-scanned (Exim 4.43)
	id 1MUsFh-0000Wr-8F
	for guile-devel@gnu.org; Sat, 25 Jul 2009 21:10:13 -0400
Original-Received: from exim by lists.gnu.org with spam-scanned (Exim 4.43)
	id 1MUsFc-0000SO-It
	for guile-devel@gnu.org; Sat, 25 Jul 2009 21:10:12 -0400
Original-Received: from [199.232.76.173] (port=60049 helo=monty-python.gnu.org)
	by lists.gnu.org with esmtp (Exim 4.43) id 1MUsFc-0000SF-G5
	for guile-devel@gnu.org; Sat, 25 Jul 2009 21:10:08 -0400
Original-Received: from mail.kapsi.fi ([217.30.184.167]:45410)
	by monty-python.gnu.org with esmtps (TLS-1.0:RSA_AES_256_CBC_SHA1:32)
	(Exim 4.60) (envelope-from <moonshine@kapsi.fi>) id 1MUsFc-0006l9-5o
	for guile-devel@gnu.org; Sat, 25 Jul 2009 21:10:08 -0400
Original-Received: from kapsi.fi ([217.30.184.161] helo=lakka.kapsi)
	by mail.kapsi.fi with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32)
	(Exim 4.69) (envelope-from <moonshine@kapsi.fi>)
	id 1MUsFW-0001Us-68; Sun, 26 Jul 2009 04:10:02 +0300
Original-Received: from moonshine (helo=localhost)
	by lakka.kapsi with local-esmtp (Exim 4.69)
	(envelope-from <moonshine@kapsi.fi>)
	id 1MUsFM-0006yG-3k; Sun, 26 Jul 2009 04:09:52 +0300
X-X-Sender: moonshine@lakka.kapsi
In-Reply-To: <m3ab2vgkgk.fsf@pobox.com>
X-SA-Exim-Connect-IP: 217.30.184.161
X-SA-Exim-Mail-From: moonshine@kapsi.fi
X-SA-Exim-Scanned: No (on mail.kapsi.fi); SAEximRunCond expanded to false
X-detected-operating-system: by monty-python.gnu.org: GNU/Linux 2.6 (newer, 3)
X-BeenThere: guile-devel@gnu.org
X-Mailman-Version: 2.1.5
Precedence: list
List-Id: "Developers list for Guile,
	the GNU extensibility library" <guile-devel.gnu.org>
List-Unsubscribe: <http://lists.gnu.org/mailman/listinfo/guile-devel>,
	<mailto:guile-devel-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/pipermail/guile-devel>
List-Post: <mailto:guile-devel@gnu.org>
List-Help: <mailto:guile-devel-request@gnu.org?subject=help>
List-Subscribe: <http://lists.gnu.org/mailman/listinfo/guile-devel>,
	<mailto:guile-devel-request@gnu.org?subject=subscribe>
Original-Sender: guile-devel-bounces+guile-devel=m.gmane.org@gnu.org
Errors-To: guile-devel-bounces+guile-devel=m.gmane.org@gnu.org
Xref: news.gmane.org gmane.lisp.guile.devel:8967
Archived-At: <http://permalink.gmane.org/gmane.lisp.guile.devel/8967>

On Thu, 23 Jul 2009, Andy Wingo wrote:

> So here's a project, should you choose to be interested ;-) Sometimes we
> do things that we don't know exactly how they affect performance. We're
> working on getting decent measurement into Guile's build itself... I
> mean, we want to work on it :) But we're not measuring.
>
> I would really, really love a graph of performance over time on the
> various Gambit benchmarks.
>
> So for every git revision, a number (and standard deviation?) for every
> Gambit benchmark. Ideally displayed in tables and graphs.
>
> I just mention all of this to you because you said at one point that you
> liked systematically testing things ;-)

At least I could easily put raw logs available to my webpage, I run the 
benchmarks by hand anyway. Then I could try to polish my hacked benchmark 
suite and send it upstream. There were some bugs introduced by my porting 
efforts, I *think* I've fixed them all now :) If someone wants to try it 
it's now available at
http://moonshine.kapsi.fi/bench-guile.tar.bz2

I am currently running the benchmarks and I will put the results for 
master (compiled and interpreted) and 1.8.6 in text format to 
http://moonshine.kapsi.fi/guile-results when finished. I'll try to hack 
something neater during the next week or so. BTW, does anyone know if 
there are guile bindings for any graphic library as I couldn't find any? 
If there aren't, I'll do it in perl then, although I don't especially like 
perl.

-- 
Juhani