From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: "Neil Jerram" Newsgroups: gmane.lisp.guile.devel,gmane.lisp.guile.user Subject: Re: "Pace is nothing without guile" Date: Sun, 13 Jul 2008 23:31:22 +0100 Message-ID: <49dd78620807131531v1f20237byfa5f4b04281bbc97@mail.gmail.com> References: <49dd78620807131006m4efc2a96v2d9778b6c4a501b4@mail.gmail.com> NNTP-Posting-Host: lo.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit X-Trace: ger.gmane.org 1215988313 30688 80.91.229.12 (13 Jul 2008 22:31:53 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Sun, 13 Jul 2008 22:31:53 +0000 (UTC) Cc: guile-user@gnu.org, guile-devel To: "Greg Troxel" Original-X-From: guile-devel-bounces+guile-devel=m.gmane.org@gnu.org Mon Jul 14 00:32:40 2008 Return-path: Envelope-to: guile-devel@m.gmane.org Original-Received: from lists.gnu.org ([199.232.76.165]) by lo.gmane.org with esmtp (Exim 4.50) id 1KIA7I-0007oj-DJ for guile-devel@m.gmane.org; Mon, 14 Jul 2008 00:32:28 +0200 Original-Received: from localhost ([127.0.0.1]:43108 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1KIA6Q-00017z-D0 for guile-devel@m.gmane.org; Sun, 13 Jul 2008 18:31:34 -0400 Original-Received: from mailman by lists.gnu.org with tmda-scanned (Exim 4.43) id 1KIA6K-00016c-KZ for guile-devel@gnu.org; Sun, 13 Jul 2008 18:31:28 -0400 Original-Received: from exim by lists.gnu.org with spam-scanned (Exim 4.43) id 1KIA6I-00015Q-Pl for guile-devel@gnu.org; Sun, 13 Jul 2008 18:31:27 -0400 Original-Received: from [199.232.76.173] (port=55945 helo=monty-python.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1KIA6I-00015J-Lw for guile-devel@gnu.org; Sun, 13 Jul 2008 18:31:26 -0400 Original-Received: from rv-out-0708.google.com ([209.85.198.242]:55051) by monty-python.gnu.org with esmtp (Exim 4.60) (envelope-from ) id 1KIA6G-0007PW-J3 for guile-devel@gnu.org; Sun, 13 Jul 2008 18:31:24 -0400 Original-Received: by rv-out-0708.google.com with SMTP id k29so5248146rvb.6 for ; Sun, 13 Jul 2008 15:31:23 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlemail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:to :subject:cc:in-reply-to:mime-version:content-type :content-transfer-encoding:content-disposition:references; bh=Po0QS1ScHAFc2sWzHb2OX9FdNX6hcnsfZ2TUYQqmAWE=; b=xIznBwXCVhl65XPgTZLpCtI4CwQhE/kOcyg9jhBnKZ80aPc//0FrzrgHpgH7pfPMQ9 ChWVQefLoBse2YV29VvZJKxjTa3Mti4E/0QAA4ia46vet4X3ZT91cq2xyccyNrhkb1FD w/vmSL/tIbA1ASQ2GIZydL0IUTAItQkK+ihvo= DomainKey-Signature: a=rsa-sha1; c=nofws; d=googlemail.com; s=gamma; h=message-id:date:from:to:subject:cc:in-reply-to:mime-version :content-type:content-transfer-encoding:content-disposition :references; b=PuJjZmfyBn3h4D0I2+jQsW5sXV+mmCxqK0MRNOfE8tkgmHC44XXPk0MOsBpHZIYGiz kJOO/fMmlRg8xgEMLUbWlW6jL9wk8JM2dM0h3JEhT2sfTZ+lnzH/hFUtyJ+iwjd6y38D yiyYqYVEP2cIdUt9qDappPWwE1Smket3J/EVI= Original-Received: by 10.114.241.15 with SMTP id o15mr16799381wah.164.1215988282759; Sun, 13 Jul 2008 15:31:22 -0700 (PDT) Original-Received: by 10.114.197.8 with HTTP; Sun, 13 Jul 2008 15:31:22 -0700 (PDT) In-Reply-To: Content-Disposition: inline X-detected-kernel: by monty-python.gnu.org: Linux 2.6 (newer, 2) X-BeenThere: guile-devel@gnu.org X-Mailman-Version: 2.1.5 Precedence: list List-Id: "Developers list for Guile, the GNU extensibility library" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Original-Sender: guile-devel-bounces+guile-devel=m.gmane.org@gnu.org Errors-To: guile-devel-bounces+guile-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.lisp.guile.devel:7375 gmane.lisp.guile.user:6653 Archived-At: 2008/7/13 Greg Troxel : > My immediate reaction is that test suites aren't good benchmarks because > we will often want to add to test suites, while changing the benchmark > invalidates previous data so we will not want to change the benchmark. Yes, but... > Now, if you mean to use the test suite as a collection of > micro-benchmarks, so that we just have a rule that individual tests > aren't modified without serious cause, but new ones can be added, then > that makes senes. Yes, this is what I meant. And I also think there will be enough test cases not changing, over the long term, that we won't have to worry in practice about changing a few here and there. I've taken a better look now at the existing benchmark-suite - which doesn't contain very many benchmarks, but does provide a sensible discussion of timings, and useful library functions. I don't think it will be very hard to somehow incorporate the test-suite into the set of benchmarks. Regards, Neil