From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: John Wiegley Newsgroups: gmane.emacs.devel Subject: Re: Emacs benchmarking suite Date: Sat, 19 Mar 2016 16:32:58 -0700 Message-ID: References: <1458384791.7944.32.camel@codingquark.com> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: ger.gmane.org 1458430421 531 80.91.229.3 (19 Mar 2016 23:33:41 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Sat, 19 Mar 2016 23:33:41 +0000 (UTC) Cc: emacs-devel@gnu.org To: Dhavan Vaidya Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Sun Mar 20 00:33:28 2016 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1ahQN4-0006TR-Pr for ged-emacs-devel@m.gmane.org; Sun, 20 Mar 2016 00:33:26 +0100 Original-Received: from localhost ([::1]:50901 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ahQN0-0008DV-PH for ged-emacs-devel@m.gmane.org; Sat, 19 Mar 2016 19:33:22 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:56761) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ahQMn-0008DC-AS for emacs-devel@gnu.org; Sat, 19 Mar 2016 19:33:10 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ahQMi-0005y5-Fj for emacs-devel@gnu.org; Sat, 19 Mar 2016 19:33:09 -0400 Original-Received: from mail-pf0-x22b.google.com ([2607:f8b0:400e:c00::22b]:34250) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ahQMi-0005xz-8m for emacs-devel@gnu.org; Sat, 19 Mar 2016 19:33:04 -0400 Original-Received: by mail-pf0-x22b.google.com with SMTP id x3so216995962pfb.1 for ; Sat, 19 Mar 2016 16:33:04 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=from:to:cc:subject:in-reply-to:date:message-id:references :user-agent:mail-followup-to:mime-version; bh=S2yM9Z4LM3Nuxm/KDQCFNFkQlE2Az+Uu/obSpH+jQMU=; b=G41lKKSi+0mCPgo0CudnNw/ZPHjUBF1gO3acXd/U9KY9LZFzA730YIbhLHMY1dp7i9 q8NIk5FAocjNzbT+AQ63a48s4DNpLeVYK2V6tUqsVv+NvbOpaTIm6M+txrV4KEpNt/n2 2OUxTXr192SbBkgSbdcLt4ZcFTvRWwbtD8Jni78swxJL6l6iAPnpzoSjs+VTEBP9gfjw Gw5VsNPdoYWg1aElvsAWMsJbsVr6+tNTCgrSlLb4wfEvkHo2BNKIxlxIeQLz9tKas2AX 2MK9oO0v2R31qMvrmFfH74lc0AxUmeD1VaTd2/5igxA2HDG5ePLrppJdSNR7k90V/Icb 9BvA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:from:to:cc:subject:in-reply-to:date:message-id :references:user-agent:mail-followup-to:mime-version; bh=S2yM9Z4LM3Nuxm/KDQCFNFkQlE2Az+Uu/obSpH+jQMU=; b=AG2r8fes3Urss9cOhxeFlR+Jo2BjzC2GVpXEcH05nbBHDcQuulsxmydL8yHZY1JjTL XCz97UZHrvhJvxT1H1zonbC8R9OcRNhWFBAiCTSsUC1WoJcJniuuCdUbB+Y0hmgAp6fF gjyZXK0tayGA9bMNBz6O1JT52nL5L/T69k7hvq8CFb7JHsuQEo1p0gpiYEtHP6SHIXtT 4E5ZcPaWGLWENSm2Fj9AdiZTqaZmc0SxlJZ2tg8vjmriUyWLTVKFkafY5mCDr755p5ZV /6100ZWBhBdLCL2QqOhcjZJSy7naO9LLpVKEmGNsNAVFZpXFmTVl19x6grSebmH7o3+u vMqQ== X-Gm-Message-State: AD7BkJIjBTgkGJ0O9+lV9TeXDfCODeEMMcZlBwjQIANQbTmC+64jfO8blRhxHGWUvs9CrA== X-Received: by 10.66.193.131 with SMTP id ho3mr33967693pac.154.1458430383543; Sat, 19 Mar 2016 16:33:03 -0700 (PDT) Original-Received: from Vulcan.local (76-234-68-79.lightspeed.frokca.sbcglobal.net. [76.234.68.79]) by smtp.gmail.com with ESMTPSA id fa3sm30279088pab.45.2016.03.19.16.33.02 (version=TLS1 cipher=AES128-SHA bits=128/128); Sat, 19 Mar 2016 16:33:02 -0700 (PDT) X-Google-Original-From: "John Wiegley" Original-Received: by Vulcan.local (Postfix, from userid 501) id 46B5C138D2053; Sat, 19 Mar 2016 16:33:02 -0700 (PDT) In-Reply-To: <1458384791.7944.32.camel@codingquark.com> (Dhavan Vaidya's message of "Sat, 19 Mar 2016 16:23:11 +0530") User-Agent: Gnus/5.130014 (Ma Gnus v0.14) Emacs/25.0.92 (darwin) Mail-Followup-To: Dhavan Vaidya , emacs-devel@gnu.org X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 2607:f8b0:400e:c00::22b X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.14 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.devel:201911 Archived-At: >>>>> Dhavan Vaidya writes: > On the topic, Sacha interviewed Johnw recently in which he mentioned the > need of having a benchmarking/profiling system for emacs. He says the > performance has been decreasing over time. Hi Dhavan! I should clarify: John has the perception that it has been decreasing, but this may not at all be the case. Hence the need for measurement. :) > Share your thoughts on this, give me guidelines and help would be much > appreciated! Investing some time in learning a bit of Lisp is a good idea; even better will be to find a buddy/collaborator who can help you to architect a benchmarking framework, ideally based on work that has already been done for this sort of thing in other language. We want to be able to measure resource usage of Lisp code, to compare this usage against previous runs (say, build to build), and a way of charting the progression over time. This way, a dev who builds Emacs frequently can watch for trends over time. -- John Wiegley GPG fingerprint = 4710 CF98 AF9B 327B B80F http://newartisans.com 60E1 46C4 BD1A 7AC1 4BA2