From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED!not-for-mail From: "Siraphob (Ben) Phipathananunth" Newsgroups: gmane.emacs.devel Subject: An Emacs benchmarking suite (was: An idea, now that we have dynamic loading) Date: Fri, 11 May 2018 22:22:47 +0700 Message-ID: <0af8a67e-3403-8e81-a666-78b3d8da54b1@disroot.org> References: <8336yypvq0.fsf@gnu.org> <83bmdmnskd.fsf@gnu.org> NNTP-Posting-Host: blaine.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit X-Trace: blaine.gmane.org 1526052061 32182 195.159.176.226 (11 May 2018 15:21:01 GMT) X-Complaints-To: usenet@blaine.gmane.org NNTP-Posting-Date: Fri, 11 May 2018 15:21:01 +0000 (UTC) User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 Cc: johnw@gnu.org, emacs-devel@gnu.org To: Eli Zaretskii Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Fri May 11 17:20:57 2018 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by blaine.gmane.org with esmtp (Exim 4.84_2) (envelope-from ) id 1fH9qq-0008EL-Gl for ged-emacs-devel@m.gmane.org; Fri, 11 May 2018 17:20:57 +0200 Original-Received: from localhost ([::1]:50947 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fH9sx-0003wx-E5 for ged-emacs-devel@m.gmane.org; Fri, 11 May 2018 11:23:07 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:43683) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1fH9so-0003wP-KH for emacs-devel@gnu.org; Fri, 11 May 2018 11:23:01 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1fH9sn-0000Ht-Sw for emacs-devel@gnu.org; Fri, 11 May 2018 11:22:58 -0400 Original-Received: from knopi.disroot.org ([178.21.23.139]:56040) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1fH9sj-0000H6-TI; Fri, 11 May 2018 11:22:54 -0400 Original-Received: from localhost (localhost [127.0.0.1]) by disroot.org (Postfix) with ESMTP id 050B82E598; Fri, 11 May 2018 17:22:52 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=disroot.org; s=mail; t=1526052172; bh=BzRFXOL/AUzI7/JEQGUTu057w5P4E4JplBK26ZA4WOU=; h=Subject:To:Cc:References:From:Date:In-Reply-To; b=SMLWkmfaQQfXy3GsUKcKi5UN0EGCkULdLh4r/2nnd2+IL/Xa+LdJ52XoOcKwA5V4y FO1snLX1wk0hQxaETMz5kphTwhHszfYT5mlXa/LpKmxdvKv8YdrMjxU8pDpWIuTHZ4 4Y/XBZTUt7T0nLWLi7ZKj2TXiDNXge5kccgkyrPgpU0zIBl78rV73u07JFt/JypuQF z8HdWLzzUcTfpHuMyQUNbaChgkvVbn4UjXbyeiJc0LONyrymDAZidaQc99hxDp7Eyb Qbsi34hh4R5ohb5NgB/0orsRXOe5C5ztQsKr+U6iJIyYcpDP42BhQU93YBynhXtHIt wHqYsFMZMcdRA== X-Virus-Scanned: Debian amavisd-new at disroot.org Original-Received: from knopi.disroot.org ([127.0.0.1]) by localhost (disroot.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NhCA0Tm0sj8U; Fri, 11 May 2018 17:22:51 +0200 (CEST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=disroot.org; s=mail; t=1526052171; bh=BzRFXOL/AUzI7/JEQGUTu057w5P4E4JplBK26ZA4WOU=; h=Subject:To:Cc:References:From:Date:In-Reply-To; b=rJ+Bja70IUMF70zBzWlHHMfH9KZn6Geusx9b0iWNmM2UboSNeqD/gnAzB872WQGYp 1oOtB9Qm12hjGauthcFCUr7bDUMFVtvoBxxQ8BZFnyZo5JY5cCx0nMS+0qwaIFCi1a XZxwdN5/NYo/IhCe9SRgUgTt53Yj6KubCt5EQWwtaLr6cWLgkcDdagFjAbK94ZSq/I d/zueF99W0QCR0GNJdUkW97rphgZudfL2WKskxGBpF9ZUfkQ+Hmeg+GwdnbgN3O1jv Q3Rzf4XwtYnOjh1kAYU0nx9+lkqUB9x1VsXnrpfNdYDvtY1MzeS1pJau0XBE3GY7D5 1FoJP4Cyqyj5A== In-Reply-To: <83bmdmnskd.fsf@gnu.org> Content-Language: en-US X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] [fuzzy] X-Received-From: 178.21.23.139 X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.org gmane.emacs.devel:225236 Archived-At: Eli Zaretskii wrote: > John even asked for creation of such a suite of performance tests, but > AFAIK no one has picked the gauntlet till now. Would it suffice to use Emacs Lisp to run these performance tests (i.e. using benchmark.el)? Even so, how would one account for external factors in the operating system? Perhaps when the test is performed, the deltas between commits are given as percentages instead of CPU time. Once we have that, it would be great to have tests run multiple times and/or on various devices to refine the data further. An area that would be interesting to look at is memory usage of functions over commits, but I don't know of a way of measuring memory usage in Emacs (especially over an extended period, to analyze things such as maximum memory usage). -- Siraphob (Ben) Phipathananunth