From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.ciao.gmane.io!not-for-mail From: Andrea Corallo Newsgroups: gmane.emacs.devel Subject: Re: On elisp running native - Update 9 Date: Mon, 15 Jun 2020 07:41:08 +0000 Message-ID: References: <83imlwl9vm.fsf@gnu.org> <83o8uegykm.fsf@gnu.org> <74dd94a9-28cb-a5fd-dbc7-ab21009834ad@cs.ucla.edu> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Injection-Info: ciao.gmane.io; posting-host="ciao.gmane.io:159.69.161.202"; logging-data="123546"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) Cc: Eli Zaretskii , Stefan Monnier , emacs-devel@gnu.org To: Gong-Yi Liao =?utf-8?B?5buW5a6u5q+F?= Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Mon Jun 15 09:42:09 2020 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1jkjku-000W1O-RD for ged-emacs-devel@m.gmane-mx.org; Mon, 15 Jun 2020 09:42:08 +0200 Original-Received: from localhost ([::1]:46936 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jkjkt-0004am-Sn for ged-emacs-devel@m.gmane-mx.org; Mon, 15 Jun 2020 03:42:07 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:51062) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jkjkF-0003lM-KE for emacs-devel@gnu.org; Mon, 15 Jun 2020 03:41:27 -0400 Original-Received: from mx.sdf.org ([205.166.94.20]:59967) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jkjkC-0007BI-3Y; Mon, 15 Jun 2020 03:41:27 -0400 Original-Received: from sdf.org (ma.sdf.org [205.166.94.33]) by mx.sdf.org (8.15.2/8.14.5) with ESMTPS id 05F7f9Yk002354 (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256 bits) verified NO); Mon, 15 Jun 2020 07:41:09 GMT Original-Received: (from akrl@localhost) by sdf.org (8.15.2/8.12.8/Submit) id 05F7f8RL017695; Mon, 15 Jun 2020 07:41:08 GMT In-Reply-To: ("Gong-Yi Liao =?utf-8?B?5buW5a6u5q+FIidz?= message of "Mon, 15 Jun 2020 00:04:13 -0500") Received-SPF: pass client-ip=205.166.94.20; envelope-from=akrl@sdf.org; helo=mx.sdf.org X-detected-operating-system: by eggs.gnu.org: First seen = 2020/06/15 02:47:27 X-ACL-Warn: Detected OS = ??? X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=_AUTOLEARN X-Spam_action: no action X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.io gmane.emacs.devel:252258 Archived-At: Gong-Yi Liao =E5=BB=96=E5=AE=AE=E6=AF=85 writes: > Andrea, > > Question: > What's the difference between Update 1's and=C2=A0 =C2=A0Update 9's bench= mark > table's byte code column? > > The byte code column's=C2=A0 run time results have=C2=A0 decreased roughl= y 78% > from Update 1's 507.23s to Update 9's 114.91, that seems unbelievable > if all the Update 9's byte code result are purely based on byte code > without any natively compiled code. > > Are Update 9's byte code result based on natively compiled built-in > function and byte code compiled benchmark functions or they are > purely all byte code compiled? > > Or there are drastic changes in benchmark environment settings > (hardware, number of repetitions) betweens these two updates? > > Thanks, > Gong-Yi.=C2=A0 Hi Gong-Yi, The first measures were based on a collection of benchmarks that later became what we have in ELPA now. In the transition a number of things changed: the set slightly changed, IIRC also the durations have been normalized to be more homogeneous and the result is given in avg per iteration instead of being cumulated. Lastly the two tests has been run on two different machines. Probably would be interesting to re-add the u-benchmark for type-hints in the future. Regards Andrea --=20 akrl@sdf.org