From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Andrea Corallo Newsgroups: gmane.emacs.bugs Subject: bug#75356: impossible to benchmark byte-compiled code in a native-comp build Date: Mon, 06 Jan 2025 15:30:24 -0500 Message-ID: References: <87ldvqfsi4.fsf@protonmail.com> <86ldvo58br.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="20577"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Cc: pipcet@protonmail.com, 75356@debbugs.gnu.org To: Eli Zaretskii Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Mon Jan 06 21:32:16 2025 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1tUtln-0005D0-Hb for geb-bug-gnu-emacs@m.gmane-mx.org; Mon, 06 Jan 2025 21:32:15 +0100 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1tUtle-00065F-GL; Mon, 06 Jan 2025 15:32:06 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1tUtlb-00064q-4X for bug-gnu-emacs@gnu.org; Mon, 06 Jan 2025 15:32:03 -0500 Original-Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1tUtla-0006Tt-S8 for bug-gnu-emacs@gnu.org; Mon, 06 Jan 2025 15:32:02 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=debbugs.gnu.org; s=debbugs-gnu-org; h=MIME-Version:Date:References:In-Reply-To:From:To:Subject; bh=1s7JdsKyh9CPAIgtFx7+E4jwpeBiowkQ9mRqURTlsvE=; b=vdp/aNrf817Btwu0RucJOHOuK9xq3pzXxUjS7dSO6m+gQ9sCDFggn4StEVBnn2apREBUG0VMcVUsVFOWeVMGrPWcHLpG37ca9e7iFo0Jpbs7mGmCTgujUBmlvxFa8IDJ9gwP4WBuWS5TtjaGpb6zlEfMUASD3j43oCSHP/lIvsmdAyrWEWOYh+1GDJoSfo9v5NjVDgHj3RViGQyWZEy7SqHb+2QJV6r0//PeDd9Ypa7GRB0h9fNKN4u4nPEbLEoqBrj8/PDGIK2NLkiCW69nED0nsqjli30tFYcAcgIubOcBS+OS9IuFunIJNOdeFHUOcjY1FCY1BUkQsxlFnuWDGQ==; Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1tUtla-0001OM-LD for bug-gnu-emacs@gnu.org; Mon, 06 Jan 2025 15:32:02 -0500 X-Loop: help-debbugs@gnu.org Resent-From: Andrea Corallo Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Mon, 06 Jan 2025 20:32:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 75356 X-GNU-PR-Package: emacs Original-Received: via spool by 75356-submit@debbugs.gnu.org id=B75356.17361954765270 (code B ref 75356); Mon, 06 Jan 2025 20:32:02 +0000 Original-Received: (at 75356) by debbugs.gnu.org; 6 Jan 2025 20:31:16 +0000 Original-Received: from localhost ([127.0.0.1]:40319 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1tUtkp-0001Mw-VQ for submit@debbugs.gnu.org; Mon, 06 Jan 2025 15:31:16 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:48538) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1tUtkn-0001Me-EV for 75356@debbugs.gnu.org; Mon, 06 Jan 2025 15:31:14 -0500 Original-Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1tUtkh-0006R3-T9; Mon, 06 Jan 2025 15:31:08 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=1s7JdsKyh9CPAIgtFx7+E4jwpeBiowkQ9mRqURTlsvE=; b=gc+ur9QfYNbLhKOKWppd WdjiKViUiRznG7Gv9C0yAWGr/uY4cWVgYVfXTp6hf6OiozhDqDIo/1Jhcke5z0d+LHyY7oXrALkdC H45rZIRuR6XWrjxDwUlWPbKHzs3Om2p8ncQqUinkkyYrdDD2eDSjaB1CyaNxZRm4yCdXlIQY/p84b yA5H7ARGPlhA+Dy2qg7KR/nztF2CuPEIpNF+6617PxBEnHB3jskzn89qnlffCojOuQlq57pKG67ZG 4gyKvAozreRAQUgb27Tn57zbesTXo/HsxPmaToZKNuDfxeL6lxPUCsZXAhAkSguTHkZzAkX80QWng dHOj60qgsAlgGw==; Original-Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1) (envelope-from ) id 1tUtk1-0006zQ-23; Mon, 06 Jan 2025 15:30:33 -0500 In-Reply-To: <86ldvo58br.fsf@gnu.org> (Eli Zaretskii's message of "Mon, 06 Jan 2025 16:24:24 +0200") X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.bugs:298699 Archived-At: Eli Zaretskii writes: >> Cc: pipcet@protonmail.com >> From: Andrea Corallo >> Date: Mon, 06 Jan 2025 04:24:44 -0500 >> >> Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text >> editors" writes: >> >> > elisp-benchmarks.el unconditionally forces use of native compilation >> > if run on an Emacs which is compiled with native-comp enabled. This >> > is a minor issue, but it's still important to benchmark this >> > configuration once in a while. >> >> Why is this important? On a native compiled Emacs all code is supposed >> to run native compiled, not only the test, but runtime libraries as >> well, further more even Emacs primitives are different in order to >> accomodate native code execution. My opinion is that results of such a >> mixed tests would make little no sense in general. > > I think the idea is that we don't want to force someone who wants to > benchmark bytecode to build a separate Emacs configured without native > compilation. Okay still the results are not very meaningful IMO for the mentioned reasons. > It is okay to default to native code, but it would be nice to have a > knob to run the benchmarks without compiling them to native code. Okay, should be very easy to add one if the 'elb-speed -1' option is deemed not sufficient, suggestions for the name? "elb-no-native"? >> Anyway if you really want to run bytecode on a native compiled Emacs >> elisp-benchamerks let you do this with: >> >> emacs -batch -l ./elisp-benchmarks.el --eval '(progn (setq elb-speed -1) (elisp-benchmarks-run))' > > Would this refrain from loading *.eln files if they are already there? This way (on a native compiled Emacs) it will produce and load eln files with regular bytecode inside. > Or does the benchmark suite remove all the *.eln files after it > finishes? Nope