From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Andrea Corallo Newsgroups: gmane.emacs.devel Subject: Re: New "make benchmark" target Date: Thu, 12 Dec 2024 05:59:27 -0500 Message-ID: References: <87h679kftn.fsf@protonmail.com> <86frmt1k6w.fsf@gnu.org> <871pydjo23.fsf@protonmail.com> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="24811"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Cc: Pip Cet , Eli Zaretskii , Mattias =?utf-8?Q?Engdeg=C3=A5rd?= , Paul Eggert , emacs-devel@gnu.org To: Stefan Kangas Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Thu Dec 12 12:00:17 2024 Return-path: Envelope-to: ged-emacs-devel@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1tLgvZ-0006FP-4P for ged-emacs-devel@m.gmane-mx.org; Thu, 12 Dec 2024 12:00:17 +0100 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1tLgur-0005g9-UN; Thu, 12 Dec 2024 05:59:33 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1tLguq-0005fr-9D for emacs-devel@gnu.org; Thu, 12 Dec 2024 05:59:32 -0500 Original-Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1tLguo-0000ft-96; Thu, 12 Dec 2024 05:59:30 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=6y3zxg6P/jgueR9bXXktFLVwT2bNCfA2cZQLWtUqi1o=; b=IPnsK5C5bZyTX+VrnZF5 LcCectkeBbdgXLzQ33/YZfbOMYWlvtB+wMFf1/Ia2MYvhlS39v31xffx89Fu/ax9MCA5R4FO3GqSy kJRT6Ty5lqgdoUhHf3tSE92Njj0DPgu/KI2iUTtZo3EaZ/S3QmdC3YZgQ0qFEGOC8JuYcbiPvKS+D yGOozwJtz3VBGLPu5RXUDIOwne4ex4auma2rly+bleL96/YBZBccx12mNiWhXjTgfB1ZR+CIGWGhU 7ZcTj/sF84dMh7/FZiyuNYSA4CaHEc28t9K5HzzReOnm32K0gKL900xb+KURRJ2wDYXmzeqNNA9MW 3dwkKhW9mNSQ5g==; Original-Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1) (envelope-from ) id 1tLgum-0008WF-4E; Thu, 12 Dec 2024 05:59:29 -0500 In-Reply-To: (Stefan Kangas's message of "Thu, 12 Dec 2024 02:53:40 -0800") X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Original-Sender: emacs-devel-bounces+ged-emacs-devel=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.devel:326425 Archived-At: Stefan Kangas writes: > Pip Cet via "Emacs development discussions." > writes: > >> https://elpa.gnu.org/packages/elisp-benchmarks.html ? It'd be great if >> we could agree on a benchmark, and even better if there were a way to >> reliably run it from emacs -Q :-) >> >> In fact, I would suggest to move a reduced benchmark suite to the emacs >> repo itself, and run it using "make benchmark". > > SGTM, but why a reduced suite and not just the whole thing? My fear is that if we start going into the rabbit hole of which benchmark of elisp-benchmarks should or should not be included, we will never agree and as a consequence succeed. So I guess I'd favor as well including all elisp-benchmarks. Andrea