From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Alan Mackenzie Newsgroups: gmane.emacs.bugs Subject: bug#71178: Batch ert wrongly aborts a test run, and wrongly fails to say why. Date: Fri, 24 May 2024 19:23:14 +0000 Message-ID: Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="2899"; mail-complaints-to="usenet@ciao.gmane.io" Cc: Stefan Monnier To: 71178@debbugs.gnu.org Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Fri May 24 21:24:12 2024 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1sAaWS-0000cY-9D for geb-bug-gnu-emacs@m.gmane-mx.org; Fri, 24 May 2024 21:24:12 +0200 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1sAaWG-0006nA-S2; Fri, 24 May 2024 15:24:01 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sAaWB-0006ma-R7 for bug-gnu-emacs@gnu.org; Fri, 24 May 2024 15:23:56 -0400 Original-Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1sAaWB-0006s0-JZ for bug-gnu-emacs@gnu.org; Fri, 24 May 2024 15:23:55 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1sAaWI-0005pW-DO; Fri, 24 May 2024 15:24:02 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Alan Mackenzie Original-Sender: "Debbugs-submit" Resent-CC: monnier@iro.umontreal.ca, bug-gnu-emacs@gnu.org Resent-Date: Fri, 24 May 2024 19:24:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 71178 X-GNU-PR-Package: emacs X-Debbugs-Original-To: bug-gnu-emacs@gnu.org X-Debbugs-Original-Xcc: Stefan Monnier Original-Received: via spool by submit@debbugs.gnu.org id=B.171657862322402 (code B ref -1); Fri, 24 May 2024 19:24:02 +0000 Original-Received: (at submit) by debbugs.gnu.org; 24 May 2024 19:23:43 +0000 Original-Received: from localhost ([127.0.0.1]:38733 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sAaVz-0005pG-Is for submit@debbugs.gnu.org; Fri, 24 May 2024 15:23:43 -0400 Original-Received: from lists.gnu.org ([209.51.188.17]:43080) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1sAaVx-0005pA-HT for submit@debbugs.gnu.org; Fri, 24 May 2024 15:23:41 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sAaVp-0006XI-NX for bug-gnu-emacs@gnu.org; Fri, 24 May 2024 15:23:33 -0400 Original-Received: from mail.muc.de ([193.149.48.3]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1sAaVn-0006li-P5 for bug-gnu-emacs@gnu.org; Fri, 24 May 2024 15:23:33 -0400 Original-Received: (qmail 15265 invoked by uid 3782); 24 May 2024 21:23:15 +0200 Original-Received: from muc.de (p4fe15616.dip0.t-ipconnect.de [79.225.86.22]) (using STARTTLS) by colin.muc.de (tmda-ofmipd) with ESMTP; Fri, 24 May 2024 21:23:15 +0200 Original-Received: (qmail 17894 invoked by uid 1000); 24 May 2024 19:23:14 -0000 Content-Disposition: inline X-Submission-Agent: TMDA/1.3.x (Ph3nix) X-Primary-Address: acm@muc.de Received-SPF: pass client-ip=193.149.48.3; envelope-from=acm@muc.de; helo=mail.muc.de X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.bugs:285792 Archived-At: Hello, Stefan and Emacs. In my development branch, based on master, last updated ~March 2024. (i) Build emacs. (ii) make -j17 check. The ert session this starts goes well, apart from in lisp/erc/erc-tests.el. This gets aborted by ert after 62 from 92 tests have passed. Test 63 fails for known reasons, a mismatch of two strings compared with `equal'. The log file, erc-tests.log, looks like this around the output for test 63: ......................................................... passed 60/92 erc--update-user-modes (0.000093 sec) passed 61/92 erc--user-modes (0.000053 sec) passed 62/92 erc--valid-local-channel-p (0.000071 sec) Test erc--with-dependent-type-match backtrace: Aborted: Ran 92 tests, 62 results as expected, 1 unexpected (2024-05-24 15:26:55+0000, 2.791555 sec) 1 unexpected results: FAILED erc--with-dependent-type-match UNKNOWN erc--with-entrypoint-environment UNKNOWN erc-channel-p UNKNOWN erc-channel-user ........................................................ Note that (i) No error message or backtrace gets printed for test 63. This is a bug. (ii) The test run gets aborted. This shouldn't happen, and is a bug. erc-tests.el runs satisfactorally in an Emacs session, started by M-x ert, and accepting the default selection t. -- Alan Mackenzie (Nuremberg, Germany).