From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Xiyue Deng Newsgroups: gmane.emacs.bugs Subject: bug#66782: 29.1; ERT tests report test redefined depending on loading sequence Date: Sat, 28 Oct 2023 12:41:19 -0700 Message-ID: <871qdeh6w0.fsf@debian-hx90.lan> References: <87msw393z8.fsf@debian-hx90.lan> <83y1fncl4k.fsf@gnu.org> <87o7gjgk65.fsf_-_@debian-hx90.lan> <83pm0zcc25.fsf@gnu.org> <87jzr7gfso.fsf@debian-hx90.lan> <83jzr7c74y.fsf@gnu.org> <87cywzge42.fsf@debian-hx90.lan> <83h6mbc5ss.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="5506"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Gnus/5.13 (Gnus v5.13) Cc: mattiase@acm.org, 66782@debbugs.gnu.org To: Eli Zaretskii Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Sat Oct 28 21:42:52 2023 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1qwpCu-0001I4-10 for geb-bug-gnu-emacs@m.gmane-mx.org; Sat, 28 Oct 2023 21:42:52 +0200 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1qwpCa-0004AD-1J; Sat, 28 Oct 2023 15:42:32 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qwpCY-0004A0-Vv for bug-gnu-emacs@gnu.org; Sat, 28 Oct 2023 15:42:31 -0400 Original-Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1qwpCY-0003fp-Ne for bug-gnu-emacs@gnu.org; Sat, 28 Oct 2023 15:42:30 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1qwpD4-0007Hy-Cf for bug-gnu-emacs@gnu.org; Sat, 28 Oct 2023 15:43:02 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Xiyue Deng Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sat, 28 Oct 2023 19:43:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 66782 X-GNU-PR-Package: emacs Original-Received: via spool by 66782-submit@debbugs.gnu.org id=B66782.169852212327935 (code B ref 66782); Sat, 28 Oct 2023 19:43:02 +0000 Original-Received: (at 66782) by debbugs.gnu.org; 28 Oct 2023 19:42:03 +0000 Original-Received: from localhost ([127.0.0.1]:39581 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qwpC6-0007GV-L6 for submit@debbugs.gnu.org; Sat, 28 Oct 2023 15:42:02 -0400 Original-Received: from mail-oo1-xc33.google.com ([2607:f8b0:4864:20::c33]:57437) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qwpC3-0007G1-OR for 66782@debbugs.gnu.org; Sat, 28 Oct 2023 15:42:00 -0400 Original-Received: by mail-oo1-xc33.google.com with SMTP id 006d021491bc7-581fb6f53fcso1972390eaf.2 for <66782@debbugs.gnu.org>; Sat, 28 Oct 2023 12:41:27 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1698522081; x=1699126881; darn=debbugs.gnu.org; h=mime-version:user-agent:message-id:date:references:in-reply-to :subject:cc:to:from:from:to:cc:subject:date:message-id:reply-to; bh=KbOoc0uByfaWYw9yG61KpUCCf8U9SS0cFJMKFoEo0HE=; b=YdiMuSnhp7Y4oBp2p5iVrD0ZGrxmd0PS7G26gjFvwB+ItNywNCGcOtbGDj1cjCSGyx orcmDpwfFUywGXENEU0+XK1hfu5nQP9/YWNNxWfC93KXk5PbskGog/O81eWZii18dpzR +HE3VRCfmh4YqSeV9zAdNKyAZ13v5jWdhBj1XrT/LLxkXr8vIdACmKC00CIK1p+ZGkWs /x3d8xZqu9xrKMNU4AE+BabI3WnERkh1WEISiZAhyZfvdbhheBGZ9ko8XHD8OgjmGTAo 0I9Uo1lgrUDF2yUdOvxKnWoX0RA/MW+NCAa34VVKnknIyFy2H6HzvVfoVc+wNemZiZTq rvhQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1698522081; x=1699126881; h=mime-version:user-agent:message-id:date:references:in-reply-to :subject:cc:to:from:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=KbOoc0uByfaWYw9yG61KpUCCf8U9SS0cFJMKFoEo0HE=; b=cZOiQo0P1Bb4a7PjTroXPvbdBP+7D3XNxrn6az9w3/G27loQ8QdaVdLf3t4DEsBv1D 6SjiHAg3UD4Cf+m77SQ3vLNwD2hljzDRQCc1PBsxO4Z/svI+XjMJt7s1O3x6efoUXpz3 DAF9gSZP97HCv5OhXAavH8zkyDvpwHUO+y2yNRuuGLkVEtyexBREI9yqlP8jtEiiVJMI dKCa0zqxngZ3uHDr2boJywAg5yYS7x+FlzTP8t2TBv9+m/aVxNCxjcZK7hUtQJRiAiB1 OjFsG2TuI8W+cs2zfgCn4tXonfpWyEOY/sJC+LiVF3YlCF0p+QfBTnI3cPUOJd8xvwGf Tlkw== X-Gm-Message-State: AOJu0YzlXrCI7XgDQ9RY8F0VUEN7X8XRIhwS5/wtzRxlcJsjcpUuZ6x3 BU5HDKA3CqGiNrX7E5SOeVjBwEEBGQVDGg== X-Google-Smtp-Source: AGHT+IFdUDeARuQckZSnSJqOIqIBcmB6giFTwXMKLTISd/X/o5gZWuIxvOqTh+GPt25WXQ8mY9VFQg== X-Received: by 2002:a05:6359:2c88:b0:168:e7da:30ad with SMTP id qw8-20020a0563592c8800b00168e7da30admr5271183rwb.10.1698522081343; Sat, 28 Oct 2023 12:41:21 -0700 (PDT) Original-Received: from debian-hx90 (2603-8000-a400-0cdc-2578-79b2-8435-c317.res6.spectrum.com. [2603:8000:a400:cdc:2578:79b2:8435:c317]) by smtp.gmail.com with ESMTPSA id d9-20020a170903230900b001cc40912649sm165442plh.304.2023.10.28.12.41.20 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 28 Oct 2023 12:41:20 -0700 (PDT) In-Reply-To: <83h6mbc5ss.fsf@gnu.org> (Eli Zaretskii's message of "Sat, 28 Oct 2023 15:03:47 +0300") X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.bugs:273467 Archived-At: Eli Zaretskii writes: >> From: Xiyue Deng >> Cc: mattiase@acm.org, 66782@debbugs.gnu.org >> Date: Sat, 28 Oct 2023 04:50:37 -0700 >> >> P.S. I also thought of another potential counter-example of preferring >> running one test file over running many in one batch: the tests within >> the same test file may also leave garbage for the rest of the tests > > We could reasonably expect from the author of a single .el test file > to make sure the tests in that file don't interfere with one another > and make the necessary cleanups for that purpose. But it is much > harder to expect the same from several disparate test files, which can > quite frequently be written and maintained by different people. Fair enough. And of course ideally each test should be able to run either independently and batched together so that running everything in batch is possible with the nice summary :-) -- Xiyue Deng