From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:403:478a::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id oOC0M36T8WQQYwEAauVa8A:P1 (envelope-from ) for ; Fri, 01 Sep 2023 09:32:14 +0200 Received: from aspmx1.migadu.com ([2001:41d0:403:478a::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id oOC0M36T8WQQYwEAauVa8A (envelope-from ) for ; Fri, 01 Sep 2023 09:32:14 +0200 Received: from mail.notmuchmail.org (yantan.tethera.net [IPv6:2a01:4f9:c011:7a79::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 6F7C0D158 for ; Fri, 1 Sep 2023 09:32:14 +0200 (CEST) Authentication-Results: aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=gmail.com header.s=20221208 header.b=dOCLbyz2; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 2a01:4f9:c011:7a79::1 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1693553534; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-owner:list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=DJ9q5VRhTrO0sK2nnI8hPVP2kGX1OMn5tnM3F9Zhg4U=; b=JwiJKHJY3OIiMSUwlYhTxW8X0flZuICiWvt3d926qZF0N5fjlSIiVcL7E2+oIAsR4oa1i3 OllqKQ4ucmkX5gfNicqMTUbfUjhtuD4X7z/+naKGDsq4iBjMAScVwp1P4XWq73oZ26qM2c gFckLRioQZ+9zGSdBSi9q1iVjlUP2QEqKT/Xqb/bo0Oe+EtaNtJS1miVSY8Gis4Voxsmzo l/nQKjvmoP5J63Q31zAg/00YOEO2xZrMMlhEnja3Bxo7U0SIwInd2UwdElUEqDtcAkUKTD ChJkXYYBdAiomUwcj5VGwKuLTXoDnBbp3IxewJsqOLqUuejyt9WyFJDg4pXtmg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=gmail.com header.s=20221208 header.b=dOCLbyz2; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 2a01:4f9:c011:7a79::1 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org ARC-Seal: i=1; s=key1; d=yhetil.org; t=1693553534; a=rsa-sha256; cv=none; b=OUqb/MNNaf+UUMB0H5dYEA3317TT87j+Zk9VHk4frvzGNM8j1L5uaKYaIElHbl1uGa0RY4 v5jnNcmSLx8SYooz7gXX2g85EDtmDGGFB5UpB5tJEeuUvxvTCAE+dECbdDdp5jj8Q0H/dB 3qYo3g4ffG1aYcRiC1G8Gc6ZZqU3x1uPC2axyiky/9uj2t5+FVE/ZO3Vi6VNOW+jdLTqy2 CyUW4pcKdIrwBpOJViD7UVA2yXvydz8i5Vuz0uM8ra5Q/VjOjczvLXvSEktgeRH1YAuk7V 86fbZGWC9qJsm46kIJrHMjxdVrzvZS2iRxkOxRkzP4ly8sdedq/r5Le7664yeQ== Received: from yantan.tethera.net (localhost [127.0.0.1]) by mail.notmuchmail.org (Postfix) with ESMTP id BFF2F60934; Fri, 1 Sep 2023 07:32:11 +0000 (UTC) Received: from mail-ed1-x534.google.com (mail-ed1-x534.google.com [IPv6:2a00:1450:4864:20::534]) by mail.notmuchmail.org (Postfix) with ESMTPS id 17BAA5E020 for ; Fri, 1 Sep 2023 07:32:09 +0000 (UTC) Received: by mail-ed1-x534.google.com with SMTP id 4fb4d7f45d1cf-51e28cac164so5995339a12.1 for ; Fri, 01 Sep 2023 00:32:09 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1693553528; x=1694158328; darn=notmuchmail.org; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=CwEwopPh91PHTiqAjJOPeRuXjqHgEOwxCxhtIdeEo9o=; b=dOCLbyz2onCc2PS6RR3731aLcfGCzVjYvbt4fp2uRqJ8RTpawCXH+Fs23xpDyhAmwv Y2XAU799L9zSjXiNjBt9t2a+dxL8+jFathCiIBCCiLdztIQ8hsZIvEnJcQ5T80JpZS0a B3Wd0aqP6s49pOS6lkOzPI9eYE78HY2nQ6grMen3I70PmOYVwJ58YPGAXbx6tKb+TXM1 g5rk0TK6eCZBBjpbPlnIUsuG9zyFprobyTiZ1C2eMXNUFGgzx1cknv4pE4BE22zy3yPG HPAaTs4OFywF5p+1gq33SE7g2DyS9GVlso5M2umXtoz6rfLSj2tYEVztsptvcdiv6JnB vV6g== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1693553528; x=1694158328; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=CwEwopPh91PHTiqAjJOPeRuXjqHgEOwxCxhtIdeEo9o=; b=Sg8xgOLXGiaruKXxq4TjpjjoOztcxIqb99smoPOG7Sxuv5VGsevNN6weUUicc21JtM zXDa0qjVB0TeKGYL5Z0ioZIFj66mq3lDRv50+hL7gbBDSyGsyCUmYnZhBKQ2HXqJ3k0W IBc6JgFbRTvSk1bHetsxIRdkPMPACssPawPWLwiUSGjKAVjUjAREXwUrWDvXx+gUkj/O At2UjVAhBJt+VdlwHoOILkCzO5iITCzPcLD1kI9iVcuSmB8P6+Tbpi6gmcm9HeWt9xY2 izcOYIrxdTTaiA27FcL2jrBvvq5IY29Jvx7WejJTRsBTLfmu8CVWBMslLtlvcfSLD2rs qHaQ== X-Gm-Message-State: AOJu0YylOOKWQE5bAj54qRYGUHS/j/sHfCQ79Y2+dniniG0pywVqJVEz 5u1lFlvec/ZEIwIKae7u9QBb6eMl9GTlVaO7kuY= X-Google-Smtp-Source: AGHT+IFSJi+58OWVIYGSdqAaA9gkTI7l8e9rhKGbz0KMHE8vHpau0xgryJq6WtP9NRQDIjCtys3BKY3nfTMtMLz6+EU= X-Received: by 2002:a05:6402:616:b0:523:b133:5c7a with SMTP id n22-20020a056402061600b00523b1335c7amr2165004edv.21.1693553527818; Fri, 01 Sep 2023 00:32:07 -0700 (PDT) MIME-Version: 1.0 References: <875y54lgxs.fsf@motzkin.cs.unb.ca> <87y1i05ykk.fsf@tethera.net> <87v8d45ve8.fsf@tethera.net> <87sf864v0j.fsf@motzkin.cs.unb.ca> <878r9x50ia.fsf@motzkin.cs.unb.ca> <87ledrqrn5.fsf@motzkin.cs.unb.ca> <87cyz36y20.fsf@motzkin.cs.unb.ca> In-Reply-To: <87cyz36y20.fsf@motzkin.cs.unb.ca> From: Michael J Gruber Date: Fri, 1 Sep 2023 09:31:55 +0200 Message-ID: Subject: Re: T460: new sporadic failures with emacs 29 To: David Bremner Message-ID-Hash: WMC4XGQ6644MEMIVJO2S6IH4PFAVY7DY X-Message-ID-Hash: WMC4XGQ6644MEMIVJO2S6IH4PFAVY7DY X-MailFrom: michaeljgruber@gmail.com X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-notmuch.notmuchmail.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: "notmuch@notmuchmail.org" X-Mailman-Version: 3.3.3 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Migadu-Country: DE X-Migadu-Flow: FLOW_IN X-Spam-Score: -1.84 X-Migadu-Queue-Id: 6F7C0D158 X-Migadu-Scanner: mx0.migadu.com X-Migadu-Spam-Score: -1.84 X-TUID: wD6e63VO79l9 Am Do., 31. Aug. 2023 um 17:17 Uhr schrieb David Bremner : > > Michael J Gruber writes: > > > > > I still get those issues. OTOH, skipping T460.14 did not show any > > adverse side effects. So I'll do that for emacs29. > > I might be nice to mark some tests ignored rather than skipped so that > > we notice when they do not fail sporadically any more. That is, *if* > > we look at the output of a passing test suite ... > > > > It is possible to selectively mark tests as broken, but it requires > patching the test suite, and it sets a failing exit code if those tests > start passing. Yes, that's why I wrote "ignore". Something like NOTMUCH_IGNORE_TESTS which runs the test, outputs the diff on fail, but "succeeds" without counting towards pass/fail, and reports the number of ignored pass/fail separately - basically "known_broken" without the "known/expectation". I just don't know whether it's worth it. Other folks disable a whole test suite when they want to get a package update going ... Michael