From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:403:478a::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id qGcnI/W98WQSEgAA9RJhRA:P1 (envelope-from ) for ; Fri, 01 Sep 2023 12:33:25 +0200 Received: from aspmx1.migadu.com ([2001:41d0:403:478a::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id qGcnI/W98WQSEgAA9RJhRA (envelope-from ) for ; Fri, 01 Sep 2023 12:33:25 +0200 Received: from mail.notmuchmail.org (yantan.tethera.net [IPv6:2a01:4f9:c011:7a79::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 704DD5571F for ; Fri, 1 Sep 2023 12:33:25 +0200 (CEST) Authentication-Results: aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=unbcloud.onmicrosoft.com header.s=selector1-unbcloud-onmicrosoft-com header.b=RzK1Kyp3; dmarc=fail reason="SPF not aligned (relaxed)" header.from=unb.ca (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 2a01:4f9:c011:7a79::1 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org; arc=reject ("signature check failed: fail, {[1] = sig:microsoft.com:reject}") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1693564405; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-owner:list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=7s8DzzSraNlCmx7x9wxNl15VpHmHeZTtpu/UHcQFy1g=; b=Y+TzxbFt3XpFLWoEihAVTrulcjsGQdvgPcK2ukkygXypGNg9ZGSBbBFzNgfO2e0PSdtBEB khnePNopQ1pnZJ/2q9rUnWa0niaWhkxBfTMQjNKAC8sqqRbZk+mDvpyBGAKayMen9WnQMs JtTD3hlBCQ5FG1uKj3XoGdsi10s2hbUfWsP1339sBLEG0tb3jSWbUUb+m9tMM/7H3i5/YR hTSyoE6WykXmRE5bNrZM8+afX4hGW0sprRRP+LM93Sb8iC38Bd/2ep9DTYEfy79t0VTsY3 ppRVCC7G3VVL1MT/0Yb0JHeDuPWqTQJ/YgOTKyCzaFHzofDr0HauLzplzsKR9Q== ARC-Seal: i=2; s=key1; d=yhetil.org; t=1693564405; a=rsa-sha256; cv=fail; b=NVt5IDfn1vJc2pT2tduUcc0qW4gext1do8matWQBW3a9w5RQnIwX7b/onJVF2lXq9bIeTv OHYdA9tf9UPdcahUiNTVtEIjwfKe7xKd/U7wpH5cyCkrgeWAfDIdo6bPT+r/XstpOjq/eR QudrG8yXNucIqFWPSmjsUlacGZyW3rNYHNcpTfd75pPYDxvOSfGZ6zsEBS6ucfFZ72gLut UFEHqjD65xEHzsCv8JPoUep61VMqrCoBjY2MvxKx1qVG5JULoFmfUkQb1DA0WuHz9ZRZn3 Lcbmt5veu75NOjvCVud3iciwNXS4IlEMbjy49ngiwrEssqaOOMsJaQuoMVMDUA== ARC-Authentication-Results: i=2; aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=unbcloud.onmicrosoft.com header.s=selector1-unbcloud-onmicrosoft-com header.b=RzK1Kyp3; dmarc=fail reason="SPF not aligned (relaxed)" header.from=unb.ca (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 2a01:4f9:c011:7a79::1 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org; arc=reject ("signature check failed: fail, {[1] = sig:microsoft.com:reject}") Received: from yantan.tethera.net (localhost [127.0.0.1]) by mail.notmuchmail.org (Postfix) with ESMTP id 886FA60939; Fri, 1 Sep 2023 10:27:58 +0000 (UTC) Received: from CAN01-YT3-obe.outbound.protection.outlook.com (mail-yt3can01on2102.outbound.protection.outlook.com [40.107.115.102]) by mail.notmuchmail.org (Postfix) with ESMTPS id C019C60934 for ; Fri, 1 Sep 2023 10:27:56 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=St2aE/q1megEQ1adL9A29lBjDChHucJEkgAlyZ1OcRHFXuj5JeWAaGyMhS1ji+sN7m5LuxdbyFcjf42Eui2emFAhYFfqfiXLvNXntC6q9iOolUe7hIi5hgngr2KU0yO2mncTVLcvylgleFF7cFsXZiLTGrzUTnFXssFg9OfmAK0owXnUyypV325zt68W3xgLdhJ+Grv6zG23u6l7bo3gLS3ReqzrH2XKh5/jMzTx1AQYmpRoxpTKQqoAqhY5FWXjgMumwOhgWqXtLTwROLsF3Xht44EufuX/JYfJBqqAX/4Iu91BgcCZ5UKTqge9EePAygp54O2KgpiA9jiuoFVcuQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=tPZo7SCDAehKIMVvQdX32ZheBFG9nP+Kj0xXbNr5Ouw=; b=Te6hwI497GAyeeTG5TWla8qWxwxcOle9qxbVd6BZZzx1b8CGHJ2tP8JzRCV/LHeECIahfr1FgBD5yePhS54gqSPBgH1WQ8lgkgibOj2C7+DW6DXOARZTrsA5Ljo9JKRQdO6NGLu5PeQq4Lx7FZqIlfiLxWfHSXeVRz9wz4f1WedzDn4I3m5TSe2ymgf4mAL9rhWIJx9aMq3HqrLl4ygwNpE0maJmHpjxI8wgzQn/hZzKLXXoVUSD1KHynpV0tGC27f5mRpeBoYIxuTRAdRqsEcI7neqDSYuVDEoCFUyyFoEs82PM1e+t1/E9Jv+B52tQvmK7NwJoVYcanCxaM7IhHA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=unb.ca; dmarc=pass action=none header.from=unb.ca; dkim=pass header.d=unb.ca; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=unbcloud.onmicrosoft.com; s=selector1-unbcloud-onmicrosoft-com; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=tPZo7SCDAehKIMVvQdX32ZheBFG9nP+Kj0xXbNr5Ouw=; b=RzK1Kyp3cjejZHEYW23OvSIIn/qFRXUhBXxbk+0HwJeExfnQfJVytAzQxxqkK3QVCuvfCtPxkVAWbTlmBJ4FTqyRddqjsfEqxQHBVXiFYZTVNJ6Cl6jE18lE3FJEKRuFiYSC3QF6KtmaxvHTaW5IyannLoHyVbYe6edumo0nf9A= Received: from YT3PR01MB10265.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:8d::10) by YT2PR01MB9253.CANPRD01.PROD.OUTLOOK.COM (2603:10b6:b01:bd::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6745.27; Fri, 1 Sep 2023 10:27:54 +0000 Received: from YT3PR01MB10265.CANPRD01.PROD.OUTLOOK.COM ([fe80::1440:78da:52d6:fc7b]) by YT3PR01MB10265.CANPRD01.PROD.OUTLOOK.COM ([fe80::1440:78da:52d6:fc7b%7]) with mapi id 15.20.6745.026; Fri, 1 Sep 2023 10:27:54 +0000 From: David Bremner To: Michael J Gruber Subject: Re: T460: new sporadic failures with emacs 29 Thread-Topic: T460: new sporadic failures with emacs 29 Thread-Index: AQHZ3A1IVVcT79HetES7hR9nTpQFZw== Date: Fri, 1 Sep 2023 10:27:54 +0000 Message-ID: <87sf7ykx1y.fsf@motzkin.cs.unb.ca> References: <875y54lgxs.fsf@motzkin.cs.unb.ca> <87y1i05ykk.fsf@tethera.net> <87v8d45ve8.fsf@tethera.net> <87sf864v0j.fsf@motzkin.cs.unb.ca> <878r9x50ia.fsf@motzkin.cs.unb.ca> <87ledrqrn5.fsf@motzkin.cs.unb.ca> <87cyz36y20.fsf@motzkin.cs.unb.ca> In-Reply-To: Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-ms-publictraffictype: Email x-ms-traffictypediagnostic: YT3PR01MB10265:EE_|YT2PR01MB9253:EE_ x-ms-office365-filtering-correlation-id: bf88978d-7086-4fb6-7131-08dbaad61a3d x-ms-exchange-senderadcheck: 1 x-ms-exchange-antispam-relay: 0 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: RpzQ7XDkEoCrceDgL1n0LcpmMTYwNCENnBFLzRdW/46uQ3BaAGYaeT4hRHB4KV69YC/t9lDun+zU9EWFU7QQrifQwcp8J8Hwt0TLjVl/osrgnqpCsjhE0rlrVW9piKlEym+gqKgEhYQjv+Y7mRkCrsomIoMQ+4K2wBbF9HwjSx8Pck4IJr/HyprIkxRsXKvxMnACTFaQZP8cbEjMS/QZ1wPx8Igrt0OO1FCWshWr7QWvLvPJ1oyBufOfWBqSNBy0CwNvyey9os6fIH5xIchvA7Z8b9hJwjJ2T8Ph6iaDrlKg6YBy4Q99picd1YTxPqob5udivF1Nr9Wr0Ccw1A0dbL6onMQDm1HwXWcG+oe/u0W4uX9D7xvelURD7heFTuVvRaLu8qIQPQ7Bg95911eoyiKSgmmYsHNU23ud4nQTnMqeMjAB22s5+z/2tqWBisiJ2dlHixjxtZRvaQCMFNgJ34YoV/PuiSomKxFYcSZV0Fe/sMZNAZkdvbB6J+qSFBbwectq2PZ3mIKVin7d0kzW8dqeGSPNNKn0iNHEdetEhl2d1ZbYZNljCFC/hmM+hwLmJEqmxn/693ovw+BQHbFQnWgALGmgljwfj7NtXNxyq4q0N0s2ESJ/7ditsFiwIPXa x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:YT3PR01MB10265.CANPRD01.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230031)(39860400002)(376002)(346002)(396003)(366004)(136003)(1800799009)(186009)(451199024)(6506007)(6486002)(6512007)(71200400001)(83380400001)(122000001)(86362001)(38100700002)(38070700005)(26005)(41300700001)(4744005)(2906002)(91956017)(64756008)(66446008)(66476007)(66556008)(66946007)(76116006)(54906003)(8936002)(8676002)(4326008)(316002)(786003)(478600001)(5660300002);DIR:OUT;SFP:1102; x-ms-exchange-antispam-messagedata-chunkcount: 1 x-ms-exchange-antispam-messagedata-0: =?iso-8859-1?Q?VLprJgOEu9C5TyiOfDdOw2Hp0B+bJbOrHlYOmGHPOt48UpY3S4vGs5Dhe3?= =?iso-8859-1?Q?RDFMFPBbHSkjxBCQ7E4SPOgMA5LLGF0PDfGwtzSBCwrmu0Lfx0Cav11w7/?= =?iso-8859-1?Q?j68W1lBPfdgSaLiOORCHMJw7ewCxkkdEiv9gO1iD+AsNDbDQRJKYg/jAy/?= =?iso-8859-1?Q?YqXGhSdqLH+SUVB1uyW8Y0LTxqphte5G36UhzIIxVTU9ILMOjUIZwIdMW1?= =?iso-8859-1?Q?aHMc2mIS7Df0IRXnh0HYKSEofG3vhScUnJlbMWRdZmFSLCSnq58TUvqwb3?= =?iso-8859-1?Q?+JIzaFsYUpRt5ISmRkRyknqjWbzulBxFcmSoDvZavhGinaoOXhG76eDkeZ?= =?iso-8859-1?Q?QlbCDYGikkXGnYdJLesxlvKppThCbtYn8M6qJo6gzavo5iiPv30zcdA7ZS?= =?iso-8859-1?Q?e1yZKURWSJA/9sh7lZbMy4Xnw/h8juyPGhxAGEde46eRqDvhkYF46rPhOm?= =?iso-8859-1?Q?1M42G9B7CGpP0nAvVYgY1VnY5fJUvOHpGIR1G9Z1tnrVfeCsX/ChHsKvYQ?= =?iso-8859-1?Q?3GSnTYoPlbdxw6JCOiBXIZwYu+JWOuYPn6cX8aD5YK5ie5LTQL9/kVKgdU?= =?iso-8859-1?Q?r7bGsp/yWmkMmlSCIdJUiKxpfRW1rPgWDtoPFlVQAH1sDKhBFEsXL1gr8t?= =?iso-8859-1?Q?wg9WL11oqkxtW8oVmsuFTRANSGuZtvyevKkFkzFS5jikGb4sEOBlVqnYEl?= =?iso-8859-1?Q?rzTHimWmLl6y3wbf5rwigg9JOCuWvmtVQTGbwQtOrSMZxdLLgDElh+6cT2?= =?iso-8859-1?Q?ejVkHxM+nCnvsB6yVekrvRWwhg2vbWFHH8SZmXeUxA5egOTzcVMCZ1grPm?= =?iso-8859-1?Q?e21A9b/mMeyHphu1GpKFzmC8lpCR3Yj/v2rfXN4XNHYPmiB6Qfx0hRVBeA?= =?iso-8859-1?Q?rapX71j2NVN6yyEZVrFbhank7/YiE0AD9GqHp/lVvSq1/fjTtswSoH8XoC?= =?iso-8859-1?Q?TDsLm9fkjsqpUC5qb/EEqiqAnzUA0YozaMpbwtR5j9QEWN5+MAoKLDBv5D?= =?iso-8859-1?Q?bMnQudhaT4qQeG/aqv4xgXDJT4gEIeMUu6WGHH5bOVRAh5luRVZAw4YXCU?= =?iso-8859-1?Q?/LMz0MSOjQgq3S4UBs8nO9X/FU4LKSe2MOwkjYEzvXSnaOYyh0O+sYMDOI?= =?iso-8859-1?Q?efugR5Ung3XEo4kU2TbUe7pvQAjM6jiVwi6NfQPknOfMa04GLHcibugFH7?= =?iso-8859-1?Q?NrcPbkw1JkbbDcIyFbtMFKOjPDtK0zwNNa59COlppQtBu/gxJSHzkOGEUj?= =?iso-8859-1?Q?Rjw/RNaAmDSKuxY1b1ZQrVe8cO/r0JbvYYB9qlvL9uLONxDw2/cMK2sRVM?= =?iso-8859-1?Q?0KODBnNgC0kRYRnhWHsIcn1Z7YRd+9/42col1mD4EysvZXZ8ggicRbdTeZ?= =?iso-8859-1?Q?gqIGJ5xgieVxY3hgi8vSY5uSo6W7Bwd/csKw07SgXhkSCjcO6IhY/o3f91?= =?iso-8859-1?Q?A6X5+hYuvTvsDkeIS0CiEBHZxSalCC4SqsBkQK5a/41k5Uw1hg79/+dqv2?= =?iso-8859-1?Q?//pkG0ykHHPan80DFQPuQmkFrZi6m0TOKmvTGd2f0Jp0dWPW62jMDmAmqQ?= =?iso-8859-1?Q?AuQR0kfpXoSRS+1iyv8ZbT8lyiW2Q+eJj9Shj1jZaht9x55wvPflxmVFYI?= =?iso-8859-1?Q?vwZpWVzMgzRYTIMFdm5J63NxEK78tDXPg1?= MIME-Version: 1.0 X-OriginatorOrg: unb.ca X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-AuthSource: YT3PR01MB10265.CANPRD01.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-Network-Message-Id: bf88978d-7086-4fb6-7131-08dbaad61a3d X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Sep 2023 10:27:54.2899 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: 244e6ed2-339a-47f3-b95c-e45351c198b7 X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: 74SvNdsGY1m/AIWk03jfkEK0U1VoSpCvoSst2k0SXVgmD/Zu3JnlBD5CVbcXXhEQ X-MS-Exchange-Transport-CrossTenantHeadersStamped: YT2PR01MB9253 Message-ID-Hash: 5I2WCEYAC6DVALB773FV5IDWE5WIP24K X-Message-ID-Hash: 5I2WCEYAC6DVALB773FV5IDWE5WIP24K X-MailFrom: bremner@unb.ca X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-notmuch.notmuchmail.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: "notmuch@notmuchmail.org" , Tomi Ollila X-Mailman-Version: 3.3.3 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Migadu-Flow: FLOW_IN X-Migadu-Country: DE X-Migadu-Spam-Score: 7.51 X-Spam-Score: 7.51 X-Migadu-Queue-Id: 704DD5571F X-Migadu-Scanner: mx0.migadu.com X-TUID: kxiLAgBnvOlf Michael J Gruber writes: > > Yes, that's why I wrote "ignore". Something like NOTMUCH_IGNORE_TESTS > which runs the test, outputs the diff on fail, but "succeeds" without > counting towards pass/fail, and reports the number of ignored > pass/fail separately - basically "known_broken" without the > "known/expectation". > > I just don't know whether it's worth it. Other folks disable a whole > test suite when they want to get a package update going ... I guess it would be mainly interesting for distro packagers, or I guess people who wanted to run come kind of CI. Without looking at the code, I think just ignoring the return value would be relatively easy, while keeping track of ignored tests might be a bit more work. Maybe Tomi has a clearer idea / finds this a fun problem. d