From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id yDb/BhFfxF7YNQAA0tVLHw (envelope-from ) for ; Tue, 19 May 2020 22:34:57 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id ePEBAxFfxF7BBgAA1q6Kng (envelope-from ) for ; Tue, 19 May 2020 22:34:57 +0000 Received: from arlo.cworth.org (arlo.cworth.org [50.126.95.6]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id A49839402D1 for ; Tue, 19 May 2020 22:34:54 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id E19AD6DE13AB; Tue, 19 May 2020 15:34:48 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id zP5ImrtyLTL1; Tue, 19 May 2020 15:34:48 -0700 (PDT) Received: from arlo.cworth.org (localhost [IPv6:::1]) by arlo.cworth.org (Postfix) with ESMTP id 102B36DE138B; Tue, 19 May 2020 15:34:47 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 3E20B6DE138B for ; Tue, 19 May 2020 15:34:45 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id XTGM5orV982k for ; Tue, 19 May 2020 15:34:44 -0700 (PDT) Received: from che.mayfirst.org (unknown [162.247.75.117]) by arlo.cworth.org (Postfix) with ESMTPS id BB2EC6DE137E for ; Tue, 19 May 2020 15:34:43 -0700 (PDT) DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/simple; d=fifthhorseman.net; i=@fifthhorseman.net; q=dns/txt; s=2019; t=1589927682; h=from : to : subject : in-reply-to : references : date : message-id : mime-version : content-type : from; bh=vw+SZjn8kc4dreQEVkYMkoG400VAVfGzxH2JhrC+1G8=; b=dXzc0AUj7olfOrG6VcaKR8iVohNK36nT0iCfPePck7olG2ILUJe65ECBNenzbJekVsGtG EfWehRDFbWTs2V4CQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=fifthhorseman.net; i=@fifthhorseman.net; q=dns/txt; s=2019rsa; t=1589927682; h=from : to : subject : in-reply-to : references : date : message-id : mime-version : content-type : from; bh=vw+SZjn8kc4dreQEVkYMkoG400VAVfGzxH2JhrC+1G8=; b=Ql1ms7GF0T0MmaTbH5FuTE55kov1sG9rCXAfaZ1y4ibK+Drvc2RB/JCtQdyHjro4qToyl sWpK0+Y1LyPcaShQ2flVfxRLNmu0OlFL9D2gXNw9jdQnAopdJ4AeWxadDTosauoyY2WTUy2 9eI2lCXeb989fpl3eQk1vS32OOYGcOdVMwCWf7XdkjHIhblExXRV5WnKNMaQVDjQt61PdwQ JnBwGJbOdQOBGRRfSAabGpniuKPQL1An9P8/ZuPMbDr3l+VrJrlcscgOYwjKmI2mQpQjGTl BdatUqP3hrdHS/7Jlz0wE7mpFIkDKcnizYsNtqmALpn9xpGsx5FgOIi3w/zQ== Received: from fifthhorseman.net (unknown [108.58.6.98]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by che.mayfirst.org (Postfix) with ESMTPSA id 69825F9A5; Tue, 19 May 2020 18:34:41 -0400 (EDT) Received: by fifthhorseman.net (Postfix, from userid 1000) id 876B220181; Tue, 19 May 2020 18:13:19 -0400 (EDT) From: Daniel Kahn Gillmor To: David Bremner , notmuch@notmuchmail.org Subject: Re: test suite: FIXED messages are misordered with tests In-Reply-To: <87tv0kd9vk.fsf@tethera.net> References: <87eeron74q.fsf@fifthhorseman.net> <87tv0kd9vk.fsf@tethera.net> Autocrypt: addr=dkg@fifthhorseman.net; prefer-encrypt=mutual; keydata= mDMEXEK/AhYJKwYBBAHaRw8BAQdAr/gSROcn+6m8ijTN0DV9AahoHGafy52RRkhCZVwxhEe0K0Rh bmllbCBLYWhuIEdpbGxtb3IgPGRrZ0BmaWZ0aGhvcnNlbWFuLm5ldD6ImQQTFggAQQIbAQULCQgH AgYVCgkICwIEFgIDAQIeAQIXgAIZARYhBMS8Lds4zOlkhevpwvIGkReQOOXGBQJd5Hw3BQkFpJWB AAoJEPIGkReQOOXGDYEA/j0ERjPxDleKMZ2LDcWc/3o5cLFwAVzBKQHppu0Be5IWAP0aeTnyEqlp RTE7M8zugwkhYeUYfYu0BjecDUMnYz6iDLgzBF3kewUWCSsGAQQB2kcPAQEHQK1IuW0GZmcrs2mx CYMl8IHse0tMF8cP7eBNXevrlx2ZiPUEGBYIACYCGwIWIQTEvC3bOMzpZIXr6cLyBpEXkDjlxgUC XeR7TwUJAiGl/gCBdiAEGRYIAB0WIQQsv6x2UaqQJzY+dXHEDyVUMvKBDwUCXeR7BQAKCRDEDyVU MvKBD7KmAQCHs+7588C4jto6fMje0Nu97zzoppjJM7lrGF2rVnbHvwD+MgmGUbHzPSUrTWnZBQDi /QM595bxNrBA4N1CiXhs2AMJEPIGkReQOOXGpp0BAM7YeBnt/UNvxJAGm4DidSfHU7RDMWe6Tgux HrH21cDkAQC9leNFXJsQ7F2ZniRPHa8CkictcQEKPL8VCWpfe8LbArg4BF3ke5wSCisGAQQBl1UB BQEBB0Cf+EiAXtntQMf51xpqb6uZ5O0eCLAZtkg0SXHjA1JlEwMBCAeIfgQYFggAJhYhBMS8Lds4 zOlkhevpwvIGkReQOOXGBQJd5HucAhsMBQkCIaVkAAoJEPIGkReQOOXGdYcBANYnW7VyL2CncKH1 iO4Zr0IwfdIv6rai1PUHL98pVi3cAP9tMh85CKGDa0Xi/fptQH41meollLW5tLb/bEWMuUNuBQ== Date: Tue, 19 May 2020 18:13:18 -0400 Message-ID: <878shnlgjl.fsf@fifthhorseman.net> MIME-Version: 1.0 X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============5668021377068233969==" Errors-To: notmuch-bounces@notmuchmail.org Sender: "notmuch" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=fail (body hash did not verify) header.d=fifthhorseman.net header.s=2019 header.b=dXzc0AUj; dkim=fail (body hash did not verify) header.d=fifthhorseman.net header.s=2019rsa header.b=Ql1ms7GF; dmarc=fail reason="SPF not aligned (relaxed)" header.from=fifthhorseman.net (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 50.126.95.6 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Spam-Score: -0.51 X-TUID: F3NZZS+exwC3 --===============5668021377068233969== Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature" --=-=-= Content-Type: text/plain On Tue 2020-05-12 20:14:07 -0300, David Bremner wrote: > Daniel Kahn Gillmor writes: >> >> Clearly, that FIXED should come *after* the "T356-protected-headers:" >> separator. >> > > Can you reproduce this without running the tests in parallel? Yep: I've seen the misordered output when using "make -j4 check". I've also seen it with plain old "make check". And i can replicate it with: make check NOTMUCH_TEST_SERIALIZE=1 NOTMUCH_TESTS=T355-smime.sh (i don't think NOTMUCH_TEST_SERIALIZE=1 makes any difference when only one item is present in NOTMUCH_TESTS) I also tried "make check NOTMUCH_TEST_SERIALIZE=1" (so slow, i'm spoiled by the parallel test suite!) and yes, i see the same problem there. --dkg --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYIAB0WIQQsv6x2UaqQJzY+dXHEDyVUMvKBDwUCXsRZ/wAKCRDEDyVUMvKB D6ilAQCInK70qz+Y6nzK8v63j38gJSpr3TieeTm4Xf3Hq895RAD/XltHm6AgC255 zmnbpoPp0MJCsXYLNUkRLWI42bMmewU= =0sKs -----END PGP SIGNATURE----- --=-=-=-- --===============5668021377068233969== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline --===============5668021377068233969==--