From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id AMaKIi0hu16RVgAA0tVLHw (envelope-from ) for ; Tue, 12 May 2020 22:20:29 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id sAjGAzwhu160ZwAA1q6Kng (envelope-from ) for ; Tue, 12 May 2020 22:20:44 +0000 Received: from arlo.cworth.org (unknown [50.126.95.6]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 6FD68940609 for ; Tue, 12 May 2020 22:20:41 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 778E26DE13CC; Tue, 12 May 2020 15:20:26 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id RxMNFP1YdpIQ; Tue, 12 May 2020 15:20:24 -0700 (PDT) Received: from arlo.cworth.org (localhost [IPv6:::1]) by arlo.cworth.org (Postfix) with ESMTP id 9C71A6DE1396; Tue, 12 May 2020 15:20:20 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 971686DE10AA for ; Tue, 12 May 2020 15:20:19 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Wa431L6T5gC2 for ; Tue, 12 May 2020 15:20:17 -0700 (PDT) Received: from che.mayfirst.org (unknown [162.247.75.117]) by arlo.cworth.org (Postfix) with ESMTPS id 6A39E6DE136E for ; Tue, 12 May 2020 15:20:17 -0700 (PDT) DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/simple; d=fifthhorseman.net; i=@fifthhorseman.net; q=dns/txt; s=2019; t=1589322016; h=from : to : subject : date : message-id : mime-version : content-type : from; bh=hAcHQOIQPXir4o7FOEusdNA+NyyrST28uNr1+yGhDjQ=; b=GkWD+8Xy6cpqJOT22VOQtTM1jFb5uTJMakO4vnvoCwSTxzuXvxFfO7G3qadZrCVydmdTq //pvzdCZi7P+HPKAA== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=fifthhorseman.net; i=@fifthhorseman.net; q=dns/txt; s=2019rsa; t=1589322016; h=from : to : subject : date : message-id : mime-version : content-type : from; bh=hAcHQOIQPXir4o7FOEusdNA+NyyrST28uNr1+yGhDjQ=; b=Mp4vtbL3H46eUwpG9HTmco0sbhLZg7Rl5Vdes875Z3GkHmBl9T0vQ4iH3EBAVbX7JjLHE vjor8w3rwcerqCR0gJ8RE6Dh1TDVikCN7LKAAtqfeFtdaET3pjRCmYfB+V3sHASBLb/ThfX K2upiBblITqGZf/YxkleKlus4JOVZ/7oG/WrhEOaMiQwtfFQccHUyDMt540717o3oT8skVg dW2nsPrS3qSTUGrgEm9Sd+8beujW4/W+BIONhbAJQAQfNCGwZlcn1ghCRPUYW3OhjjNP2Cw u2oxxz08p/VtYS9pxzyPWs0ieB+yowSjpbQOwf6f1PyNtBDlULTdXjktc/Og== Received: from fifthhorseman.net (unknown [108.58.6.98]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by che.mayfirst.org (Postfix) with ESMTPSA id 1BEE0F9A6 for ; Tue, 12 May 2020 18:20:13 -0400 (EDT) Received: by fifthhorseman.net (Postfix, from userid 1000) id C6E9420438; Tue, 12 May 2020 18:03:18 -0400 (EDT) From: Daniel Kahn Gillmor To: notmuch@notmuchmail.org Subject: test suite: FIXED messages are misordered with tests Autocrypt: addr=dkg@fifthhorseman.net; prefer-encrypt=mutual; keydata= mDMEXEK/AhYJKwYBBAHaRw8BAQdAr/gSROcn+6m8ijTN0DV9AahoHGafy52RRkhCZVwxhEe0K0Rh bmllbCBLYWhuIEdpbGxtb3IgPGRrZ0BmaWZ0aGhvcnNlbWFuLm5ldD6ImQQTFggAQQIbAQULCQgH AgYVCgkICwIEFgIDAQIeAQIXgAIZARYhBMS8Lds4zOlkhevpwvIGkReQOOXGBQJd5Hw3BQkFpJWB AAoJEPIGkReQOOXGDYEA/j0ERjPxDleKMZ2LDcWc/3o5cLFwAVzBKQHppu0Be5IWAP0aeTnyEqlp RTE7M8zugwkhYeUYfYu0BjecDUMnYz6iDLgzBF3kewUWCSsGAQQB2kcPAQEHQK1IuW0GZmcrs2mx CYMl8IHse0tMF8cP7eBNXevrlx2ZiPUEGBYIACYCGwIWIQTEvC3bOMzpZIXr6cLyBpEXkDjlxgUC XeR7TwUJAiGl/gCBdiAEGRYIAB0WIQQsv6x2UaqQJzY+dXHEDyVUMvKBDwUCXeR7BQAKCRDEDyVU MvKBD7KmAQCHs+7588C4jto6fMje0Nu97zzoppjJM7lrGF2rVnbHvwD+MgmGUbHzPSUrTWnZBQDi /QM595bxNrBA4N1CiXhs2AMJEPIGkReQOOXGpp0BAM7YeBnt/UNvxJAGm4DidSfHU7RDMWe6Tgux HrH21cDkAQC9leNFXJsQ7F2ZniRPHa8CkictcQEKPL8VCWpfe8LbArg4BF3ke5wSCisGAQQBl1UB BQEBB0Cf+EiAXtntQMf51xpqb6uZ5O0eCLAZtkg0SXHjA1JlEwMBCAeIfgQYFggAJhYhBMS8Lds4 zOlkhevpwvIGkReQOOXGBQJd5HucAhsMBQkCIaVkAAoJEPIGkReQOOXGdYcBANYnW7VyL2CncKH1 iO4Zr0IwfdIv6rai1PUHL98pVi3cAP9tMh85CKGDa0Xi/fptQH41meollLW5tLb/bEWMuUNuBQ== Date: Tue, 12 May 2020 18:03:17 -0400 Message-ID: <87eeron74q.fsf@fifthhorseman.net> MIME-Version: 1.0 X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============0796890991222848319==" Errors-To: notmuch-bounces@notmuchmail.org Sender: "notmuch" X-Scanner: scn0 X-Spam-Score: 1.49 Authentication-Results: aspmx1.migadu.com; dkim=fail (body hash did not verify) header.d=fifthhorseman.net header.s=2019 header.b=GkWD+8Xy; dkim=fail (body hash did not verify) header.d=fifthhorseman.net header.s=2019rsa header.b=Mp4vtbL3; dmarc=fail reason="SPF not aligned (relaxed)" header.from=fifthhorseman.net (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 50.126.95.6 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Scan-Result: default: False [1.49 / 13.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; RDNS_NONE(1.00)[]; GENERIC_REPUTATION(0.00)[-0.44784583994606]; FORGED_SENDER_MAILLIST(0.00)[]; DWL_DNSWL_BLOCKED(0.00)[50.126.95.6:from]; R_DKIM_REJECT(1.00)[fifthhorseman.net:s=2019,fifthhorseman.net:s=2019rsa]; IP_REPUTATION_HAM(0.00)[asn: 27017(-0.18), country: US(-0.00), ip: 50.126.95.6(-0.45)]; TO_DN_NONE(0.00)[]; R_SPF_ALLOW(-0.20)[+a]; DKIM_TRACE(0.00)[fifthhorseman.net:-]; MX_GOOD(-0.50)[cached: notmuchmail.org]; MAILLIST(-0.20)[mailman]; SIGNED_PGP(-2.00)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:~,4:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:27017, ipnet:50.126.64.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; FROM_NEQ_ENVFROM(0.00)[dkg@fifthhorseman.net,notmuch-bounces@notmuchmail.org]; RDNS_DNSFAIL(0.00)[]; ARC_NA(0.00)[]; URIBL_BLOCKED(0.00)[notmuchmail.org:email,test-lib.sh:url]; FROM_HAS_DN(0.00)[]; SPF_REPUTATION_HAM(0.00)[-0.41300344938248]; MIME_GOOD(-0.20)[multipart/mixed,multipart/signed,text/plain]; PREVIOUSLY_DELIVERED(0.00)[notmuch@notmuchmail.org]; HAS_LIST_UNSUB(-0.01)[]; RCPT_COUNT_ONE(0.00)[1]; DNSWL_BLOCKED(0.00)[50.126.95.6:from]; RCVD_COUNT_SEVEN(0.00)[8]; HFILTER_HOSTNAME_UNKNOWN(2.50)[]; DMARC_POLICY_SOFTFAIL(0.10)[fifthhorseman.net : SPF not aligned (relaxed),none] X-TUID: 30Vmy2PWIdq9 --===============0796890991222848319== Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature" --=-=-= Content-Type: text/plain I'm debugging/diagnosing/trying to clean up some "FIXED" known-broken tests right now. Sometimes, depending on circumstances i can't predict (race conditions?), I see funny output like: ~~~ Use "make V=1" to see the details for passing and known broken tests. INFO: using 2m timeout for tests INFO: running tests with moreutils parallel FIXED verify signed PKCS#7 subject (onepart-signed) signer User ID T356-protected-headers: Testing Message decryption with protected headers BROKEN confirm signed and encrypted PKCS#7 subject (sign+enc) BROKEN confirm signed and encrypted PKCS#7 subject (sign+enc) signer User ID BROKEN confirm signed and encrypted PKCS#7 subject (sign+enc+legacy-disp) BROKEN confirm signed and encrypted PKCS#7 subject (sign+enc+legacy-disp) signer User ID BROKEN confirm encryption-protected PKCS#7 subject (enc+legacy-disp) ~~~ Clearly, that FIXED should come *after* the "T356-protected-headers:" separator. This is a minor bug, i suppose, but i confess i don't understand the maze of shell functions in test-lib.sh well enough to see why this is happening, let alone to fix it. Anyone interested in fixing it should be able to do so by marking a good test "known broken" and then re-running the test suite. The above output is taken from: make -j4 check NOTMUCH_TESTS=T356-protected-headers.sh Sorry to send a bug report with no fixes! --dkg --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYIAB0WIQQsv6x2UaqQJzY+dXHEDyVUMvKBDwUCXrsdJgAKCRDEDyVUMvKB D1JrAQCYYmPCSjU4BmyFwdkwhQ1Fo4XFS1hyf937VbX5Xjqk7QEA66AI3wZqidRT zPa5jTidp3JkZN+cE4OOXo7E2MjfywY= =/7oZ -----END PGP SIGNATURE----- --=-=-=-- --===============0796890991222848319== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline --===============0796890991222848319==--