From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id eGZ6CxElx14vGgAA0tVLHw (envelope-from ) for ; Fri, 22 May 2020 01:04:17 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id +P9uBxElx15UUwAA1q6Kng (envelope-from ) for ; Fri, 22 May 2020 01:04:17 +0000 Received: from arlo.cworth.org (arlo.cworth.org [50.126.95.6]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id B6F599402D1 for ; Fri, 22 May 2020 01:04:16 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id C227E6DE119D; Thu, 21 May 2020 18:04:11 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id qOs7Lm0iJghU; Thu, 21 May 2020 18:04:11 -0700 (PDT) Received: from arlo.cworth.org (localhost [IPv6:::1]) by arlo.cworth.org (Postfix) with ESMTP id AE3756DE136D; Thu, 21 May 2020 18:04:07 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 5901C6DE1055 for ; Thu, 21 May 2020 18:04:05 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id R-ylr0MJqLVn for ; Thu, 21 May 2020 18:04:04 -0700 (PDT) Received: from che.mayfirst.org (unknown [162.247.75.117]) by arlo.cworth.org (Postfix) with ESMTPS id 938E36DE104A for ; Thu, 21 May 2020 18:04:04 -0700 (PDT) DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/simple; d=fifthhorseman.net; i=@fifthhorseman.net; q=dns/txt; s=2019; t=1590109443; h=from : to : subject : in-reply-to : references : date : message-id : mime-version : content-type : from; bh=X57hwlYDTPMX9UsEhS+ckyp5tgZVa1PorF+Dnz+qUi8=; b=t3SYf60djNg77H+T8VNYPvHU6JxaN2jPtNGZdDcIwzwKNjXRbcYURbknjPnCW1lNZPvm+ 5M17Wz/8eG7tg6/Cw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=fifthhorseman.net; i=@fifthhorseman.net; q=dns/txt; s=2019rsa; t=1590109443; h=from : to : subject : in-reply-to : references : date : message-id : mime-version : content-type : from; bh=X57hwlYDTPMX9UsEhS+ckyp5tgZVa1PorF+Dnz+qUi8=; b=NJX3m4c0lLJwbzAZDA07NPgPD+H0h51lxCoogb8/fgEMdvzO44Wwx98HSEIeg2jTEZaSd n/Jsq0bAtpkqeTpq0rQYy/zDFNarE51CHnUIujgVXXEpeE3PcetowBAW4D0iRL36aj+R/Ub 20ToqgF5FjNeuz2GWqPU4xjaFIBkFFX8P0LNeCxT4/7qy42qPyrtKUy6pjV9DHuXwXmklAs 08BdzE1xX8BerDcniUl851ZP0L7NbhK7wzMUrF5a57UUIRRmh6DwTOBrATwX9RhGeCnQrRw fsoBj0gKeTZIg6NSArDPD8oiVQDWeJfxcE2Pqj31SeLWE5kLr5NBx07T0Ppg== Received: from fifthhorseman.net (unknown [108.58.6.98]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by che.mayfirst.org (Postfix) with ESMTPSA id C2877F9A5; Thu, 21 May 2020 21:04:02 -0400 (EDT) Received: by fifthhorseman.net (Postfix, from userid 1000) id B67D4202CB; Thu, 21 May 2020 20:48:01 -0400 (EDT) From: Daniel Kahn Gillmor To: Tomi Ollila , notmuch@notmuchmail.org Subject: Re: test suite: FIXED messages are misordered with tests In-Reply-To: References: <87eeron74q.fsf@fifthhorseman.net> <87h7w9jhqp.fsf@fifthhorseman.net> Autocrypt: addr=dkg@fifthhorseman.net; prefer-encrypt=mutual; keydata= mDMEXEK/AhYJKwYBBAHaRw8BAQdAr/gSROcn+6m8ijTN0DV9AahoHGafy52RRkhCZVwxhEe0K0Rh bmllbCBLYWhuIEdpbGxtb3IgPGRrZ0BmaWZ0aGhvcnNlbWFuLm5ldD6ImQQTFggAQQIbAQULCQgH AgYVCgkICwIEFgIDAQIeAQIXgAIZARYhBMS8Lds4zOlkhevpwvIGkReQOOXGBQJd5Hw3BQkFpJWB AAoJEPIGkReQOOXGDYEA/j0ERjPxDleKMZ2LDcWc/3o5cLFwAVzBKQHppu0Be5IWAP0aeTnyEqlp RTE7M8zugwkhYeUYfYu0BjecDUMnYz6iDLgzBF3kewUWCSsGAQQB2kcPAQEHQK1IuW0GZmcrs2mx CYMl8IHse0tMF8cP7eBNXevrlx2ZiPUEGBYIACYCGwIWIQTEvC3bOMzpZIXr6cLyBpEXkDjlxgUC XeR7TwUJAiGl/gCBdiAEGRYIAB0WIQQsv6x2UaqQJzY+dXHEDyVUMvKBDwUCXeR7BQAKCRDEDyVU MvKBD7KmAQCHs+7588C4jto6fMje0Nu97zzoppjJM7lrGF2rVnbHvwD+MgmGUbHzPSUrTWnZBQDi /QM595bxNrBA4N1CiXhs2AMJEPIGkReQOOXGpp0BAM7YeBnt/UNvxJAGm4DidSfHU7RDMWe6Tgux HrH21cDkAQC9leNFXJsQ7F2ZniRPHa8CkictcQEKPL8VCWpfe8LbArg4BF3ke5wSCisGAQQBl1UB BQEBB0Cf+EiAXtntQMf51xpqb6uZ5O0eCLAZtkg0SXHjA1JlEwMBCAeIfgQYFggAJhYhBMS8Lds4 zOlkhevpwvIGkReQOOXGBQJd5HucAhsMBQkCIaVkAAoJEPIGkReQOOXGdYcBANYnW7VyL2CncKH1 iO4Zr0IwfdIv6rai1PUHL98pVi3cAP9tMh85CKGDa0Xi/fptQH41meollLW5tLb/bEWMuUNuBQ== Date: Thu, 21 May 2020 20:48:01 -0400 Message-ID: <87r1vciym6.fsf@fifthhorseman.net> MIME-Version: 1.0 X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6411180915407416661==" Errors-To: notmuch-bounces@notmuchmail.org Sender: "notmuch" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=fail (body hash did not verify) header.d=fifthhorseman.net header.s=2019 header.b=t3SYf60d; dkim=fail (body hash did not verify) header.d=fifthhorseman.net header.s=2019rsa header.b=NJX3m4c0; dmarc=fail reason="SPF not aligned (relaxed)" header.from=fifthhorseman.net (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 50.126.95.6 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Spam-Score: -2.01 X-TUID: QGzp9Lftzc8S --===============6411180915407416661== Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature" --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On Fri 2020-05-22 00:57:14 +0300, Tomi Ollila wrote: > We've accumulated quite a bit of mess during these years to the test > system, which makes it harder to do larger adjustments (and not (yet) > mentioning even larger refactorings...). The last significant refactoring was probably when jrollins and i got the test suite running in parallel, and that might not even qualify as "major". Of course, the most effective tool for encouraging any refactoring is having a robust and reliable test suite to make sure that nothing broke. But now we're talking about a test suite for the test suite=E2=80=A6 i dunno how far we want to go down the rabbit hole! --dkg --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYIAB0WIQQsv6x2UaqQJzY+dXHEDyVUMvKBDwUCXschQQAKCRDEDyVUMvKB DykzAQCxUY6mDDINtwvMb8P78RbjglNeTpBSEtnFgVsYv0VwuAD/XoQ7FxvCX+8F RCDh1iYSFSZKZ6jNMBx1wm2Rp94I3Qk= =bdlZ -----END PGP SIGNATURE----- --=-=-=-- --===============6411180915407416661== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline --===============6411180915407416661==--