From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id wCh1KfDrA2HycgEAgWs5BA (envelope-from ) for ; Fri, 30 Jul 2021 14:09:20 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id UFcuJfDrA2HEewAA1q6Kng (envelope-from ) for ; Fri, 30 Jul 2021 12:09:20 +0000 Received: from mail.notmuchmail.org (nmbug.tethera.net [144.217.243.247]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 5CBA0C9E3 for ; Fri, 30 Jul 2021 14:09:20 +0200 (CEST) Received: from nmbug.tethera.net (localhost [127.0.0.1]) by mail.notmuchmail.org (Postfix) with ESMTP id 0D61B291E6; Fri, 30 Jul 2021 08:09:06 -0400 (EDT) X-Greylist: delayed 1200 seconds by postgrey-1.36 at nmbug; Thu, 14 Jan 2021 13:11:13 EST Received: from wout1-smtp.messagingengine.com (wout1-smtp.messagingengine.com [64.147.123.24]) by mail.notmuchmail.org (Postfix) with ESMTPS id 3C1EB2A137 for ; Thu, 14 Jan 2021 13:11:13 -0500 (EST) Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.west.internal (Postfix) with ESMTP id B6B0A1796; Thu, 14 Jan 2021 10:59:23 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Thu, 14 Jan 2021 10:59:23 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=alyssa.is; h= from:to:cc:subject:date:message-id:mime-version:content-type; s= fm2; bh=oO2A5Lmo2cO8BN+pidz7saYqoyKq+lisG7MwWyv4Iw4=; b=MTGPbgCn OyPazqRY2A9EtGskCGMtn20gvGDKa7KqNEcjp+BKJA2KcNjNpPkbmA5Z87fNRbK7 zeOqpFK58W+rzLno8hxH6TxJnFRYGGWvsQ6ISWptw80muulMj+QZ+VMZ34zaiWmJ fSDAfRp2m7dR3M3CsEX1qG2TqN/I1p7lvn1xKr1LWZ8pyECpdRLjQEI/EctGJzO5 yBjXLXU3r/2cCZRtbtP5jKkytw+Jq6D6WqWzbM/Xwrk/SIQXNdSyKDHYpBFhNMRq MHo5CMJzg1lmDoUITNpGFfyXfKblpEy6Ii5UQFrxGhKA3V75V9aVWYu35aIXFkZl pcml8XC8G+uurg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-type:date:from:message-id :mime-version:subject:to:x-me-proxy:x-me-proxy:x-me-sender :x-me-sender:x-sasl-enc; s=fm1; bh=oO2A5Lmo2cO8BN+pidz7saYqoyKq+ lisG7MwWyv4Iw4=; b=NYRPsHUNnsDBhNRwwuZyw+IfkcHb3wts/xIqxIpRctew5 JPmmW/MbO58lhORYpDOjl6nwCClWurp8c4ouXynyyMJLBa39t9C/N4n5szNNDAx5 j1QUTNRwJi6LZCQwN3O1d0l9ncs7F1VFAcDyM7Z9URoej+EvXXtNgGZ3cmusnpF9 +QCccLecHDmRIxV/xjvVXkN7uo38LeABfvZT1nRSTwPGPUVStfDsSvNm0dncIWVn vTiAc0qRyrOsv4FL5pgkjNA77523iif9a/MClSwKNqM7Gm54jjshJTZGs+H3kRTx I/FG+0+XLqCSpvRyHgdKH1iIA7VzfUblhUjrhlSEA== X-ME-Sender: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduledrtddtgdehkecutefuodetggdotefrodftvf curfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfghnecu uegrihhlohhuthemuceftddtnecusecvtfgvtghiphhivghnthhsucdlqddutddtmdenuc fjughrpefhvffufffkgggtsehttdertddttddtnecuhfhrohhmpeetlhihshhsrgcutfho shhsuceohhhisegrlhihshhsrgdrihhsqeenucggtffrrghtthgvrhhnpeegvddthffhke eihfdttedtkeejheegvefhjeeftdfftdeuledtgeekiedttdeuvdenucffohhmrghinhep ghhithhhuhgsrdgtohhmpdhnohhtmhhutghhmhgrihhlrdhorhhgnecukfhppeejledrvd efhedruddvuddrvdegheenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgr ihhlfhhrohhmpehhihesrghlhihsshgrrdhish X-ME-Proxy: Received: from eve.qyliss.net (p4feb79f5.dip0.t-ipconnect.de [79.235.121.245]) by mail.messagingengine.com (Postfix) with ESMTPA id 4DFBB108005F; Thu, 14 Jan 2021 10:59:22 -0500 (EST) Received: by eve.qyliss.net (Postfix, from userid 1000) id 3F61F1496; Thu, 14 Jan 2021 15:59:20 +0000 (UTC) From: Alyssa Ross To: notmuch@notmuchmail.org Subject: T568-lib-thread is non-deterministic Date: Thu, 14 Jan 2021 15:59:20 +0000 Message-ID: <871reno6g7.fsf@alyssa.is> MIME-Version: 1.0 X-MailFrom: hi@alyssa.is X-Mailman-Rule-Hits: nonmember-moderation X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-notmuch.notmuchmail.org-0 Message-ID-Hash: O7U6RT3MQQUAMWFK4INHHF4ZGVJH5RN7 X-Message-ID-Hash: O7U6RT3MQQUAMWFK4INHHF4ZGVJH5RN7 X-Mailman-Approved-At: Fri, 30 Jul 2021 12:08:59 -0400 CC: Puck Meerburg X-Mailman-Version: 3.2.1 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Help: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1627646960; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=dC2B93AFLtPaPGPYibiFFYsksp4AuSdLa2RleTbV5eg=; b=lDPcHiMTWI0m5EXxmG/zaps93utpehW46CIfxje8BRQmsnm5a2czTNItVDmdWshvzASG4L ZS0uGHvhS7M7rYic/tnA/0MTeZKQ7z3ND9Jo3hq4H7TPH1jdFN43JbPQN89kHDQ1/O8b76 YYdwwi7wTxB4Co3eVcHc38sSzm/8donTJmdqF9xkbAATv78ucZPyAiKcVbYzFYybMTcV13 Hz6hHKgvgJmjM1aitQsqGbJRhLDDcbaQE4fCiKabiBjfa3nNrogKU9sVkZYbX3xueIDpYF gIxkQn+hhbMJBrqTFlpnrUvlDnq2xYOMGmketEHKqq2pP3lqAk8wGE/b+aW2rw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1627646960; a=rsa-sha256; cv=none; b=seU1QC/tqLYVlHkwlWs4njOyNh17l6mPJVR1YkNotgLJIvVGxgeY1plomYi1QMbkjhkv8h esonWLpCHf4Z4PbtszQSE9q8kzUntnYODp5ZZT66rGfD7m9KAROqW8mCFbom1k3dDZ0JLQ wq3pEcqBlrqGS4fgGJN2Ql+5uO1KSOKDTnbBmDKMsS8OQPoM86xvlILyDNzQQEvdRH39m/ SVL0Ywn3OetfFcy06xIa1cA8K9jhKw7nbKCw4UqjN1I+v4ZqMFUV8x6MEsDNwbVB05uQEf ml3VteC/qOkQ41seJzuZpe55qgv7oRY85Mci9KJuwvGXB2vn1q0k1H4AnwJEKA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=alyssa.is header.s=fm2 header.b=MTGPbgCn; dkim=none ("invalid DKIM record") header.d=messagingengine.com header.s=fm1 header.b=NYRPsHUN; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 144.217.243.247 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Spam-Score: 1.49 Authentication-Results: aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=alyssa.is header.s=fm2 header.b=MTGPbgCn; dkim=none ("invalid DKIM record") header.d=messagingengine.com header.s=fm1 header.b=NYRPsHUN; dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 144.217.243.247 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Queue-Id: 5CBA0C9E3 X-Spam-Score: 1.49 X-Migadu-Scanner: scn0.migadu.com X-TUID: hCn+HJK11ZQw T568-lib-thread assums that there will always be a thread with ID thread:0000000000000009, but this turns out not to be the case. This was reported to us in Nixpkgs[1], where it caused builds of our notmuch package to intermittently fail, and I was able to (intermittently) reproduce. We are going to work around this problem for now by disabling T568. I can provide a Xapian DB generated by this test with no thread with that ID if that's helpful. I believe this also explains this report previously sent to the Notmuch mailing list[2]. Note on reproducing: I found that it often would succeed repeatedly many, many times before failing, and then failing consistently for a while. My co-conspirator Puck (CCed) thinks this might be due to how directory order works in ZFS (which just happens to be the filesystem we are using). [1]: https://github.com/NixOS/nixpkgs/issues/109092 [2]: https://nmbug.notmuchmail.org/nmweb/show/874ko8trhk.fsf%40tethera.net