From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id 2IzcDg3NB2KgUgAAgWs5BA (envelope-from ) for ; Sat, 12 Feb 2022 16:06:53 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id WKlNCw3NB2IILgAAauVa8A (envelope-from ) for ; Sat, 12 Feb 2022 16:06:53 +0100 Received: from mail.notmuchmail.org (yantan.tethera.net [135.181.149.255]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 97A7B340EE for ; Sat, 12 Feb 2022 16:06:52 +0100 (CET) Received: from yantan.tethera.net (localhost [127.0.0.1]) by mail.notmuchmail.org (Postfix) with ESMTP id 718445F702; Sat, 12 Feb 2022 15:06:50 +0000 (UTC) Received: from lahtoruutu.iki.fi (lahtoruutu.iki.fi [185.185.170.37]) by mail.notmuchmail.org (Postfix) with ESMTPS id 0AD0E5F6C3 for ; Sat, 12 Feb 2022 15:06:48 +0000 (UTC) Received: from guru.guru-group.fi (unknown [IPv6:2a02:2380:1:9:5054:ff:feb7:a4bc]) (using TLSv1.2 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: too) by lahtoruutu.iki.fi (Postfix) with ESMTPSA id F2C3E1B00214; Sat, 12 Feb 2022 17:06:46 +0200 (EET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=iki.fi; s=lahtoruutu; t=1644678407; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=1N5iKU6AhyXoIheBlOxceypYMDVLfTnONMPr85rKeNM=; b=ilyXGjFsdh1LsqOxe7tkaYsQ80/FCN+OTJaT/yw0AHPlGfuItRblmZ+efpfO72J03YoaSJ gBlFd64Wcoyn0BKGT82vQri9eX7OxitzuE8AxQFDuytaotpGIofIzXBNh3j67fYSwDrqM3 Kyo9U1lqGcklwOfEFoc0J01J1+3GR/mZD7R7a+UJbW4D0Z3YtaOBlPz2/5GhjLAyq9fb1U xtrQkfo3u5xkoEyKj7d1CEcI7Ek8HHHHqtbenmi40w95X2EiBrqxSsBzUNyoTk4Ym8D1rz oz5GpNbVrGllZErHltrKfW3en8eRkCES4Mq0lAZScqggkV7whTgfr/zC5UbiIw== From: Tomi Ollila To: Michael J Gruber , David Bremner Subject: Re: Test suite timing issues? In-Reply-To: <164467277576.6467.13919733764427871872.git@grubix.eu> References: <164458773197.3086.16103597141743611268.git@grubix.eu> <87k0e1x87f.fsf@tethera.net> <164467277576.6467.13919733764427871872.git@grubix.eu> User-Agent: Notmuch/0.35+4~ge2bb4cd (https://notmuchmail.org) Emacs/27.1 X-Face: HhBM'cA~ MIME-Version: 1.0 ARC-Authentication-Results: i=1; ORIGINATING; auth=pass smtp.auth=too smtp.mailfrom=tomi.ollila@iki.fi ARC-Seal: i=1; s=lahtoruutu; d=iki.fi; t=1644678407; a=rsa-sha256; cv=none; b=AeaXK/akaTv8gVuDJyopl7jnkKg0O3NhTEixv6bqHXvmRXyxbAxc5hihYv3rcatmOtz9r3 y8uGwVCrR1eB/d1Rl5pLQqzewEm5IdqopewvGCgpNPZ06zTzIC/vLPECl3m9Pjanr66Wih rxkevswMA3dxxUecIZmIa5Qk8KdPYHOHG/WkezXeKVd1YkK7xMiTPXK7hXXKHloEIct1Zv gXKpl8LzMLkFKRHOagLFNcYMHG51BksC6/8qsQwAwq7V0uFdInH+k5NRP2us7jvlL/MW2O 5QdfeEEm17Fib6djjbcGK1tDjgtZ0aS9pUyjXfzVU6v5ZicHZiLifyeXM5ZgVw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=iki.fi; s=lahtoruutu; t=1644678407; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references; bh=1N5iKU6AhyXoIheBlOxceypYMDVLfTnONMPr85rKeNM=; b=HBBW4Pvz2i0l7gpaz6n13Qb78E0qNuDH+wMGTSSZIMfF/k74XvlzK5AgxePUiYv4zuBwMX uFUqOr2O6zgJXQFcj3hFybKSyyzrbP2vG1/QBXMNuh0gvnAIk/0G5FOyKFsUk+MOlLH6zG r/I0czDWk0uJdtxbvo+GNZfGlcDQNb8FZtqdCBspdbJEcUq+zv0y8VCKd85OgWATtdZgQE CG0JBCUfz70nNgtJjN+NZWBceyqSBvgoKGzmQQokelVla0IJCq/22/lFP3W1K8eT7XRDqQ 5UU9p+iU9vnVmFCDwcIk9MOsbGMkbSlxVxys+aIy6jIvNeSWHXu1c3Tj98A6LA== Message-ID-Hash: FYDBLYMICMD7FLJRIQK3ILPDZR32HUXM X-Message-ID-Hash: FYDBLYMICMD7FLJRIQK3ILPDZR32HUXM X-MailFrom: tomi.ollila@iki.fi X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-notmuch.notmuchmail.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header CC: notmuch@notmuchmail.org X-Mailman-Version: 3.3.3 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Migadu-Flow: FLOW_IN X-Migadu-Country: DE ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1644678412; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-owner:list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=FvgG+X1aeaefyJCIZCaVm+OL0mDu2Y5J12CkCqgbhV8=; b=MI/Pwmu99cIs+aSavbUuN8ZoPQpx/ycefhFbtQZcgnNepdQA64H1G+rIeuGdqlRa6VwEYJ bfPi2k4ni05B2DWoLzXSLB7DTlyNAJBjkW29/koV6LnQxOWoZdk4oIlRokKXvhXm78bKGp 33bNTC6NBSzGZec0pTyllv8SavXR3J7BxMMCOqVO81ZdYSksT7u7WGTmOZ34D1Y0SONLFk B6uAMMolP8ZPKFnnv4ejCQQGTMAFbj3OXthmvfHT8y6FgCFjw+B7c3OhtV4QsJYIsnSnfu MiNibaBmQzB2kRK/G4ckz9uTZpzAo2VC2jBp2pDdoXgduDCMdEouNPCMDyUYqA== ARC-Seal: i=2; s=key1; d=yhetil.org; t=1644678412; a=rsa-sha256; cv=fail; b=SX9xs7fAbUnnJYVmt+6hXS05bEsK63FlAVfvUo8pp0Ivu3x99IYokTIoq7hRt+HRBf9STc MVGBXmrEp4Am50vmmvRjSQ0FzVRzahBV7+HW7HwLSf5Bh7BD5UmbrPQ4l9JUUZWkvqJx0b BCxI38dOkgC4j4OnTp8BOiZimBTfkEEd3lEIvaUMGvKIHxaDNrgRnEeGrv/oPTRq6UAr1N WDr+AM6r26hOIIquPRfCqcIg/oEjMNY1XcOnuoNW7SB+SF4cB4ULj0T8pkRshgqOn9Mp6z RBCpydWIxh0olriBLXPGT6Awn5WNnk86nIAxWpA1lqLwOairVrg3UXYtBlw3NA== ARC-Authentication-Results: i=2; aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=iki.fi header.s=lahtoruutu header.b=ilyXGjFs; arc=reject ("signature check failed: fail, {[1] = sig:iki.fi:reject}"); dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 135.181.149.255 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Spam-Score: 0.56 Authentication-Results: aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=iki.fi header.s=lahtoruutu header.b=ilyXGjFs; arc=reject ("signature check failed: fail, {[1] = sig:iki.fi:reject}"); dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 135.181.149.255 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Queue-Id: 97A7B340EE X-Spam-Score: 0.56 X-Migadu-Scanner: scn1.migadu.com X-TUID: OgmD1fYsbEsh On Sat, Feb 12 2022, Michael J. Gruber wrote: > David Bremner venit, vidit, dixit 2022-02-12 01:03:00: >> Michael J Gruber writes: >> >> > Hi there, >> > >> > I'm trying to package notmuch for Redhat's enterprise linux and clones >> > (EPEL, extra packages for enterprise linux). >> > >> > This looks mostly fine, including the tests, except for intermittent >> > failures on epel-8-s390x. They look like the below, or in tests >> > following those, and apparantly all have to do with "db not synced yet" >> > or such, so that a message one subtest creates only shows up in the db >> > for the next subtest. >> > >> > I've also had completely fine test runs on epel-8-s390x, but I'm >> > starting to wonder whether I've just been lucky so far on other >> > platforms ... Could it be possible that generate_message(), even though >> > adding the message, still returns false and therefore add_message() does >> > not call "notmuch new"? One might want to drop the "&&" there in >> > test-lib-common, I dunno. This shouldn't be "intermittent". >> >> It's hard to see what can go wrong (maybe perl doesn't work?), but >> failing to generate a message should be a fatal error. Maybe try >> something like >> > > Well, as you can see in both reports, the pattern is as follows: > > The first subttest sees 1 less message than expected. > The second sees 1 more message than expected. Only thing that came into mind are directory timestamps... if directory (m)time is same as before notmuch will not scan it for files... ... following that if the granularity of directory timestamp were 1 second, then it could easily happen than first one new message is not seen, and next time there is one extra message to be see... Just wild guesses... Tomi > > So in summary, they are generated but "notmuch new" is not run or does > not pick them up. Though it's a Heisenbug on a specific arch, I'll try > your suggestion and hammer our infra with it ...