From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id uDroGuVqBmKiIAAAgWs5BA (envelope-from ) for ; Fri, 11 Feb 2022 14:55:49 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id qMCNE+VqBmIZtQAAG6o9tA (envelope-from ) for ; Fri, 11 Feb 2022 14:55:49 +0100 Received: from mail.notmuchmail.org (yantan.tethera.net [IPv6:2a01:4f9:c011:7a79::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 1747F29523 for ; Fri, 11 Feb 2022 14:55:49 +0100 (CET) Received: from yantan.tethera.net (localhost [127.0.0.1]) by mail.notmuchmail.org (Postfix) with ESMTP id 184695F71E; Fri, 11 Feb 2022 13:55:47 +0000 (UTC) X-Greylist: delayed 92575 seconds by postgrey-1.36 at yantan; Fri, 11 Feb 2022 13:55:44 UTC Received: from mailproxy07.manitu.net (mailproxy07.manitu.net [IPv6:2a00:1828:1000:1112::2]) by mail.notmuchmail.org (Postfix) with ESMTPS id BAA0D5F700 for ; Fri, 11 Feb 2022 13:55:44 +0000 (UTC) Received: from localhost (200116b860714e008ddcdcc7fff9f68c.dip.versatel-1u1.de [IPv6:2001:16b8:6071:4e00:8ddc:dcc7:fff9:f68c]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange ECDHE (P-256) server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) (Authenticated sender: michael@grubix.eu) by mailproxy07.manitu.net (Postfix) with ESMTPSA id D28CCC88C2 for ; Fri, 11 Feb 2022 14:55:45 +0100 (CET) MIME-Version: 1.0 From: Michael J Gruber To: Notmuch mailing list Subject: Test suite timing issues? Message-ID: <164458773197.3086.16103597141743611268.git@grubix.eu> Date: Fri, 11 Feb 2022 14:55:32 +0100 User-Agent: alot/0.10 Message-ID-Hash: 65EWVHRLHN5LE25ARBLEWBUIJYH5GUCE X-Message-ID-Hash: 65EWVHRLHN5LE25ARBLEWBUIJYH5GUCE X-MailFrom: michael@grubix.eu X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-notmuch.notmuchmail.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header X-Mailman-Version: 3.3.3 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Migadu-Flow: FLOW_IN X-Migadu-Country: DE ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1644587749; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding:list-id:list-help: list-owner:list-unsubscribe:list-subscribe:list-post; bh=dBoEPA1QPGhoBBemGjtuvkSHJDCqeBHST8x2u1qx4qM=; b=sn9apyH1ocX29W7vKb3j1FQxnohfTvFdGtJITFgwBZYQ6/9VHgdSiVRTcKzOVQTaa3JYBV Wt1OqQFsgNnwHL3ynYJnznLDbDkfIHLr9PKiq0us6hMFAdVfVdGveSPK2i71mVv3xRt1SP Eh+1/q77046xk8XkqL5U+hAzx60ya4dXVFI52XWBO2BkbxUAMLMiIbGKE0BR2G9+M0RHgT lZYLNkRimNOiKdTK+jrxCJKipjav5Q6XbN5LlQj1ndPBgHBlE+chRNm4X7QdP7BLi9lnNr Y6EvfyrbbOcoj2IfIjwu5s1AGSOMSY5tPwPoCANqMpCfjmoE7nEHoR2SkbYquw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1644587749; a=rsa-sha256; cv=none; b=Dzgx/TjAkhwbx5d6tDKI1y1Pq1CWKAHpaNJN/w/RFcvZWpf4fkyYJooyzDj00crfjSlxlb f7ch3rQ2df/+gaLdODrzLQMV9rgJVmGts5w278hu9VBTCbYummBjDJuiQiLteF5BUIIRdc Yzht4Q8b7/t7dQYHywXP5fsujfGXBei3tb2J3Yd9JRqFKhCdBLa33u9xKk5ZOlqUZjbteJ mRl6qWn7+i5/ZUw9d4w14BXQZEayswJOkf/9cyAlcfxzhzM2VzVFiFsGfQ8baJySDBfkPY SSkSnJpHKFuLvd4ENH4ro/9RhkssiyqsXd8eoq9NLm4mdCtizBcMUF123y9Mlw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 2a01:4f9:c011:7a79::1 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Spam-Score: -1.33 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 2a01:4f9:c011:7a79::1 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Queue-Id: 1747F29523 X-Spam-Score: -1.33 X-Migadu-Scanner: scn0.migadu.com X-TUID: SPr4spTlT44u Hi there, I'm trying to package notmuch for Redhat's enterprise linux and clones (EPEL, extra packages for enterprise linux). This looks mostly fine, including the tests, except for intermittent failures on epel-8-s390x. They look like the below, or in tests following those, and apparantly all have to do with "db not synced yet" or such, so that a message one subtest creates only shows up in the db for the next subtest. I've also had completely fine test runs on epel-8-s390x, but I'm starting to wonder whether I've just been lucky so far on other platforms ... Could it be possible that generate_message(), even though adding the message, still returns false and therefore add_message() does not call "notmuch new"? One might want to drop the "&&" there in test-lib-common, I dunno. This shouldn't be "intermittent". Michael T210-raw: Testing notmuch show --format=raw FAIL Attempt to show multiple raw messages --- T210-raw.1.expected 2022-02-11 13:22:28.011556841 +0000 +++ T210-raw.1.output 2022-02-11 13:22:28.011556841 +0000 @@ -1 +1,7 @@ -Error: search term did not match precisely one message (matched 2 messages). +From: Notmuch Test Suite +To: Notmuch Test Suite +Message-Id: +Subject: Test message #1 +Date: Fri, 05 Jan 2001 15:43:56 +0000 + +This is just a test message (#1) PASS Show a raw message FAIL Show another raw message --- T210-raw.3.expected 2022-02-11 13:22:28.031556841 +0000 +++ T210-raw.3.output 2022-02-11 13:22:28.031556841 +0000 @@ -1,7 +1 @@ -From: Notmuch Test Suite -To: Notmuch Test Suite -Message-Id: -Subject: Test message #2 -Date: GENERATED_DATE -This is just a test message (#2) Error: search term did not match precisely one message (matched 0 messages).