From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms8.migadu.com with LMTPS id EHsgIgvYYGU/zgAAauVa8A:P1 (envelope-from ) for ; Fri, 24 Nov 2023 18:06:19 +0100 Received: from aspmx1.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id EHsgIgvYYGU/zgAAauVa8A (envelope-from ) for ; Fri, 24 Nov 2023 18:06:19 +0100 Received: from mail.notmuchmail.org (yantan.tethera.net [135.181.149.255]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 2122A64828 for ; Fri, 24 Nov 2023 18:06:17 +0100 (CET) Authentication-Results: aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=gmail.com header.s=20230601 header.b=U54Yf1No; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 135.181.149.255 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org ARC-Seal: i=1; s=key1; d=yhetil.org; t=1700845579; a=rsa-sha256; cv=none; b=NvwqtkVnxmNUB9JuAm184+upt6W1EtSy5fuZU3040cDKHfRBfRKKli37JwZm+C3OvXvZoy PDHxdr6xvlKYb0RU/KVySz/d5aPvCEt/dM5Ibv21pT5a7OKyt/pBDJmjHNduEdwS3ijaLN 4AtblA14TwJpBZ0GGjm1Os1qa666Yop8zqFlSG2fDcFC+4aXSiQwIAmBYvOU43TPTCSSvK h2zvLmE5K8XJfH8wD8/2Z2MLS6D1b0CXRRHaedLxvaQIoT70L2l3wUOe6rZDyZUPsw8E8A EhliQvDK4bq9wXG+TXdvSqa0bmx6sScU0QqcnUMh6sYkNgG0ukF5o9Oh71YLNA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=gmail.com header.s=20230601 header.b=U54Yf1No; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 135.181.149.255 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1700845579; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: in-reply-to:in-reply-to:references:references:list-id:list-help: list-owner:list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=D2efCoz3yEebXT+6wN1KLtDD2sJMCfxIB5fOAm+QrH4=; b=X1NrKi1GYWhKyrNAfNoUX+spV7mewh4rGAMpt5D1/Ft2r8Kxxt435ruJUzDlo8++G0AF+z u7sjqNg4Avsia7vK8TbI0dSuJiw0ZzfKUU4/7VcZKvQKfSZfSuJeEWKyCBbs4Kqxs6uYTl 2bMBHFEE65m34NCORAyDlNXgTnPU192syYvxNmSCd8yDetJTOINIaylz5ols0+g+ftKRr0 Qe+3pCYaD663iCBgXq62mdiZFNIN8Qii0IIxQNIrzTP+XKtKi+dfzONaaXLIQ9+4oeNvQt E0ocCJl/yGbOIsb0dCZoVs3td7IqgdK/W7pAv1GcXkMoE5mxcjFh0qgmvAT4QQ== Received: from yantan.tethera.net (localhost [127.0.0.1]) by mail.notmuchmail.org (Postfix) with ESMTP id 413E25F6BC; Fri, 24 Nov 2023 17:06:09 +0000 (UTC) Received: from mail-ed1-x535.google.com (mail-ed1-x535.google.com [IPv6:2a00:1450:4864:20::535]) by mail.notmuchmail.org (Postfix) with ESMTPS id 0F6A95F3B3 for ; Fri, 24 Nov 2023 17:06:07 +0000 (UTC) Received: by mail-ed1-x535.google.com with SMTP id 4fb4d7f45d1cf-54af61f2a40so1103852a12.3 for ; Fri, 24 Nov 2023 09:06:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1700845566; x=1701450366; darn=notmuchmail.org; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :from:to:cc:subject:date:message-id:reply-to; bh=9wPFPml3asGtzBe5AC7f99hRNuY7ymIkllKA245vNXE=; b=U54Yf1Nob+rLC2hkhx90setAkH20R+Yvsfo89ddo1xOHQRxrlsxbfIBVHvRiwTkqiS UVxdmqUwWWYC2adsFKDlRC4f4+FrdOchjiwz8UuTG4tAM+Pz3V8Ct7N9hauQpSfUpgDK qcRNiLUkutD28I9FTq8GvO5be95MnunYLpy5/7VjTaf8RPy4KSigfJRws3Kdt0JmVyu8 tvKRy1niE38f54pa/pO4/gdXmrgMJlbLmBboccjdm/3EC4WeZPODX8dE+N9j6MZ6hSYm C2Mb3TPW0Y+ooTzjmQLeMbJ3x8fVNkRU3WyGnVQiC2lw0WkLpCDXbCScHgDHLBLcAGUt dM2A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1700845566; x=1701450366; h=to:subject:message-id:date:from:in-reply-to:references:mime-version :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=9wPFPml3asGtzBe5AC7f99hRNuY7ymIkllKA245vNXE=; b=T7BbuaKL9JcLiOSI/G4l+qM+U2ZH0rk/EZNzJUtYhqNDbLeKHhE+AODT0rUSvQNHAI Gw3iOgirKaEnTlqUTeYQSzoPvjbqHbFPcl7msgIscGzOFhuB44XESUiYdjsM5yw6MqJn +zyZA+yqXZUjj5gTbfgkhOf7CDGmhge+aFAb0Yqli1Ag1AHwyha2Rkq8C1jS5pM3ArM0 V0oJGY1RoiMhL+syHAyz+pC1tp0ZQPqO9lybbnZ3fmpn5XHoyOmfAs39h9sGSj9DSk4e lyWf7hJnfPhfvQOltIwiIiw65ZYDdGWV+OubXzpfKiKPdNO+u+F1v0lzjkkMC2/vkOOH kWlQ== X-Gm-Message-State: AOJu0Yzz5mBgMgzWTMpiyFz/o7laiiOWPhWvgD8E9tBOuI9swN6dwBMR kMCwD6H9n3JRp7b1+BMlA8amUjRXFVvg8GnRaiND2YV9yLG3OQ== X-Google-Smtp-Source: AGHT+IE3VSaxMBQrJdcYw8M7m9fdE8SfJHuWWxQBo85LuoZ1CiYQIZENW6o+jP1R7fOYfg8Qo9zPqTYS1ADkb3p4Spo= X-Received: by 2002:a17:907:3a93:b0:9fe:ac0e:9c01 with SMTP id fh19-20020a1709073a9300b009feac0e9c01mr2461907ejc.62.1700845565393; Fri, 24 Nov 2023 09:06:05 -0800 (PST) MIME-Version: 1.0 References: In-Reply-To: From: Michael J Gruber Date: Fri, 24 Nov 2023 18:05:54 +0100 Message-ID: Subject: Re: [PATCH 0/4] test: T380 rework To: notmuch@notmuchmail.org Message-ID-Hash: TN6MZOLL2VYZBIK7GANXQHXNIVTAI2DL X-Message-ID-Hash: TN6MZOLL2VYZBIK7GANXQHXNIVTAI2DL X-MailFrom: michaeljgruber@gmail.com X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-notmuch.notmuchmail.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header X-Mailman-Version: 3.3.3 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: multipart/mixed; boundary="===============4487295045903294892==" X-Migadu-Flow: FLOW_IN X-Migadu-Country: DE X-Migadu-Queue-Id: 2122A64828 X-Migadu-Scanner: mx12.migadu.com X-Migadu-Spam-Score: -2.26 X-Spam-Score: -2.26 X-TUID: 2qgTkGWSHcaV --===============4487295045903294892== Content-Type: multipart/alternative; boundary="000000000000be3f07060ae8f79e" --000000000000be3f07060ae8f79e Content-Type: text/plain; charset="UTF-8" So, with the key-value pairs sorted by both, I resumed testing for Python 3.1.13 and encountered failing T380 which gave me some a deja-vue due to its confusing messages: ``` T380-atomicity: Testing atomicity cat: outcount: No such file or directory /builddir/build/BUILD/notmuch-0.38.1/test/T380-atomicity.sh: line 79: ((: i < : syntax error: operand expected (error token is "< ") PASS "notmuch new" is idempotent under arbitrary aborts FAIL detected >10 abort points test -gt 10 /builddir/build/BUILD/notmuch-0.38.1/test/test-lib.sh: line 701: test: -gt: unary operator expected ``` And that is why this is a reply to the old thread where I suggested making this less confusing, because everything reported is not the actual failure, but the consequence of not safe-guarding against a failed test setup. The *real cause* is most likely that `import gdb` fails in `atomicity.py` because it's not ready for py 3.13 yet. But maybe it's time to reconsider some bits of the old series? We ended up discussing "echo vs printf" and never addressed the real issues here. Cheers, Michael P.S.: There are also a few lines like ``` Error: database path '/builddir/build/BUILD/notmuch-0.38.1/test/tmp.T400-hooks/database.85' does not exist or is not a directory. ``` sprinkled in the test output between PASS tests, apparently without making any test fail. I don't know whether I never noticed for a apassing test suite, or whether this is new. --000000000000be3f07060ae8f79e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
So, with the key-value pairs sorted by both, I resumed tes= ting for Python 3.1.13 and encountered failing T380 which gave me some a de= ja-vue due to its confusing messages:

```
T380= -atomicity: Testing atomicity
cat: outcount: No such file or directory/builddir/build/BUILD/notmuch-0.38.1/test/T380-atomicity.sh: line 79: ((:= i < : syntax error: operand expected (error token is "< ")=
=C2=A0PASS =C2=A0 "notmuch new" is idempotent under arbitrary= aborts
=C2=A0FAIL =C2=A0 detected >10 abort points
=C2=A0 =C2=A0 = =C2=A0 =C2=A0 test =C2=A0-gt 10
/builddir/build/BUILD/notmuch-0.38.1/tes= t/test-lib.sh: line 701: test: -gt: unary operator expected
`= ``

And that is why this is a reply to the old thre= ad where I suggested making this less confusing, because everything=C2=A0re= ported is not the actual failure, but the consequence of not safe-guarding = against=C2=A0a failed test setup.

The *real cause*= is most likely that `import gdb` fails in `atomicity.py` because it's = not ready for py 3.13 yet.

But maybe it's time= to reconsider some bits of the old series? We ended up discussing=C2=A0&qu= ot;echo vs printf" and never addressed=C2=A0the real issues here.

Cheers,
Michael

P.S= .: There are also a few lines like=C2=A0
```
Error: dat= abase path '/builddir/build/BUILD/notmuch-0.38.1/test/tmp.T400-hooks/da= tabase.85' does not exist or is not a directory.
```
sprinkled in the test output between PASS tests, apparently=C2=A0with= out making any test fail. I don't know whether=C2=A0I never noticed for= a apassing test suite, or whether this is new.
--000000000000be3f07060ae8f79e-- --===============4487295045903294892== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline --===============4487295045903294892==--