From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id dqVPNR4NsF7lOAAA0tVLHw (envelope-from ) for ; Mon, 04 May 2020 12:39:58 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id qKK6NigNsF6JUgAAB5/wlQ (envelope-from ) for ; Mon, 04 May 2020 12:40:08 +0000 Received: from arlo.cworth.org (arlo.cworth.org [50.126.95.6]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id B850A942190 for ; Mon, 4 May 2020 12:40:07 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 2DCBD6DE0F8C; Mon, 4 May 2020 05:40:03 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xfMbPkkrGOwv; Mon, 4 May 2020 05:40:02 -0700 (PDT) Received: from arlo.cworth.org (localhost [IPv6:::1]) by arlo.cworth.org (Postfix) with ESMTP id 4DBC26DE0F07; Mon, 4 May 2020 05:40:01 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id F120B6DE0F07 for ; Mon, 4 May 2020 05:39:59 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id c9a1AEhhBczp for ; Mon, 4 May 2020 05:39:58 -0700 (PDT) Received: from mail-wr1-f43.google.com (mail-wr1-f43.google.com [209.85.221.43]) by arlo.cworth.org (Postfix) with ESMTPS id 8CA8F6DE092B for ; Mon, 4 May 2020 05:39:58 -0700 (PDT) Received: by mail-wr1-f43.google.com with SMTP id x18so20750176wrq.2 for ; Mon, 04 May 2020 05:39:58 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:subject:to:references:in-reply-to:mime-version:date:message-id; bh=BNvCkzGTz05NuGR6OWXec8ar81/LU8AhrWU9s041TWk=; b=LRtUpzZUTrNIEGaNqtlhB7wd4Iog3RNK2xi+blTyGQsqKuqq7r8+gWmnd/O9zTlJKp e8Wsbb8Ji0o53s29tyAKwjdg37JTurA2ZuH3jJLjJ2algeFLJPQ081r+SCN2XdsG6pe3 MqFU1TeclwM+VAM5s3zjqa/uHIVsuA8rxTImi6dAGSrJiJh5XZH+3Z9uxGBBIZRBqWxi qbgP67RmHyvOXdHSHKx/Xs3Ifj1P2nPjQFqGyyqtURLzpDQGqxL+9iRFx0ZHkM8je5yP lNE4SxwcUmYgvfOXcTj9xenugXp+qsSiQcvAtOwvOYs9CMsde3p1sY346YBR3TgR0Uoa yl5w== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:subject:to:references:in-reply-to :mime-version:date:message-id; bh=BNvCkzGTz05NuGR6OWXec8ar81/LU8AhrWU9s041TWk=; b=V/A+LVP0Vz90RgRZ45wG7EWEb2gZJzF8udLbnhHU1BlKIcU1IC3Km/e4o5t9r7KuxK 0gkGy1BGMFFP60VCczcrlYE7XfbYLjVaqPfuAh7pLpK32N7L5WmUjZBjeGFwFIi8S/9y ajpDu2rXzLaUf09cdHSOagDD1aeAVJ0dj1ygZGASoTUjb44diIsts7S6D6bqsVT4xQl2 gPxKwYRtZJ560qMmRnp5x/Z4XE0nEgL9R5ZrvBBaDEjyEldvhIKu0GaaUlQEl5RvCpO3 MxHI86nJO1n79AACbg0X8HYd6ubVb/d1EpkMiRVFRfLzBcFwWu6D4lu+tYRtps/humqN WCkQ== X-Gm-Message-State: AGi0PuZg5ZXiTEakh1jIRQu9arBD+606JO1uUjKRflL4nkAFwiLvgXKt j0gnJTrFbIXSN4q6u5Qw5rvCGNrB X-Google-Smtp-Source: APiQypL1B5/lwKlCO7dNaTj4uLH2xJPRIX0WztbkRqw1N9F/iq9kV3K0ysFlPuOpOqVOQz+jOZb1Hg== X-Received: by 2002:adf:aa88:: with SMTP id h8mr17102192wrc.197.1588595995288; Mon, 04 May 2020 05:39:55 -0700 (PDT) Received: from localhost ([79.116.154.70]) by smtp.gmail.com with ESMTPSA id n7sm48999wrm.86.2020.05.04.05.39.54 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 04 May 2020 05:39:54 -0700 (PDT) From: Franz Fellner Subject: Re: notmuch reindex wipes existing tags To: David Bremner , notmuch@notmuchmail.org References: <1588577150-ner-4.226@TPL520> <87wo5sf0vl.fsf@tethera.net> In-Reply-To: <87wo5sf0vl.fsf@tethera.net> MIME-Version: 1.0 Date: Mon, 04 May 2020 15:39:53 +0300 Message-Id: <1588595993-ner-8.651@TPL520> X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: notmuch-bounces@notmuchmail.org Sender: "notmuch" X-Scanner: scn0 X-Spam-Score: 0.59 Authentication-Results: aspmx1.migadu.com; dkim=fail (body hash did not verify) header.d=gmail.com header.s=20161025 header.b=LRtUpzZU; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 50.126.95.6 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Scan-Result: default: False [0.59 / 13.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; GENERIC_REPUTATION(0.00)[-0.4656628010123]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:c]; R_DKIM_REJECT(1.00)[gmail.com:s=20161025]; DWL_DNSWL_FAIL(0.00)[50.126.95.6:server fail]; FREEMAIL_FROM(0.00)[gmail.com]; IP_REPUTATION_HAM(0.00)[asn: 27017(-0.18), country: US(-0.00), ip: 50.126.95.6(-0.47)]; MX_GOOD(-0.50)[cached: notmuchmail.org]; DKIM_TRACE(0.00)[gmail.com:-]; RCPT_COUNT_TWO(0.00)[2]; MAILLIST(-0.20)[mailman]; RCVD_IN_DNSWL_FAIL(0.00)[50.126.95.6:server fail]; MIME_TRACE(0.00)[0:+]; RCVD_TLS_LAST(0.00)[]; ASN(0.00)[asn:27017, ipnet:50.126.64.0/18, country:US]; TAGGED_FROM(0.00)[]; FROM_NEQ_ENVFROM(0.00)[alpineartde@gmail.com,notmuch-bounces@notmuchmail.org]; RECEIVED_SPAMHAUS_PBL(0.00)[79.116.154.70:received]; ARC_NA(0.00)[]; URIBL_BLOCKED(0.00)[notmuchmail.org:email,t700-reindex.sh:url,tethera.net:email]; FROM_HAS_DN(0.00)[]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[notmuch@notmuchmail.org]; HAS_LIST_UNSUB(-0.01)[]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_COUNT_SEVEN(0.00)[9]; FORGED_SENDER_MAILLIST(0.00)[]; DMARC_POLICY_SOFTFAIL(0.10)[gmail.com : SPF not aligned (relaxed),none] X-TUID: GSlZxfFhOjYR On Mon May 4 07:30:38 2020, David Bremner wrote: > Franz Fellner writes: > > > Ran notmuch reindex. > > And now all custom tags were wiped, especially attachments-extracted. > > I now can't see if the pdf of a certain message was already saved. > > This is 3 years of 5 newspapers a weak. I must delete the files > > and re-extract them. > > > > I did not expect that, especially after reading the man page > > which doesn't warn about resetting tags. > > > > So here my question: > > Is this a bug or a feature? > > It sounds like a bug. But it's a bug that the test suite specifically > tests for ("reindex preserves tags" in T700-reindex.sh) so I'm not sure > what is going on. To eliminate the obvious, does the test suite pass for > you? > > d > > -- T700 passes. Wanted to know if I was wrong: [15:19] $ notmuch search tag:adz date:1M thread:00000000000099a2 Wed. 15:15 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-30 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:000000000000995b Tue. 15:15 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-29 als PDF (adz attachment attachments-extracted inbox news newspaper unread) thread:000000000000993c April 27 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-28 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:00000000000098e2 April 24 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-25 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:00000000000098bd April 23 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-24 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:0000000000009882 April 22 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-23 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:0000000000009858 April 21 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-22 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:00000000000097ac April 15 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-16 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:0000000000009790 April 14 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-15 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:0000000000009762 April 13 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-14 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:0000000000009730 April 10 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-11 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:0000000000009710 April 09 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-10 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:00000000000096e9 April 08 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-09 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:00000000000096db April 07 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-08 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:00000000000096b9 April 06 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-07 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:000000000000966e April 03 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-04 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:0000000000009652 April 02 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-03 als PDF (adz attachment attachments-extracted inbox news newspaper) thread:0000000000009636 April 01 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-02 als PDF (adz attachment attachments-extracted inbox news newspaper) [15:19] $ notmuch reindex tag:adz date:1M [15:19] $ notmuch search tag:adz date:1M thread:00000000000099a2 Wed. 15:15 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-30 als PDF (adz attachment inbox news newspaper) thread:000000000000995b Tue. 15:15 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-29 als PDF (adz attachment inbox news newspaper unread) thread:000000000000993c April 27 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-28 als PDF (adz attachment inbox news newspaper) thread:00000000000098e2 April 24 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-25 als PDF (adz attachment inbox news newspaper) thread:00000000000098bd April 23 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-24 als PDF (adz attachment inbox news newspaper) thread:0000000000009882 April 22 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-23 als PDF (adz attachment inbox news newspaper) thread:0000000000009858 April 21 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-22 als PDF (adz attachment inbox news newspaper) thread:00000000000097ac April 15 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-16 als PDF (adz attachment inbox news newspaper) thread:0000000000009790 April 14 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-15 als PDF (adz attachment inbox news newspaper) thread:0000000000009762 April 13 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-14 als PDF (adz attachment inbox news newspaper) thread:0000000000009730 April 10 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-11 als PDF (adz attachment inbox news newspaper) thread:0000000000009710 April 09 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-10 als PDF (adz attachment inbox news newspaper) thread:00000000000096e9 April 08 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-09 als PDF (adz attachment inbox news newspaper) thread:00000000000096db April 07 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-08 als PDF (adz attachment inbox news newspaper) thread:00000000000096b9 April 06 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-07 als PDF (adz attachment inbox news newspaper) thread:000000000000966e April 03 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-04 als PDF (adz attachment inbox news newspaper) thread:0000000000009652 April 02 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-03 als PDF (adz attachment inbox news newspaper) thread:0000000000009636 April 01 [1/1] ADZ PDF Versand; Ihre ADZ vom 2020-04-02 als PDF (adz attachment inbox news newspaper) So either I hit a case T700 doesn't cover. Played a little bit: =================== diff --git a/test/T700-reindex.sh b/test/T700-reindex.sh index 9e795896..4e76ad3e 100755 --- a/test/T700-reindex.sh +++ b/test/T700-reindex.sh @@ -5,6 +5,7 @@ test_description='reindexing messages' add_email_corpus notmuch tag +usertag1 '*' +notmuch tag +attachments-extracted '*' notmuch search '*' | notmuch_search_sanitize > initial-threads notmuch search --output=messages '*' > initial-message-ids =================== And it fails. The tag "attachments-extracted" got removed. Got curious, it seems as soon as the additional tag starts with "attachment" "notmuch reindex" removes it. With "extracted-attachments" everything is fine. Thought it might clash with preserved tags. But "unreadable" and "inboxable" works just fine. So it has to do with special handling of "attachment". Regards Franz