From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id qO1lDjdFSGQIfQEASxT56A (envelope-from ) for ; Tue, 25 Apr 2023 23:25:11 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id OAV5DTdFSGSucgAAG6o9tA (envelope-from ) for ; Tue, 25 Apr 2023 23:25:11 +0200 Received: from mail.notmuchmail.org (yantan.tethera.net [135.181.149.255]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 9042712130 for ; Tue, 25 Apr 2023 23:25:08 +0200 (CEST) Received: from yantan.tethera.net (localhost [127.0.0.1]) by mail.notmuchmail.org (Postfix) with ESMTP id 1B1DD5F5F0; Tue, 25 Apr 2023 21:25:06 +0000 (UTC) Received: from mail-wr1-x429.google.com (mail-wr1-x429.google.com [IPv6:2a00:1450:4864:20::429]) by mail.notmuchmail.org (Postfix) with ESMTPS id A01B05E021 for ; Tue, 25 Apr 2023 21:25:03 +0000 (UTC) Received: by mail-wr1-x429.google.com with SMTP id ffacd0b85a97d-2f4214b430aso3885104f8f.0 for ; Tue, 25 Apr 2023 14:25:03 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20221208; t=1682457903; x=1685049903; h=mime-version:message-id:date:references:in-reply-to:subject:to:from :from:to:cc:subject:date:message-id:reply-to; bh=TwS9bEy5Hs79gs4523RhKmIVUAqFGj8KFCBV4kPAIlI=; b=J//MqRXVLGrMce7EcRBqCL4zbunPgdDa2kRzheVSLmk22CsUc0W1YpFgUIHWAX9cbJ rFyLQ6RA6UA50XR7hOFTLIObS9SePrFUgU9NVS/TP+IUu5VnmMxrrGMCPVlQT2bNUKom g20x8T09wVQ/W7jNNalyvjlBTOOnDU4/YLrefxOeOpiKjf5soYZgIsM3LpshgOUA9KL6 8dWLEqiBIfD6pJ+PnluZHCK5iZI6r3rrT17ucKtaye3Cv4oWKIDTYBVoWRGZl2UfQQog o4sWMGWqFvtuHEzJHiWF90aIho3mgISPWib9ByM938rPOUokXkI4Mjk3OAz1CyKxorjp +QGQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20221208; t=1682457903; x=1685049903; h=mime-version:message-id:date:references:in-reply-to:subject:to:from :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=TwS9bEy5Hs79gs4523RhKmIVUAqFGj8KFCBV4kPAIlI=; b=NkCs24gOB7dQ8JkUpECBrT0tCzslcOd9m5XTZcbjz2goHhM4G0F2Uto7sQts5sTsjK uXSR3ZjyXOb+mwqt5T3KdlrsH0jqsehcCydZbqcLC28kMLPq4tNZta09XPp2CFf7i6iN s80BwITfImfu2PSCYWwukBKwNi4z+I0JNeS3Nc8cScu6XtRdMEWmZzGF9aNJ2aLjFqFx 98qeOF4idkd00rD+yY/EGTsWDv70943f0y3BQ+tl1xt+NoY5Ie8ZJVT3dnEz0Kpyq8eY tgr3JOCFjKt+L/r5frLVftUqTSUMdmkXGAK4okP/FhPTU4Q5K1ievRw5QMiCSnHgTS7s p0Jw== X-Gm-Message-State: AAQBX9c242ALgRwPmPyw91u+ptaHRvicb5mftKKGIG7ATfkQDEfh5203 UT8Yx/PRzRcsgVa6dmT0VOm6u6Wa1LJ8og== X-Google-Smtp-Source: AKy350YYWSPiFXcbjmaTFsZC8gB7r6soYAjPca4m8rVvSJ8xkPcrpid8vzREfonz2Ielmeq05/HdyQ== X-Received: by 2002:a5d:40cc:0:b0:2f0:58a:db82 with SMTP id b12-20020a5d40cc000000b002f0058adb82mr11303765wrq.36.1682457902693; Tue, 25 Apr 2023 14:25:02 -0700 (PDT) Received: from localhost (sgyl-45-b2-v4wan-165314-cust948.vm6.cable.virginm.net. [92.236.87.181]) by smtp.gmail.com with ESMTPSA id y4-20020adffa44000000b002f013fb708fsm14151266wrr.4.2023.04.25.14.25.02 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 25 Apr 2023 14:25:02 -0700 (PDT) From: Al Haji-Ali To: David Bremner , notmuch@notmuchmail.org Subject: Re: Correcting message references In-Reply-To: <87ildjn41q.fsf@tethera.net> References: <874jp85g26.fsf@minkowski.home> <87o7nf50ve.fsf@minkowski.home> <87r0s8141e.fsf@tethera.net> <87ildjn41q.fsf@tethera.net> Date: Tue, 25 Apr 2023 22:20:49 +0100 Message-ID: MIME-Version: 1.0 Message-ID-Hash: NBDRTBUXYOIBVL4DJX7WNJY2ZUGHANBZ X-Message-ID-Hash: NBDRTBUXYOIBVL4DJX7WNJY2ZUGHANBZ X-MailFrom: abdo.haji.ali@gmail.com X-Mailman-Rule-Hits: nonmember-moderation X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-notmuch.notmuchmail.org-0 X-Mailman-Version: 3.3.3 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Migadu-Country: DE X-Migadu-Flow: FLOW_IN ARC-Seal: i=1; s=key1; d=yhetil.org; t=1682457911; a=rsa-sha256; cv=none; b=j/yvSsFNYgQeD+VY3JQd2jeCXlvEAFvN9eTDS3VNVf0KzPhktWBFXuzQPHaiJRGTgji5dg NAn6blkRw5ClPiyEeEEHXF9ZJQPhirwTRe5sLFu8XqXUxTuX3VhPR1XmTd7dkzpJbfak7x x11RVT42kUhE9q7ZYI8/iYiiNRZ9YtED5g71wyJFhNsbHPaZJhDzAC6X5KOYHLKX2NAfem D141ha7pDf/maljsUuPSf2960z0/Tj4j34iEFfjZVYnSXWxLSWSwKBzoOPDF+jl9dPG9tg Ud42cCt2Vs/fBgtQDKiGy6kPfF6K3UzFdx1dwn7bLzaHSWbx/zqYv2NiAzTusQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=gmail.com header.s=20221208 header.b="J//MqRXV"; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 135.181.149.255 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1682457911; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-owner:list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=OpiH2jfB1FQ3YkhMU5YdZl69XtpkG3Y98jnuh//9gGc=; b=b0S9m4iSCQtKJhe8irfmdQEIXjCArUmCy1AubVAZPmsYKLr+NnhmjUoMcV3j9TS8hqECsQ H9XsbA+nE7nMybs/kxNYHbbOAYMKUqGyEa2x6PN34Nm2Dh8I5Z3nEdZMJc8nD2hcy/5n73 ESw1KmdkvB5q+f8iMxjDKoSfMfEFGVyfw735QBOgG1YPUGXTC02tVPwM/xwgNoiUVlx/yg SbMsEIYdR0mQJWxF4Qeg0asKYSNguAlBYeB8UmiaGH7KKJIhB5XLP9p60tB/BDhg94szoM EyaCMmZBju+vrQfhqBxVrtmK1Y/pMsn2MQFvAy3X7RakiKoQdlf8N0wNIt/+Eg== X-Migadu-Spam-Score: -1.31 X-Spam-Score: -1.31 X-Migadu-Queue-Id: 9042712130 X-Migadu-Scanner: scn0.migadu.com Authentication-Results: aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=gmail.com header.s=20221208 header.b="J//MqRXV"; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 135.181.149.255 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-TUID: 1fGCKtpdVW4v On 25/04/2023, David Bremner wrote: > I would be interested if it finds your problematic ghost message (and > how long it takes). Thanks! This is much quicker than a script that I wrote using quest and xapian-delve (which took minutes!) Your code took 0.03 seconds to find 74 unreferenced ghost messages out of 9335 ghost messages, I can't imagine why so many un-referenced ghost messages were created. 47 of the 74 messages have "draft" in the ID (seemingly created by notmuch). At first your code didn't find my problematic message (which caused a draft with the ID in `In-Reply-To` to be grouped with unrelated messages from a completely separate thread). But then I deleted the draft (including the file), ran `notmuch new` and re-ran the script and the problematic ghost message was correctly reported. So this approach would work to find un-referenced messages, but not messages which are being erroneously grouped (without first deleting the offending message), correct? -- Al