From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id UPY6KcN/4WHNagEAgWs5BA (envelope-from ) for ; Fri, 14 Jan 2022 14:50:59 +0100 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id yDbCJcN/4WEMcgEAauVa8A (envelope-from ) for ; Fri, 14 Jan 2022 14:50:59 +0100 Received: from mail.notmuchmail.org (yantan.tethera.net [IPv6:2a01:4f9:c011:7a79::1]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 57DD43C155 for ; Fri, 14 Jan 2022 14:50:59 +0100 (CET) Received: from yantan.tethera.net (localhost [127.0.0.1]) by mail.notmuchmail.org (Postfix) with ESMTP id DF41B5F6EF; Fri, 14 Jan 2022 13:50:54 +0000 (UTC) X-Greylist: delayed 5470 seconds by postgrey-1.36 at yantan; Fri, 14 Jan 2022 12:57:32 UTC Received: from mx0a-001b2d01.pphosted.com (mx0b-001b2d01.pphosted.com [148.163.158.5]) by mail.notmuchmail.org (Postfix) with ESMTPS id 963175F6EC for ; Fri, 14 Jan 2022 12:57:32 +0000 (UTC) Received: from pps.filterd (m0098414.ppops.net [127.0.0.1]) by mx0b-001b2d01.pphosted.com (8.16.1.2/8.16.1.2) with SMTP id 20EAMJxT021189; Fri, 14 Jan 2022 11:26:20 GMT DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ibm.com; h=date : from : subject : to : references : in-reply-to : message-id : content-type : content-transfer-encoding : mime-version; s=pp1; bh=4/OmJrEmZ8fovGRf8r+P72rDNsiqltuBsc7C15oViLw=; b=j3sd7Sn4vwP/LuIAGZZ+hIjKGclFlkVTqE0qdPfjJKcfyywRF3wI8RBMuMK5hq+hJyyP yaXHx273iUDsZuX2l8URfTBTaB5ZssWjJzjdI+eYbE8YXHWsl1hifdna4dJR9C3bfdmb UMuDWWaUKuy8tcBGuIk0am3HPP6BmU433+Qrnjl2ATbmDKVHCihWRt4//bU21fMNtkGa qHkZCWuot6X74cp42PkYI4giFfrV3x34Kd2uGZJBonCfyWkJNwXMJslbJCm6aMtragKo U8nwI6jyQ62ctpNNkSJa/ccUQKDdlphbjnGrhZQOOgFe/gD5G8My9d3UWce8kDsaMBM0 0A== Received: from ppma06ams.nl.ibm.com (66.31.33a9.ip4.static.sl-reverse.com [169.51.49.102]) by mx0b-001b2d01.pphosted.com with ESMTP id 3dk7c5s230-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 14 Jan 2022 11:26:20 +0000 Received: from pps.filterd (ppma06ams.nl.ibm.com [127.0.0.1]) by ppma06ams.nl.ibm.com (8.16.1.2/8.16.1.2) with SMTP id 20EBCrgK015810; Fri, 14 Jan 2022 11:26:18 GMT Received: from b06cxnps4074.portsmouth.uk.ibm.com (d06relay11.portsmouth.uk.ibm.com [9.149.109.196]) by ppma06ams.nl.ibm.com with ESMTP id 3df1vjwqc5-1 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 14 Jan 2022 11:26:18 +0000 Received: from d06av26.portsmouth.uk.ibm.com (d06av26.portsmouth.uk.ibm.com [9.149.105.62]) by b06cxnps4074.portsmouth.uk.ibm.com (8.14.9/8.14.9/NCO v10.0) with ESMTP id 20EBQGA944040530 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Fri, 14 Jan 2022 11:26:16 GMT Received: from d06av26.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id 2AD36AE056; Fri, 14 Jan 2022 11:26:16 +0000 (GMT) Received: from d06av26.portsmouth.uk.ibm.com (unknown [127.0.0.1]) by IMSVA (Postfix) with ESMTP id B5E09AE057; Fri, 14 Jan 2022 11:26:15 +0000 (GMT) Received: from localhost (unknown [9.43.21.93]) by d06av26.portsmouth.uk.ibm.com (Postfix) with ESMTP; Fri, 14 Jan 2022 11:26:15 +0000 (GMT) Date: Fri, 14 Jan 2022 16:56:14 +0530 From: "Naveen N. Rao" Subject: Re: 'notmuch search thread:<>' lists multiple threads To: David Bremner , notmuch@notmuchmail.org References: <1523007700.l8xm6nm6af.naveen@linux.ibm.com> <87sh86v1oc.fsf@tethera.net> <878t9wvbmu.fsf@tethera.net> <1524045467.a0aq8zermb.naveen@linux.ibm.com> <87bl17i4lv.fsf@tethera.net> In-Reply-To: <87bl17i4lv.fsf@tethera.net> User-Agent: astroid/v0.16-1-g4d6b06ad (https://github.com/astroidmail/astroid) Message-Id: <1642159442.om6czpqdt6.naveen@linux.ibm.com> X-TM-AS-GCONF: 00 X-Proofpoint-GUID: kgSEeDjd0OGBqItgKTZhCnwKS66ZszOd X-Proofpoint-ORIG-GUID: kgSEeDjd0OGBqItgKTZhCnwKS66ZszOd X-Proofpoint-UnRewURL: 0 URL was un-rewritten MIME-Version: 1.0 X-Proofpoint-Virus-Version: vendor=baseguard engine=ICAP:2.0.205,Aquarius:18.0.816,Hydra:6.0.425,FMLib:17.11.62.513 definitions=2022-01-14_04,2022-01-14_01,2021-12-02_01 X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 priorityscore=1501 spamscore=0 clxscore=1011 mlxlogscore=830 mlxscore=0 malwarescore=0 phishscore=0 impostorscore=0 adultscore=0 bulkscore=0 suspectscore=0 lowpriorityscore=0 classifier=spam adjust=0 reason=mlx scancount=1 engine=8.12.0-2110150000 definitions=main-2201140074 X-MailFrom: naveen.n.rao@linux.vnet.ibm.com X-Mailman-Rule-Hits: nonmember-moderation X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-notmuch.notmuchmail.org-0 Message-ID-Hash: SZT5C3IJGQVDDH2X2EAPEGA3AKREPPT5 X-Message-ID-Hash: SZT5C3IJGQVDDH2X2EAPEGA3AKREPPT5 X-Mailman-Approved-At: Fri, 14 Jan 2022 13:50:52 +0000 X-Mailman-Version: 3.3.3 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: text/plain; charset="us-ascii"; format="flowed" Content-Transfer-Encoding: 7bit X-Migadu-Flow: FLOW_IN X-Migadu-Country: DE ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1642168259; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-owner:list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=fxp1ahT6MFj/1kA0zELxWN2w7qYehWrYmNemUpqddaY=; b=AehVV8H3Cw22jcTRGAOVb9adqwCKuPn5lPkb0lyAeUs+q4OAL0lfwaBP7hDDJ+saS+d7ej 7HnsCxQ2wUXVbXAamCpH/QwoF8b5eOYjEwLhWp3ksGU3wTnwDyc+Dc7KQu6KMLrlm9QzUo kQImAo34F7s9yF95WluFRSKxKyeulwvv9dDhgI12Q3O0qr3rbtewez0V/RbSNDsNF161cJ L+dgibk9v5F+Cnb0dugD+wU7pvzNovceyjqdXuCjgnRyyNFNYaKK+k2GTH80BP9UdqmDyV QGHYgrAu9St+LE1ZJX50j4k90tj/+UxG+NPX1U1uHkjmrxMhRaQhVzeceqKGkA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1642168259; a=rsa-sha256; cv=none; b=bga/2cyk0Zd/f63ldEsOt+JBcnbu9m6ouPmDwnLiZGAdd7c5qbpsVIw8vFZoroW2I6a4ZM z2YwOlwS1dMwC5BncuC6vwfS9IO37T+9MJkqQaLYSb8jgW9juU8zeEJiQOxyZX72vvYudE hnXOSj4dEe+tuITN+QOMCVe9HVGaYQT7d33w9EwNTGd3NT7OrSi/KiURAyHEu1V0Z3KzyN X+0qoLS2R6JVckaiYPeKf2og2ph4JPd0R0PdYJSwBKVx7Ntuo7QvmXY/8DML0/HwTQCLgR y/uj35ygR8MG1PCOf8HYlIq2nf9vNRLyl5WIy9kpv1he0ArrErWDsc6K7Thwfg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=ibm.com header.s=pp1 header.b=j3sd7Sn4; dmarc=fail reason="SPF not aligned (relaxed)" header.from=ibm.com (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 2a01:4f9:c011:7a79::1 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Spam-Score: -2.21 Authentication-Results: aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=ibm.com header.s=pp1 header.b=j3sd7Sn4; dmarc=fail reason="SPF not aligned (relaxed)" header.from=ibm.com (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 2a01:4f9:c011:7a79::1 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Queue-Id: 57DD43C155 X-Spam-Score: -2.21 X-Migadu-Scanner: scn0.migadu.com X-TUID: n6xn4745L6Jr David Bremner wrote: > "Naveen N. Rao" writes: > >> David Bremner wrote: >>> David Bremner writes: >>> >>>> At least some of this mail data is public, but I'm not sure if the bad >>>> threading is reproducible or not; I want to run a complete census >>>> overnight before I reindex. >>>> >>>> Even if the bug is non-deterministic, it probably lives in lib/add-message.cc >>> >>> I have a reproducible test for this bug now >>> >>> http://pivot.cs.unb.ca/git?p=notmuch.git;a=shortlog;h=refs/heads/fix/thread-search >> >> Thanks for looking into this. >> >>> >>> I still need to analyze the mails a bit more, but it looks like at least >>> one of the strange results is caused by multiple mail files sharing the >>> same message-id, but with different References headers (and no >>> In-Reply-To headers). >> >> In my case, I seem to be having the In-Reply-To headers. I end up with >> two files per message: one from my inbox and one from the gmane archive >> that I pull in. All the messages from the gmane archive seem to have a >> re-written 'In-Reply-To' header, but 'Message-Id' and 'References' are >> the same. >> >> In the problematic email thread, all other files/messages get allotted a >> single thread except for one of the messages. The offending message has >> 3 references compared to 1 or 2 references for the rest, but I don't >> know if that's relevant here. >> > > I _think_ this problem has been resolved with 3f4de98e7c8 / > dab32dc70c15, so in releases after 0.32.2. > > At least the tests I had previously for it are passing in current > notmuch. That's great to hear! I have moved to using lore.kernel.org for the mailing list archives and I haven't had an issue in a while - notmuch has been very stable. Thanks for all your work! - Naveen