From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <e@80x24.org>
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net
X-Spam-Level: 
X-Spam-ASN:  
X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00
	shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2
Received: from localhost (dcvr.yhbt.net [127.0.0.1])
	by dcvr.yhbt.net (Postfix) with ESMTP id 0005F1F8C8;
	Fri,  1 Oct 2021 23:46:00 +0000 (UTC)
Date: Fri, 1 Oct 2021 23:46:00 +0000
From: Eric Wong <e@80x24.org>
To: Konstantin Ryabitsev <konstantin@linuxfoundation.org>
Cc: meta@public-inbox.org
Subject: Re: Troubleshooting threads missing from /all/
Message-ID: <20211001234600.GA28791@dcvr>
References: <20211001130527.z7eivotlgqbgetzz@meerkat.local>
 <20211001195811.GA31313@dcvr>
 <20211001200842.kife7viwej5arza7@meerkat.local>
 <20211001204131.GA20263@dcvr>
 <20211001204943.l4yl6xvc45c5eapz@meerkat.local>
 <YVd1kpL7YVDMLCqN@dcvr>
 <20211001205817.y2h3xypudngkttkj@meerkat.local>
 <20211001222509.GA1968@dcvr>
 <20211001231104.lne6aoq7a5hsqi2e@meerkat.local>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
In-Reply-To: <20211001231104.lne6aoq7a5hsqi2e@meerkat.local>
List-Id: <meta.public-inbox.org>

Konstantin Ryabitsev <konstantin@linuxfoundation.org> wrote:
> On Fri, Oct 01, 2021 at 10:25:09PM +0000, Eric Wong wrote:
> >   export HOME=/tmp/trash # fresh lei/store instance
> >   M=87czop5j33.fsf@tynnyri.adurom.net
> >   lei import https://yhbt.net/lore/all/$M/t.mbox.gz
> >   lei q z:0.. | wc -l # should have all (11) msgs
> >   lei q m:$M -t | wc -l # should have the same msgs (11)
> 
> Yes, both are reporting 11.

OK, good.

> I'll also be happy to provide the extindex, though that's a bit on the largish
> side at almost 225G. :) Just let me know and I'll see if I can set up a
> temporary VM with access for you.

Probably not needed    I wonder if it's related to some
dedupe bugs I also noticed with lei.  I'll take a harder look
at it once I get some more calories+sleep in me...  I hit some
massive brain fade yesterday-ish working on yhbt :<

If you have extra space somewhere to:

a) copy the old extindex somewhere and do extindex --reindex on it
b) just reindex in place (it /should/ work...)
c) start a new extindex from scratch...

And seeing if inspect gives different results

I'm also running:

  public-inbox-extindex --no-fsync /tmp/foo lore/linux-wireless lore/regressions

To create a new extindex with just those two inboxes (and maybe
again with inbox order reversed).  But it's also taking a while...