From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <e@80x24.org>
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net
X-Spam-Level: 
X-Spam-ASN:  
X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00
	shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2
Received: from localhost (dcvr.yhbt.net [127.0.0.1])
	by dcvr.yhbt.net (Postfix) with ESMTP id 4D3A61F670;
	Mon, 18 Oct 2021 05:25:26 +0000 (UTC)
Date: Mon, 18 Oct 2021 05:25:26 +0000
From: Eric Wong <e@80x24.org>
To: Konstantin Ryabitsev <konstantin@linuxfoundation.org>
Cc: meta@public-inbox.org
Subject: Re: Troubleshooting threads missing from /all/
Message-ID: <20211018052526.M214021@dcvr>
References: <20211001231104.lne6aoq7a5hsqi2e@meerkat.local>
 <20211001234600.GA28791@dcvr>
 <20211005043954.GA23990@dcvr>
 <20211005180324.3miboond7ubth5v5@meerkat.local>
 <20211007213307.29376-0@dcvr>
 <20211008173336.ftokrvr73vcuhtpg@meerkat.local>
 <20211008213433.M867097@dcvr>
 <20211016094324.GA16488@dcvr>
 <20211017180450.e6zsbbx2at2rggxx@nitro.local>
 <20211017231245.GA10556@dcvr>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
In-Reply-To: <20211017231245.GA10556@dcvr>
List-Id: <meta.public-inbox.org>

Eric Wong <e@80x24.org> wrote:
> Konstantin Ryabitsev <konstantin@linuxfoundation.org> wrote:
> > On Sat, Oct 16, 2021 at 09:43:24AM +0000, Eric Wong wrote:
> > > Eric Wong <e@80x24.org> wrote:
> > > > Yes.  Though given the current situation with missing messages
> > > > from /all/, I'd wait until a reindex recovers the missing
> > > > messages (and probably a fast fsck checker).
> > > 
> > > I think "public-inbox-extindex --reindex --all --fast" is
> > > reasonably ready as an fsck checker.  I've been running it a
> > > bunch in recent days/weeks and also found+fixed some other bugs
> > > along the way.
> 
> Btw, I'm chasing a separate bug in v2 which causes recycled
> Message-IDs to go missing sometimes from a v2 over.sqlite3;
> which then causes -extindex to lose a message...

I just pushed out commit 325fbe26c3e7731e
(v2: mirrors don't clobber msgs w/ reused Message-IDs, 2021-10-18)

Now I'm reindexing all my v2 inboxes before running
"-extindex --all --reindex --fast".  Fortunately, v2 inboxes
are all "-L basic" so they're not too expensive to reindex.

Really hoping this is the last bug related to indexing for a
while...