From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <e@80x24.org>
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net
X-Spam-Level: 
X-Spam-ASN:  
X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00
	shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2
Received: from localhost (dcvr.yhbt.net [127.0.0.1])
	by dcvr.yhbt.net (Postfix) with ESMTP id 36D911F670;
	Sun, 17 Oct 2021 23:12:45 +0000 (UTC)
Date: Sun, 17 Oct 2021 23:12:45 +0000
From: Eric Wong <e@80x24.org>
To: Konstantin Ryabitsev <konstantin@linuxfoundation.org>
Cc: meta@public-inbox.org
Subject: Re: Troubleshooting threads missing from /all/
Message-ID: <20211017231245.GA10556@dcvr>
References: <20211001222509.GA1968@dcvr>
 <20211001231104.lne6aoq7a5hsqi2e@meerkat.local>
 <20211001234600.GA28791@dcvr>
 <20211005043954.GA23990@dcvr>
 <20211005180324.3miboond7ubth5v5@meerkat.local>
 <20211007213307.29376-0@dcvr>
 <20211008173336.ftokrvr73vcuhtpg@meerkat.local>
 <20211008213433.M867097@dcvr>
 <20211016094324.GA16488@dcvr>
 <20211017180450.e6zsbbx2at2rggxx@nitro.local>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
In-Reply-To: <20211017180450.e6zsbbx2at2rggxx@nitro.local>
List-Id: <meta.public-inbox.org>

Konstantin Ryabitsev <konstantin@linuxfoundation.org> wrote:
> On Sat, Oct 16, 2021 at 09:43:24AM +0000, Eric Wong wrote:
> > Eric Wong <e@80x24.org> wrote:
> > > Yes.  Though given the current situation with missing messages
> > > from /all/, I'd wait until a reindex recovers the missing
> > > messages (and probably a fast fsck checker).
> > 
> > I think "public-inbox-extindex --reindex --all --fast" is
> > reasonably ready as an fsck checker.  I've been running it a
> > bunch in recent days/weeks and also found+fixed some other bugs
> > along the way.

Btw, I'm chasing a separate bug in v2 which causes recycled
Message-IDs to go missing sometimes from a v2 over.sqlite3;
which then causes -extindex to lose a message...

For example, patches v7 and v8 of
  "btrfs: consolidate device_list_mutex in prepare_sprout to its parent"
reused the same Message-ID, but hitting the v2 inbox directly
https://lore.kernel.org/linux-btrfs/6585e7d938e6600189c1bc7b61a7c76badef18dd.1633003671.git.anand.jain@oracle.com/
doesn't show it, anymore.  --reindex on the v2 inbox seems to
work, but not always...

> Thanks, Eric! I've been out this week for some family time (it was
> Thanksgiving in Canada), which is why I was staying conspicuously silent. :)
> I'll give --reindex --fast a whirl in the next few days.

No problem, but there's more bugs to fix :/