From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 4D3A61F670; Mon, 18 Oct 2021 05:25:26 +0000 (UTC) Date: Mon, 18 Oct 2021 05:25:26 +0000 From: Eric Wong To: Konstantin Ryabitsev Cc: meta@public-inbox.org Subject: Re: Troubleshooting threads missing from /all/ Message-ID: <20211018052526.M214021@dcvr> References: <20211001231104.lne6aoq7a5hsqi2e@meerkat.local> <20211001234600.GA28791@dcvr> <20211005043954.GA23990@dcvr> <20211005180324.3miboond7ubth5v5@meerkat.local> <20211007213307.29376-0@dcvr> <20211008173336.ftokrvr73vcuhtpg@meerkat.local> <20211008213433.M867097@dcvr> <20211016094324.GA16488@dcvr> <20211017180450.e6zsbbx2at2rggxx@nitro.local> <20211017231245.GA10556@dcvr> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline In-Reply-To: <20211017231245.GA10556@dcvr> List-Id: Eric Wong wrote: > Konstantin Ryabitsev wrote: > > On Sat, Oct 16, 2021 at 09:43:24AM +0000, Eric Wong wrote: > > > Eric Wong wrote: > > > > Yes. Though given the current situation with missing messages > > > > from /all/, I'd wait until a reindex recovers the missing > > > > messages (and probably a fast fsck checker). > > > > > > I think "public-inbox-extindex --reindex --all --fast" is > > > reasonably ready as an fsck checker. I've been running it a > > > bunch in recent days/weeks and also found+fixed some other bugs > > > along the way. > > Btw, I'm chasing a separate bug in v2 which causes recycled > Message-IDs to go missing sometimes from a v2 over.sqlite3; > which then causes -extindex to lose a message... I just pushed out commit 325fbe26c3e7731e (v2: mirrors don't clobber msgs w/ reused Message-IDs, 2021-10-18) Now I'm reindexing all my v2 inboxes before running "-extindex --all --reindex --fast". Fortunately, v2 inboxes are all "-L basic" so they're not too expensive to reindex. Really hoping this is the last bug related to indexing for a while...