From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <e@80x24.org>
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net
X-Spam-Level: 
X-Spam-ASN:  
X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00
	shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2
Received: from localhost (dcvr.yhbt.net [127.0.0.1])
	by dcvr.yhbt.net (Postfix) with ESMTP id CB19C1F670;
	Sun, 24 Oct 2021 00:03:17 +0000 (UTC)
Date: Sun, 24 Oct 2021 00:03:17 +0000
From: Eric Wong <e@80x24.org>
To: Konstantin Ryabitsev <konstantin@linuxfoundation.org>
Cc: meta@public-inbox.org
Subject: Re: Troubleshooting threads missing from /all/
Message-ID: <20211024000317.GA9012@dcvr>
References: <20211001222509.GA1968@dcvr>
 <20211001231104.lne6aoq7a5hsqi2e@meerkat.local>
 <20211001234600.GA28791@dcvr>
 <20211005043954.GA23990@dcvr>
 <20211005180324.3miboond7ubth5v5@meerkat.local>
 <20211007213307.29376-0@dcvr>
 <20211008173336.ftokrvr73vcuhtpg@meerkat.local>
 <20211008213433.M867097@dcvr>
 <20211016094324.GA16488@dcvr>
 <20211018140325.er5vq5oqjtysvubn@meerkat.local>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
In-Reply-To: <20211018140325.er5vq5oqjtysvubn@meerkat.local>
List-Id: <meta.public-inbox.org>

Konstantin Ryabitsev <konstantin@linuxfoundation.org> wrote:
> On Sat, Oct 16, 2021 at 09:43:24AM +0000, Eric Wong wrote:
> > With --fast, --reindex takes around 20 minutes for me with
> > "--batch-size=20m --no-fsync".  The first run may take longer
> > if it has stuff to do.  But running it repeatedly should not
> > cause it to complain about unseen/stale/mismatched messages
> > (likely the first run will).
> 
> I just ran it across the 3 lore nodes and the results have been fairly
> consistent:
> 
> - 16m for the initial run where it finds a few hundred things to fix
> - 14m for the subsequent runs
> 
> I used the default flags for --reindex --all --fast, so it can perhaps be sped
> up with larger memory use, but this is good enough for daily runs already.

Cool.  Just wondering if all is well on your end with daily runs.

--reindex --all --fast hasn't found any work to do the past week
or so on https://yhbt.net/lore/

I'm thinking about cutting a new release soonish and just
putting giant warnings around the not-yet-ready parts of
lei for now...