From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <e@80x24.org>
X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on dcvr.yhbt.net
X-Spam-Level: 
X-Spam-ASN:  
X-Spam-Status: No, score=-4.2 required=3.0 tests=ALL_TRUSTED,AWL,BAYES_00,
	DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,
	T_SCC_BODY_TEXT_LINE shortcircuit=no autolearn=ham autolearn_force=no
	version=3.4.6
Received: from localhost (dcvr.yhbt.net [127.0.0.1])
	by dcvr.yhbt.net (Postfix) with ESMTP id 3DDED1F566;
	Tue,  4 Jun 2024 17:07:36 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=80x24.org;
	s=selector1; t=1717520856;
	bh=sv1dfpNapQY5+COikxx8QuinY6bLOAnfoRttxp8aBFc=;
	h=Date:From:To:Cc:Subject:References:In-Reply-To:From;
	b=a3pcqMjRlaetfSblx2WYjqR4fQI7NP9UUql8sebwwnQH+miaQ7IamLtvoSrMhFwGC
	 nHRHu13L+xSB9UbKPcNCFSkRuKqOvGknUIGvyebLlimU9REiYL6KL9CnfrqaX9PIHj
	 NoaHE4gbFh4SWazqOmLUBDnl+v5hbzpqy8AO83BM=
Date: Tue, 4 Jun 2024 17:07:35 +0000
From: Eric Wong <e@80x24.org>
To: Jonathan Corbet <corbet@lwn.net>
Cc: meta@public-inbox.org
Subject: Re: Switching to extindex
Message-ID: <20240604170735.M954932@dcvr>
References: <87ed9c1ywx.fsf@meer.lwn.net>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
In-Reply-To: <87ed9c1ywx.fsf@meer.lwn.net>
List-Id: <meta.public-inbox.org>

Jonathan Corbet <corbet@lwn.net> wrote:
> I"ve run public-inbox-extindex --all and waited a few days; once I
> figured out that I also need to have it running with --watch, things
> *seem* to be working well.
> 
> My understanding is that I can now get rid of the per-inbox indexing and
> get a bunch of disk space back, and I would like to do that.  This,
> though, is the step that I've not been able to figure out.  Which files
> can I remove, and how do I tell public-inbox to not recreate them?

Yes, you can remove the Xapian shard directories (0, 1, 2, ...)
under xap15 and -watch will be able to detect indexlevel=basic
on the next SIGHUP or restart.

Leave the per-inbox *.sqlite3 files, they're still required for
-extindex and don't use too much space compared to Xapian.

For new inboxes you can -init with `-L basic' to avoid per-inbox
Xapian DBs.