From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 176701F4B4 for ; Tue, 15 Dec 2020 02:02:25 +0000 (UTC) From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 0/9] extindex: --reindex support Date: Tue, 15 Dec 2020 02:02:15 +0000 Message-Id: <20201215020224.11739-1-e@80x24.org> In-Reply-To: <20201211033740.24568-1-e@80x24.org> References: MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: Patches 1 and 2 are resends, the rest have gone through a lot of changes and I'm probably ready to run this live on the extindex which holds my lore mirror onion Eric Wong (9): extindex: preliminary --reindex support extindex: delete stale messages from over.sqlite3 over: sort xref3 by xnum if ibx_id repeats extindex: support --rethread and content bifurcation extsearchidx: reindex works on Xapian, too extsearchidx: checkpoint releases locks extsearchidx: simplify reindex code paths extsearchidx: reindex releases over.sqlite3 handles properly searchidxshard: simplify newline elimination lib/PublicInbox/ExtSearchIdx.pm | 369 +++++++++++++++++++++++++++++- lib/PublicInbox/Over.pm | 5 +- lib/PublicInbox/OverIdx.pm | 23 ++ lib/PublicInbox/SearchIdx.pm | 13 +- lib/PublicInbox/SearchIdxShard.pm | 20 +- lib/PublicInbox/V2Writable.pm | 11 +- t/extsearch.t | 133 ++++++++++- 7 files changed, 542 insertions(+), 32 deletions(-)