From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-Status: No, score=-3.0 required=3.0 tests=ALL_TRUSTED,AWL,BAYES_00, URIBL_SBL,URIBL_SBL_A shortcircuit=no autolearn=no autolearn_force=no version=3.4.2 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 30EED1FB06 for ; Fri, 25 Dec 2020 10:21:15 +0000 (UTC) From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 0/7] index + extindex interaction improvements Date: Fri, 25 Dec 2020 10:21:08 +0000 Message-Id: <20201225102115.6745-1-e@80x24.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: Some things which make -index less painful when auto-updating external indices. "public-inbox-extindex --all" itself is still painfully slow with 50K inboxes, but I think that can only be used once for initialization and -index can be relied on for all incremental updates. Eric Wong (7): index: disable --fast-noop on --reindex extsearchidx: delay SQLite availability checks extsearchidx: close DB handles after use if FD constrained index: do not attach inbox to extindex unless updated index: fix --no-fsync flag propagation to extindex v2writable: don't verify tip if reindexing index: filter out indexlevel=basic from extindex lib/PublicInbox/Admin.pm | 1 + lib/PublicInbox/ExtSearchIdx.pm | 96 +++++++++++++++++++++------------ lib/PublicInbox/SearchIdx.pm | 2 + lib/PublicInbox/V2Writable.pm | 36 +++++++++---- script/public-inbox-index | 27 ++++++---- 5 files changed, 109 insertions(+), 53 deletions(-)