From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 160F21F990 for ; Fri, 7 Aug 2020 10:52:19 +0000 (UTC) From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 0/5] more indexing improvements Date: Fri, 7 Aug 2020 10:52:13 +0000 Message-Id: <20200807105218.16843-1-e@yhbt.net> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: VERY big batch sizes seem helpful on HDDs.. And I also blew up a run because --compact ran in parallel with 32 shards :x And --help should exist for all commands users may run from the CLI. Eric Wong (5): v2writable: fix batch size accounting index: --compact respects --sequential-shard index: max out XAPIAN_FLUSH_THRESHOLD if using --batch-size searchidx: use Perl truthiness to detect XAPIAN_FLUSH_THRESHOLD index: add built-in --help / -? Documentation/public-inbox-index.pod | 4 +- lib/PublicInbox/SearchIdx.pm | 3 +- lib/PublicInbox/V2Writable.pm | 10 ++++- script/public-inbox-index | 58 ++++++++++++++++++++++------ 4 files changed, 58 insertions(+), 17 deletions(-)