From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-4.2 required=3.0 tests=ALL_TRUSTED,AWL,BAYES_00, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF shortcircuit=no autolearn=ham autolearn_force=no version=3.4.6 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id BB8711F4CC for ; Wed, 11 Dec 2024 08:10:47 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=80x24.org; s=selector1; t=1733904647; bh=00xZQYNc3sY74Y5AGlIXleOFJ37qOntu/ni9Bj0YQbk=; h=From:To:Subject:Date:From; b=cgAjF63C/Z6sGsZAxPTVVltvWZJ1BZR+ERbc3/9xXR3RnoXoCjQEZ1HBljTvTQfE7 bl8bHSaOptwm3Ce/KawBZMQUqP/vv8rY8mThq+FWy1K9VvD7Sw9rX5IQwBiRJ3CZZ8 mXyigjN3LxTJavuzkiLGP/fpwuFRGF+xd1kVd820= From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 0/4] various indexing updates Date: Wed, 11 Dec 2024 08:10:43 +0000 Message-ID: <20241211081047.1267062-1-e@80x24.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: 1/4 is a big one, and a CLI switch might be necessary for some... 3/4 is fairly minor and probably not noticeable, but deletes are very common for coderepos. Accounting for delete costs for inboxes (not coderepos) is probably something that can wait for post-2.0. 2/4 and 4/4 are trivial cleanups. In retrospect, I probably should've used `local' more back in the day to simplify internal data structures. But didn't start using it heavily until a few years ago... Eric Wong (4): (ext)index: use time-based commits to avoid busy timeout lei/store: use global checkpoint interval cindex: adjust estimated memory cost for deletes over_idx: simplify each_by_mid lib/PublicInbox/CodeSearchIdx.pm | 9 ++++++++- lib/PublicInbox/ExtSearchIdx.pm | 14 ++++++-------- lib/PublicInbox/LeiStore.pm | 4 +++- lib/PublicInbox/OverIdx.pm | 3 +-- lib/PublicInbox/SearchIdx.pm | 29 +++++++++++++++++++++-------- lib/PublicInbox/V2Writable.pm | 22 ++++++++++------------ 6 files changed, 49 insertions(+), 32 deletions(-)