From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-4.2 required=3.0 tests=ALL_TRUSTED,AWL,BAYES_00, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF shortcircuit=no autolearn=ham autolearn_force=no version=3.4.6 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id DF4251F44D for ; Tue, 16 Apr 2024 20:56:29 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=80x24.org; s=selector1; t=1713300989; bh=Dbk/F9/2cQH7PgbLE/NtjSkL/ZQig1vixpYu8eGFKHo=; h=From:To:Subject:Date:From; b=QiQSjmLDcTB0RXzP8mEJgISnF2wTeerYFc5SWCrR7pizq4keGzHCeaE6as2dRm/Vx JSZ12a0K2wSGr3x5RUwe20FWyAOx48vE8Mjk1xmV2lVKKoe16UBApDno6VnOCeMXUZ T1GNoYanprgbt/c6r8Pz20GqGJoK5amItOIBoLEw= From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 0/4] lei parallelism fixes Date: Tue, 16 Apr 2024 20:56:25 +0000 Message-ID: <20240416205629.3648894-1-e@80x24.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: This series allows `lei reindex' to run in parallel with other lei commands which write to lei/store. Eric Wong (4): v2 + lei/store: always wait for fast-import checkpoint lei: use ->barrier to commit to lei/store lei/store: stop shard workers + cat-file on idle lei: use async barrier for --import-before lib/PublicInbox/EOFpipe.pm | 7 ++-- lib/PublicInbox/ExtSearchIdx.pm | 1 + lib/PublicInbox/LEI.pm | 6 ++-- lib/PublicInbox/LeiInput.pm | 2 +- lib/PublicInbox/LeiRefreshMailSync.pm | 2 +- lib/PublicInbox/LeiRemote.pm | 4 +-- lib/PublicInbox/LeiStore.pm | 46 ++++++++++++++++----------- lib/PublicInbox/LeiToMail.pm | 28 ++++++++++++---- lib/PublicInbox/LeiXSearch.pm | 17 ++++++---- lib/PublicInbox/V2Writable.pm | 8 +---- t/lei-store-fail.t | 2 +- 11 files changed, 74 insertions(+), 49 deletions(-)