From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 0F9CE1F9FD for ; Sun, 21 Feb 2021 07:41:35 +0000 (UTC) From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 0/7] "lei q -o imaps://..." support Date: Sun, 21 Feb 2021 07:41:27 +0000 Message-Id: <20210221074134.15084-1-e@80x24.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: -a/--augment dedupe is now parallel for both Maildirs and IMAP stores (probably not worth the serialization cost for mbox*). LeiAuth remains inefficient, unfortunately; but wq_broadcast has been added to address it in the future. The parallelization work for IMAP for "lei q" can also be done for "lei convert" and "lei import", but it'll probably be opt-in in case people care about preserving UID order. Eric Wong (7): inbox_writable: require PublicInbox::MdirReader lei q: support IMAP/IMAPS --output destinations ipc: add wq_broadcast lei q: move augment into lei2mail workers ipc: support setting a locked number of WQ workers net_reader: use and accept URIimap objects in more places lei2mail: parallel augment for lock-free stores lib/PublicInbox/IPC.pm | 35 +++++++-- lib/PublicInbox/InboxWritable.pm | 1 + lib/PublicInbox/LeiAuth.pm | 2 +- lib/PublicInbox/LeiOverview.pm | 7 +- lib/PublicInbox/LeiQuery.pm | 24 +++++-- lib/PublicInbox/LeiToMail.pm | 93 ++++++++++++++++++++++-- lib/PublicInbox/LeiXSearch.pm | 48 ++++++------- lib/PublicInbox/NetReader.pm | 75 +++++++++++--------- lib/PublicInbox/NetWriter.pm | 12 ++++ lib/PublicInbox/WQWorker.pm | 8 +-- lib/PublicInbox/Watch.pm | 11 +-- t/ipc.t | 39 +++++----- t/lei-externals.t | 3 +- xt/net_writer-imap.t | 118 ++++++++++++++++++++++++++++--- 14 files changed, 362 insertions(+), 114 deletions(-)