From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on dcvr.yhbt.net X-Spam-Level: X-Spam-Status: No, score=-4.0 required=3.0 tests=ALL_TRUSTED,BAYES_00 shortcircuit=no autolearn=ham autolearn_force=no version=3.4.2 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 8668E1F4B4 for ; Tue, 2 Feb 2021 11:47:02 +0000 (UTC) From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 00/16] lei: -I/--include and more Date: Tue, 2 Feb 2021 11:46:46 +0000 Message-Id: <20210202114702.29886-1-e@80x24.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: We're further embracing SOCK_SEQPACKET for progress reporting. There's numerous cleanups for the oneshot case, but that's still using worker processes. Worker-less oneshot seems pretty-broken atm, but 16/16 will let us work on it more easily. Eric Wong (16): lei: switch to use SEQPACKET socketpair instead of pipe lei_query: default to 10000 messages as documented lei q: emit progress and counting via PktOp lei q: support --only, --include and --exclude lei: complete: do not complete non-arg options w/ help text lei: q: shell completion for --(include|exclude|only) lei_xsearch: truncate curl stderr after reading it lib: explicitly distinguish oneshot use lei q: do not leave temporary files after oneshot exit cmd_ipc4: fix comments and formatting pktop: fix potential undefined var lei_xsearch: ensure curl.err and tail(1) cleanup happens doc: lei-q: note "-a" and link to Xapian QueryParser lei_overview: avoid unnecessary {l2m} delete lei q: tidy up progress reporting lei q: support --jobs [SEARCHERS],[WRITERS] Documentation/lei-q.pod | 5 +- MANIFEST | 2 +- lib/PublicInbox/CmdIPC4.pm | 7 ++- lib/PublicInbox/IPC.pm | 42 +++++++++++++---- lib/PublicInbox/LEI.pm | 60 +++++++++++++++--------- lib/PublicInbox/LeiExternal.pm | 12 ++--- lib/PublicInbox/LeiOverview.pm | 15 +++--- lib/PublicInbox/LeiQuery.pm | 77 ++++++++++++++++++++++++------- lib/PublicInbox/LeiXSearch.pm | 83 ++++++++++++++++++++++++---------- lib/PublicInbox/OpPipe.pm | 41 ----------------- lib/PublicInbox/PktOp.pm | 69 ++++++++++++++++++++++++++++ lib/PublicInbox/V2Writable.pm | 22 +-------- t/lei.t | 14 ++++-- t/lei_external.t | 2 +- xt/lei-sigpipe.t | 29 ++++++++++-- 15 files changed, 318 insertions(+), 162 deletions(-) delete mode 100644 lib/PublicInbox/OpPipe.pm create mode 100644 lib/PublicInbox/PktOp.pm