From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-4.2 required=3.0 tests=ALL_TRUSTED,BAYES_00, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF shortcircuit=no autolearn=ham autolearn_force=no version=3.4.6 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 5B9011F454 for ; Wed, 11 Oct 2023 07:20:57 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=80x24.org; s=selector1; t=1697008857; bh=6iwMnC1g6X0FO56o62BH752M7DaumrtCKZmsaLuCYhk=; h=From:To:Subject:Date:From; b=YpOIVmP74RxvqjcoNMomKogKJnpVhCGySFrf/obB5I+UYo65IqwQ4rslmw42t2z0C JaPHgcPY3ZzWCR36HQVQA4CruxZ3onCvgJVpDTnurs6jPzRic0+yCcFwynURAYSC4y U+6M7ek3pjNqptmmPI3uE+2tDmE3F+Dd2UxHkyYE= From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 0/9] lei + import-related updates Date: Wed, 11 Oct 2023 07:20:48 +0000 Message-ID: <20231011072057.758022-1-e@80x24.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: A few more ProcessIO conversions to start with, and then cleanups while I started working on import-related stuff. Some of this will tie in nicely for FUSE, too... I've realized msgtime messages were pointless anyways since there's nothing anybody can really do about bad messages that get through various upstream spam filters. 5/9 is a long-overdue cleanup I noticed while going over Import.pm 9/9 ought to fix the fragile t/lei-store-fail.t test by using new features. Eric Wong (9): lei rediff: use ProcessIO for --drq support lei_xsearch: improve curl progress reporting msgtime: quiet warnings we can do nothing about msgtime: simplify msg_timestamp and msg_datestamp treewide: consolidate "From " line removal import: switch to Unix stream socket for fast-import import: cat_blob is a no-op w/o live fast-import lei blob: run cat_blob on lei/store for pending blobs lei import|tag|rm: support --commit-delay=SECONDS lib/PublicInbox/Eml.pm | 6 ++ lib/PublicInbox/IMAP.pm | 2 +- lib/PublicInbox/Import.pm | 138 ++++++++++++++++------------------ lib/PublicInbox/LEI.pm | 23 +++--- lib/PublicInbox/LeiBlob.pm | 16 ++-- lib/PublicInbox/LeiInput.pm | 5 +- lib/PublicInbox/LeiInspect.pm | 2 +- lib/PublicInbox/LeiRediff.pm | 33 ++++---- lib/PublicInbox/LeiStore.pm | 11 +++ lib/PublicInbox/LeiToMail.pm | 3 +- lib/PublicInbox/LeiXSearch.pm | 34 +++++---- lib/PublicInbox/Mbox.pm | 16 ++-- lib/PublicInbox/MboxReader.pm | 2 +- lib/PublicInbox/MsgTime.pm | 49 +++++------- lib/PublicInbox/NNTP.pm | 3 +- lib/PublicInbox/ProcessIO.pm | 18 ++--- lib/PublicInbox/Spawn.pm | 1 + script/public-inbox-convert | 18 ++--- script/public-inbox-edit | 5 +- script/public-inbox-learn | 2 +- script/public-inbox-mda | 4 +- script/public-inbox-purge | 4 +- t/lei-import.t | 13 ++++ t/lei-store-fail.t | 20 +++-- t/lei-tag.t | 15 +++- 25 files changed, 230 insertions(+), 213 deletions(-)