From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: X-Spam-Status: No, score=-4.2 required=3.0 tests=ALL_TRUSTED,AWL,BAYES_00, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF, T_SCC_BODY_TEXT_LINE shortcircuit=no autolearn=ham autolearn_force=no version=3.4.6 Received: from localhost (dcvr.yhbt.net [127.0.0.1]) by dcvr.yhbt.net (Postfix) with ESMTP id 201441F406 for ; Mon, 13 Nov 2023 13:15:52 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=80x24.org; s=selector1; t=1699881352; bh=+6uK1c30KjY64m+/nXVeXK9Z8CqwfUe0zHBY5HxK4FU=; h=From:To:Subject:Date:From; b=sOo3J5kMbXnqtqWiMCQoyZtNxlhdrK33xRNTWf3HhG6VV2xa5buf7S0KSsGRqdaKv xPKfYcMMFy/vjEDixGu8icwlD2gb9nVp0uF1YvYWQ6Tl0L5Nkhu8xz6dHkdhAzADtm rT9Ytqd/l3LN0y7zYiPO6V8H/GDNYYiuQlUxbZcw= From: Eric Wong To: meta@public-inbox.org Subject: [PATCH 00/18] cindex: some --associate work Date: Mon, 13 Nov 2023 13:15:33 +0000 Message-Id: <20231113131551.843230-1-e@80x24.org> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit List-Id: Still very much in flux, but some treewide cleanups in there... And I've been wondering if "join" is a better word than "associate" to denote the relationship between inboxes and coderepos. But "join" (even if we use join(1) internally) probably implies strict relationships, whereas our current "associate" is always going to be fuzzy due to patchids being fuzzy and blobs OIDs being abbreviated in patches. I'm also thinking about moving --associate-* CLI switches into suboptions (e.g. what getsubopt(3) supports), so: --associate=aggressive,prefixes=patchid+dfblob But Perl doesn't ship with getsubopt(3) emulation out-of-the-box Eric Wong (18): cindex: check `say' errors w/ close or ->flush tmpfile: check `stat' errors, use autodie for unlink cindex: use `local' for pipes between processes xap_helper_cxx: use write_file helper xap_helper_cxx: make the build process ccache-friendly xap_helper_cxx: use -pipe by default in CXXFLAGS xap_client: spawn C++ xap_helper directly treewide: update read_all to avoid eof|close checks spawn: don't append to scalarrefs on stdout/stderr cindex: imply --all with --associate w/o -I/--only cindex: delay associate until prune+indexing finish xap_helper: Perl dump_ibx respects `-m MAX' cidx_xap_helper_aux: complain about truncated inputs xap_helper: stricter and harsher error handling xap_helper: better variable naming for key buffer cindex: do not guess integer maximum for Xapian cindex: rename associate-max => window cindex: support --associate-aggressive shortcut lib/PublicInbox/CidxComm.pm | 6 +- lib/PublicInbox/CidxXapHelperAux.pm | 6 +- lib/PublicInbox/CodeSearchIdx.pm | 122 ++++++++++----- lib/PublicInbox/Gcf2.pm | 3 +- lib/PublicInbox/IO.pm | 18 ++- lib/PublicInbox/LeiInput.pm | 10 +- lib/PublicInbox/LeiMirror.pm | 10 +- lib/PublicInbox/LeiToMail.pm | 3 +- lib/PublicInbox/Spawn.pm | 4 +- lib/PublicInbox/TestCommon.pm | 6 +- lib/PublicInbox/Tmpfile.pm | 10 +- lib/PublicInbox/XapClient.pm | 28 ++-- lib/PublicInbox/XapHelper.pm | 30 ++-- lib/PublicInbox/XapHelperCxx.pm | 55 +++---- lib/PublicInbox/xap_helper.h | 233 ++++++++++++---------------- script/public-inbox-cindex | 3 +- script/public-inbox-learn | 2 +- script/public-inbox-mda | 2 +- script/public-inbox-purge | 2 +- t/spawn.t | 2 +- t/xap_helper.t | 27 ++-- 21 files changed, 287 insertions(+), 295 deletions(-) Yay, less code!