From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id yGelJZuxwWIFVAEAbAwnHQ (envelope-from ) for ; Sun, 03 Jul 2022 17:11:23 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id MFt5JZuxwWJJ5AAA9RJhRA (envelope-from ) for ; Sun, 03 Jul 2022 17:11:23 +0200 Received: from mail.notmuchmail.org (yantan.tethera.net [135.181.149.255]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 36AA03FD31 for ; Sun, 3 Jul 2022 17:11:19 +0200 (CEST) Received: from yantan.tethera.net (localhost [127.0.0.1]) by mail.notmuchmail.org (Postfix) with ESMTP id 8DA135E538; Sun, 3 Jul 2022 15:11:15 +0000 (UTC) Received: from fethera.tethera.net (fethera.tethera.net [IPv6:2607:5300:60:c5::1]) by mail.notmuchmail.org (Postfix) with ESMTP id B12585E01E for ; Sun, 3 Jul 2022 15:11:12 +0000 (UTC) Received: by fethera.tethera.net (Postfix, from userid 1001) id 77E425FBD0; Sun, 3 Jul 2022 11:11:11 -0400 (EDT) Received: (nullmailer pid 1800784 invoked by uid 1000); Sun, 03 Jul 2022 15:11:09 -0000 From: David Bremner To: notmuch@notmuchmail.org Subject: performance improvements for notmuch git checkout Date: Sun, 3 Jul 2022 12:10:59 -0300 Message-Id: <20220703151103.1800726-1-david@tethera.net> X-Mailer: git-send-email 2.35.2 MIME-Version: 1.0 Message-ID-Hash: APCMHYYSQHH6GYKQCQWA7DZNZA3Q76IN X-Message-ID-Hash: APCMHYYSQHH6GYKQCQWA7DZNZA3Q76IN X-MailFrom: bremner@tethera.net X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-notmuch.notmuchmail.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; digests; suspicious-header X-Mailman-Version: 3.3.3 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Help: List-Owner: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Migadu-Flow: FLOW_IN X-Migadu-To: larch@yhetil.org X-Migadu-Country: DE ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1656861079; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding:list-id:list-help: list-owner:list-unsubscribe:list-subscribe:list-post; bh=L8D3gLF6/geh75lWUAtocDVsUmxQ7ajDDv7SRKgPRQQ=; b=QXbCHDlLt8PYbxQcd08Y5Yk0ChIn2BiE2MtKcqpGMgHDKHWxDjelpUPZkPjK8XVO5qk/oW N97UT7T0qvyFaZfl1E97w7mEsV+5c7L4nOuWYoQ8kJPB8jF9RIK+jtIRvxJSWoJDpodH0t 1a/eNlbPxlUeYGxA3/asOTENpwmAJoyqQYqi7rKTbXxi5jrq73uwge9jheX1q7Ea11pFIq byHtCNXyUF7rPVDw16Qk2daNgNPegVUU5JnsmfMoHHnH7S/DcVvAC6x30H71Vz4u9eso9O FfB41earYrqEcfFOqL+btig3y2n1J9iDJXUm4J3l00IBii1B9N4Xy2kqq5xA0A== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1656861079; a=rsa-sha256; cv=none; b=WftL2qpDRKOyu3o0hiI5pdvftuHcXqF8rYQ1+HM2PqYYeyKe2Z2ppKiJBqo+mwPIf3LWIy NovCz1WeB1evu48RIB7KOpuTT+ChXUxpFbsypiQ1oEIEBlbCTBmdiHTaAfepHSx85/xKFz NbGYZ/rbu4XltczfD2Cu9+m+ZFuGMm6HNTG0v66Lx42CgmpYwE1jvmjfGk8rJCHA6iQ/HW xIcJHPp00YoAorWFuaAsgzLeL3KXuzJVr8A7qu+kW2iBSN60WCWQ9HpwwiE520w7Wrh0+8 9ypo035nJbMURBoBPYfEOmRXjIqFvULwliSHPfBEjCT+BBMMgPRnNhUbJoNHYQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 135.181.149.255 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Spam-Score: -1.66 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 135.181.149.255 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Queue-Id: 36AA03FD31 X-Spam-Score: -1.66 X-Migadu-Scanner: scn0.migadu.com X-TUID: omf9bJ+zM5c/ This series speeds up "notmuch git checkout" from "intolerably slow" to "OKish" on my mail. [PATCH 1/4] debian: add git as a build-dependency, for the test suite This is unrelated to the rest of the series, but needed to build the debian package [PATCH 2/4] perf-test: add tests for notmuch-git Mainly commit and checkout the entire corpus. [PATCH 3/4] CLI/git: current cache contents (file list) of index Remove many (1 per message) execs of git-ls-files [PATCH 4/4] CLI/git: replace calls to notmuch-search with database Remove many (1 per message) execs notmuch-search