From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id EC4866DE0F80 for ; Mon, 15 Apr 2019 18:46:27 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org X-Spam-Flag: NO X-Spam-Score: -0.025 X-Spam-Level: X-Spam-Status: No, score=-0.025 tagged_above=-999 required=5 tests=[AWL=-0.024, SPF_PASS=-0.001] autolearn=disabled Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id hjf3957SNOA0 for ; Mon, 15 Apr 2019 18:46:27 -0700 (PDT) Received: from fethera.tethera.net (fethera.tethera.net [198.245.60.197]) by arlo.cworth.org (Postfix) with ESMTPS id E7DDF6DE0F59 for ; Mon, 15 Apr 2019 18:46:26 -0700 (PDT) Received: from remotemail by fethera.tethera.net with local (Exim 4.89) (envelope-from ) id 1hGDB1-0007oo-G9 for notmuch@notmuchmail.org; Mon, 15 Apr 2019 21:46:23 -0400 Received: (nullmailer pid 31744 invoked by uid 1000); Tue, 16 Apr 2019 01:46:21 -0000 From: David Bremner To: notmuch@notmuchmail.org Subject: reindex improvements Date: Mon, 15 Apr 2019 22:46:14 -0300 Message-Id: <20190416014616.31623-1-david@tethera.net> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 16 Apr 2019 01:46:28 -0000 With the upgrade path for the body: prefix being "notmuch reindex '*'", it's important that that is usable. It turns out that due to a blunder on my part it wasn't really unless your whole mail store fits comfortably in RAM. [PATCH 1/2] CLI/reindex: fix memory leak This is an outright bugfix. [PATCH 2/2] n_m_remove_indexed_terms: reduce number of Xapian API This is optional, but the performance payoff is impressive. I suspect it might be even more impressive on spinning rust, but I didn't test it.