From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id 8407C429E21 for ; Sun, 13 Nov 2011 22:34:48 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: -2.29 X-Spam-Level: X-Spam-Status: No, score=-2.29 tagged_above=-999 required=5 tests=[RCVD_IN_DNSWL_MED=-2.3, T_MIME_NO_TEXT=0.01] autolearn=disabled Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id NiIW8DjUAtKB for ; Sun, 13 Nov 2011 22:34:47 -0800 (PST) Received: from outgoing-mail.its.caltech.edu (outgoing-mail.its.caltech.edu [131.215.239.19]) by olra.theworths.org (Postfix) with ESMTP id BD4C6431FB6 for ; Sun, 13 Nov 2011 22:34:47 -0800 (PST) Received: from earth-doxen.imss.caltech.edu (localhost [127.0.0.1]) by earth-doxen-postvirus (Postfix) with ESMTP id 5080D66E00E4; Sun, 13 Nov 2011 22:34:45 -0800 (PST) X-Spam-Scanned: at Caltech-IMSS on earth-doxen by amavisd-new Received: from finestructure.net (cpe-76-174-136-149.socal.res.rr.com [76.174.136.149]) (Authenticated sender: jrollins) by earth-doxen-submit (Postfix) with ESMTP id 77E6F66E00CF; Sun, 13 Nov 2011 22:34:41 -0800 (PST) Received: by finestructure.net (Postfix, from userid 1000) id E747B36C; Sun, 13 Nov 2011 22:34:40 -0800 (PST) From: Jameson Graef Rollins To: Austin Clements , notmuch@notmuchmail.org Subject: Re: [PATCH] Store "from" and "subject" headers in the database. In-Reply-To: <1320599856-24078-1-git-send-email-amdragon@mit.edu> References: <1320599856-24078-1-git-send-email-amdragon@mit.edu> User-Agent: Notmuch/0.9+78~g0c48b2d (http://notmuchmail.org) Emacs/23.3.1 (x86_64-pc-linux-gnu) Date: Sun, 13 Nov 2011 22:34:38 -0800 Message-ID: <877h331abl.fsf@servo.finestructure.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature" Cc: notmuch@kismala.com X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 14 Nov 2011 06:34:48 -0000 --=-=-= Content-Transfer-Encoding: quoted-printable On Sun, 6 Nov 2011 12:17:36 -0500, Austin Clements wrot= e: > This is a rebase and cleanup of Istvan Marko's patch from > id:m3pqnj2j7a.fsf@zsu.kismala.com >=20 > Search retrieves these headers for every message in the search > results. Previously, this required opening and parsing every message > file. Storing them directly in the database significantly reduces IO > and computation, speeding up search by between 50% and 10X. Hey, Austin. This is a very nice patch. Short and sweet, a really nice performance improvement, and a nice gentle fallback. I just rebuilt my database and I can definitely see the improvements. Search results are incredibly snappy, and the resultant database is only about 8% bigger. I fully endorse this being pushed. jamie. --=-=-= Content-Type: application/pgp-signature -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.11 (GNU/Linux) iQIcBAEBCAAGBQJOwLZ+AAoJEO00zqvie6q86fUP/34JOJ9Abt0b1iMXwWw98mND p+xx9Q0dhi5zesWThXTh58dLFFpx23BzyOwBwCj7LX6MAui7+jxCqxZ8XFmjXGKd mV9SY2N3XESYZlk/Dw0YfDuH6hSKXxSJIzIyz3rIZZCOAYyxjF9NoXg1ymFV1wJz 29WkfO84H+45heEqHcS3AxZ8TtmI2W2zWocV142kzu0tMytVIsjZAfLgbuuZGVEM +tJx/JXpwkgsX1/zRNpfb7oa+QmAl/KQx4pPNSgyOCA7wYkNZCbrNB/0834Wyipg Qj6eCgoJUynpAV8sDzbeiB6lbRIhmwq+5j87vwSJBsoPQfVL+rc+aDFyGlKxwjX4 SAnF3qw2nhlFmgMdFdiZXYvcnUJd8J+wrdLwKVLKYzFmnMO55GHktaORWkba1gxm yJFTbWbps++30nva0FESucubM9EWmDkBUkcf4rvhuLMoFJyWCpQS9Qkx8TJBSL+x rJolW9b1D9vxxfzlx0A00XNXBVE9Z9wkfZT8p/mLFlw/b3VkqrnoJLtpufeE10iW EJABzBJzWC2zkdfHnx2EhfpAe+QCHiGSShWKZsDkikGbU2DYIlu6/33blRPg7Qcf EDP5YaWWTWF9caSBjWA+MyKaF1m6B4gsaugUIg/KZYKxHM0ulKYmAI/Zxz9efByC ZkAiTB9lwtPU2ASnuYsL =ia1o -----END PGP SIGNATURE----- --=-=-=--