From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id 7EC9C431FB6 for ; Wed, 5 Dec 2012 04:23:49 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: 0 X-Spam-Level: X-Spam-Status: No, score=0 tagged_above=-999 required=5 tests=[none] autolearn=disabled Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id mStgE4Xftv9Y for ; Wed, 5 Dec 2012 04:23:48 -0800 (PST) Received: from tesseract.cs.unb.ca (tesseract.cs.unb.ca [131.202.240.238]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by olra.theworths.org (Postfix) with ESMTPS id 60A9A431FAE for ; Wed, 5 Dec 2012 04:23:48 -0800 (PST) Received: from fctnnbsc30w-142167090129.dhcp-dynamic.fibreop.nb.bellaliant.net ([142.167.90.129] helo=zancas.localnet) by tesseract.cs.unb.ca with esmtpsa (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:16) (Exim 4.72) (envelope-from ) id 1TgE0x-0001QM-3W; Wed, 05 Dec 2012 08:23:47 -0400 Received: from bremner by zancas.localnet with local (Exim 4.80) (envelope-from ) id 1TgE0r-00029f-J4; Wed, 05 Dec 2012 08:23:41 -0400 From: David Bremner To: Austin Clements , notmuch@notmuchmail.org Subject: Re: [PATCH 3/4] perf-test: unpack tags. In-Reply-To: <87pq2pcbsl.fsf@awakening.csail.mit.edu> References: <1354583824-10520-3-git-send-email-david@tethera.net> <1354594712-5179-1-git-send-email-david@tethera.net> <1354594712-5179-3-git-send-email-david@tethera.net> <87pq2pcbsl.fsf@awakening.csail.mit.edu> User-Agent: Notmuch/0.14+75~g984212d (http://notmuchmail.org) Emacs/24.1.1 (x86_64-pc-linux-gnu) Date: Wed, 05 Dec 2012 08:23:41 -0400 Message-ID: <87zk1swuuq.fsf@zancas.localnet> MIME-Version: 1.0 Content-Type: text/plain X-Spam_bar: - X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 05 Dec 2012 12:23:49 -0000 Austin Clements writes: > On Mon, 03 Dec 2012, david@tethera.net wrote: >> From: David Bremner >> >> It's a bit annoying to call tar twice, but we cache the results so it >> isn't as bad as it could be. > Why not --strip-components=1 and unpack both mail/ and tags/ into a > single, shared corpus cache directory in one call to tar? Since you're > going to cp -lr things anyway, you can structure the corpus cache > however is convenient. It's a good suggestion. The only downside is duplicating the tags. I suppose on the scale of things that isn't a very big waste of space; the tag corpus is currently 300k, which is dwarfed by even the "small" corpus. d