From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id A05E9431FB6 for ; Mon, 10 Dec 2012 03:50:17 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: 0 X-Spam-Level: X-Spam-Status: No, score=0 tagged_above=-999 required=5 tests=[none] autolearn=disabled Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id xZ1fSVOO-Yju for ; Mon, 10 Dec 2012 03:50:16 -0800 (PST) Received: from tesseract.cs.unb.ca (tesseract.cs.unb.ca [131.202.240.238]) (using TLSv1 with cipher AES256-SHA (256/256 bits)) (No client certificate requested) by olra.theworths.org (Postfix) with ESMTPS id B5DC8431FAF for ; Mon, 10 Dec 2012 03:50:16 -0800 (PST) Received: from fctnnbsc30w-142167090129.dhcp-dynamic.fibreop.nb.bellaliant.net ([142.167.90.129] helo=zancas.localnet) by tesseract.cs.unb.ca with esmtpsa (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:16) (Exim 4.72) (envelope-from ) id 1Ti1sF-00081S-7h; Mon, 10 Dec 2012 07:50:15 -0400 Received: from bremner by zancas.localnet with local (Exim 4.80) (envelope-from ) id 1Ti1s9-0005Rf-MH; Mon, 10 Dec 2012 07:50:09 -0400 From: David Bremner To: Petter Reinholdtsen , notmuch@notmuchmail.org Subject: Re: 'notmuch new' leaking memory and getting slower over time? In-Reply-To: <2flfwhht87d.fsf@diskless.uio.no> References: <2flfwhht87d.fsf@diskless.uio.no> User-Agent: Notmuch/0.14+151~g9a98977 (http://notmuchmail.org) Emacs/24.1.1 (x86_64-pc-linux-gnu) Date: Mon, 10 Dec 2012 07:50:09 -0400 Message-ID: <87hanup1n2.fsf@zancas.localnet> MIME-Version: 1.0 Content-Type: text/plain X-Spam_bar: - X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 10 Dec 2012 11:50:17 -0000 Petter Reinholdtsen writes: > Running 'notmuch restore' to get my tags back took 106 minutes, and I > was very surprised that the restore could not load all the tags stored > by 'notmuch dump'. The restore complained about this line: > > NO*TELEMAX**NORWAYII M0018001012307699038 (unread usit year-2002) > > The message in question is a bounce from some X400 mail system, and its > message id look like this: > > Message-Id: > > I would like 'notmuch new' to use less memory and be better at > estimating the time left, and would also like 'notmuch restore' to > always be able to load the output from 'notmuch dump'. As of git commit 0.14-162-g5c7990f, notmuch supports a new dump restore format 'batch-tag' that can handle these message-id's. See the man pages for more details. I'm marking this bug as fixed; feel free to let us know of any problems with the new batch-tag format. d