From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from localhost (localhost [127.0.0.1]) by olra.theworths.org (Postfix) with ESMTP id A83CB431FAF for ; Tue, 11 Dec 2012 05:47:36 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at olra.theworths.org X-Spam-Flag: NO X-Spam-Score: -0.1 X-Spam-Level: X-Spam-Status: No, score=-0.1 tagged_above=-999 required=5 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_NONE=-0.0001] autolearn=disabled Received: from olra.theworths.org ([127.0.0.1]) by localhost (olra.theworths.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id P8MFP3DA-J8X for ; Tue, 11 Dec 2012 05:47:36 -0800 (PST) Received: from homiemail-a3.g.dreamhost.com (caiajhbdcbbj.dreamhost.com [208.97.132.119]) by olra.theworths.org (Postfix) with ESMTP id 3BCF8431FAE for ; Tue, 11 Dec 2012 05:47:36 -0800 (PST) Received: from homiemail-a3.g.dreamhost.com (localhost [127.0.0.1]) by homiemail-a3.g.dreamhost.com (Postfix) with ESMTP id 5B6F9284081 for ; Tue, 11 Dec 2012 05:47:34 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=zx2c4.com; h=mime-version :date:message-id:subject:from:to:cc:content-type; s=zx2c4.com; bh=Bz6umJ0e+4OSH3CoxHUjHeD/DFQ=; b=B6CoOxB2lfjsNXaaTImelAsK32jw c1pjg1gA3MI6wbjQSrhQpJf4Px7QKG8US9v5pH+vOWM2P0drk+InPzIuUnQ82TYT jHzYgWBjMuBqC+uolievtxQBIU8Ou99qW+98Tnq7qnsIza3qtmxeDgt5fvyYe0UQ iFTa2dehlX4xwZg= Received: from mail-oa0-f53.google.com (mail-oa0-f53.google.com [209.85.219.53]) (using TLSv1 with cipher RC4-SHA (128/128 bits)) (No client certificate requested) (Authenticated sender: jason@zx2c4.com) by homiemail-a3.g.dreamhost.com (Postfix) with ESMTPSA id 36CDA284076 for ; Tue, 11 Dec 2012 05:47:34 -0800 (PST) Received: by mail-oa0-f53.google.com with SMTP id j6so3463965oag.26 for ; Tue, 11 Dec 2012 05:47:33 -0800 (PST) MIME-Version: 1.0 Received: by 10.60.30.70 with SMTP id q6mr9089028oeh.103.1355233652683; Tue, 11 Dec 2012 05:47:32 -0800 (PST) Received: by 10.76.33.70 with HTTP; Tue, 11 Dec 2012 05:47:32 -0800 (PST) Date: Tue, 11 Dec 2012 14:47:32 +0100 Message-ID: Subject: notmuch python bindings corrupt db index (was: gmail importer script) From: "Jason A. Donenfeld" To: Patrick Totzke Content-Type: text/plain; charset=ISO-8859-1 Cc: notmuch@notmuchmail.org X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 11 Dec 2012 13:47:36 -0000 On Tue, Dec 11, 2012 at 11:04 AM, Patrick Totzke wrote: > I ended up killing the process after i saw that ETA was >3h. Gmail's bottleneck. Very unfortunate. Leave it going over night. > This broke my index! > > afterwards, a `notmuch new` printed > > A Xapian exception occurred creating a directory: Expected block > 485 to be level 1, not 0. > > I wasnt able to properly read the index anymore and had to > restore an old index dump. not cool! Can you provide any more information about this? The script properly uses atomic transactions. Any corruption here is the result of a notmuch library bug, which should be investigated.