From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 7798E6DE0262 for ; Sat, 7 Apr 2018 03:51:27 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org X-Spam-Flag: NO X-Spam-Score: 0 X-Spam-Level: X-Spam-Status: No, score=0 tagged_above=-999 required=5 tests=[AWL=0.011, SPF_PASS=-0.001, T_RP_MATCHES_RCVD=-0.01] autolearn=disabled Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Kj2TpEh9hE9h for ; Sat, 7 Apr 2018 03:51:26 -0700 (PDT) Received: from fethera.tethera.net (fethera.tethera.net [198.245.60.197]) by arlo.cworth.org (Postfix) with ESMTPS id 7AEF76DE0260 for ; Sat, 7 Apr 2018 03:51:26 -0700 (PDT) Received: from remotemail by fethera.tethera.net with local (Exim 4.89) (envelope-from ) id 1f4lRJ-0001O8-J2; Sat, 07 Apr 2018 06:51:21 -0400 Received: (nullmailer pid 17031 invoked by uid 1000); Sat, 07 Apr 2018 10:51:20 -0000 From: David Bremner To: Javier Garcia , notmuch@notmuchmail.org Cc: xapian-discuss@lists.xapian.org, Patrick Totzke , Justus Winter Subject: Re: Database corruption after clean rebuild In-Reply-To: References: <8a311263-a46f-3327-4054-d8d863fa0169@gmail.com> <874lknwztk.fsf@tethera.net> X-List-To: notmuch Date: Sat, 07 Apr 2018 07:51:20 -0300 Message-ID: <87y3hzuw5z.fsf@tethera.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Apr 2018 10:51:27 -0000 Javier Garcia writes: > I've applied the path to notmuch 0.26.1 without success. > > $ rm -rf ~/.mail/.notmuch > $ LD_LIBRARY_PATH=3D/hidden-path/notmuch-0.26.1/lib/:$LD_LIBRARY_PATH > ./notmuch new > =C2=A0=C2=A0 Found 20065 total files (that's not much mail). > =C2=A0=C2=A0 Processed 20065 total files in 58s (341 files/sec.). > =C2=A0=C2=A0 Added 19605 new messages to the database. > > $ xapian-check .mail/.notmuch/xapian/ > =C2=A0=C2=A0 docdata: > =C2=A0=C2=A0 blocksize=3D8K items=3D63 firstunused=3D1 revision=3D2 level= s=3D0 root=3D0 > =C2=A0=C2=A0 B-tree checked okay > =C2=A0=C2=A0 docdata table structure checked OK > =C2=A0=C2=A0 termlist: > =C2=A0=C2=A0 blocksize=3D8K items=3D43520 firstunused=3D8293 revision=3D2= levels=3D2 root=3D748 > =C2=A0=C2=A0 xapian-check: DatabaseError: 1 unused block(s) missing from = the free > list, first is 0 OK, so probably not related to reference loops (although that patch is not very well tested). It's not clear how notmuch is triggering it, but this looks like the same bug in Xapian that olly fixed recently [1]. A possible next step is to try building xapian master, and linking notmuch against that. Maybe Patrick or Justus (in copy) has some idea why you're only seeing problems in afew. Another debugging direction is to try to duplicate your problem with some subset of mail that you're willing to share (bisection is the usual strategy). [1] https://notmuchmail.org/pipermail/notmuch/2018/026369.html