From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 4A9416DE0238 for ; Sun, 1 Jul 2018 10:13:06 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org X-Spam-Flag: NO X-Spam-Score: -0.001 X-Spam-Level: X-Spam-Status: No, score=-0.001 tagged_above=-999 required=5 tests=[SPF_PASS=-0.001] autolearn=disabled Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id E0k5O6PNzkaQ for ; Sun, 1 Jul 2018 10:13:04 -0700 (PDT) X-Greylist: delayed 3780 seconds by postgrey-1.36 at arlo; Sun, 01 Jul 2018 10:13:03 PDT Received: from slow1-d.mail.gandi.net (mslow2.mail.gandi.net [217.70.178.242]) by arlo.cworth.org (Postfix) with ESMTPS id DA4846DE01CE for ; Sun, 1 Jul 2018 10:13:03 -0700 (PDT) Received: from relay5-d.mail.gandi.net (unknown [217.70.183.197]) by slow1-d.mail.gandi.net (Postfix) with ESMTP id 888C23A4A1C for ; Sun, 1 Jul 2018 17:36:33 +0200 (CEST) X-Originating-IP: 76.102.151.26 Received: from localhost (c-76-102-151-26.hsd1.ca.comcast.net [76.102.151.26]) (Authenticated sender: leonard@lausen.nl) by relay5-d.mail.gandi.net (Postfix) with ESMTPSA id 30E391C0004 for ; Sun, 1 Jul 2018 15:36:26 +0000 (UTC) From: Leonard Lausen To: notmuch@notmuchmail.org Cc: Subject: Re: Bug: fatal error with notmuch new, second run starts indexing all over again In-Reply-To: <20170714212703.wn5ben7tygr7c6sx@len.workgroup> References: <20170706093101.cdjxdgvfy57a3kkb@len.workgroup> <87o9st3hz0.fsf@tethera.net> <20170709142147.czeett6stskxrnkp@len.workgroup> <87k23h3cgg.fsf@tethera.net> <20170713070444.tr4n2yfot5t4j663@len.workgroup> <87bmooebfs.fsf@tethera.net> <20170713135947.nqdagxnxe5sdubko@len.workgroup> <87y3rsp517.fsf@tesseract.cs.unb.ca> <20170714101436.dnacwh3rbwva5htp@len.workgroup> <878tjre0f6.fsf@tethera.net> <20170714212703.wn5ben7tygr7c6sx@len.workgroup> Date: Sun, 01 Jul 2018 15:36:23 +0000 Message-ID: <87tvpjhsso.fsf@lausen.nl> MIME-Version: 1.0 Content-Type: text/plain X-Mailman-Approved-At: Mon, 02 Jul 2018 09:10:34 -0700 X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.26 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 01 Jul 2018 17:13:06 -0000 I also experience this error trying to import the emacs-orgmode mailing list archive. Has there been any progress on fixing the issue? What steps should be taken to help? Also it seems that the midsize corpus https://giku.de/reduced-sample-midsized.xapian-exeption.tar.xz is not available anymore. David introduced a patch to improve the error message, below I paste the message I get: add_file: A Xapian exception occurred A Xapian exception occurred adding message: Unexpected end of posting list for 'G00000000000255c6'. Processed 4949 total files in 10m 13s (8 files/sec.). Added 4921 new messages to the database. Note: A fatal error was encountered: A Xapian exception occurred Gregor Zattler writes: > Hi David, > * David Bremner [14. Jul. 2017]: >> Gregor Zattler writes: >>> I redid the test on this mid-sized corpus and I got an >>> exeption (again): >> [snip] >>> Error: A Xapian exception occurred. Halting processing. >>> Processed 27611 total files in 21m 2s (21 files/sec.). >>> Added 27481 new messages to the database. >>> Note: A fatal error was encountered: A Xapian exception occurred >>> [Inferior 1 (process 6752) exited with code 01] >>> (gdb) >> >> I can finally replicate the crash. I do crash in a different place >> (after processing 25184 files), so it suggests a certain non-determinism >> or dependence on the host configuration. > > I would assume the first difference is in the file system: > Perhaps the files are accessed in a different order!? > >> Anyway, now that I have a test case, I'll try and figure out what the >> underlying Xapian exeception is. > > > Thanks. > > Ciao, Gregor > -- > -... --- .-. . -.. ..--.. ...-.-