From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms1 with LMTPS id WEJLCngFjV5QIgAAk0OIDg (envelope-from ) for ; Tue, 07 Apr 2020 22:58:00 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id KMDhJnYFjV5FHgAA1q6Kng (envelope-from ) for ; Tue, 07 Apr 2020 22:57:58 +0000 Received: from arlo.cworth.org (arlo.cworth.org [50.126.95.6]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 6823D951664 for ; Tue, 7 Apr 2020 22:57:56 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id B96A86DE13E6; Tue, 7 Apr 2020 15:57:52 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id Ra_rlKnODNy2; Tue, 7 Apr 2020 15:57:52 -0700 (PDT) Received: from arlo.cworth.org (localhost [IPv6:::1]) by arlo.cworth.org (Postfix) with ESMTP id 98A206DE13E7; Tue, 7 Apr 2020 15:57:51 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 6D3D86DE13E7 for ; Tue, 7 Apr 2020 15:57:50 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2MjikbIZk6Ov for ; Tue, 7 Apr 2020 15:57:49 -0700 (PDT) X-Greylist: delayed 2267 seconds by postgrey-1.36 at arlo; Tue, 07 Apr 2020 15:57:49 PDT Received: from thyestes.tartarus.org (thyestes.tartarus.org [5.196.91.86]) by arlo.cworth.org (Postfix) with ESMTPS id 32FDB6DE13E6 for ; Tue, 7 Apr 2020 15:57:49 -0700 (PDT) Received: from olly by thyestes.tartarus.org with local (Exim 4.92) (envelope-from ) id 1jLwZZ-0001zs-AV; Tue, 07 Apr 2020 23:19:57 +0100 Date: Tue, 7 Apr 2020 23:19:57 +0100 From: Olly Betts To: David Bremner Subject: Re: crash after running notmuch new Message-ID: <20200407221957.GD28897@survex.com> Mail-Followup-To: David Bremner , Matt , notmuch@notmuchmail.org, xapian-discuss@lists.xapian.org References: <87y2r74fde.fsf@tethera.net> <87k12r3v38.fsf@tethera.net> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <87k12r3v38.fsf@tethera.net> User-Agent: Mutt/1.10.1 (2018-07-13) X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-To: Xapian Discussion Cc: notmuch@notmuchmail.org, Matt , xapian-discuss@lists.xapian.org Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: notmuch-bounces@notmuchmail.org Sender: "notmuch" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=default; t=1586300277; h=from:from:sender:sender:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post; bh=aVQASvatl+Qss0FFXHKWgqwKiUwIaejBc8tD5m2VAwg=; b=hJmjO2aNdEWnbzFNfR1yf4W1gcmGgqiiBB7eFgyAoS9Pt3p2jUYjSOXJcv4PzqAJD+YaFE 6w6+8dPt36R3BKOUCLKeDo4NopdMM+eJSN0kOOlARNF4eorOC53wGq2rJ0C65leystY1CY siYGdlvDcpgnkmsUV67s6YBfJ3+OTjw= ARC-Seal: i=1; s=default; d=yhetil.org; t=1586300277; a=rsa-sha256; cv=none; b=hU+9oAbSIz8hnM8rqcVPkY6xUBJDR6OH6tOshiiOcoAxbD8sMSYZafgNSoOjFACcAnDIuD +EqhDC/cRlMwzOe0rj7b64sC9cVh5WyR0ltWqGZLxIgmJzt5155XMPxQOcAiUFRu+TtnS/ k4x036BSJEUvksj/PQu9g3M2geBglrM= ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 50.126.95.6 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Scanner: scn0 X-Spam-Score: -1.01 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 50.126.95.6 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Scan-Result: default: False [-1.01 / 13.00]; HAS_REPLYTO(0.00)[xapian-discuss@lists.xapian.org]; GENERIC_REPUTATION(0.00)[-0.44414178264658]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:c]; IP_REPUTATION_HAM(0.00)[asn: 27017(-0.18), country: US(-0.01), ip: 50.126.95.6(-0.44)]; ARC_SIGNED(0.00)[i=1]; MX_GOOD(-0.50)[cached: notmuchmail.org]; MAILLIST(-0.20)[mailman]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:27017, ipnet:50.126.64.0/18, country:US]; MID_RHS_MATCH_FROM(0.00)[]; FROM_NEQ_ENVFROM(0.00)[olly@survex.com,notmuch-bounces@notmuchmail.org]; ARC_NA(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; MIME_GOOD(-0.10)[text/plain]; REPLYTO_DOM_NEQ_FROM_DOM(0.00)[]; PREVIOUSLY_DELIVERED(0.00)[notmuch@notmuchmail.org]; HAS_LIST_UNSUB(-0.01)[]; DMARC_NA(0.00)[survex.com]; MIME_TRACE(0.00)[0:+]; FREEMAIL_CC(0.00)[notmuchmail.org,gmail.com,lists.xapian.org]; RCVD_COUNT_SEVEN(0.00)[8]; FORGED_SENDER_MAILLIST(0.00)[] X-TUID: 9Xh+93zQLuCt On Tue, Apr 07, 2020 at 05:21:47PM -0300, David Bremner wrote: > Matt writes: [...] > > termlist: > > blocksize=8K items=186136 firstunused=62058 revision=421 levels=2 root=12260 > > B-tree checked okay > > termlist table structure checked OK > > > > postlist: > > blocksize=8K items=2598971 firstunused=61412 revision=421 levels=2 root=49814 > > xapian-check: DatabaseCorruptError: Db block overwritten - are there > > multiple writers? > > === > > suggests there is an error but I couldn't find a fix for it. Should I > > just remove the xapian folder and rerun `notmuch new` ? > > If you have a backup of your tags from notmuch-dump, then yes that's > probably a good way forward. If you don't have a current dump, you may be able to rescue a dump of tags from a broken notmuch database using: https://git.xapian.org/?p=xapian;a=blob;f=README.notmuch;hb=refs/heads/notmuch-tag-rescue-hack That should work if the termlist table is undamaged (as the above appears to show), and may work even if it's damaged. > I've put the xapian developers in copy in > case they are interested in trying to debug this corruption. For those > just joining us, this is notmuch 0.29.3 linked against xapian 1.4.15 Was the database created with 1.4.15 too? If it's reproducible, I'm definitely interested. If it isn't reproducible (and/or the data is sensitive) it's much more difficult to usefully investigate. And it may also be due to a non-Xapian issue (a bug in something else or a hardware problem). Cheers, Olly