From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id iJurOjzEvGBrVQAAgWs5BA (envelope-from ) for ; Sun, 06 Jun 2021 14:49:00 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id GEb9NTzEvGB5UQAAB5/wlQ (envelope-from ) for ; Sun, 06 Jun 2021 12:49:00 +0000 Received: from mail.notmuchmail.org (nmbug.tethera.net [144.217.243.247]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 6622712514 for ; Sun, 6 Jun 2021 14:49:00 +0200 (CEST) Received: from nmbug.tethera.net (localhost [127.0.0.1]) by mail.notmuchmail.org (Postfix) with ESMTP id 85C3529C43; Sun, 6 Jun 2021 08:48:54 -0400 (EDT) Received: from mail-wm1-x32a.google.com (mail-wm1-x32a.google.com [IPv6:2a00:1450:4864:20::32a]) by mail.notmuchmail.org (Postfix) with ESMTPS id BE89F27185 for ; Sun, 6 Jun 2021 08:48:51 -0400 (EDT) Received: by mail-wm1-x32a.google.com with SMTP id k5-20020a05600c1c85b02901affeec3ef8so409960wms.0 for ; Sun, 06 Jun 2021 05:48:51 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=pneC9UnsdF5UOJ2BRor0LJf4HD/HY6Eyj6Rx0XbIcWE=; b=kg/I37HSMLxFIzlAKOr3qz8eM9uaA0vUYysTeoZC2F62+vZjeu/QaYTFFZGoYsN3pg rgSqlv+bWJHb7DNEKe5bo1UmJdjWueCziH+pj4NuK/3BZiEmllGIQhYIID8zWQ8n0UBN jEEY7vFia8gbTtvJ+uzZaeCqiaoIEN17Soh2fdReGM5OmTS9tNl1hR0fMi7bmTdsn3k2 vI9sWQq8OpY9FjC9nyoaHHowLegy5Eumb0iVYaTRgsPkIKKYa3hz8s+Sbuqk4dYNURrp sa3qcxnVoPhSFQN9Anywrkjm8IYUGQw+T2QURNgTxkIDl8CPjZc+5nM8JAbarK9+CYo9 xRmg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=pneC9UnsdF5UOJ2BRor0LJf4HD/HY6Eyj6Rx0XbIcWE=; b=s2e+tRk26nt+fFQKdw8VnVl3vYG0fJ4imiro8ZFcmv4svPcEI1WXhQA7DK82g5+t0P IdWTcqNJ/HBwkVWnHfVAMcSkn+nyS4XUIjYP/qIJxsleS409N1etGwWSRQx+eLWdLeAT smadWjdii6Uc5qP73h1PsfeXQqn2Wn6L6GZC4cuAY3lUDeU9L++9g/TPhQsNRHAcDUOo 7o+2OeHclV8B+bBUvRmANpq8OcmiznXYDp/iHNLtiCOvcRVAMAu6M8wkyMjW6OFfIGtt nwi7dBud5rVYpZEclEUsqPE8hOQOlD3E35sSp/oHhFe0l/vx6LlEm7oIYalidwO/EHgx xOaw== X-Gm-Message-State: AOAM531avJtDfcP5/6INBkxP7JZ480tbGSMG6C1zIYrGMyKkcn41Ea4q vRU2S5YLeVaIbjVhtMiozzuDowD64aLy0iee/3Y= X-Google-Smtp-Source: ABdhPJytBElClhJNKuXijVtE8Y0lVxFv2pI2t74HmEYaSj/GtXHsrmTwITrzng4DPZuS7XyZcMkMJd4pHimC6y//D8Y= X-Received: by 2002:a1c:6a14:: with SMTP id f20mr12350690wmc.37.1622983730535; Sun, 06 Jun 2021 05:48:50 -0700 (PDT) MIME-Version: 1.0 References: <8735txjdmc.fsf@tethera.net> <20210605024316.GC9932@survex.com> <20210606014517.GD9932@survex.com> <20210606100851.GA18586@survex.com> In-Reply-To: <20210606100851.GA18586@survex.com> From: Felipe Contreras Date: Sun, 6 Jun 2021 07:48:39 -0500 Message-ID: Subject: Re: How to recover from this permanent fatal error? To: Xapian Discussion , Felipe Contreras , David Bremner , "notmuch@notmuchmail.org" Message-ID-Hash: XJEIUNKONLECT3VN4OIS45BX33YS5GQ6 X-Message-ID-Hash: XJEIUNKONLECT3VN4OIS45BX33YS5GQ6 X-MailFrom: felipe.contreras@gmail.com X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-notmuch.notmuchmail.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; suspicious-header X-Mailman-Version: 3.2.1 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Help: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1622983740; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=bagpabQC7wxravt7FamsW3gqUxmkPneAwjTQDYmsSk4=; b=GLrlBeMHNdoNIJ+A4bxGT6NLlFKHlWl6JQ5TCAHLZEqUc8m6WoGc10mJN3uQxPkC1J2Tm/ LJ5NR3gjTAIwtWq9h97ah0Xd8oeHkHe0qoaxvmj37Ujy2EQjWBnjswfkWASUFEBmIb10S7 P1uwmpN2pMz3+B9DPEcg4gjX1r/Q/jTI7mbTUIP11hJp4P/Qnn4TvVilgQfip4NV8kPWHK //VYCphX5hVABhmzQSzIU3fYkpw6Hdhd0S/YDxWtLkQm0SRc1jZNV4L9/Ap2ckvvIuZUYT 5x3V0HC9PCv5KOHMNEnuI71TBInf38lmuSNRbQPBjEa1UVh12QXSjubyOqT07A== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1622983740; a=rsa-sha256; cv=none; b=Q5RDfXQlLY9qzf8g/wOS2kCBT3Ld1X2CQ/tyXDfA2pdN1Gw1sIu9mcR5Ng7CplG9mf/CIz 2ZbvQuU52ZYjJU0VVDSJpsbH/PrKspnKZFlrzgUQAIYFbDVPm/bcgIo/AKxSf/TA7p/go4 TDxI8WeK5uacayNRltpqdMjw/sWMxECUhRv16Lad9tZCDwUncRBs7nzhv5IKi5A2HIXYXG sa5Q3CzuBr990gqZA0onUlrg68Xp4MeJhNUE1zNtx0eqGc6AngNmPcWpYxvoJ9dbNmYq/D tNSoQpcoCMhc7GT3JrI1Zv44o2QgqxXIlyfHMK288Jzi8nmIV0thjhw4NKIG3Q== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=gmail.com header.s=20161025 header.b="kg/I37HS"; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 144.217.243.247 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Spam-Score: 1.59 Authentication-Results: aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=gmail.com header.s=20161025 header.b="kg/I37HS"; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 144.217.243.247 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Queue-Id: 6622712514 X-Spam-Score: 1.59 X-Migadu-Scanner: scn0.migadu.com X-TUID: TzMunK6srOIE On Sun, Jun 6, 2021 at 5:08 AM Olly Betts wrote: > You could try commenting out the body of GlassTable::set_overwritten() > in xapian-core/backends/glass/glass_table.cc so it keeps going instead > of throwing this exception, which might allow it to usefully recover > some or all tags. If you (or anyone) try that and it works let me know > and I can patch the branch to emit a warning message and continue there. Now I get this: termlist: blocksize=8K items=687440 firstunused=152676 revision=2 levels=2 root=749 /home/felipec/contrib/xapian/xapian-core/bin/.libs/lt-xapian-check: DatabaseError: Block 152676: used more than once in the Btree -- Felipe Contreras