From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id aO71A5wSRWCrCgAA0tVLHw (envelope-from ) for ; Sun, 07 Mar 2021 17:51:24 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id 0ANpO5sSRWCnHAAAbx9fmQ (envelope-from ) for ; Sun, 07 Mar 2021 17:51:23 +0000 Received: from mail.notmuchmail.org (nmbug.tethera.net [IPv6:2607:5300:201:3100::1657]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (2048 bits) server-digest SHA256) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id B0FD524D01 for ; Sun, 7 Mar 2021 18:51:23 +0100 (CET) Received: from nmbug.tethera.net (localhost [127.0.0.1]) by mail.notmuchmail.org (Postfix) with ESMTP id 3551927C54; Sun, 7 Mar 2021 12:51:18 -0500 (EST) Received: from fethera.tethera.net (fethera.tethera.net [IPv6:2607:5300:60:c5::1]) by mail.notmuchmail.org (Postfix) with ESMTP id 2284F27BC0 for ; Sun, 7 Mar 2021 12:51:16 -0500 (EST) Received: by fethera.tethera.net (Postfix, from userid 1001) id 090325FA96; Sun, 7 Mar 2021 12:51:16 -0500 (EST) Received: (nullmailer pid 1099298 invoked by uid 1000); Sun, 07 Mar 2021 17:51:14 -0000 From: David Bremner To: Matt Armstrong , notmuch@notmuchmail.org Subject: Re: Notmuch and backups In-Reply-To: <87pn0cm8gy.fsf@mdeb> References: <20210217201045.2021106-1-david@tethera.net> <87pn0cm8gy.fsf@mdeb> Date: Sun, 07 Mar 2021 13:51:14 -0400 Message-ID: <87h7lmj1il.fsf@tethera.net> MIME-Version: 1.0 Message-ID-Hash: PFKDXZOSWI4TGFBKUH4MH3YNCMDAPT7A X-Message-ID-Hash: PFKDXZOSWI4TGFBKUH4MH3YNCMDAPT7A X-MailFrom: david@tethera.net X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-notmuch.notmuchmail.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; suspicious-header X-Mailman-Version: 3.2.1 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Help: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1615139483; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post; bh=kb6RuSEft+SHY7Tdk/3tt3r0FvYGqDSaPaCMNrOOGJM=; b=I5UrWK9lQxPb+eJzXCok0n6g0BiOFQCNxwcuKpYQ2YMZUyy42F30pTSPr44yaWjLSyIDYY 40tWegq30XKJmZ7St0EJl+DuMe9x5ApN3PZ+w8b6gwsjBhb11p7nAFPXPmm0w+Wpk9OkKP lKFEnhtOKPNTOkM9CYsqr9tIRgxv9xwReTA05jZPPwm8bdaFvx6dNJ+p0HC7/2j2Xxogj/ t1rMgSmYMXYQ0HQxoeBsaZqyEnRM6u4zwqBrH03dQtSP/rLteXnkP4sa8UR3BsgCRWr2IO 02HDCtIkqN29XvHufuhRgxQrPOkZdRRENOTE8rGu4yZoZG4fMv9PkhzTAnqNmw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1615139483; a=rsa-sha256; cv=none; b=TxFax48/CEsKXz2y2q3L4/5l7BF6Foc76BdtAmW7m0IFlxwqzMoEdcAPDjED1QVPzxVljG DQ43Wn5pIGKwPn9CCofit0l49/U/bfMXPDzq7NHHG4O1OYPnmt+fu+6ECALp+unhmj7ulD omEBRppETEx7DDaooaUzg7FZGS+1ogX9w9sgV6AfzECKS/zwzE8Nx/pxoYlp4DHWqGnKRf XuGAzg+uSpQla+kz4D1IEMnqCwlzkdwg+PKCBbAWGmO9Qoofzx7lzWwvgKQx0Q8kyUYNzV Ojhwb2+ETX6+NVNxKQYnbQWtBqK8OOh+m0WJMSk69PtwsZKyOdv4BD5mtn4DUw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 2607:5300:201:3100::1657 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Spam-Score: -1.75 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 2607:5300:201:3100::1657 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Queue-Id: B0FD524D01 X-Spam-Score: -1.75 X-Migadu-Scanner: scn1.migadu.com X-TUID: RmhA4VedpOZ+ Matt Armstrong writes: > > David, your recent changes that allow configurable separation of the > mail store and .notmuch files look like good ideas to me. Thanks! > Separately, I've recently set up backups of my system and noticed that > the Xapian files are an order of magnitude larger than the notmuch dumps > (3.6 GiB vs. 15 MiB). Is there any turn key code in notmuch itself to > keep a rolling set of "recent" notmuch dumps? > There is nothing turnkey. One thing that might be of interest is the ability to do incremental backups via lastmod: queries. This would require seperately tracking the output of "notmuch count --lastmod '*'. It's not clear the extra complexity is worth for daily backups. Personally I backup tags indirectly as part of a tag synchronization script called "gitmuch" that I write many years ago. Others report doing the same thing with nmbug, which is shipped with notmuch source. d