From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id WOQoE2sRF2ARDAAA0tVLHw (envelope-from ) for ; Sun, 31 Jan 2021 20:22:03 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id INTjDmsRF2D5fAAAbx9fmQ (envelope-from ) for ; Sun, 31 Jan 2021 20:22:03 +0000 Received: from mail.notmuchmail.org (nmbug.tethera.net [144.217.243.247]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (2048 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 6620B940251 for ; Sun, 31 Jan 2021 20:22:01 +0000 (UTC) Received: from nmbug.tethera.net (localhost [127.0.0.1]) by mail.notmuchmail.org (Postfix) with ESMTP id BC58D28CD0; Sun, 31 Jan 2021 15:21:52 -0500 (EST) Received: from mout.gmx.net (mout.gmx.net [212.227.15.19]) by mail.notmuchmail.org (Postfix) with ESMTPS id 9A32B28CCB for ; Sun, 31 Jan 2021 15:21:49 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net; s=badeba3b8450; t=1612124506; bh=Jj0Lj77jErtAHnyPNXivaCjE74gVAdHgMMPFnMXjv+w=; h=X-UI-Sender-Class:Date:From:To:Subject:References:In-Reply-To; b=lz3CHLHeVd0pgv5y9NYWMuIvUtuuuZwrAgCJf1TkbiReDa6pfbHKClpvwAEMw0Awu Q/0JT/UQez2CQjibXtASZQ2o6T8iGqpBHiD9cPFoAOxO/8fZum69F+PmESSXg5byRm iN76fCOYyS7jBKg76V0+sNKu7UDFtT4p3HFbHGEQ= X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c Received: from no.workgroup ([84.185.97.253]) by mail.gmx.net (mrgmx005 [212.227.17.190]) with ESMTPSA (Nemesis) id 1MUosN-1lWXBz28sz-00QipA for ; Sun, 31 Jan 2021 21:21:46 +0100 Date: Sun, 31 Jan 2021 21:21:39 +0100 From: Gregor Zattler To: notmuch Subject: Re: out of memory on idle machine Message-ID: <20210131202139.GC5640@no.workgroup> Mail-Followup-To: notmuch References: <20201213131909.GD21521@no.workgroup> <87zh2hhk15.fsf@tethera.net> <20201213141543.GE21521@no.workgroup> <20201213151336.GF21521@no.workgroup> <20201213212252.GH21521@no.workgroup> <20201214192251.GA7858@no.workgroup> <20210130085432.GA14025@no.workgroup> <87bld6shrk.fsf@tethera.net> <20210131081638.GA5640@no.workgroup> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <20210131081638.GA5640@no.workgroup> X-Provags-ID: V03:K1:FwqwgwORsvJQPjrHPtK73d+k0E32wtFeKb8+bC7Chk7iFUBX+zN 3KaOdkK0M8AuFxmfOx6Aod/AH9MRMx5IGtoFTOw+dTheicIVdn0r5pL7OOW7gc07dcrv5aW mlD7hO8RWuEC3Amc7zfZtecHfjiL7s2hUN8Jh9XWfko2k6yg18cgzJoYrrwn+2cRzwXh2Cb LSWfNnKkhaHHEzXHp+IzQ== X-Spam-Flag: NO X-UI-Out-Filterresults: notjunk:1;V03:K0:/4A/KggQZ4c=:nMcSu3PNp7bS4UdBrMYWh9 IicHwh8SvzgOPpDhg4SGWnq+zTzPDgvVMRb8Irdk7NhPRjS9F0xbIpvRrk45p9dFV7yZrNeuv vzGCNVctnKa4p4bxHIc8zRekl275ZTi9ceeyrmPSqSmrYWKRY/bC6QLdAGpVrhd6QW5RXFQtU qU7uhMP8fTSCLdxXKPRI+5YO4gV7clwPXtBPmRBaywpbGXAlfiMYArOPYTar8AYlHaeMPTita 29+WybXYae9mZcmJgtFAaJwMZdlF8SLGy1MNCsrACF327sfdxKIIsbHBQvx9PwcVMyG4ycBZx zs4MZZskXt4Do21dpQCHu6+vh12oHvNYsgtLGmpENg6rBwhFiZ83B/lqRJlcsHOITqBGZmdYs K/aeI7eMM8k7aa/xUdWpAKVoCkWCQxWHCrvIfNBuptlRmEJNEndPslCudSxtT6Nkn61cMJ+bH JCA8oB+djVPfpXWTermAHoTR7OAW3XftdzmkxaCn5rCZrXCM+l5yqG59YLT1ouykKxTJ1YzU2 wBM6eAByTie8WDdWT1Qyk6HmTihMPrRv+82VgpUiOSCwX5tGkdodrPxvjxCmZHZ3SPNCpxcRm POvdGi5eNqqbKGQuZFM9FjG9cn0+OT8wa9zDdXLXsq+V39qYh5fV5Un69IwzI2TAkLMUmo+Fv rP2MS1hGroE74YL0tvUjeO/WxAOIfIxNbTOzGL0OTdLtdL0v7paVaTwB+JKwPBQzkrzSGjinR yxiPwRF2I8ohS8lQas7Oo3TEyjXN+m1KKi6th9RsAgQN1M8yktrmh5ALK2uCQU9YpAw1m7quB OWFbMtM12PHluHiLlaKwXodR7fflqqIQMHrUQn4x/zhNLJ9TMW+8quNbu+ASUI50O9MllHr2U U5rPM5M/3hqoEjRcmwHwbXEeCsSUkb4Q24mUrLE+ybeBrFk7DsTu/FrGIApQFZ Message-ID-Hash: IL7MAP6NU6CGGB7JWJFO6P5PIT6OLMEN X-Message-ID-Hash: IL7MAP6NU6CGGB7JWJFO6P5PIT6OLMEN X-MailFrom: telegraph@gmx.net X-Mailman-Rule-Misses: dmarc-mitigation; no-senders; approved; emergency; loop; banned-address; member-moderation; header-match-notmuch.notmuchmail.org-0; nonmember-moderation; administrivia; implicit-dest; max-recipients; max-size; news-moderation; no-subject; suspicious-header X-Mailman-Version: 3.2.1 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Help: List-Post: List-Subscribe: List-Unsubscribe: Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -0.96 Authentication-Results: aspmx1.migadu.com; dkim=fail ("body hash did not verify") header.d=gmx.net header.s=badeba3b8450 header.b=lz3CHLHe; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmx.net (policy=none); spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 144.217.243.247 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Migadu-Queue-Id: 6620B940251 X-Spam-Score: -0.96 X-Migadu-Scanner: scn0.migadu.com X-TUID: BNXog6MuiBQ8 Hi David, notmuch developers, * Gregor Zattler [31. Jan. 2021]: > I'll redo idea #2 on my laptop and will report it's results. Now on the laptop: grfz@no:~/Mail/.notmuch$ nice ionice -c 3 notmuch new Welcome to a new version of notmuch! Your database will now be upgraded. This process is safe to interrupt. Backing up tags to /home/grfz/Mail/.notmuch/dump-20210131T080546.gz... Your notmuch database has now been upgraded. Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607940473.9509_1.no:2,S Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607943993.24776_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607947606.8134_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1611742380.14576_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607969276.21046_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607972847.4857_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607976389.23296_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607979988.4942_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607983586.19063_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607987211.1395_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/drafts.mbox Processed 1184742 total files in 3h 33m 35s (92 files/sec.). Added 1115147 new messages to the database. 0 (master *) grfz@no:~/Mail/.notmuch$ stat --format "%Y" ~/Mail/inbox/cur 1612091679 0 (master *) grfz@no:~/Mail/.notmuch$ stat --format "%y" ~/Mail/inbox/cur 2021-01-31 12:14:39.771049424 +0100 0 (master *) grfz@no:~/Mail/.notmuch$ 0 (master *) grfz@no:~/Mail/.notmuch$ quest -bdir:XDIRECTORY -d ~/Mail/.notmuch/xapian/ dir:inbox/cur bash: quest: command not found 127 (master *) grfz@no:~/Mail/.notmuch$ quest -bdir:XDIRECTORY -d ~/Mail/.notmuch/xapian/ dir:inbox/cur Parsed Query: Query(0 * XDIRECTORYinbox/cur) MSet: 1114128: [0] inbox/cur 0 (master *) grfz@no:~/Mail/.notmuch$ xapian-delve -r 1114128 -VS0 ~/Mail/.notmuch/xapian Value 0 for record #1114128: 1.61208e+09 Term List for record #1114128: XDDIRENTRY1114127:cur XDIRECTORYinbox/cur So I think that's OK on my laptop, after the first notmuch new. Now I do another one. 0 (master *) grfz@no:~/Mail/.notmuch$ nice ionice -c 3 notmuch new Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607940473.9509_1.no:2,S Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607943993.24776_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607947606.8134_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607969276.21046_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607972847.4857_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607976389.23296_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607979988.4942_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607983586.19063_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607987211.1395_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1611742380.14576_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/drafts.mbox Processed 121712 total files in 45m 4s (45 files/sec.). Added 85345 new messages to the database. Removed 3 messages. 0 (master *) grfz@no:~/Mail/.notmuch$ The Problem remains, but at a different scale: In between these two notmuch new runs there were only a few hours, there's no way I received 121712 or 85345 emails in this time frame. 0 (master *) grfz@no:~/Mail/.notmuch$ nice ionice -c 3 notmuch new Note: Ignoring non-mail file: /home/grfz/Mail/spam/new/1612101986.719_1.no Note: Ignoring non-mail file: /home/grfz/Mail/spam/new/1612105584.10821_1.no Note: Ignoring non-mail file: /home/grfz/Mail/spam/new/1612109187.21153_1.no Note: Ignoring non-mail file: /home/grfz/Mail/spam/new/1612112775.31326_1.no Note: Ignoring non-mail file: /home/grfz/Mail/spam/new/1612116375.9385_1.no Note: Ignoring non-mail file: /home/grfz/Mail/spam/new/1612120297.21133_1.no Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607940473.9509_1.no:2,S Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607943993.24776_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607947606.8134_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607969276.21046_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607972847.4857_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607976389.23296_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607979988.4942_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607983586.19063_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1607987211.1395_1.no:2, Note: Ignoring non-mail file: /home/grfz/Mail/spam-old/cur/1611742380.14576_1.no:2, terminate called after throwing an instance of 'Xapian::DatabaseCorruptError' Aborted 134 (master *) grfz@no:~/Mail/.notmuch$ So here is the database corruption again, while doing the third notmuch new. I only now realize I did not do the tests after the second notmuch new, but I copied the database so here is it: 0 (master *) grfz@no:~/Mail/.notmuch$ xapian-delve -r 1114128 -VS0 ~/Mail/.notmuch/xapian-2 Value 0 for record #1114128: 1.61209e+09 Term List for record #1114128: XDDIRENTRY1114127:cur XDIRECTORYinbox/cur 0 (master *) grfz@no:~/Mail/.notmuch$ stat --format "%Y" ~/Mail/inbox/cur 1612091679 0 (master *) grfz@no:~/Mail/.notmuch$ quest -bdir:XDIRECTORY -d ~/Mail/.notmuch/xapian-2/ dir:inbox/cur Parsed Query: Query(0 * XDIRECTORYinbox/cur) MSet: 1114128: [0] inbox/cur 0 (master *) grfz@no:~/Mail/.notmuch$ xapian-delve -r 1114128 -VS0 ~/Mail/.notmuch/xapian-2 Value 0 for record #1114128: 1.61209e+09 Term List for record #1114128: XDDIRENTRY1114127:cur XDIRECTORYinbox/cur 0 (master *) grfz@no:~/Mail/.notmuch$ I don't have a clue on how to interpret this. Any ideas? Thanks for your attention, Gregor P.S.: These are the properties of the laptops root filesystem: 0 (master *) grfz@no:~$ sudo tune2fs -l /dev/mapper/vg-lv--root [sudo] password for grfz: tune2fs 1.44.5 (15-Dec-2018) Filesystem volume name: root Last mounted on: / Filesystem UUID: 801d2942-610d-4f43-9824-b275642e75de Filesystem magic number: 0xEF53 Filesystem revision #: 1 (dynamic) Filesystem features: has_journal ext_attr resize_inode dir_index filetype needs_recovery extent 64bit flex_bg sparse_super large_file huge_file dir_nlink extra_isize metadata_csum Filesystem flags: signed_directory_hash Default mount options: user_xattr acl Filesystem state: clean Errors behavior: Continue Filesystem OS type: Linux Inode count: 14082048 Block count: 56308736 Reserved block count: 2815436 Free blocks: 23262312 Free inodes: 11957831 First block: 0 Block size: 4096 Fragment size: 4096 Group descriptor size: 64 Reserved GDT blocks: 1024 Blocks per group: 32768 Fragments per group: 32768 Inodes per group: 8192 Inode blocks per group: 512 RAID stripe width: 8191 Flex block group size: 16 Filesystem created: Sat Nov 23 11:59:12 2019 Last mount time: Sun Jan 31 08:43:15 2021 Last write time: Sun Jan 31 08:43:00 2021 Mount count: 1 Maximum mount count: 23 Last checked: Sun Jan 31 08:43:00 2021 Check interval: 0 () Lifetime writes: 7448 GB Reserved blocks uid: 0 (user root) Reserved blocks gid: 0 (group root) First inode: 11 Inode size: 256 Required extra isize: 32 Desired extra isize: 32 Journal inode: 8 First orphan inode: 13902671 Default directory hash: half_md4 Directory Hash Seed: 22422f4f-fec4-4a9b-8ee6-5be99ecb21f4 Journal backup: inode blocks Checksum type: crc32c Checksum: 0x69629743