From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id 6CoUBojWpl5vCgAA0tVLHw (envelope-from ) for ; Mon, 27 Apr 2020 12:56:40 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id gMwcKI/Wpl4BZQAA1q6Kng (envelope-from ) for ; Mon, 27 Apr 2020 12:56:47 +0000 Received: from arlo.cworth.org (arlo.cworth.org [50.126.95.6]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) server-signature RSA-PSS (4096 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id D38A6942D25 for ; Mon, 27 Apr 2020 12:56:44 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 80F046DE0F0D; Mon, 27 Apr 2020 05:56:40 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id y0GcxaH1fAPb; Mon, 27 Apr 2020 05:56:40 -0700 (PDT) Received: from arlo.cworth.org (localhost [IPv6:::1]) by arlo.cworth.org (Postfix) with ESMTP id 787266DE0EDC; Mon, 27 Apr 2020 05:56:39 -0700 (PDT) Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id C3E906DE0EDC for ; Mon, 27 Apr 2020 05:56:38 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 9g_hKCY_MMPL for ; Mon, 27 Apr 2020 05:56:38 -0700 (PDT) Received: from fethera.tethera.net (fethera.tethera.net [198.245.60.197]) by arlo.cworth.org (Postfix) with ESMTPS id E1A086DE0ACD for ; Mon, 27 Apr 2020 05:56:37 -0700 (PDT) Received: from remotemail by fethera.tethera.net with local (Exim 4.92) (envelope-from ) id 1jT3JM-0002Gu-Np; Mon, 27 Apr 2020 08:56:36 -0400 Received: (nullmailer pid 3691820 invoked by uid 1000); Mon, 27 Apr 2020 12:56:35 -0000 From: David Bremner To: Don Zickus Subject: Re: performance problems with notmuch new In-Reply-To: <20200427124800.6xkutxg2vrsecvql@redhat.com> References: <20200415150801.h2mazyo37sspvech@redhat.com> <874ktku49b.fsf@tethera.net> <20200415173138.rn3ubtxo6mkracss@redhat.com> <87y2qwsdba.fsf@tethera.net> <20200420152519.gt73upo6mowhzsca@redhat.com> <87y2qljhlk.fsf@tethera.net> <20200424190526.gfypvd4aooe34y6t@redhat.com> <87mu70jxe8.fsf@tethera.net> <20200427124800.6xkutxg2vrsecvql@redhat.com> Date: Mon, 27 Apr 2020 09:56:35 -0300 Message-ID: <87sggp84u4.fsf@tethera.net> MIME-Version: 1.0 X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: notmuch@notmuchmail.org Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: notmuch-bounces@notmuchmail.org Sender: "notmuch" X-Scanner: scn0 X-Spam-Score: -1.01 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of notmuch-bounces@notmuchmail.org designates 50.126.95.6 as permitted sender) smtp.mailfrom=notmuch-bounces@notmuchmail.org X-Scan-Result: default: False [-1.01 / 13.00]; ARC_NA(0.00)[]; GENERIC_REPUTATION(0.00)[-0.46231571189647]; MID_RHS_MATCH_FROM(0.00)[]; FROM_HAS_DN(0.00)[]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+a:c]; IP_REPUTATION_HAM(0.00)[asn: 27017(-0.18), country: US(-0.00), ip: 50.126.95.6(-0.46)]; MIME_GOOD(-0.10)[text/plain]; PREVIOUSLY_DELIVERED(0.00)[notmuch@notmuchmail.org]; DMARC_NA(0.00)[tethera.net]; HAS_LIST_UNSUB(-0.01)[]; DNSWL_BLOCKED(0.00)[50.126.95.6:from]; URIBL_BLOCKED(0.00)[notmuchmail.org:email]; RCVD_TLS_LAST(0.00)[]; MX_GOOD(-0.50)[cached: notmuchmail.org]; RCPT_COUNT_TWO(0.00)[2]; DWL_DNSWL_FAIL(0.00)[50.126.95.6:server fail]; MAILLIST(-0.20)[mailman]; FORGED_SENDER_MAILLIST(0.00)[]; R_DKIM_NA(0.00)[]; MIME_TRACE(0.00)[0:+]; ASN(0.00)[asn:27017, ipnet:50.126.64.0/18, country:US]; RCVD_COUNT_SEVEN(0.00)[8]; FROM_NEQ_ENVFROM(0.00)[david@tethera.net,notmuch-bounces@notmuchmail.org] X-TUID: mDgXx4tEs9gf Don Zickus writes: > On Fri, Apr 24, 2020 at 08:07:27PM -0300, David Bremner wrote: >> Don Zickus writes: >> >> > >> > Of course I am using this in a strange context. I am deleting emails >> > locally and then running 'notmuch new' to clean up the database. >> > >> [snip] >> > So maybe my use case is unusual and the slowness is expected. >> >> I'd say it's a known performance bug in notmuch that it doesn't deal >> well with large numbers of deletions. At some point it is faster to >> reindex the whole database from scratch. > > Does that mean 'notmuch dump' and 'notmuch restore'? Willing to try that. > Exactly. David