From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 5A9946DE020D for ; Thu, 18 Feb 2016 14:12:56 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at cworth.org X-Spam-Flag: NO X-Spam-Score: 0.093 X-Spam-Level: X-Spam-Status: No, score=0.093 tagged_above=-999 required=5 tests=[AWL=0.003, DKIM_SIGNED=0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, T_DKIM_INVALID=0.01] autolearn=disabled Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id mKIk1ItGPdjX for ; Thu, 18 Feb 2016 14:12:54 -0800 (PST) Received: from mx1.solardns.com (mx1.solardns.com [109.73.127.119]) by arlo.cworth.org (Postfix) with ESMTPS id 0A5E56DE01D0 for ; Thu, 18 Feb 2016 14:12:54 -0800 (PST) Received: from [213.129.84.218] (helo=luna.solardns.com) by mx1.solardns.com with esmtps (TLSv1.2:DHE-RSA-AES256-SHA:256) (Exim 4.85) (envelope-from ) id 1aWOB9-000244-1E for notmuch@notmuchmail.org; Thu, 18 Feb 2016 12:59:33 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=deptj.eu; s=default; h=Date:Message-ID:References:In-Reply-To:To:Subject:From; bh=pOlqG3WJAPxDCGA86tc5ggLlSny+hZzn75sd54nBvns=; b=blRaHY+xXPlT9rYHZPfstcfss5 sznAj8C5xIGlrpFsD5/RRA/9qz0yNvEaocuk9pbefTay5QZXXeeZgmAXbxHMORopL8kI8D8n0pBvH L47PNpj3VqtJjHV9zub7e3zv3DCp5/oGbnFK4Q3B98CSzUaTW1ZKyFI+Zw5SSxKBrUmI=; Received: from [92.135.160.170] (port=45007 helo=bruno.deptj.eu) by luna.solardns.com with esmtpsa (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (Exim 4.86) (envelope-from ) id 1aWOB7-00231G-4u for notmuch@notmuchmail.org; Thu, 18 Feb 2016 12:59:29 +0000 Received: from eric by bruno.deptj.eu with local (Exim 4.84) (envelope-from ) id 1aWOB5-0005eU-Vb for notmuch@notmuchmail.org; Thu, 18 Feb 2016 13:59:28 +0100 From: Eric J Subject: Re: Lost updates to Notmuch database To: notmuch@notmuchmail.org In-Reply-To: <871t8avnhq.fsf@zancas.localnet> References: <337393ce5e2484d64f837a44b2c4f2ea32f91295-NM@bruno.deptj.eu> <871t8avnhq.fsf@zancas.localnet> Message-ID: Date: Thu, 18 Feb 2016 13:59:28 +0100 (CET) X-AuthUser: deptjeu X-Filter-ID: s0sct1PQhAABKnZB5plbIZxxbsbMXbbOVqDrOlLQDPCKLoLP9dSDpksiPa3sfcfQiw3bi2TEXpBy KOgMDJLxZ2gLr13hkJnqYlE8dI2PqoFC/lGsrXcsS0xY0J18f6o7xB66CWvXcfKDfXjTU++u6/cO QQommvORTE20Rks847c6row+/zX/W00wt70Tbqz7ZuM7jUXIESohoO51xWmU8U0XxLGz4gGrl7np YUMMsx7Zx6js8RMGZ+eyCM03IideZE/8G6RrW+hPYRmHOym9VEp4OmAp9SwcFw57ijAOXur1H/aA warQpYDOYx/6JtUOKIpz/KyJk6xidDbrtJGeIvwS+mRNB2u5eXMTyiRDCl4blv/7/GYDGL6pBAPx 3RhxuHrpSpJU4PQlqFj9797wgsGhIeDBws4kvu4hgViYIJSOH7FelTFEA57OugCjQqJvq5XDlSi1 S/CAqp6x6giLUpAadaOpLL7vzAlHz9Vt0lJbH3q7FSJEAvmcpRDg+DcXMCx8qKfWo/2nfeswSb/v XOidX4Ts4xdG+C13IyWeZaJClvAWyUAUCSYHhmge3quet8geXjZWRvaT/RbJ/nX/IFFm7SbdEzck 901Ob2Iq9tC/Vh1lis0iI/S1HLwoHXf0 X-Report-Abuse-To: spam@mx1.solardns.com X-Filter-Fingerprint: IFrWXGses7OKB5S5G8/dJdIz5bb8V0ykx8BnFBnunHBA3cTUQ1R++keuE7RDJ8Kg3RbMLUalw1oC mj99/u+Poh38tEMU4IgC4sNz49qn3HHnhRv/ZJ3kEy8bfiAr+Fb/UpndEJ0YoaLytXXo8BMTaVt0 ARHRi6XGuAluI1udprGClI6bm+u9ssQgM5AHe3Zacv4uJct5wtJvPpZ2dlBHCwDSxr3Vz+LJ/RhM 2JZ0ECN5dnq47RWft7iCyM9+PbHelB4qP9S6mTzNwoPraFy6ieiDqMHb2a0eZvGOvr7RaxKWGCKO us9nABr0Pk/4CplP X-Originating-IP: 213.129.84.218 X-SpamExperts-Domain: out.solardns.com X-SpamExperts-Username: 213.129.84.218 Authentication-Results: solardns.com; auth=pass smtp.auth=213.129.84.218@out.solardns.com X-SpamExperts-Outgoing-Class: ham X-SpamExperts-Outgoing-Evidence: Combined (0.28) X-Recommended-Action: accept X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 18 Feb 2016 22:12:56 -0000 On Wed, 17 Feb 2016 21:03:13 -0400, David Bremner wrote: > Eric J writes: > > > However, if I do it twice, in different processes, at the same time, one > > file is added and tagged properly, the other is not (totally unfindable > > by notmuch search). Neither process reports any error, and they both log > > their actions normally. Actually a third simultaneous process also fails > > to leave any result in the database. > > It should be impossible for more than one process to open a Xapian > database for writing at the same time. So if the processes are really > running in parallel, you should be getting error codes from the later > calls to notmuch_database_open{_verbose}. You claim that's not > happening, which is puzzling. Maybe you can try to duplicate your > problem with a tiny C program. Thanks David. Impossible? - yes, but if I do just the open in two interactive sessions (the Tcl interface makes this easy), I get the following from "lsof flintlock": COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME cat 21408 eric 5w REG 8,9 0 667773 flintlock cat 21418 eric 5w REG 8,9 0 667773 flintlock So, open for writing, but not locked (the processes have the right parents). I managed to catch a run of "notmuch new" with "lsof -r5 flintlock": COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME cat 20763 eric 3ww REG 8,9 0 667773 flintlock which is open for writing and (partially) locked, so it must be doing something that I'm not. I obviously need to go carefully through the code to see what that is (and experiment in C if I can't find it!). I don't have the _verbose functions BTW, still on 0.18.1 - I thought I would get a proof-of-concept before upgrading notmuch, but... Thanks again, Eric -- ms fnd in a lbry