From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 832566DE0FC5 for ; Wed, 17 Feb 2016 12:44:34 -0800 (PST) X-Virus-Scanned: Debian amavisd-new at cworth.org X-Spam-Flag: NO X-Spam-Score: 0.094 X-Spam-Level: X-Spam-Status: No, score=0.094 tagged_above=-999 required=5 tests=[AWL=0.004, DKIM_SIGNED=0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=-0.01, RCVD_IN_MSPIKE_WL=-0.01, T_DKIM_INVALID=0.01] autolearn=disabled Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id RujTulTrhrjg for ; Wed, 17 Feb 2016 12:44:32 -0800 (PST) Received: from mx1.solardns.com (mx1.solardns.com [109.73.127.119]) by arlo.cworth.org (Postfix) with ESMTPS id 8344B6DE091E for ; Wed, 17 Feb 2016 12:44:31 -0800 (PST) Received: from [213.129.84.218] (helo=luna.solardns.com) by mx1.solardns.com with esmtps (TLSv1.2:DHE-RSA-AES256-SHA:256) (Exim 4.85) (envelope-from ) id 1aW8xV-0001G3-2n for notmuch@notmuchmail.org; Wed, 17 Feb 2016 20:44:27 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=deptj.eu; s=default; h=Date:Message-ID:To:Subject:From; bh=QUiNPGCK4Yu9l/jdSG4igFSXvmgDbfbTLjIRjE68FHA=; b=Wo9YHcdHx1/b7YwrhI9Ejx2BPZ GXYWkE3l+RaCcIqzVtzmn8BhEYpdZDbMp07HYzRb6aWodwtbdKCaZFWq5YyRxFFyHiUNdV6yurBaA Zb8auZ/PqIsBCx4mFK5zHSg/Oiq1d21PaC2K1yw+ogPTTaA3RNOw+Jt28F79WYMQL8GU=; Received: from [92.135.160.170] (port=44718 helo=bruno.deptj.eu) by luna.solardns.com with esmtpsa (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) (Exim 4.86) (envelope-from ) id 1aW8xU-0037bh-KA for notmuch@notmuchmail.org; Wed, 17 Feb 2016 20:44:24 +0000 Received: from eric by bruno.deptj.eu with local (Exim 4.84) (envelope-from ) id 1aW8xT-0002qC-8R for notmuch@notmuchmail.org; Wed, 17 Feb 2016 21:44:23 +0100 From: Eric J Subject: Lost updates to Notmuch database To: notmuch@notmuchmail.org Message-ID: <337393ce5e2484d64f837a44b2c4f2ea32f91295-NM@bruno.deptj.eu> Date: Wed, 17 Feb 2016 21:44:23 +0100 (CET) X-AuthUser: deptjeu X-Filter-ID: s0sct1PQhAABKnZB5plbIZxxbsbMXbbOVqDrOlLQDPCKLoLP9dSDpksiPa3sfcfQiw3bi2TEXpBy KOgMDJLxZ2gLr13hkJnqYlE8dI2PqoFC/lGsrXcsS0xY0J18f6o7xB66CWvXcfKDfXjTU++u6wnX lL5Lm4Xkn3qRe+MKYG9KBamV5mBRFH60GvshNV8TZuM7jUXIESohoO51xWmU8U0XxLGz4gGrl7np YUMMsx7Zx6js8RMGZ+eyCM03IideZE/8G6RrW+hPYRmHOym9VEp4OmAp9SwcFw57ijAOXur1H/aA warQpYDOYx/6JtUOKIpz/KyJk6xidDbrtJGeIvwS+mRNB2u5eXMTyiRDCl4blv/7/GYDGL6pBAPx 3RhxuHrpSpJU4PQlqFj9797wgsGhIeDBws4kvu4hgViYIJSOH7FelTFEA57OugCjQqJvq5XDlSi1 S/CAqp6x6giLUpAadaOpLL7vzAlHz9Vt0lJbH3q7FSJEAvmcpRDg+DcXMCx8qKfWo/2nfeswSb/v XOidX4Ts4xdG+C13IyWeZaJClvAWyUAUCSYHhmge3quet8geXjZWRvaT/RbJ/nX/IFFm7SbdEzck 901Ob2Iq9tC/Vh1lis0iI/S1HLwoHXf0 X-Report-Abuse-To: spam@mx1.solardns.com X-Filter-Fingerprint: IFrWXGses7OKB5S5G8/dJdIz5bb8V0ykx8BnFBnunHBA3cTUQ1R++keuE7RDJ8Kg3RbMLUalw1oC mj99/u+Poh38tEMU4IgC4sNz49qn3HHnhRv/ZJ3kEy8bfiAr+Fb/UpndEJ0YoaLytXXo8BMTaVt0 ARHRi6XGuAluI1udprGClI6bm+u9ssQgM5AHe3Zacv4uJct5wtJvPpZ2dlBHCwDSxr3Vz+LJ/RhM 2JZ0ECN5dnq47RWft7iCyM9+PbHelB4qP9S6mTzNwoPraFy6ieiDqMHb2a0eZvGOvr7RaxKWGCKO us9nABr0Pk/4CplP X-Originating-IP: 213.129.84.218 X-SpamExperts-Domain: out.solardns.com X-SpamExperts-Username: 213.129.84.218 Authentication-Results: solardns.com; auth=pass smtp.auth=213.129.84.218@out.solardns.com X-SpamExperts-Outgoing-Class: unsure X-SpamExperts-Outgoing-Evidence: Combined (0.56) X-Recommended-Action: accept X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.20 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 17 Feb 2016 20:44:34 -0000 Using the API, I am adding single mail files, already in the maildir, to the Notmuch database and tagging them. It works, every time, as long as I run it one file at a time. However, if I do it twice, in different processes, at the same time, one file is added and tagged properly, the other is not (totally unfindable by notmuch search). Neither process reports any error, and they both log their actions normally. Actually a third simultaneous process also fails to leave any result in the database. This is in spite of using begin_atomic/end_atomic. I would not have been surprised to get Xapian lock errors, but the database_open returns success, as does the database_begin_atomic. The wrapper around the API for Tcl is very simple, and I can not see any way for that or Tcl itself to cause this sort of problem. Beyond this, I haven't thought of any way to decide if this could be a Notmuch problem or a Xapian problem. The API sequence is: database_open database_begin_atomic database_add_message (next 4 are a for loop) message_get_tags tags_valid tags_move_to_next tags_get message_freeze message_add_tag message_thaw message_maildir_flags_to_tags message_get_filename message_get_message_id database_end_atomic message_destroy database_close database_destroy I didn't realise till it was mostly written, but it is pretty much like add_new() in notmuch-new.c . Eric -- ms fnd in a lbry