From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from localhost (localhost [127.0.0.1]) by arlo.cworth.org (Postfix) with ESMTP id 8B0DC6DE0F16 for ; Mon, 22 Apr 2019 16:19:39 -0700 (PDT) X-Virus-Scanned: Debian amavisd-new at cworth.org X-Spam-Flag: NO X-Spam-Score: -0.13 X-Spam-Level: X-Spam-Status: No, score=-0.13 tagged_above=-999 required=5 tests=[AWL=0.071, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Received: from arlo.cworth.org ([127.0.0.1]) by localhost (arlo.cworth.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 0rPwmpDXMB30 for ; Mon, 22 Apr 2019 16:19:38 -0700 (PDT) Received: from che.mayfirst.org (che.mayfirst.org [162.247.75.118]) by arlo.cworth.org (Postfix) with ESMTPS id B0B4E6DE0F10 for ; Mon, 22 Apr 2019 16:19:38 -0700 (PDT) DKIM-Signature: v=1; a=ed25519-sha256; c=relaxed/simple; d=fifthhorseman.net; i=@fifthhorseman.net; q=dns/txt; s=2019; t=1555975176; h=from : to : subject : in-reply-to : references : date : message-id : mime-version : content-type : from; bh=n8OyHl4vaIHhPigYHYtUuxP8stE5H7BQEO3oXA1hTQo=; b=jBNMSgz6X73lCiSxqyo1dR0465cuce6TBUdbbarkBJM/ia/ztK9yuntJ r3onDiF4EC6bSxzhfgIM/QHbETKADg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=fifthhorseman.net; i=@fifthhorseman.net; q=dns/txt; s=2019rsa; t=1555975176; h=from : to : subject : in-reply-to : references : date : message-id : mime-version : content-type : from; bh=n8OyHl4vaIHhPigYHYtUuxP8stE5H7BQEO3oXA1hTQo=; b=Y1vaRRW+2NeqEiz+5UwW7P/ssNHPGwu9SQjkOAE9AdqJTv0sLHzYKbLQ ze5kmm5uAo0OsiR1D2VnMdIp5z8OVlrrqzAmfs4KtkMtJHcOh4l+vuXXdC aHzZx5w7MESN6wC+ooWqns3SUUegY9tV9eqgpfrTfRYFhbJr9wNmFpZPGj 1lsWiq8G5V8Htx0mSL07lNMvX0F4p348eHijtdEx/Pe25oKI4l0IOMziDW 6KlCvQapNy7zdhIr9Qk2HrtiwdWVUgYzhtf4KdshdM6g6bULCH6tJWBFXB 1k5kKg6n9vvrC74U/1YtHG8jjE7bKq+98+7ZgK7saadtj8C/Xun76g== Received: from fifthhorseman.net (ool-6c3a0662.static.optonline.net [108.58.6.98]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by che.mayfirst.org (Postfix) with ESMTPSA id 2527EF99D; Mon, 22 Apr 2019 19:19:36 -0400 (EDT) Received: by fifthhorseman.net (Postfix, from userid 1000) id 5214A202A1; Mon, 22 Apr 2019 19:19:32 -0400 (EDT) From: Daniel Kahn Gillmor To: David Bremner , Notmuch Mail Subject: Re: subsequent rebuilds of notmuch always re-build sphinx and ruby In-Reply-To: <87mukjcg3l.fsf@tethera.net> References: <87r29wwgq2.fsf@fifthhorseman.net> <87a7gkdxns.fsf@tethera.net> <87d0lgvylb.fsf@fifthhorseman.net> <87mukjcg3l.fsf@tethera.net> Autocrypt: addr=dkg@fifthhorseman.net; prefer-encrypt=mutual; keydata= mDMEXEK/AhYJKwYBBAHaRw8BAQdAr/gSROcn+6m8ijTN0DV9AahoHGafy52RRkhCZVwxhEe0K0Rh bmllbCBLYWhuIEdpbGxtb3IgPGRrZ0BmaWZ0aGhvcnNlbWFuLm5ldD6ImQQTFggAQQIbAQUJA8Jn AAULCQgHAgYVCgkICwIEFgIDAQIeAQIXgBYhBMS8Lds4zOlkhevpwvIGkReQOOXGBQJcQsbzAhkB AAoJEPIGkReQOOXG4fkBAO1joRxqAZY57PjdzGieXLpluk9RkWa3ufkt3YUVEpH/AP9c+pgIxtyW +FwMQRjlqljuj8amdN4zuEqaCy4hhz/1DbgzBFxCv4sWCSsGAQQB2kcPAQEHQERSZxSPmgtdw6nN u7uxY7bzb9TnPrGAOp9kClBLRwGfiPUEGBYIACYWIQTEvC3bOMzpZIXr6cLyBpEXkDjlxgUCXEK/ iwIbAgUJAeEzgACBCRDyBpEXkDjlxnYgBBkWCAAdFiEEyQ5tNiAKG5IqFQnndhgZZSmuX/gFAlxC v4sACgkQdhgZZSmuX/iVWgD/fCU4ONzgy8w8UCHGmrmIZfDvdhg512NIBfx+Mz9ls5kA/Rq97vz4 z48MFuBdCuu0W/fVqVjnY7LN5n+CQJwGC0MIA7QA/RyY7Sz2gFIOcrns0RpoHr+3WI+won3xCD8+ sVXSHZvCAP98HCjDnw/b0lGuCR7coTXKLIM44/LFWgXAdZjm1wjODbg4BFxCv50SCisGAQQBl1UB BQEBB0BG4iXnHX/fs35NWKMWQTQoRI7oiAUt0wJHFFJbomxXbAMBCAeIfgQYFggAJhYhBMS8Lds4 zOlkhevpwvIGkReQOOXGBQJcQr+dAhsMBQkB4TOAAAoJEPIGkReQOOXGe/cBAPlek5d9xzcXUn/D kY6jKmxe26CTws3ZkbK6Aa5Ey/qKAP0VuPQSCRxA7RKfcB/XrEphfUFkraL06Xn/xGwJ+D0hCw== Date: Mon, 22 Apr 2019 19:19:31 -0400 Message-ID: <87h8apvda4.fsf@fifthhorseman.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-BeenThere: notmuch@notmuchmail.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Use and development of the notmuch mail system." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 22 Apr 2019 23:19:39 -0000 --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable On Sun 2019-04-21 16:29:02 -0300, David Bremner wrote: > the html rebuild is much faster than the texinfo + info rebuilds. agreed, in the runs that i've been doing as well. I was concerned that the html rebuild itself may have been *triggering* the rebuild of the texinfo stuff, though. Sounds like you don't think that's the case. > I've posted some patches for the sphinx-doc issues a couple of hours ago > (id:20190421171245.19729-1-david@tethera.net).=20 thanks! your own commentary on that series seems to acknowledge that there are problems with it (though i don't understand the tradeoffs well). i'm not super comfortable with make-style "stamping": my experience with it is that it creates a synchronization problem, and it's easy for the "sync" between the stamp and the generated artifacts to break, at which point the safest thing is to "make clean" and start fully over. Is there no way to give make itself full visibility into the specific generated files so it can do its comparisons directly? I'm obviously not asking you to rewrite the entire native sphinx build system, i'm just observing that at present it seems suboptimal, though i don't know how to fix it either :/ > Currently the ruby rebuild doesn't seem to be slowing things down much > for me. > > =E2=95=AD=E2=94=80 convex:~/software/upstream/notmuch=20 > =E2=95=B0=E2=94=80 (git)-[wip/make-docs]-% /usr/bin/time make ruby-bindin= gs 1>/dev/null > 0.13user 0.02system 0:00.15elapsed 101%CPU (0avgtext+0avgdata 11504maxres= ident)k > 0inputs+208outputs (0major+6523minor)pagefaults 0swaps > > That's with an SSD, so maybe there's more of hit for other environments. I agree, this one isn't particularly slow, and it appears to be a leaf dependency (for now), so it's not the worst thing. But it's still pretty clearly a bug that this thing loops. --dkg --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iHUEARYKAB0WIQTJDm02IAobkioVCed2GBllKa5f+AUCXL5MBAAKCRB2GBllKa5f +J7AAQCD/COk9s343l3SfthDjQ78LbNauof6e7zRue4NpSenXgEA7CUSfsGtku9z pq4aNyNsr5bRbs9l5c+T5YBYOdSQQg8= =d/5R -----END PGP SIGNATURE----- --=-=-=--