From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:470:142:3::10]:59853) by lists.gnu.org with esmtp (Exim 4.86_2) (envelope-from ) id 1hns4l-0000N8-NU for guix-patches@gnu.org; Wed, 17 Jul 2019 18:07:04 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1hns4k-0005da-OG for guix-patches@gnu.org; Wed, 17 Jul 2019 18:07:03 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:44299) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1hns4k-0005dI-KZ for guix-patches@gnu.org; Wed, 17 Jul 2019 18:07:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1hns4k-00016Q-Ct for guix-patches@gnu.org; Wed, 17 Jul 2019 18:07:02 -0400 Subject: [bug#36630] [PATCH] guix: parallelize building the manual-database Resent-Message-ID: References: <20190712214245.23857-1-arne_bab@web.de> <878sszl1jo.fsf@gnu.org> <877e8ig9gh.fsf@web.de> <87zhldel6f.fsf@gnu.org> From: Arne Babenhauserheide In-reply-to: <87zhldel6f.fsf@gnu.org> Date: Thu, 18 Jul 2019 00:06:36 +0200 Message-ID: <878ssw8ger.fsf@web.de> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature" List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+kyle=kyleam.com@gnu.org Sender: "Guix-patches" To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Cc: 36630@debbugs.gnu.org --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi, Ludovic Court=C3=A8s skribis: > Arne Babenhauserheide skribis: Offtopic: I love reading Esperanto here! >> Ludovic Court=C3=A8s writes: >>> guix environment --ad-hoc jupyter python-ipython python-ipykernel -n >> How exactly did you run the derivation? > If you run the command above, it=E2=80=99ll list > /gnu/store/=E2=80=A6-manual-database.drv. So you can just run: > > guix build /gnu/store/=E2=80=A6-manual-database.drv > > or: > > guix build /gnu/store/=E2=80=A6-manual-database.drv --check > > if it had already been built before. Somehow I can=E2=80=99t get guix to actually run my changed code with this command, so I=E2=80=99m not sure I tested the right thing. What is the clean approach to run the profile.scm from git? >>> On a SSD and with a hot cache, on my 4-core laptop, I get 74s with >>> =E2=80=98master=E2=80=99, and 53s with this patch. >> >> I=E2=80=99m using a machine with 6 physical cores, hyperthreading, and a= n NVMe >> M.2 disk, so it is likely that it would not be disk-bound for me at 4 >> threads. > > The result may be entirely different with a spinning disk. :-) > > I=E2=80=99m not saying we should optimize for spinning disks, just that w= hat you > see is at one end of the spectrum. That=E2=80=99s right, yes. > But anyway, another issue is that we would need to honor > =E2=80=98parallel-job-count=E2=80=99, which means using =E2=80=98n-par-ma= p=E2=80=99, which doesn=E2=80=99t use > futures. Ouch, yes. That=E2=80=99s an issue =E2=80=A6=20 Thank you for bringing it up! Best wishes, Arne =2D-=20 Unpolitisch sein hei=C3=9Ft politisch sein ohne es zu merken --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEE801qEjXQSQPNItXAE++NRSQDw+sFAl0vm+4ACgkQE++NRSQD w+uICBAAwiQygjoFRmEjJDl6Y8Ny6AdeTGmLXfOVb2FH9s/FEF2zhJtLf0atKWUN EDqoj5mzqQ1IEoyKhcgzBbw/kWdx/eNj4qp/yJpj/Tp5z39Rr5QZFtbgX+oEQUur d1T4zgCb2tpll93W3IC4BKGNtTBbubYM0SlPxlELU+x0yGRKTccYfSaYIHynWgC1 3Ij5tYZoU34m1Tk29H5AGdjlPjMfF5oNapmwwNk/JGlUWtg9Vaquf1S9HFqOcn3d mezgEMz22wyXOdMXpUkuIxjwtvwJ5qvbxb0mlfjejt3eiShl0R8eThYhebzKgDNq DTZ//3XLGaSf6Ih99Up4E03HUXOhZBCdQfM8aucU9LUR0okMGm5N9Nc+C4v0AI/N hWzyuLC0wTKBdDLOqBJx5WTUBvKnuKIGKwOq0n3PQYVzVhye/eLFdTMAojPMXWaI CK7edZP5HzKHnrRWxeTIIGkUrcccfQa1adVDH2d7xF1MzOSTAhkTSPGKGW7EZ2Ce aeu0/DyGY8LGQD55sAoIeSKKfRkt1zkCA/AYsLC4ZkhuwdfoLQ9kvgp/DqvorUKl bDMgFoMcDOo0mBHm409N5HQudca10FYPuaw4LwBIbKKxebY5Iiv75NA3WFehCDOs ub4EX4C5lraADIqf9NY1AYo5CNYHpiegaeuA0jWT7jfEcNXCkXWIswQBAQgAHRYh BN0ovebZh1yrzkqLHdzPDbMLwQVIBQJdL5vuAAoJENzPDbMLwQVIWr8D/1A6Kdyf dQOA+QugrHNqVeYC5MqT/GvisnlikfM0N1mU+KrNX59CnoHZetKzKrYS8dh07eOU 3Ad3tdvSCErAQoUIhP6zACDeSudAu4ofuCxI9b5aQM4hNvDdMRQjO3VV+wSEA6a6 qMI4FopRdngMbwtxqrZu/bE4kt5R+4PCiqrO =Uob2 -----END PGP SIGNATURE----- --=-=-=--