From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:470:142:3::10]:33368) by lists.gnu.org with esmtp (Exim 4.86_2) (envelope-from ) id 1hoFDv-0005vr-US for guix-patches@gnu.org; Thu, 18 Jul 2019 18:50:04 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1hoFDu-0000AI-RK for guix-patches@gnu.org; Thu, 18 Jul 2019 18:50:03 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:45987) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1hoFDu-0000AE-O8 for guix-patches@gnu.org; Thu, 18 Jul 2019 18:50:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1hoFDu-0002tr-HO for guix-patches@gnu.org; Thu, 18 Jul 2019 18:50:02 -0400 Subject: [bug#36630] [PATCH] guix: parallelize building the manual-database Resent-Message-ID: References: <20190712214245.23857-1-arne_bab@web.de> <878sszl1jo.fsf@gnu.org> <877e8ig9gh.fsf@web.de> <87zhldel6f.fsf@gnu.org> <878ssw8ger.fsf@web.de> <875znzhg91.fsf@gnu.org> <87k1cfpq0k.fsf@web.de> <87zhlbe9qt.fsf@gnu.org> From: Arne Babenhauserheide In-reply-to: <87zhlbe9qt.fsf@gnu.org> Date: Thu, 18 Jul 2019 22:03:03 +0200 Message-ID: <87d0i7p0ug.fsf@web.de> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature" List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+kyle=kyleam.com@gnu.org Sender: "Guix-patches" To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Cc: 36630@debbugs.gnu.org --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Ludovic Court=C3=A8s writes: > Arne Babenhauserheide skribis: > >> Ludovic Court=C3=A8s writes: >> >>> Did you try the =E2=80=98guix environment -n=E2=80=99 command above? D= oesn=E2=80=99t it show >>> the manual-database.drv? >> >> It does show the manual database, but then running guix build >> /gnu/....drv --check does not run my changed code. >> >> I=E2=80=99m doing >> >> time ./pre-inst-env guix build /gnu/store/jnkxwwxk71n07fs6naa11fxmg3vpnn= b3-manual-database.drv --check >> >> But it runs the installed guix, not the local changes to profile.scm. > > Right, sorry for being unclear: you need to run > > ./pre-inst-env guix environment -n =E2=80=A6 > > That will run you modified code and thus create a manual-database.drv > that uses your code; it=E2=80=99s this manual-database.drv that you shoul= d pass > to =E2=80=98guix build=E2=80=99. That works now =E2=80=94 thank you! With the change: 185552 entries processed in 108.2 s Before the change: 185552 entries processed in 220.1 s The exact commands I=E2=80=99m running: cd Dokumente/Guix/guix git checkout master # with the change ./pre-inst-env guix environment --ad-hoc jupyter python-ipython python-ipyk= ernel -n time guix build /gnu/...-manual-database.drv git checkout 97bf46e64c11c64a968fdb833983ede6bdafbc00 ./pre-inst-env guix environment --ad-hoc jupyter python-ipython python-ipyk= ernel -n time guix build /gnu/...-manual-database.drv So I also see roughly factor 2 speedup, which means a limit to 4 threads should work. (what I saw is that I only see the =E2=80=A6manual-database.drv before I bu= ild it, after it=E2=80=99s built, I no longer see it in the environment output) How do I get the defined limit of cores and threads? Best wishes, Arne =2D-=20 Unpolitisch sein hei=C3=9Ft politisch sein ohne es zu merken --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEE801qEjXQSQPNItXAE++NRSQDw+sFAl0w0HkACgkQE++NRSQD w+sPHhAA0Mr9BAzh9hjHgDq+Ji5KQFRXBCEvHyyQV2TYJBs0TZ04oXmNiHZHSWQp coSGnmnPvtx1aGkXI7edHuuy/rDwKBcUpJtWZLmFiZ/89baFL+hJnRteZSJILj9P DFGFFODAg/2MRyDZQhpMcEx+ea9hZKUJ068aGPW66DkpN35hJoSu/w0qetAqD8Pm +o1WyB0z5Y/5vuUPgGcN63EVh+BMMAQABGJLlYBJjEao2n5EsrAh6q+c4yMn5JjO PLybFvT/MLkWfUylNpvlIbRffJaphgwbXhLlZBbzPivyZ/ucZTek3J1439JW65oN u4IziODcVZwsZfjluR0koRNvJx73CAM7eflfQp+A/lwNRLDQf96Qqc6VYJO/2HdJ YhVNX3RqFCzgVAdo6fosjtCkPQUJAkfiq4gmNIPAR6Q9ZMn7jw/hD6GDGRJMlFZ8 aqN9QlWVdkLS4Bn9TJ4mZpNcA7F+YF9xusFhk3yC/ViYe5O9iaCtACml4wGVCRzL q1He4D/ZVjXNusfv734vGjxW89gfRuF9/J+CClEwCwaOA8N0p0lK+MFqRInzjvDI aA/i/Bf20RVtjl8tZA6/lZi/bwubwJGU21D2mEcNrdFZFCV73Zl11vVvEc0bsaLH 2LAp/39saKigMZO3jVGrQ9vnVjCAjIv2fnUB97W51463FR3fKUyIswQBAQgAHRYh BN0ovebZh1yrzkqLHdzPDbMLwQVIBQJdMNB5AAoJENzPDbMLwQVIcBMD/i6C+ujg +M7Y7GC2YXgXEHmnZQGRMQ6MJGdF6nqy9jTQFXx5ZyCALtgGSi0JKy2dExF28a3n xzYs9MNftZ03sMxEKl1sOh9GNbLFEPAZNCkTBX2yxGBM7AnoqHjUn7YHLtdtPfmQ AFu5xtjKSUTYWsPlfaX125ExhcPnKUPLu3uS =UQ9d -----END PGP SIGNATURE----- --=-=-=--