From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:470:142:3::10]:34411) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1iNMqW-0000Nw-7G for guix-patches@gnu.org; Wed, 23 Oct 2019 16:03:05 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1iNMqU-0007nf-Uk for guix-patches@gnu.org; Wed, 23 Oct 2019 16:03:04 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:54471) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1iNMqU-0007nR-3l for guix-patches@gnu.org; Wed, 23 Oct 2019 16:03:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1iNMqT-0005CQ-VO for guix-patches@gnu.org; Wed, 23 Oct 2019 16:03:02 -0400 Subject: [bug#36630] [PATCH] guix: parallelize building the manual-database Resent-Message-ID: References: <20190712214245.23857-1-arne_bab@web.de> <878sszl1jo.fsf@gnu.org> <877e8ig9gh.fsf@web.de> <87zhldel6f.fsf@gnu.org> <878ssw8ger.fsf@web.de> <875znzhg91.fsf@gnu.org> <87k1cfpq0k.fsf@web.de> <87zhlbe9qt.fsf@gnu.org> <87d0i7p0ug.fsf@web.de> From: Arne Babenhauserheide In-reply-to: <87d0i7p0ug.fsf@web.de> Date: Wed, 23 Oct 2019 22:01:46 +0200 Message-ID: <87d0entemt.fsf@web.de> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature" List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+kyle=kyleam.com@gnu.org Sender: "Guix-patches" To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Cc: 36630@debbugs.gnu.org --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Arne Babenhauserheide writes: >> Right, sorry for being unclear: you need to run >> >> ./pre-inst-env guix environment -n =E2=80=A6 >> >> That will run you modified code and thus create a manual-database.drv >> that uses your code; it=E2=80=99s this manual-database.drv that you shou= ld pass >> to =E2=80=98guix build=E2=80=99. > > That works now =E2=80=94 thank you! =E2=80=A6 > With the change: > 185552 entries processed in 108.2 s > Before the change: > 185552 entries processed in 220.1 s > > The exact commands I=E2=80=99m running: > cd Dokumente/Guix/guix > git checkout master # with the change > ./pre-inst-env guix environment --ad-hoc jupyter python-ipython python-ip= ykernel -n > time guix build /gnu/...-manual-database.drv > git checkout 97bf46e64c11c64a968fdb833983ede6bdafbc00 > ./pre-inst-env guix environment --ad-hoc jupyter python-ipython python-ip= ykernel -n > time guix build /gnu/...-manual-database.drv I now reduced the thread count to exactly 2 (to avoid running into resource troubles; I hope that two should be safe) and added a mutex for status messages to ensure that writes don=E2=80=99t overlap. The patch should arrive shortly. Best wishes, Arne =2D- Unpolitisch sein hei=C3=9Ft politisch sein ohne es zu merken --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCAAdFiEE801qEjXQSQPNItXAE++NRSQDw+sFAl2wsa0ACgkQE++NRSQD w+sN7g//fy4HDFaVlUVHxACX9sIYsFi+R6xR654u+Q8UujdtryKizroo4vGCY4Fr QmWPXonFn/npwUMni1IFPgQ7JsWRvyXghZfs4hHG45y3tc8AGIVfs3Z5yC4WqVi1 07cIvTHnmoL0/XQW4U38BGwWfY1MH1eypVTPp3mvwJZgGvSB2yjmRCVKVxxbQwX+ t1KzpdWq/guBBHoMl4qkNv5BBWHmoOO/1KQY/92BwMNorwtL95MJFqjqcwCfOdpo 6HLXg6UgBdAyoxoxmUoGhJqAtJhrkP4sC60syg/vl+Pi3pFL3wvPOP3gzRnIAwU4 31ZurLSsemlVESsI2w5u0zuhakup+k6emHwgXIkbTE4WYMySMgw1I57G8qnPlLOW jsiajBlOx4F0MQnpsWRovhaSfG7M1QFfY8c+FR1MR/XkiKTSKYrDXK0PyX30Orm8 Xy2RWJ/dFaZqp3kSzvWxrIX6GOQdU/wAlzI/1FYQTav0qEInXYNOvIfMeg55RKUV wdneE6d7/CGpZaRGV3SdYZ6roQdCHnldA1xaaUsmC/Xf46yVhUzhhktkkkNA4K6C uOXHgebZUUuslMTEl3DNPXy3EdYmVvtWJoiES64Rq/PY7R1G/mCxNJ1wN5TLsDOu AjOxsLENBJKiaqRDuGM+1arSGIN/HspFvRKbHyLUBT9a3KItfzmIswQBAQgAHRYh BN0ovebZh1yrzkqLHdzPDbMLwQVIBQJdsLGtAAoJENzPDbMLwQVIGKMEAJlgj9AX iJ+O8cUqr60V9ZneVgaNqMmpLc2BuCPFHcAuHmym0tPDvWWp7dcdGsQWbXgWVXKt 01iilzh/dLe1er6TeKWbevfcAZx2ZB5gCn9SSvtP0CwA6HJsDnIht5QzHV4YeuI/ 0tRDgXdtxGjgrgUCdLZh474pd7Ri66bvVL7a =IW/g -----END PGP SIGNATURE----- --=-=-=--