From mboxrd@z Thu Jan 1 00:00:00 1970 From: Efraim Flashner Subject: Re: parallelizing more actions Date: Mon, 13 Nov 2017 20:55:22 +0200 Message-ID: <20171113185522.GM1815@macbook41> References: <20171109090559.GF1815@macbook41> <20171112133149.GI1815@macbook41> Mime-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="DITGHUV3p5DjDsXt" Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:59523) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1eEJtL-0003Xr-Pz for guix-devel@gnu.org; Mon, 13 Nov 2017 13:55:32 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1eEJtI-0002SL-KX for guix-devel@gnu.org; Mon, 13 Nov 2017 13:55:31 -0500 Received: from flashner.co.il ([178.62.234.194]:48222) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1eEJtI-0002MS-Cb for guix-devel@gnu.org; Mon, 13 Nov 2017 13:55:28 -0500 Received: from localhost (46-117-130-79.bb.netvision.net.il [46.117.130.79]) by flashner.co.il (Postfix) with ESMTPSA id 7DB1840214 for ; Mon, 13 Nov 2017 18:55:23 +0000 (UTC) Content-Disposition: inline In-Reply-To: <20171112133149.GI1815@macbook41> List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: "Guix-devel" To: guix-devel@gnu.org --DITGHUV3p5DjDsXt Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Sun, Nov 12, 2017 at 03:31:49PM +0200, Efraim Flashner wrote: > On Thu, Nov 09, 2017 at 11:05:59AM +0200, Efraim Flashner wrote: > > While rebuilding glibc-final on aarch64 I realized that the 'strip phase > > took 235 seconds. The relevant code for 'strip from gnu-build-system is > > in guix/build/gnu-build-system.scm, starting at line 340, with the > > actual stripping starting at 398. When I changed 'for-each' to > > 'par-for-each' the time dropped from 235 seconds to 215, about an 8.5% > > savings. I'm pretty sure most of that time was spent failing to strip > > certain files, but it is still a savings. > >=20 >=20 > These numbers were for glibc@2.26. I ran it against glibc@2.25 on my > x86_64 machine with a spinning harddrive and 2 cores, without the patch > it took 165.7 seconds (164.6 the second time), with the patch it dropped > to 24.3 seconds. >=20 > I'll test it with glibc@2.25 on aarch64 later when its not building > other things. >=20 Looks like aarch64 could use some help somewhere. With the patch it took 221.9 seconds, without the patch it was 219.8. so in summary, aarch64 is terrible at stripping, parallel or not, and on x86_64 my patch saved 85% of the patching time, despite only using 2 cores. both versions for aarch64 had many lines like: strip: /gnu/store/gslfpqdmgbwb5ryilq33bn9vs1466fn2-glibc-2.25-debug/lib/deb= ug//gnu/store/7iihk77hqvsqjx7dnb19237dg4xgqvis-glibc-2.25/lib/stSy721B/fget= ws_chk.o: no group info for section .data.DW.ref.__gcc_personality_v0 --=20 Efraim Flashner =D7=90=D7=A4=D7=A8=D7=99=D7=9D = =D7=A4=D7=9C=D7=A9=D7=A0=D7=A8 GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Confidentiality cannot be guaranteed on emails sent or received unencrypted --DITGHUV3p5DjDsXt Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAloJ6pUACgkQQarn3Mo9 g1GG+w//foLLZM4BqkJ4Yt2ghHnk8xV59jtuq54ubR4HVGbojOsO4DNHZZlCTv// QRnSjOGo9sCu7FrG9hz0hPJeVavKsiehj6UCicpe9C7MgGqglb8jqVdTbGyR2Yge 5eCuJxLVEBSfXbNMvyRqmBGxc+SGBcwAOd30MBKhZitYlRDsWaqX8vac2Ri9nb0g aNEBRtqoeJqCHDgVzyacC1kEWeM9YshZylWWxtyvqNya6xye8khaVbx8rhu0LpBl O5YZCl3k69UXZBUpfWRECS1S14SjTPmY9Qok5jDvXIa3HV2fgkeoNavNohz7mpjx W80/Gz0IUN8ueP2Ay7eIDBaZcUssqpc6XGgwAthR6JOfMRqC+1O4Msg90iwPmz9Q zGxlzN++JE0Rgyh61Vm0vWN35JRpQ465g5GrUcoUJCS/2x+c0cPMvI0wq4mLKmhu VoaJKHwJvwGjIf5w70liaHO6Lb1zIQchDOJd6HneCQZ6rN7YKSmZZpmvtXWYEitX Zcb53zFbzPjtdI2uN38ojj29NjzTsd35QN2MBWxgeJFyQ3hVAD/uaET+4SzUNTjM OtMzzuGrbfw35HEb+qeR/hpxwezyj0OziNCnia6iSd/NuqIoGzkHDmonsSbyEyPZ HYzfGcg4y4n98h4XSuduskgdxFu12DFovmcoVnQFU7PrxMQJRGE= =tU1N -----END PGP SIGNATURE----- --DITGHUV3p5DjDsXt--