From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:54951) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1gW08p-0002J0-Mz for guix-patches@gnu.org; Sun, 09 Dec 2018 09:33:08 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1gW08k-0006z5-NX for guix-patches@gnu.org; Sun, 09 Dec 2018 09:33:07 -0500 Received: from debbugs.gnu.org ([208.118.235.43]:35104) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1gW08k-0006yv-J2 for guix-patches@gnu.org; Sun, 09 Dec 2018 09:33:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1gW08k-0000OK-F0 for guix-patches@gnu.org; Sun, 09 Dec 2018 09:33:02 -0500 Subject: [bug#33643] [PATCH] gnu-build-system: Enable xz to decompress in parallel. Resent-Message-ID: Date: Sun, 9 Dec 2018 16:32:01 +0200 From: Efraim Flashner Message-ID: <20181209143201.GA1307@macbook41> References: <20181206075615.4637-1-mail@cbaines.net> <20181206081352.GA31941@jasmine.lan> <87o99yo382.fsf@cbaines.net> <20181206210653.GA909@jasmine.lan> MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha512; protocol="application/pgp-signature"; boundary="7JfCtLOvnd9MIVvH" Content-Disposition: inline In-Reply-To: <20181206210653.GA909@jasmine.lan> List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+kyle=kyleam.com@gnu.org Sender: "Guix-patches" To: Leo Famulari Cc: 33643@debbugs.gnu.org --7JfCtLOvnd9MIVvH Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: quoted-printable On Thu, Dec 06, 2018 at 04:06:53PM -0500, Leo Famulari wrote: > On Thu, Dec 06, 2018 at 07:38:21PM +0000, Christopher Baines wrote: > > So, if -T was used to compress the data, then it sounds like it'll work > > to decompress it. I guess this adds a little more uncertainty to the > > benefit of this change, as the impact is dependent on the way the source > > data is compressed. >=20 > Right. When parallel decompression is implemented, I think we should > enable it in order to get some benefit from upstream tarballs that may > have been created with multi-threaded compression.=20 >=20 > However, we probably won't be able to use the parallel compression > within Guix because it is apparently not deterministic: >=20 > If the tarball is compressed in parallel then it can be decompressed in parallel. As for compressing in parallel, it *might work* to pass it through our non-bootstrap tar for 'tar --sort=3Dname' and then pass it through xz -T(pick-a-num). --=20 Efraim Flashner =D7=90=D7=A4=D7=A8=D7=99=D7=9D = =D7=A4=D7=9C=D7=A9=D7=A0=D7=A8 GPG key =3D A28B F40C 3E55 1372 662D 14F7 41AA E7DC CA3D 8351 Confidentiality cannot be guaranteed on emails sent or received unencrypted --7JfCtLOvnd9MIVvH Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAABCgAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAlwNJ10ACgkQQarn3Mo9 g1ELVRAAllajPCkWXEEPQXn9pF4gHqjDzkf2N8mDNBKtd+iEILkv5QLlu+KaqPjJ vcg+ZGPD6upDXu/FnGNTuLn4aOcsqJ6ESG6dmHPO0v2yOZXN7StqlggxMkobe2ZE 5MOwW1V49xbmsh9GQBysqqn+Yer81kX3gepw/E5o+fnOlZJXQtkQqtAju8fwl/rF GSibFmRmq7rSdshFFH4fN+0WuIE1tIMTDJeATkX35l+hou6Y6nyg1GnzFwv6ItRx uVrzp+6XrMxK594TrdJ9EPfuWDl3ElKY1dEiDLcZkDArzZQJm7VZG/ONERJ6KtrB 8cLb+hW0ASGKWNMegt4NwmpbGJdnwHbBccYJs38GgzmfQIfivVLiIApIbT9REoM7 UuRUCgQ64zK7FlAsMzbsfZb+r23Eh+tVpz76+LBP2vlI1iRH2evSjeVWLcA0Hz7S loZeFT4sUN3Y2GO8GSawXzD8kSw2esg/mGSXtumfmiwL3VIe2xxahlfI/k6wOQtf 9qI5jJGybjoj0bopJSB2hLgsU7F5mCrbzN2tJqPcXSv/8uJ6tZTfaqeU2Y94jGPt HwbCZz/ikfJuKPeAiUQfnI7cZ6YbguE8c4criyLBiVDKFYL+KLMM0ERSFJgmYtXE lktAbnwMz8SdnN34lJVZORsF1KLbapk5NCWcyvkJvd801Rbsf7k= =GGyt -----END PGP SIGNATURE----- --7JfCtLOvnd9MIVvH--