From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id 41+sAp2S2F+0JAAA0tVLHw (envelope-from ) for ; Tue, 15 Dec 2020 10:40:29 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id gKqMOZyS2F/NHwAAbx9fmQ (envelope-from ) for ; Tue, 15 Dec 2020 10:40:28 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 993C6940222 for ; Tue, 15 Dec 2020 10:40:28 +0000 (UTC) Received: from localhost ([::1]:59292 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kp7kp-0007ZZ-FS for larch@yhetil.org; Tue, 15 Dec 2020 05:40:27 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:46386) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kp7kf-0007ZH-WE for guix-devel@gnu.org; Tue, 15 Dec 2020 05:40:18 -0500 Received: from mout.web.de ([212.227.15.4]:54835) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kp7kd-0002uR-QK for guix-devel@gnu.org; Tue, 15 Dec 2020 05:40:17 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=web.de; s=dbaedf251592; t=1608028811; bh=hpdqblKsD8Osct4X6UIq1+R8Bm3AvtpmwHGGjCFa07I=; h=X-UI-Sender-Class:To:References:From:Subject:Date:In-Reply-To; b=aQgFCYfOZwwDiANrCPnc8DxkEDy4q9KA+0d37UxtqTYF9QvOAdDhzST2mTmHUHSQ3 t9UFwO7rpVJPJuXJgleTXVnyr51NeH9dogAbOrGHQMpTXtof5LV4jn/+Zny3U+6x0V 7ZoWDEolzx2zrPWq9hsc8aEAPCRKRPw1Hxkod7g4= X-UI-Sender-Class: c548c8c5-30a9-4db5-a2e7-cb6cb037b8f9 Received: from [192.168.178.74] ([5.146.192.224]) by smtp.web.de (mrweb002 [213.165.67.108]) with ESMTPSA (Nemesis) id 0MCqSB-1kymXA26L5-009eva for ; Tue, 15 Dec 2020 11:40:11 +0100 To: guix-devel@gnu.org References: <87im94qbby.fsf@gnu.org> From: Jonathan Brielmaier Subject: Re: When substitute download + decompression is CPU-bound Message-ID: <94405d66-b13c-e6e6-e8d5-df23b93e5d97@web.de> Date: Tue, 15 Dec 2020 11:40:10 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Icedove/78.5.1 MIME-Version: 1.0 In-Reply-To: <87im94qbby.fsf@gnu.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:uXge++Narv9FuimVhFW1fBYJFxlExpZKyAxiE5k9QT/opPJ6Ka3 51CloP/RZ9jzU8w+nXB7i6VXAPbSo0ehS6jLal/6jYZQ+T41KfH+W1S0C9BjjmqnpvE7xQx Xc7q5fHk+/3rxgVq+iopqiqPU78sKhnnstgcbnL8l+R1ltgBYiqX7aKnL4M/OA8XdZvBhva 6+fuBUl/zaoWUZ/f6doPw== X-UI-Out-Filterresults: notjunk:1;V03:K0:UaJ84Djjye4=:D3gPSPDwMAoZ3fuRPKqlR6 Kt1cVdU8nxa777PWJjcSYGVIugK3n1D7U+yGu9ck7GubQ8isQwhajyRkUxLHvVwo9k0fm+LnW l0kkQ29EOsETtl9OwQdZ4mCI4BUVF/4MENBRHruueO53d8YcAbvgzlcgFcjnFeaW1FI37ip6E TzwUBk2jxgMLMRaCHRB5DkBvOfjmHZkDeBtjp/rWJ7s0DF89LKzh8gagO4fxLjH7wDNevV1+j AW+296YD3hB/5lbB7AxyAB9giF0irHUJnR0h8D1QjvuF+XxFhCWt0Jy1Sno7uCV0JvOOJMZlI IHYBC5K75jgZahuodWTush9C1BaQQm77CTnavTDvHAQt/4qagHY0p2CTdFKFP47av5gQ7xGRw Yp1aCiG1W/YFn6rFmxe6nm473xFcC8RrujE9f2FD+ObOaPsoj7dJH3Gbpi+/kWdKS5AWYlWGb J64pTKm403qfkYGbZ3vUC0E9X5EdLwx8aJVEb/ZqNDwHkik2yfUzEURFgJv6EPJtyfK/y0fmn 2sHfU9M2VAbbSK9OEQhKdsVL1g+Uf+xtPtbgmHSJqdGHT89c/OQcvkomEohlZY2PSkZi/OrI6 l8kevnPhx9OKAM2/nxswxX0p39P4F6sJznZLoBf0DZYzPghjrrYxbIbgclQuwP3WdbHINUIcf aky2L1dnTyfJlImDb7cCjuwNF+9UM8tcmVQml2irADS4M3QSwIw+mAg+bqxEC0yO8cx5u9zSA eAbhZo5gU5CiQm4Lp/pqLfaD7nlR4tr/0ZyXl43jUp19pewq+AXHjrEvjY4x5vxDRL0U3TDa+ T/MVFbozivbagFCnN22vu6s2+orVw4tyNZyBvU/9o8qBZ0TaxRKBO6rWvGyOr5FND9G4EMnjN GRxRrFp4UTgZiHEltbNXAAQxhgyF/+qcG0lv5v9VY= Received-SPF: pass client-ip=212.227.15.4; envelope-from=jonathan.brielmaier@web.de; helo=mout.web.de X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, NICE_REPLY_A=-0.001, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -3.01 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=web.de header.s=dbaedf251592 header.b=aQgFCYfO; dmarc=pass (policy=none) header.from=web.de; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 993C6940222 X-Spam-Score: -3.01 X-Migadu-Scanner: scn0.migadu.com X-TUID: JJz4DDZ+m935 Super interesting findings! On 14.12.20 23:20, Ludovic Court=C3=A8s wrote: > 2. Use Zstd like all the cool kids since it seems to have a much > higher decompression speed: . > 630=C2=A0MB/s on ungoogled-chromium on my laptop. Woow. Not only decompression speed is fast, compression is as well: size file time for compression (lower is better) 335M uc.nar 104M uc.nar.gz 8 71M uc.nar.lz.level9 120 74M uc.nar.lz.level6 80 82M uc.nar.lz.level3 30 89M uc.nar.lz .level1 16 97M uc.nar.zst 1 So I am bought by zstd, as user and as substitution server care taker :) For mobile users and users without internet flatrates the increased nar size is a problem. Although I think the problem here is not bewtween gzip, lzip and zstd. It's the fact that we completely download the new package even if's just some 100 lines of diffoscope diff[0]. And most of them is due to the change /gnu/store name... [0] diffoscope --max-diff-block-lines 0 /gnu/store/zvcn2r352wxnmq7jayz5myg23gh9s17q-icedove-78.5.1 /gnu/store/dzjym6y7b9z4apgvvydj9lf0kbaa8qbv-icedove-78.5.1 lines: 783 size: 64k