From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:c151::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id eENpNZVIUmCWBwAA0tVLHw (envelope-from ) for ; Wed, 17 Mar 2021 18:21:09 +0000 Received: from aspmx2.migadu.com ([2001:41d0:2:c151::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id GGdUMZVIUmCXPAAAB5/wlQ (envelope-from ) for ; Wed, 17 Mar 2021 18:21:09 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx2.migadu.com (Postfix) with ESMTPS id 3E29C20CD6 for ; Wed, 17 Mar 2021 19:21:09 +0100 (CET) Received: from localhost ([::1]:37994 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lMan6-0005Ws-3I for larch@yhetil.org; Wed, 17 Mar 2021 14:21:08 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:35632) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lMamR-0005Vh-OY for guix-devel@gnu.org; Wed, 17 Mar 2021 14:20:36 -0400 Received: from mout.web.de ([212.227.15.4]:34137) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lMamD-0003Nj-0d for guix-devel@gnu.org; Wed, 17 Mar 2021 14:20:27 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=web.de; s=dbaedf251592; t=1616005208; bh=oCEEZOxGRtsQNCer7wtdbtZh1NaU1sZU+jsRA66h9r8=; h=X-UI-Sender-Class:Subject:To:References:From:Date:In-Reply-To; b=Zm5gfmcOWFA99PzN4uzxXzvxrJYLZlnVxmGxId1VDOLCwn/iGnLdHEcCOabIZ3UVL I9gDGy2NF6e7/l+WLbCw40nJk4AcLaEM8nY7l17zeCb64YkoL8wCmAa70Oq3pfQluF rEN/uQijqgjkhPKWZguEEikyfkZT6j3M2PKD79Gk= X-UI-Sender-Class: c548c8c5-30a9-4db5-a2e7-cb6cb037b8f9 Received: from [192.168.178.74] ([5.146.192.139]) by smtp.web.de (mrweb002 [213.165.67.108]) with ESMTPSA (Nemesis) id 0M6UiB-1lbnTH3BaF-00ySds for ; Wed, 17 Mar 2021 19:20:08 +0100 Subject: Re: Are gzip-compressed substitutes still used? To: guix-devel@gnu.org References: <87im94qbby.fsf@gnu.org> <94405d66-b13c-e6e6-e8d5-df23b93e5d97@web.de> <87im92voqw.fsf@dismail.de> <87ft3d2fge.fsf@yamatai> <87bldr191v.fsf@gnu.org> <87v9bzmat1.fsf@guixSD.i-did-not-set--mail-host-address--so-tickle-me> <87im7hj6cb.fsf_-_@gnu.org> <87im5p3dsq.fsf@gnu.org> From: Jonathan Brielmaier Message-ID: <2368135b-5f20-1e9a-3ff2-e0bff8ed5a02@web.de> Date: Wed, 17 Mar 2021 19:20:07 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Icedove/78.7.1 MIME-Version: 1.0 In-Reply-To: <87im5p3dsq.fsf@gnu.org> Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-GB Content-Transfer-Encoding: quoted-printable X-Provags-ID: V03:K1:cfr4oKIwpJB50kFE67w1q4y+R35ysP5n8RVLyBZ2sVLYAM27OSy G6aswjZiJSeSJ97tne2zitv3FmbgmkjRXzTAK+e0aEjMGsK1ZyCqo7XBtqCLIpDzCYJGG64 LYKHWApl3bi9sUoUstc9mmVSGoHpC4sNs+4CaGw7ZdGWmoy1D+fea5PMopDlXqx767RVZrP 5nA0YeBpvMEFkENI9exXg== X-UI-Out-Filterresults: notjunk:1;V03:K0:k68TQxVXNK8=:jfvY4AM4vSov5Yjf+UGVqn 7fOTFFDAq/VJT3UGMEBWAW9D5xpVoEfyk6msSHx5LBT//HSIo5scwiUbDTb90LNRsefA9Flhd 6osax63Comgzqwli5CP1RHKQfXHWqA89Fqk9Ewn7ajLA3AytqxCLMnTDoV0IhLT0ZTzaupIpA LrJQiJuU3u25KkfBtgRo56tE3TrtWl0wsqsemoF0W6TcwjBcVlGaNi0nZRH/S/57qk/2WJnE4 TTuFSQbKZxzcFABkaWJSFlT+yxPTTcrPpOh5omonnjCTTSVR4CAlyoLmJ3POWjTMWPi23yeq9 sgj6HAlEVSDZDCfwavdF8F5dj8lpNx82W5vfKHsOA4nBqqTZulwq2+1KZSKQORqVTs1Lb5yVF xoxd1hlm4CyzGiTwVZcXvt3neaLZgAlHK/qMSkb3omj7AtC7zH3fv159RgMOCOr6oXoanvdat UpIdxTW2Et4P/xwnIk+w6aXOYtJ8iG8XILRPHdBQNSpAk23SSD6elkp11qmDO5i8+civmY4FL uCC4yHFoNnarxvFrJ7PKA1seXCEHken9Z3PVtIMI5qVsJTtOjO5W8r+DeDslPTO0xdVEN6YDo VYdkHDUCKrZzJiINswFuuLGZ0G6FAgSTUnIBWUIPvxUDhUWinZ/dQN4o/IMweamiVm9Y2x9/Q llBO9W8/GYHxHTNSz2CF4DCG1i/84kE+Fb0b9nVe5rFmz24untWZu5AsXntPMdo+498UrIJ5O OykKBTyAR7Ur2keRDIJfT5vkAezeD7U7SSoDfDOuA6J+6HysPvVZf9HQ0PKITsLFl3NJ+Mj36 SWpUKdVM9TfymiakS+WLOVtmfuP1eVSGd5WQqmKEasy63FHDYEXvAAm/WPJwz6PB6jbLkPLg7 DPEKqFNMoEZl+ffejJfo0dG9VrKWo3D9vJ2JPCEV8= Received-SPF: pass client-ip=212.227.15.4; envelope-from=jonathan.brielmaier@web.de; helo=mout.web.de X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, NICE_REPLY_A=-0.001, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1616005269; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=/Srf5y2Pe6pflxuy+q1ykJt85ELhNf9YQFmb1niDODg=; b=JD+ssc1XQQX/mXN1LL5seSDm4x0iUrGmf4cF9XiAagu3F8pDzule3rEdisoaTwO5loZIuX nOXBNyAZaQahiE5EOchZRgFNL7lxAPSHVGBPHWFuSr9wdZsI5SLnCkyeEwwN2rEhSaK/Pq gKk1yOKazljmWf6eShmmulCmXGsw3ErNV5SLDKDhbodQObzKxNlmVAip+6Pp7ObdiGd1u+ 5sZ1FcYCSLcj39RoXzq/0YFIZAZvY/qAbFM3lL4TtukLQAEgvSKsfEaaOydg0MkZ6hjmcQ lmFN5z6ii+gFw7HKV0U0E3ub/d2/X40nCpL2/OSeZLp+qaj7MTbSjSmwkhBC6g== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1616005269; a=rsa-sha256; cv=none; b=h2wr9scXr/C0E33NMu5kpEHZOrQz2meopre2nTJldxRB7gdc2HC22Qfz3B3DwqIf2vs2yh 2CvX+ECMldj8vVJZ4xqEgX3xdeaoB6y8TDWnyyZRuAsCzgzOA2dt78QVRQVedLBF/fNjlk Q4INiZR7rBQkjuDoWUXgr5SXxAAw4E9CMkjDM9lFxZ18pCQfuzd9tRpDVJc6E7Xj9o/Dhj CwaHPn7+IZ0GPq//ORUFUxW9TQaLpbv+2xe8JS+FMNfpIR6qlNNuuKW65gEjAEmKSKGpLR 1SBX2xcZ3b2R2j1BCZ1hK9PKOuEUc8+HO/l98IBG6PQIrl9N0q5Ixdwde9Wh6g== ARC-Authentication-Results: i=1; aspmx2.migadu.com; dkim=pass header.d=web.de header.s=dbaedf251592 header.b=Zm5gfmcO; dmarc=pass (policy=none) header.from=web.de; spf=pass (aspmx2.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -2.10 Authentication-Results: aspmx2.migadu.com; dkim=pass header.d=web.de header.s=dbaedf251592 header.b=Zm5gfmcO; dmarc=pass (policy=none) header.from=web.de; spf=pass (aspmx2.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 3E29C20CD6 X-Spam-Score: -2.10 X-Migadu-Scanner: scn0.migadu.com X-TUID: lhmg3eQeQMcd On 17.03.21 18:12, Ludovic Court=C3=A8s wrote: > (See > > for the initial message.) > > Here=E2=80=99s an update, 1.5 month later. This time I=E2=80=99m lookin= g at nginx logs > covering Feb 8th to Mar 17th and using a laxer regexp than in the > message above, here are the gzip/lzip download ratio for several > packages: > > --8<---------------cut here---------------start------------->8--- > ludo@berlin ~$ ./nar-download-stats.sh /tmp/sample3.log = gtk%2B-3: gzip/lzip ratio: = 37/3255 1% > glib-2: gzip/lzip ratio: 97/8629 1% > coreutils-8: gzip/lzip ratio: 81/2306 3% > python-3: gzip/lzip ratio: 120/7177 1% > r-minimal-[34]: gzip/lzip ratio: 8/302 2% > openmpi-4: gzip/lzip ratio: 19/236 8% > hwloc-2: gzip/lzip ratio: 10/43 23% > gfortran-7: gzip/lzip ratio: 6/225 2% > --8<---------------cut here---------------end--------------->8--- Interesting findings... > Conclusion? It still sounds like we can=E2=80=99t reasonably remove gzi= p > support just yet. > > I=E2=80=99d still like to start providing zstd-compressed substitutes th= ough. > So I think what we can do is: > > =E2=80=A2 start providing zstd substitutes on berlin right now so tha= t when > 1.2.1 comes out, at least some substitutes are available as zstd; > > =E2=80=A2 when 1.2.1 is announced, announce that gzip substitutes may= be > removed in the future and invite users to upgrade; My personal substitution servers runs with lzip + zstd, so no gzip. It works fine, but I didn't had any "legacy" users. Although zstd is only 0,6% of lzip in regards to total downloads over the last months...