From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id OI2wBxSHAmIXTAAAgWs5BA (envelope-from ) for ; Tue, 08 Feb 2022 16:07:00 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id GDhzABSHAmJq9gAAG6o9tA (envelope-from ) for ; Tue, 08 Feb 2022 16:07:00 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id BD81911B2A for ; Tue, 8 Feb 2022 16:06:59 +0100 (CET) Received: from localhost ([::1]:33276 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nHS54-0005Sg-S1 for larch@yhetil.org; Tue, 08 Feb 2022 10:06:58 -0500 Received: from eggs.gnu.org ([209.51.188.92]:46716) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nHRFX-0006vx-3x; Tue, 08 Feb 2022 09:13:44 -0500 Received: from [2607:f8b0:4864:20::82c] (port=37473 helo=mail-qt1-x82c.google.com) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nHRFR-00040A-31; Tue, 08 Feb 2022 09:13:39 -0500 Received: by mail-qt1-x82c.google.com with SMTP id k25so14784248qtp.4; Tue, 08 Feb 2022 06:13:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=from:to:cc:subject:references:date:in-reply-to:message-id :user-agent:mime-version; bh=6/M1kmVTPXWuEBbpTmcZBr/2cbHr4uztFqXWCiDASHE=; b=W3RflkoejlxSnvfLA4fD/4VrM3yn+bQPCCgxMHI6TqZTaSZjFj3aZECx7/zWy4wLDd lIFl6AJWkcM/8H0tD7nOtLt1+E4WWtvEr3A2fgb7BKydmKYiR8/ZNQk7gPQAdt3ePx3x sLbXfoU835AclSSzla/upoj+Svd9w+Dc1SWnarYwV7qDWauP4FSmRN16Qv7yB/Tz1laC irRMVfkrvhPkaFXAps2v1sm/uP1xcN3Gzj6LbspCXgCqrpDJPGysD/EFek17uIhL2AA6 mGQFHO08rchNIa9+UTSSkkZsH7CGmFOoJKkRHiNqt/Fv6RBcxqziwFEEerjkT+2Er1Pr QkhA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to :message-id:user-agent:mime-version; bh=6/M1kmVTPXWuEBbpTmcZBr/2cbHr4uztFqXWCiDASHE=; b=d+rWz0j7zBHk4t85I1J/TpAn8ENRs9zWCedn8t+omfKc/am6cUs0xJXdQNhOv08PrX A8LhTMmEktr7hTag9EiEPdiPOOWwTDJbkQHIOjdrAcgiEVTIUckuEB7qU5zRboKcqCPI 5dZGFUEnHpVa2Fddh4oHXWWNGvtzJikN5HT9AF+yanu6U46U1hKP4EECnTTH+X47kjBm sjTeobH3GaM0cHYC6+G3eaKhFvHB7W5a4c2blp0flhMuCIz54m0DMfx2Wb/UjESpkrdg cz/iY5ZMfCtI5v5lCFJISYfjXxA6oWjngdcJfIlMfSxxcMdxOp7u5eC0AjvmxhgMhzuM sUqQ== X-Gm-Message-State: AOAM530rcbXifwALT+55ajCpqej/G/x4Ukb+WlqetYk9kNKargPD2Kdp w0q8X7Uylz1fUT6yDOv6TVZ8jUjrG8w= X-Google-Smtp-Source: ABdhPJyFRxTgWC6Tvo974ywxSfVRebSq2lEAAjN0ZQtCkOT9fYSk6M6iXWcoPiWtqd+zIeRlRHy35A== X-Received: by 2002:ac8:7e89:: with SMTP id w9mr3044228qtj.574.1644329614072; Tue, 08 Feb 2022 06:13:34 -0800 (PST) Received: from hurd (dsl-154-179.b2b2c.ca. [66.158.154.179]) by smtp.gmail.com with ESMTPSA id bm8sm1384454qkb.25.2022.02.08.06.13.33 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Tue, 08 Feb 2022 06:13:33 -0800 (PST) From: Maxim Cournoyer To: Mathieu Othacehe Subject: Re: Dropping gzip-compressed substitutes References: <878rum1pph.fsf@gmail.com> <87tud9jxc6.fsf@gnu.org> Date: Tue, 08 Feb 2022 09:13:32 -0500 In-Reply-To: <87tud9jxc6.fsf@gnu.org> (Mathieu Othacehe's message of "Tue, 08 Feb 2022 14:34:49 +0100") Message-ID: <874k5930qb.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Host-Lookup-Failed: Reverse DNS lookup failed for 2607:f8b0:4864:20::82c (failed) Received-SPF: pass client-ip=2607:f8b0:4864:20::82c; envelope-from=maxim.cournoyer@gmail.com; helo=mail-qt1-x82c.google.com X-Spam_score_int: -12 X-Spam_score: -1.3 X-Spam_bar: - X-Spam_report: (-1.3 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, PDS_HP_HELO_NORDNS=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RDNS_NONE=0.793, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel , guix-sysadmin Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1644332819; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=6/M1kmVTPXWuEBbpTmcZBr/2cbHr4uztFqXWCiDASHE=; b=mGzX1C2JArMteVp3cGrLw9zd93nCixLKTx1efRPhttPW5MeCzvN3M0e8UpEjiJiVE5n6/y oXGAXU8YgCIl2OzGAVd6PSsZRXwouUY2E3urk3MiYaB/Qi3gPhLChoYpN1nguExLeF+Mjm hX/9BJwa5xiOJFKw7YiKlWlYnWZVJMMIG5IvhsLI801ijZX5cGD+MDfuce5hWjkoG/xljm gpR2LWRP26LeivG3C7F8XKEqUlqxrPIS4jsPTADqUUA5Y2CCYHqCqz1FZkHgD6f7PpFxAg 8twaC2gi4A/xbZSsH9+bK31ZZJZFz5cIRzYgn5PVDURVNNkVbhJnJo892KY0rQ== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1644332819; a=rsa-sha256; cv=none; b=WyRpghuHBBrFuqNE9eBPrOjpYi44dQ19PjNOGM1gjlJe9e0o0GhTFbYHxN0ni2RIHWTwKH Bm8YsucnHBVFLs1GomBx/as34QLVxN8EGNlLRBDv4i26SbkH1JLGOj8OETUkOJl/IcHq6K DLtsvgOGrPx4OQGq/+Rq9/9Tzr1R3gPiWHt+hvafJjv6OgpD1TfoY3vCZGTEZa40ltz/N/ lWDCPpmRu+gVkrpo0hzIvNPBQJhMN2tC89FTVtsOaS4Ah9rFekaT2MvWMSFf+N844tL83e R+jvBGieXKQocGBLMJQzXLRYRh+OCu5tvoVZGB22R3T60HEXVP0/dyNZivMUKA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=W3Rflkoe; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -4.33 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=W3Rflkoe; dmarc=pass (policy=none) header.from=gmail.com; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: BD81911B2A X-Spam-Score: -4.33 X-Migadu-Scanner: scn1.migadu.com X-TUID: 8zQnLmAjHqkj Hi Mathieu! Mathieu Othacehe writes: > Hey Maxim, > > Sound like a fine plan. > >> 1. Promptly set up both a blog post and a NEWS entry announcing the >> support for gzip substitutes is about to be phased out from the build >> farm (1 month notice), urging users to upgrade their daemon to a version >>>= 1.1.0. > > I addition, we could warn users with old daemons as proposed by Ludo & > Ricardo. There's an attached patch here. Awesome, thank you! It LGTM. Could you apply it? >> - ;; TODO: Eventually, disable gzip, as discussed at >> - ;; . >> - (compression '(("gzip" 9) ("lzip" 9) ("zstd" 19))) >> + (compression '(("lzip" 9) ("zstd" 19))) >> (cache-bypass-threshold cache-bypass-threshold) >> (workers publish-workers))) > > Nice. > >> 3. Come up with a Guile script that is able to >> >> a) Strip gzip-related metadata from the .narinfo guix-publish metadata >> files >> b) recompute and update their 'Signature' field. >> >> 4. Finally, 'rm -r /var/guix/publish/gzip' and free about 6.5 TiB of data. > > I hope the script will be able to complete within a reasonable amount of > time, but we cannot know before trying it out :). The script will run on the cache data kept on the SSD array (which we can snapshot before experimenting with). It'll probably take a while still, so care should be taken to ensure it takes as little time as possible (e.g. spawning many threads or processes to spread the load across multiple CPUs). I'll work on the blog post and news entry, and then we'll have to look at the script. Thank you! Maxim