From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:303:e16b::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms8.migadu.com with LMTPS id mIMaC6GbaGVXLgAAauVa8A:P1 (envelope-from ) for ; Thu, 30 Nov 2023 15:26:41 +0100 Received: from aspmx1.migadu.com ([2001:41d0:303:e16b::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id mIMaC6GbaGVXLgAAauVa8A (envelope-from ) for ; Thu, 30 Nov 2023 15:26:41 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id C417145DD6 for ; Thu, 30 Nov 2023 15:26:40 +0100 (CET) Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=posteo.net header.s=2017 header.b=cFhz25wm; dmarc=pass (policy=none) header.from=posteo.net; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Seal: i=1; s=key1; d=yhetil.org; t=1701354401; a=rsa-sha256; cv=none; b=jaRYlxFTU/NfoyDK3Shbn+bLk7oMnRzr9xq3MxY0z1ww511WxvOHIKxlcMAsqcRVBsR5jX HO8xd8e3Bu7yKbdM5VdP/tl58N1Jj/IfFfC+rGCQBDDUWS06GfgCl5HlCGwTP5JSJbKO5d rTgN32owdD5c3vIUTw+VROL0BGqrCoSATf0Q5dG8CLBOjT7K88VNnQyMavlyho53HZ2kXV vRb+nOuZWSuAd59mO0nrBkDK7OVdNFzXnDM2ixE/POwy0toadCHIZv24txwMKrkw06yqDb zhGVJi88uJ3zKZ5xah3bFlOZrLOzh2NjCjBbxlM6UP++v/GtPlA464pv5FqBRg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=posteo.net header.s=2017 header.b=cFhz25wm; dmarc=pass (policy=none) header.from=posteo.net; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1701354401; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=+gQfUktEpqJuJsZSynVMsP9BcLDWZBxOkYUiOKoq85U=; b=NoaahOYfszMW5mw/ZxWFMCRo5gx5GlvkLicMXWuJFVSC9z1c+PKEyfHR4zOB31zWmOEbdV UtVZeKVP9k1K9lRdEo6PXiRGk7VpAXb/RiUWQ0bFmrIx8DLzCYMQxlfLIwoY0tOC5/tw4g pV0LDKyvDF7INLuVDEHaXop07tNtTQnwwuVeb48UQa0G1ug//MfDLFvKEGAg1iyPD+Rt0S No/o51zVtczmQ2lHpcwXustLNXCgpo1DGAFUjtfTqv8vrAv6OPuw/O39TDVTnkaDwoh2N5 oA/xl54o1lu+eMh6R1gY0nzJtN/I3n1ZYMNvWQXGkiITHVKHa+LoXLhuEFLt/A== Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1r8hzP-0006JF-SU; Thu, 30 Nov 2023 09:26:05 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1r8hzG-0006IL-Cm for guix-devel@gnu.org; Thu, 30 Nov 2023 09:25:54 -0500 Received: from mout01.posteo.de ([185.67.36.65]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1r8hzE-00007n-HU for guix-devel@gnu.org; Thu, 30 Nov 2023 09:25:54 -0500 Received: from submission (posteo.de [185.67.36.169]) by mout01.posteo.de (Postfix) with ESMTPS id 6FDF324002D for ; Thu, 30 Nov 2023 15:25:47 +0100 (CET) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=posteo.net; s=2017; t=1701354347; bh=10VfCdXG3mGLsLA7VCQxM+xrox7BpmfO3kB6uEyyKq8=; h=From:To:Cc:Subject:Date:Message-ID:MIME-Version:From; b=cFhz25wmCYPz+NfCtpIspswfIb2ybZ7z/wu55AdKV788Txb/3uLN3zC4ed8v2V7aR 6ID5V8WpxJ0a/JEITdGeG29VTJqX/m+cMxtBoAZ9rmIQneF/+bgvgRSrHIq0AN7Fsj Xl8pexlAFhKZJQHuDEkdIvneL7ztgKJ40jGVOTIKuOlubYlmgD4Sf3AN8pi5feNtfy XJP/u8yB8jwSvwluX6qCIBJKeObJKSOCFp156zrafh17yQOGWmXMytTg4R4VSJUeDH h+eOXKzfgK0QcE8l+MBcAnR5Wk4znbNrUWIcGGtMVWKNPRZENZZpunT9j2U3zmf3x/ uQiXqINpKQS9w== Received: from customer (localhost [127.0.0.1]) by submission (posteo.de) with ESMTPSA id 4Sgz4n6Bcrz6twX; Thu, 30 Nov 2023 15:25:45 +0100 (CET) References: <87o7g29c94.fsf@elephly.net> <878r6xu2pe.fsf@gnu.org> <877cmfd6tm.fsf@gmail.com> <87h6ldiqyh.fsf@gnu.org> <87plzsr019.fsf@gmail.com> <87zfyv4bgc.fsf@gmail.com> From: Guillaume Le Vaillant To: Maxim Cournoyer Cc: Simon Tournier , Ludovic =?utf-8?Q?Court?= =?utf-8?Q?=C3=A8s?= , Ricardo Wurmus , guix-devel@gnu.org Subject: Re: Building and caching old Guix derivations for a faster time machine Date: Thu, 30 Nov 2023 14:05:38 +0000 In-reply-to: <87zfyv4bgc.fsf@gmail.com> Message-ID: <877clztj13.fsf@kitej> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=185.67.36.65; envelope-from=glv@posteo.net; helo=mout01.posteo.de X-Spam_score_int: -43 X-Spam_score: -4.4 X-Spam_bar: ---- X-Spam_report: (-4.4 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H5=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN X-Migadu-Scanner: mx13.migadu.com X-Migadu-Spam-Score: -10.54 X-Spam-Score: -10.54 X-Migadu-Queue-Id: C417145DD6 X-TUID: p6Vbyd7SXEKp --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Maxim Cournoyer skribis: > Hi Simon, > > Simon Tournier writes: > >> Hi, >> >> On mer., 22 nov. 2023 at 19:27, Ludovic Court=C3=A8s wrot= e: >> >>> For long-term storage though, we could choose to keep lzip only (because >>> it compresses better). Not something we can really do with the current >>> =E2=80=98guix publish=E2=80=99 setup though. >> >> It looks good to me. For me, the priority list looks like: > > I'd like to have a single archive type as well in the future, but I'd > settle on Zstd, not lzip, because it's faster to compress and > decompress, and its compression ratio is not that different when using > its highest level (19). Last time I checked, zstd with max compression (zstd --ultra -22) was a little slower and had a little lower compression ratio than lzip with max compression (lzip -9). Zstd is however much faster for decompression. Another thing that could be useful to consider is that lzip was designed for long term storage, so it has some redundancy allowing fixing/recovering a corrupt archive (e.g. using lziprecover) if there has been some bit rot in the hardware storing the file. Whereas as far as I know zstd will just tell you "error: bad checksum" and will have no way to fix the archive. --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iIUEAREKAC0WIQTLxZxm7Ce5cXlAaz5r6CCK3yH+PwUCZWibaA8cZ2x2QHBvc3Rl by5uZXQACgkQa+ggit8h/j9OxAEApXQYSbSTjoYww/IBtKeEsVoTz8edh+LtJkMV wBBcetoA/ik7F42FMbhiqY1wbsoIfIKYp7rLhlZQgIG/BPyUtvG6 =XmV2 -----END PGP SIGNATURE----- --=-=-=--