From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1.migadu.com ([2001:41d0:303:e16b::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms13.migadu.com with LMTPS id yJ1OMubX5WYYTQAA62LTzQ:P1 (envelope-from ) for ; Sat, 14 Sep 2024 18:37:27 +0000 Received: from aspmx1.migadu.com ([2001:41d0:303:e16b::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1.migadu.com with LMTPS id yJ1OMubX5WYYTQAA62LTzQ (envelope-from ) for ; Sat, 14 Sep 2024 20:37:26 +0200 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=elephly.net header.s=zoho header.b=X7juAROW; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; arc=pass ("zohomail.com:s=zohoarc:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1726339046; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=ffGnwOkoDZ/JAisRw4luZHb6AdUKS+ijC7vsSjq2je4=; b=qyytW5BZrdRIUN8P+ivf3SbaaIGvqvMoW9bEidgQlSU/pGKRrZm/+BY5V7eUZ5GSYMxH52 xjHwWZhIFSF0rDdJ8E4+2WIMiQ1pDYzzaW71kF0nVZN5qup7TulQfKhOoJSrFhFPWGzJHi Su8o77zP7Lla+n5FcehfaOYv3iCX/JIOn3qOA1SeDuKcvu2e5F8U1h66D4u9xYXgdOdmlZ /85gbTxU/jstnb/Nb9AAgw1m1rPqfIs3/WjqjCxgi8R6HrZ9HxmdRUeAzZ6VWcPBu5iNQN vo3Q5/XeUUEBT9drl5N8dwNpwqMXnXwrlrLDeNfyGlEeVg38ruHgCAfn/3WjpA== ARC-Seal: i=2; s=key1; d=yhetil.org; t=1726339046; a=rsa-sha256; cv=pass; b=mlaNk1Gi1a+rTzRaxPGOjyQnP7KC5Pl8tjw+ZH53ACzCddssiBW19vlmPjRHWrPg/qmOSy pa7RS8q12ReQKZe0wkwdryc/2Zzv//wPk6jsTnEnW3JQAq/jiSh0LAZO5ydvIAETVYsnm1 ARMz4MzRW75CWbh7Ng11Amo8tET7ttA9d2F/e1rv7Lnz3mzg+n4/PwIh9ofNf9RNPFG+9F xZd2YgGi1HFIxljSe9L++P+OZYIIOEjtQUBbSjmTEsGjZ8oK5QUa6LDtnJTxx0SqhqYqL3 WSfD82i+9FsiuvFWanIr8RSMxGRgUaO0kFVksjhnpPevkANQxeMAqAmU5ZJEUg== ARC-Authentication-Results: i=2; aspmx1.migadu.com; dkim=pass header.d=elephly.net header.s=zoho header.b=X7juAROW; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; arc=pass ("zohomail.com:s=zohoarc:i=1") Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 3ABC45C472 for ; Sat, 14 Sep 2024 20:37:26 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1spXdZ-00025X-3Y; Sat, 14 Sep 2024 14:36:49 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1spXdV-00025K-7B for guix-devel@gnu.org; Sat, 14 Sep 2024 14:36:45 -0400 Received: from sender4-of-o51.zoho.com ([136.143.188.51]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1spXdS-0006fs-J1; Sat, 14 Sep 2024 14:36:44 -0400 ARC-Seal: i=1; a=rsa-sha256; t=1726338995; cv=none; d=zohomail.com; s=zohoarc; b=N6m/Oa13tkl0ZwCJsymdtjzmzjnM0W1U1r10re0RfZzegGV86aXUKskIM+6StsR6GX9tDSu/yFk7A7RzyLJcNbP6Veq6ZKSyLFwGgkPi8RhGbY1THBBp043PZCr9U0G8lS4uqSGrdhbAlHP1ru5PVJGcuOt1SRlivUNk1ssncLw= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1726338995; h=Content-Type:Content-Transfer-Encoding:Cc:Cc:Date:Date:From:From:In-Reply-To:MIME-Version:Message-ID:References:Subject:Subject:To:To:Message-Id:Reply-To; bh=ffGnwOkoDZ/JAisRw4luZHb6AdUKS+ijC7vsSjq2je4=; b=mm6pb/jinHlW68hTif74zHOILYpnlstdGRmcSl321mKzXzMlhRCzR1Jl76x+gV1K743zaLlBwsyruHYkawh2Jqkt5JbrXDt0TGayyB3pmbGffagZBaZHZ5oUGtCBJQfPB2fpEU5SEBZ4He57j1ax4iqb06fPziFGmPL3cONqmbU= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass header.i=elephly.net; spf=pass smtp.mailfrom=rekado@elephly.net; dmarc=pass header.from= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1726338995; s=zoho; d=elephly.net; i=rekado@elephly.net; h=From:From:To:To:Cc:Cc:Subject:Subject:In-Reply-To:References:Date:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-Id:Reply-To; bh=ffGnwOkoDZ/JAisRw4luZHb6AdUKS+ijC7vsSjq2je4=; b=X7juAROW7A58qgK46Ph2K5Zo/gaSvxxLqvPaA5HoeZFCGbAqz5PQWA98PV3p/m3k KPlhPHgmfylcrHrpsr/Q08RUWc84FBsprlX+MR7IePsri7BO9DesFpcu0rGrbM22C8I lqymb4jjmbeDz2z+dxO35R9GMSKA9b8pVn9Vfdfo= Received: by mx.zohomail.com with SMTPS id 1726338994176846.5227849856599; Sat, 14 Sep 2024 11:36:34 -0700 (PDT) From: Ricardo Wurmus To: Maxim Cournoyer Cc: Ludovic =?utf-8?Q?Court=C3=A8s?= , guix-devel@gnu.org Subject: Re: "guix pack -f docker" does too much work In-Reply-To: <87y13uqo77.fsf@gmail.com> (Maxim Cournoyer's message of "Sat, 14 Sep 2024 23:55:56 +0900") References: <87sey0lqpn.fsf@elephly.net> <87cyp0ojc5.fsf@gnu.org> <87y13uqo77.fsf@gmail.com> Date: Sat, 14 Sep 2024 20:36:30 +0200 Message-ID: <87o74q3wwh.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-ZohoMailClient: External Received-SPF: pass client-ip=136.143.188.51; envelope-from=rekado@elephly.net; helo=sender4-of-o51.zoho.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -5.57 X-Spam-Score: -5.57 X-Migadu-Scanner: mx13.migadu.com X-Migadu-Queue-Id: 3ABC45C472 X-TUID: YZo50DBjcGus Maxim Cournoyer writes: >>> I think it would be great if "guix pack -f docker" could avoid building >>> all these identical layers again and again. Perhaps it would be >>> possible to have a single derivation for each layer? This way we >>> wouldn't have to recreate the same layer archives every time. >> >> That sounds nice in terms of saving CPU time. It=E2=80=99s less nice in= terms >> of disk usage: a single =E2=80=98guix pack -f docker=E2=80=99 run would = populate the >> store with roughly twice the size of the closure. >> >> I think each solution (single derivation vs. one derivation per layer) >> makes a different tradeoff. I don=E2=80=99t have a strong feeling about= which >> one is better. > > In past discussions (such as the implementation of the 'RPM' pack > format) we had concluded that a single derivation was preferable. Large > chunks to be sent to offload machines over the network are not very > practical, and as Ludovic said, they also require more store space. Dependent on the situation I can see one approach to be preferrable to the other, and in other situations this could very well be reversed. Can we expose this choice to the command line interface of "guix pack"? --=20 Ricardo