From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms13.migadu.com with LMTPS id 6C8aMq0t5mY5/gAAe85BDQ:P1 (envelope-from ) for ; Sun, 15 Sep 2024 00:43:26 +0000 Received: from aspmx1.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2.migadu.com with LMTPS id 6C8aMq0t5mY5/gAAe85BDQ (envelope-from ) for ; Sun, 15 Sep 2024 02:43:25 +0200 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=EEdtsn0R; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1726361005; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=c29FD1xTsGuas/U5JXmk/NeL2k/BuugjOiK8kEDUDHY=; b=JrRGYJ2qFvxhgJkbcMYzlVD/k+SI/cksAJxYJfbpk71dYzTd3CYM0qMO2f+xglAE+8hKnu jWPRDzgk85M8FK2CDj+nBFmwEokcpDBBvvmgoydqax5YyvyhpEsblmGZDRL3OwWvfYkF0l 7BEl2EZLMYfVyjoscXM5n2yyUTmG8XjnyEjCZL3f4lSyuegFm/uhJCYlUbvnM+PGe5aYk9 STkHzEAB3F/cQsgPQyv4dt4w53wdCeh2sLcS7f9WNyVZaqikb0yZIH+LiuP85pfHGYX61y gMiMiPAfEih7l+MOQ1vGVwvaYfRa7R+ZLX6doC8suwO0ivjrGItqEHn38gK50Q== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1726361005; a=rsa-sha256; cv=none; b=GwHKzpLs3aHRnGh1YQibHoBJZkMj7wdSKpmLCQFQ3P4VL8dPAksl1TTuXGehB1I5TFH47F V4bo9r/ui2floQ89kao9z/jXUplaWVCA8ZEi7Hc6b1mKTHavLLerWuDBNfTGyPGX2u8jF9 VBcJG2gs1nsmpTHOQMbFevjfuGl05lfM/elBUuDxPNXV2xbjHHvyNQU+CzaJwZOBqqZ2km 0PIaePNJ+DaUtp28N3ZA6Da91Z4CrK2ez9NValvVToz5j4sntXTMvKSYw71AfhaxcwhvOH WWb0qNlFvX/pftTP7M7nTpaDdDqSV+B/nwMpIOK7Nim9LuPdLLm5i2dSbAaE9Q== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=EEdtsn0R; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gmail.com Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 7A24D7EE3A for ; Sun, 15 Sep 2024 02:43:25 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1spdLl-0005lI-A8; Sat, 14 Sep 2024 20:42:49 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1spdLj-0005lA-9K for guix-devel@gnu.org; Sat, 14 Sep 2024 20:42:47 -0400 Received: from mail-qk1-x743.google.com ([2607:f8b0:4864:20::743]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1spdLh-00026j-Nm; Sat, 14 Sep 2024 20:42:46 -0400 Received: by mail-qk1-x743.google.com with SMTP id af79cd13be357-7a9a23fc16fso349575485a.2; Sat, 14 Sep 2024 17:42:43 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1726360962; x=1726965762; darn=gnu.org; h=content-transfer-encoding:mime-version:user-agent:message-id:date :references:in-reply-to:subject:cc:to:from:from:to:cc:subject:date :message-id:reply-to; bh=c29FD1xTsGuas/U5JXmk/NeL2k/BuugjOiK8kEDUDHY=; b=EEdtsn0RKM6+0rDUGYws9o8LfbKN9NktNzu3+T2aSoShwzPl514DxCD2XuDqm9iezA mA4VboyRaYZUl9KT6CjFa2iNTjXXu/9ChBbQ3c/8FzQCHppW5x4CdrzIG2+raZUpSTew UkCOkL7swDn2+sxb/5zgK3DF/VKQh91vN+hhIsCtjS7gobEbMSIYC3HreiII/UpL3kdC S01XniRPu7GxvaELbx6ira5426TpGKU5r0JPGlU7iKGgN2BW1wgOj8WB8Nt2FGGGeQc6 p1m7M7CwDRGl995/SczkzBseIRqJCx2hGtSm743TTM+TFq2kdNRErMx/yscJvtK4WUWi VMWw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1726360962; x=1726965762; h=content-transfer-encoding:mime-version:user-agent:message-id:date :references:in-reply-to:subject:cc:to:from:x-gm-message-state:from :to:cc:subject:date:message-id:reply-to; bh=c29FD1xTsGuas/U5JXmk/NeL2k/BuugjOiK8kEDUDHY=; b=LMKHqc3X4VqAow5CbbsVVWK8zh5BvlLPaXQP5NS2JZHLLcV62WfO1CmGksjoRzFOlz dgadkjWWH5kOPWmLOit8sdHQPLj/osAez06+S+nYWNr1MO2WxTCBMlGlvbbcQ3rfecH0 rVqVnrRGqYqUNMro5k27/6pcQnIXQmqZerFUD8KsPzqgs0MZkwVWkAvJcZuNZA1y+Aaf DLa4AbuwBDYwPkPTw92IJsvX9lTTj7440QgH2zPsaUErVUEK4wQzCrrRG6u1eURMeHnb eHMJOyG4Z8jycVLmYA/BHFa4qHiI/jQS79I5p31vqRwCDwd3kawIiwh/oHLcakSucGFL 3b1g== X-Forwarded-Encrypted: i=1; AJvYcCX/6XZ/TrTAKw447hh+FbVCtBDwbo8pfn7uInfZo+RP5oNdmVgwGfJ/vE6RGSj8P9MjAdCBl8McmqL8@gnu.org, AJvYcCXdijTGsqSPUsJDkoNfEkZiRiMDvecePBgZ+J5kvwEciaglVDQwqQJMMH6z7nDy+MzJp9Q8Vw==@gnu.org X-Gm-Message-State: AOJu0Yz8VINyOhuAETBt9ce02No62yuhxm3OKZbnldX6jE2gKE2etQql 1KysKbr500Nlp3Bbnh0YMM+qVbpzONY9Z/JSAGjQT0b3nhU+0zfdB9Qdc74P X-Google-Smtp-Source: AGHT+IFcPRVwPSGMPJeoJIGNq26YCGpIKywvfe9JSjXwX0vDeXbwik80EsTSHmwG1c1CqhwrYe4WhQ== X-Received: by 2002:a05:620a:2a12:b0:7a9:bd93:ac3a with SMTP id af79cd13be357-7a9e5f02dc2mr1493761485a.14.1726360961812; Sat, 14 Sep 2024 17:42:41 -0700 (PDT) Received: from gnus ([65.94.70.53]) by smtp.gmail.com with ESMTPSA id af79cd13be357-7ab3e95bce0sm116791485a.3.2024.09.14.17.42.40 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sat, 14 Sep 2024 17:42:40 -0700 (PDT) From: Suhail Singh To: Ricardo Wurmus Cc: Maxim Cournoyer , Ludovic =?utf-8?Q?Court?= =?utf-8?Q?=C3=A8s?= , guix-devel@gnu.org Subject: Re: "guix pack -f docker" does too much work In-Reply-To: <87o74q3wwh.fsf@elephly.net> (Ricardo Wurmus's message of "Sat, 14 Sep 2024 20:36:30 +0200") References: <87sey0lqpn.fsf@elephly.net> <87cyp0ojc5.fsf@gnu.org> <87y13uqo77.fsf@gmail.com> <87o74q3wwh.fsf@elephly.net> Date: Sat, 14 Sep 2024 20:42:29 -0400 Message-ID: <87ed5lpx1m.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=2607:f8b0:4864:20::743; envelope-from=suhailsingh247@gmail.com; helo=mail-qk1-x743.google.com X-Spam_score_int: -17 X-Spam_score: -1.8 X-Spam_bar: - X-Spam_report: (-1.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Scanner: mx12.migadu.com X-Migadu-Spam-Score: -9.82 X-Migadu-Queue-Id: 7A24D7EE3A X-Spam-Score: -9.82 X-TUID: 8ejH6JR3YLP9 Ricardo Wurmus writes: >>>> I think it would be great if "guix pack -f docker" could avoid building >>>> all these identical layers again and again. Perhaps it would be >>>> possible to have a single derivation for each layer? This way we >>>> wouldn't have to recreate the same layer archives every time. >>> >>> That sounds nice in terms of saving CPU time. It=E2=80=99s less nice i= n terms >>> of disk usage: a single =E2=80=98guix pack -f docker=E2=80=99 run would= populate the >>> store with roughly twice the size of the closure. >>> >>> I think each solution (single derivation vs. one derivation per layer) >>> makes a different tradeoff. I don=E2=80=99t have a strong feeling abou= t which >>> one is better. >> >> In past discussions (such as the implementation of the 'RPM' pack >> format) we had concluded that a single derivation was preferable. Large >> chunks to be sent to offload machines over the network are not very >> practical, and as Ludovic said, they also require more store space. > > Dependent on the situation I can see one approach to be preferrable to > the other, and in other situations this could very well be reversed. I agree. > Can we expose this choice to the command line interface of "guix pack"? That would be quite helpful, indeed. Happy to help with this if someone can point me in the right direction, provided the effort of "pointing me in the right direction" isn't too great to be impractical. --=20 Suhail