From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms1.migadu.com with LMTPS id sCE8AbF5Q2aCUwEAqHPOHw:P1 (envelope-from ) for ; Tue, 14 May 2024 16:48:17 +0200 Received: from aspmx1.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0.migadu.com with LMTPS id sCE8AbF5Q2aCUwEAqHPOHw (envelope-from ) for ; Tue, 14 May 2024 16:48:17 +0200 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=rdklein.fr header.s=zoho header.b=d3vVHXvK; dmarc=none; arc=pass ("zohomail.eu:s=zohoarc:i=1"); spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Seal: i=2; s=key1; d=yhetil.org; t=1715698096; a=rsa-sha256; cv=pass; b=fL/JL7kCTs0y5RdUQs6LRPiJwMTEmJg5b2nIoyLrV+pK784Dad+EnTDxCwmZpcF8SsoV0G iZ11emAOmiDeo3qhiEtaDDxr0G9W7h93bjkEi0AxjvjBcgr78lGLgpdsUhzW+5Xe/IPhvQ GgIcHrKgBxKiONIxtDpMpSRMgqzXKi2yshq70uiBShrtByRJuyaLoWW57swhP6XGQHeSES HvHVTYFy5f8IMaDY7I6JRvqFeN/29tWmdQZxYEnPjjeqZnQXdS4uMAOEBU9VRhSSSQoroY ZEmmJtt7kDI9iXPXqaH2Fra6dI+YpQWOmYuYd3DUVBnM3Z8cKNBf0mJcCgqFsQ== ARC-Authentication-Results: i=2; aspmx1.migadu.com; dkim=pass header.d=rdklein.fr header.s=zoho header.b=d3vVHXvK; dmarc=none; arc=pass ("zohomail.eu:s=zohoarc:i=1"); spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1715698096; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=siHMmTbfdTHJcI+tad4rOnayzPaPXMUyNSu6yxv+Fuo=; b=YnKL5oDH1XkqQ4Y3cUptskIvey9dEC0o8pAPB1Hd7eYm8MVPLG7traqEbA9geVUAQRRxj2 i748/QdtFbVML1WeXMWCxkmrQIZVeL10Y8cH1MDcAPX7QSFRcdkZJiXjkzzpvR60FBgLoW ElSwn0DRJs5bkZeK3HdWYY25pUotQYsplvEdCazzJ72niZF2Y9vzj737BkC3Ac2/1jSKdH SFiMZQktQFJe5BXQnY2IOyeHR66og8c+OuNG0SAzgSKt9mLkERHFtqSMl5n+Lr65nlTw3/ LLnY5BE4IapmdbVVcp0dCV+ny/jgY5SExy1TYAxch7Q+zfx3Ju5ufI1RXt4+yw== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id D25FC26B6D for ; Tue, 14 May 2024 16:48:16 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1s6tRT-0006LL-P0; Tue, 14 May 2024 10:47:47 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1s6tRJ-0006Ju-Qj for guix-devel@gnu.org; Tue, 14 May 2024 10:47:44 -0400 Received: from sender-op-o11.zoho.eu ([136.143.169.11]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1s6tRE-0006WT-GU for guix-devel@gnu.org; Tue, 14 May 2024 10:47:37 -0400 ARC-Seal: i=1; a=rsa-sha256; t=1715698046; cv=none; d=zohomail.eu; s=zohoarc; b=F/IlNYDoRRqiRO/Z4kWw2BBN62VjSMU9CwswsIYJh5hF6WhLbew44R3w7SWsDLsahqhUyH+d5/qjVpr2JoYu0ffzJpYRGTanOGOvwkgcbqTtTBaei2WuXxsZi9BPTp/VNsAOd86Db+MAznpdvuF2EWgcebB7AWLCG1U7uT/UonE= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.eu; s=zohoarc; t=1715698046; h=Content-Type:Content-Transfer-Encoding:Cc:Cc:Date:Date:From:From:In-Reply-To:MIME-Version:Message-ID:References:Subject:Subject:To:To:Message-Id:Reply-To; bh=siHMmTbfdTHJcI+tad4rOnayzPaPXMUyNSu6yxv+Fuo=; b=auI4MVVDG4o07+G9z9sI2tNj6zuYPQ3Xs+fz5Dqnwq6z238vNe2j4yUPS32dtJHJRCj8YD32cac13bpEIhfI9onUkcSGZAOaVsZnze4TIm5eaNWSAcksX38ncN3LL9pa5LXT7dh9CaMyZI9QoWX6o8oTOkYW6i6wLc4AABblPpw= ARC-Authentication-Results: i=1; mx.zohomail.eu; dkim=pass header.i=rdklein.fr; spf=pass smtp.mailfrom=edou@rdklein.fr; dmarc=pass header.from= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1715698046; s=zoho; d=rdklein.fr; i=edou@rdklein.fr; h=References:From:From:To:To:Cc:Cc:Subject:Subject:Date:Date:In-reply-to:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-Id:Reply-To; bh=siHMmTbfdTHJcI+tad4rOnayzPaPXMUyNSu6yxv+Fuo=; b=d3vVHXvKiJfj33kDDen/wBIRjFVT6jw4AXM+odkk2ItI7roT5kKKgUKP5qUuGgwL ioegs9MHJ6wxxtpTAVOZKngrhazlTLcyT6w0aGURBKtqHH6Mkevsy1IDgiI02imXSXa YrS20D+WebeVq7//ApE+qOWXSAXizhz+NTm2zJZqMF8E5mZDXRMxgJt04bMRi7jv7q+ h0G3m7b03NkCatALcPkdZx9t/j8WDTpmf10c/dOJwJoQJR0y3t0HbiP1uM9JyeLtag0 8jitqjxo0C/Ayh9CaY1iFPHqgaJa4uB3YE1QgoSMEPcvuFpKKEFhOCd1yT5l5eMxQmJ 4dgQbB39jA== Received: by mx.zoho.eu with SMTPS id 1715698043029211.95524651514393; Tue, 14 May 2024 16:47:23 +0200 (CEST) References: <874jb16993.fsf@rdklein.fr> <87ikzh340q.fsf@gmail.com> <87y18d1koi.fsf@freakingpenguin.com> <875xvh1e9y.fsf@gmail.com> <87jzjx1ago.fsf@freakingpenguin.com> <87ttj0zpwr.fsf@gmail.com> User-agent: mu4e 1.10.2; emacs 28.2 From: Edouard Klein To: Simon Tournier Cc: Richard Sent , guix-devel@gnu.org Subject: Re: Guix pull: avoiding "Computing Guix derivation" Date: Tue, 14 May 2024 16:40:47 +0200 In-reply-to: <87ttj0zpwr.fsf@gmail.com> Message-ID: <87v83g4fir.fsf@rdklein.fr> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-ZohoMailClient: External Received-SPF: pass client-ip=136.143.169.11; envelope-from=edou@rdklein.fr; helo=sender-op-o11.zoho.eu X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN X-Migadu-Queue-Id: D25FC26B6D X-Migadu-Scanner: mx12.migadu.com X-Migadu-Spam-Score: -8.92 X-Spam-Score: -8.92 X-TUID: ngw9jdZH+zjB Thank you both for this detailed explanations. I think I have a better grasp at the problem. Keep in mind that I never not dive into guix's internals. I just - had previous experience with Gentoo and Source Mage (anyone remember this distro ?) who did some interesting steps towards reproductibility back in the day - knew what a Merkle dag is - read the manual and dived in with an overconfidence in my understanding of how this all works. To simplify the problem somewhat, bear in mind that a very good first step would be to avoid the "Computing Guix derivation" step, once it's been done already once and its result is "nothing to do". If that could happen, I could just run it as root once (4 minutes of downtime a week is manageable) and let the other users enjoy my cache. Simon Tournier writes: > Hi Richard, > > On lun., 13 mai 2024 at 20:52, Richard Sent = wrote: > >> You're correct. This solution wouldn't be sufficient to avoid "Computing >> Guix Derivation" for every possible A or B. To my understanding it could >> reduce the frequency this occurs. > > [...] > >> Assuming D changes significantly less frequently than A, B, C..., I >> would think this should be something we could feasibly substitute (at >> least for recent D and Z). > > Well, the package =E2=80=99guix=E2=80=99 has changed 14 times over the pa= st year. > Therefore, this D cannot be this package =E2=80=99guix=E2=80=99, IMHO. > > $ git log --format=3D"%cd %s" --since=3D"1 year ago" | grep 'gnu: guix: U= pdate' > Mon May 13 18:22:53 2024 +0200 gnu: guix: Update to 7ca9809. > Tue Mar 12 14:27:01 2024 +0100 gnu: guix: Update to 4c94b9e. > Mon Mar 11 23:14:37 2024 +0100 gnu: guix: Update to 8f4ffb3. > Sat Dec 2 15:37:44 2023 +0100 gnu: guix: Update to 1.4.0-16.aeb494322c. > Thu Nov 30 07:15:36 2023 +0100 gnu: guix: Update to 1.4.0-15.e0885fcfbb. > Thu Nov 9 10:42:55 2023 +0200 gnu: guix: Update to a60ff46. > Fri Oct 6 12:26:44 2023 +0200 gnu: guix: Update to e863274. > Thu Sep 28 11:44:08 2023 +0200 gnu: guix: Update to d0438fc. > Mon Sep 18 12:31:52 2023 +0200 Revert "gnu: guix: Update to 1.4.0-11.658d= e25e99." > Mon Sep 18 06:49:46 2023 +0200 gnu: guix: Update to 1.4.0-11.658de25e99. > Tue Aug 22 21:30:49 2023 +0200 gnu: guix: Update to 1.4.0-10.4dfdd82210. > Tue Aug 22 11:17:52 2023 +0200 gnu: guix: Update to 30355c1. > Mon Oct 2 09:28:02 2023 +0200 gnu: guix: Update to 1.4.0-12.b9fae146d6. > Mon Aug 21 18:44:49 2023 +0200 gnu: guix: Update to 0e6215a. > Fri Jun 9 22:11:14 2023 +0200 gnu: guix: Update to 44bbfc2. > > > Maybe I have a bad practise but here my =E2=80=9Cguix pull=E2=80=9D histo= ry: > > $ guix pull -l | grep Generation > Generation 1 nov. 17 2023 13:18:58 > Generation 2 d=C3=A9c. 11 2023 10:55:51 > Generation 3 f=C3=A9vr. 02 2024 01:56:52 > Generation 4 mars 25 2024 18:22:25 > Generation 5 mai 13 2024 19:28:31 (current) > > Therefore, I am not convinced that replacing "Computing Guix derivation" > (build-aux/build-self.scm) by the package =E2=80=99guix=E2=80=99 would be= robust enough. > > (Assuming another package =E2=80=99guix=E2=80=99, lighter e.g., without r= equiring the > test suite, etc.) > > All that said, any experiment =E2=80=93 even if it appears at first clunk= y =E2=80=93 is > very welcome! This part will be improved only if there is a collective > effort / discussion / try, IMHO, i.e., by challenging the status quo. :-) > > Cheers, > simon