From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id aFNjMcTWlWJhEAAAbAwnHQ (envelope-from ) for ; Tue, 31 May 2022 10:50:12 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id CMJuMMTWlWLgNwEAG6o9tA (envelope-from ) for ; Tue, 31 May 2022 10:50:12 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 66536DB5B for ; Tue, 31 May 2022 10:50:12 +0200 (CEST) Received: from localhost ([::1]:47374 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nvxZr-0005Hl-FT for larch@yhetil.org; Tue, 31 May 2022 04:50:11 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:42346) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nvxYw-0005G2-PT for guix-devel@gnu.org; Tue, 31 May 2022 04:49:14 -0400 Received: from andre.telenet-ops.be ([2a02:1800:120:4::f00:15]:50022) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nvxYv-0001ZQ-5c for guix-devel@gnu.org; Tue, 31 May 2022 04:49:14 -0400 Received: from ptr-bvsjgyhxw7psv60dyze.18120a2.ip6.access.telenet.be ([IPv6:2a02:1811:8c09:9d00:3c5f:2eff:feb0:ba5a]) by andre.telenet-ops.be with bizsmtp id dLp92700x4UW6Th01Lp9Zu; Tue, 31 May 2022 10:49:11 +0200 Message-ID: Subject: Re: Faster "guix pull" by incremental compilation and non-circular modules? From: Maxime Devos To: =?ISO-8859-1?Q?G=E1bor?= Boskovits Cc: Ludovic =?ISO-8859-1?Q?Court=E8s?= , Ricardo Wurmus , Guix Devel Date: Tue, 31 May 2022 10:49:09 +0200 In-Reply-To: References: <2067ba1e606855eace261fd0b0ae9721b369bbd5.camel@telenet.be> <878ru5epyv.fsf@elephly.net> <753ba5897ed397b5e95175cd139137975245945b.camel@telenet.be> <875yozdta6.fsf@gnu.org> <752f9901f6c3c813b5553534aefc2e4e8f5aad63.camel@telenet.be> Content-Type: multipart/signed; micalg="pgp-sha512"; protocol="application/pgp-signature"; boundary="=-k30FOcnPTZdns8GdjQMp" User-Agent: Evolution 3.38.3-1 MIME-Version: 1.0 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=telenet.be; s=r22; t=1653986951; bh=zDCkxcSXQ3wGACd007FV3nmYS+11J+pUo5ISgbXi3tE=; h=Subject:From:To:Cc:Date:In-Reply-To:References; b=aae34lF0FSNRurenXRiLj/sPNxLSV4d0kz4l6qukVXOKelBf6ve0dQYBu6NhZyrAl zsh5A9qK3pwKlX9DuJCTtGGZ9M/nxMcJNLspIK67K3+cNzWYXfLyxeHjW08iSbpW8K XTZgW/qz7wOA4gpHlEBGwriabRwm7j/wsTag+JYYpAIFeNRAzN7enS99BGq2ZDs5Rj jfMom/o2s0FDeRuZm8B+rWujyHWK3ueQcdDdaH58eZNmH08hOd/4h0rbrbLV9BBDvP yu5D0ikbK+PrYuKMDy3uDkgw0P3FbjvnPpC07lg5nNEUb4pqfblBpi2mmoaWCgHW82 NE/pUMkEAJj+w== Received-SPF: pass client-ip=2a02:1800:120:4::f00:15; envelope-from=maximedevos@telenet.be; helo=andre.telenet-ops.be X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_LOW=-0.7, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-To: larch@yhetil.org X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1653987012; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=zDCkxcSXQ3wGACd007FV3nmYS+11J+pUo5ISgbXi3tE=; b=f/YL38mezR60Z8KuZq2cSTOetpD18sKEsODEWQV8qxBjbhIb7MbWxSW1NZ6TILyC3+ZbgS BfdrxCL4EAdEDVORbhgXyJActh+d+OPvpXMfP6M8tKhpNHlGZsePH82TCO/OUZj/28D8J0 x7uKI34zCrQ87UKagy1FWZRMgwgp/M9nhJgVoTxTerH27YWtfutgAlDsJ1ULwZe8mck19J SpoNmYqRWQo8DYui1V9RGC9JnQancAl6955bvJy/hGTVyCfy9GbufSTJqpEkqz0D3Wqvcw jxMh2tQ+pJ2hbTGmMR33Dc4BLcu5Wr3GSLTUzMJ5NWo3PPl3rEmLDGl3sAMtaw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1653987012; a=rsa-sha256; cv=none; b=TzHmzK1zvPaBvHP1oOkfJ1wmXTDMKYa5IOT/4zUDpNHqCbPi/WLhLno05LL+sX6jEtw6nP peF9o2+4P1kmIGxJ7ewCWQ+aMWG6rH3C0go11tJ4IRyb5SCaxMY0R3ZGbQn3h9iJDRlKvl CGlctFnjLuscsO/UzrUs3FOiaT7RcvEEoTw1UvjBQVjph3pvdFALYKdPsgbMNgwDMJjS4l c8KpV+mz0AcmrhgfIkQQ8mOHEw392Lhx7ZAJ8vYZFE+IvxvltZSO8oTeCUwwCtLB3DoyeN /H1pEUzO9wCmpLhR/Jk7gedgiVQzedMydhwKCYrau/V9flfq60MMDUikpsTYDg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=telenet.be header.s=r22 header.b=aae34lF0; dmarc=pass (policy=none) header.from=telenet.be; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -5.23 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=telenet.be header.s=r22 header.b=aae34lF0; dmarc=pass (policy=none) header.from=telenet.be; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 66536DB5B X-Spam-Score: -5.23 X-Migadu-Scanner: scn1.migadu.com X-TUID: Ud+QVG2aFvjb --=-k30FOcnPTZdns8GdjQMp Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable G=C3=A1bor Boskovits schreef op di 31-05-2022 om 06:54 [+0200]: > I was thinking about a bit of a different structure that can also be > automated. My original idea was to use the already existing tree > structure of the derivations, and split it based on depth. I think > that gives a bit more structure, but might require splitting things > that now are together (for example iirc sometimes we are defining > bootstrap packages inheriting from the fully fledged ones, which > introduces a syntactic dependency on something that is=C2=A0 higher up th= e > tree). Wdyt? The package modules could be split and reorganised a bit to roughly follow the derivation DAG, if that's what you mean (*)? Then the "guix" package would depend on less -> compute-guix-derivation etc has less to do, also good for lowering "guix $do_something" memory footprint.=20 Seems orthogonal to my proposal. I guess we could eventually do both? Greetings, Maxime. --=-k30FOcnPTZdns8GdjQMp Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- iI0EABYKADUWIQTB8z7iDFKP233XAR9J4+4iGRcl7gUCYpXWhRccbWF4aW1lZGV2 b3NAdGVsZW5ldC5iZQAKCRBJ4+4iGRcl7lK+AP4ugZDMLYQ4jiII7PnRxVKEQN1a citkLmMOHMEd6DfCeAD+KFK238J1Xa3pJsvDQsf6Q2rKnVxawa4SE+JuGB8iTQE= =bGjB -----END PGP SIGNATURE----- --=-k30FOcnPTZdns8GdjQMp--