From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id OAQDOTPZ5mHhGwAAgWs5BA (envelope-from ) for ; Tue, 18 Jan 2022 16:13:55 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id WPBONjPZ5mH7pAAA9RJhRA (envelope-from ) for ; Tue, 18 Jan 2022 16:13:55 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id ACAE942023 for ; Tue, 18 Jan 2022 16:13:55 +0100 (CET) Received: from localhost ([::1]:33766 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1n9qBG-0007xS-Se for larch@yhetil.org; Tue, 18 Jan 2022 10:13:54 -0500 Received: from eggs.gnu.org ([209.51.188.92]:37946) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1n9pxu-0005iJ-91 for guix-devel@gnu.org; Tue, 18 Jan 2022 10:00:07 -0500 Received: from [2a0c:e300::1] (port=45852 helo=hera.aquilenet.fr) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1n9pxs-0004wZ-3D for guix-devel@gnu.org; Tue, 18 Jan 2022 10:00:05 -0500 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id 068B6849; Tue, 18 Jan 2022 16:00:02 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id lS_JG9hpkQla; Tue, 18 Jan 2022 16:00:01 +0100 (CET) Received: from ribbon (91-160-117-201.subs.proxad.net [91.160.117.201]) by hera.aquilenet.fr (Postfix) with ESMTPSA id A1BB12B4; Tue, 18 Jan 2022 16:00:00 +0100 (CET) From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: Maxime Devos Subject: Re: Parallel guix builds can trample? References: <877db6ge0o.fsf@beadling.co.uk> <874k697thf.fsf@elephly.net> <87r19d5pcw.fsf@elephly.net> <871r1dguq6.fsf@beadling.co.uk> <7a2e92a6871fa2e40b749d8e4bfc6aa811df0a22.camel@telenet.be> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 29 =?utf-8?Q?Niv=C3=B4se?= an 230 de la =?utf-8?Q?R?= =?utf-8?Q?=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Tue, 18 Jan 2022 15:59:59 +0100 In-Reply-To: <7a2e92a6871fa2e40b749d8e4bfc6aa811df0a22.camel@telenet.be> (Maxime Devos's message of "Mon, 17 Jan 2022 18:44:19 +0100") Message-ID: <87wnixf5sg.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spamd-Bar: + X-Rspamd-Server: hera X-Rspamd-Queue-Id: 068B6849 X-Spamd-Result: default: False [1.52 / 15.00]; ARC_NA(0.00)[]; TO_DN_EQ_ADDR_SOME(0.00)[]; RCVD_VIA_SMTP_AUTH(0.00)[]; FROM_HAS_DN(0.00)[]; RCPT_COUNT_THREE(0.00)[4]; TO_DN_SOME(0.00)[]; TO_MATCH_ENVRCPT_ALL(0.00)[]; MIME_GOOD(-0.10)[text/plain]; R_MIXED_CHARSET(0.63)[subject]; FROM_EQ_ENVFROM(0.00)[]; MIME_TRACE(0.00)[0:+]; SUBJECT_ENDS_QUESTION(1.00)[]; RCVD_COUNT_TWO(0.00)[2]; RCVD_TLS_ALL(0.00)[]; MID_RHS_MATCH_FROM(0.00)[] X-Host-Lookup-Failed: Reverse DNS lookup failed for 2a0c:e300::1 (failed) Received-SPF: softfail client-ip=2a0c:e300::1; envelope-from=ludo@gnu.org; helo=hera.aquilenet.fr X-Spam_score_int: -3 X-Spam_score: -0.4 X-Spam_bar: / X-Spam_report: (-0.4 / 5.0 requ) BAYES_00=-1.9, RDNS_NONE=0.793, SPF_HELO_PASS=-0.001, SPF_SOFTFAIL=0.665 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: "guix-devel@gnu.org" Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1642518835; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post; bh=0w23Uy+R22dCtB+KWCoJHmGL3oIlrn3EbWxIQWiMC68=; b=opQX11cImBKXdiquPqsPoAze87ujzXOD26zcSr/UpUqgD0Z2h0SfQ6utjKLQ+NhbmTNYEc R7ek1QW+Cyb1zsc0d1MiE+799QmrUrgpXyK4oeh3755QhK0zlCLMbX4Gw+I0nHN0Yu4c8l CMMPw76yXwtikaYTnCzgtpDfegA4WNxuMb+hNFikEKTwH3KA+rXw5QiwXSX3v8CD8saMOS wsj8ZWNFJLmxQ5C2mgNnya2lHsG9huXw3VvAWxVPQS7u5j5RdAdU45HLXD1utVipqiPcSr Eu8kuMvVQVAuRkwaVNoix8Vqygv1cw6iOfU8J0InSUNsHp21+5ZZeNNwBiqPhQ== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1642518835; a=rsa-sha256; cv=none; b=Ho6hY6+QdeaR1+giUcNdF+1HbRMhlAWVHeTfjefxSjsWt0qyJfGXxj7hQRhSHvXQ1j6KG0 cb3kVNjvwhmGbeRiCMHyg0520uNR2CBQf5e5+9YcbMxZUuFRjBb8JivUwUdV3gbxskeLFJ iil3LlLJWs1X2CJcfjdvoAJjcvQGhwirGPq4Wvmc+GFk9rhx3TUUz8cAPPcUWDTWONQOMm eZYrArULpzO2OLjy6GtNvC6jyi+cGkdUr6zGh/tn2AtLpFi9JP/03LRXw/uZDteCsbR3Cb G5QPGgHyD4YD58vTkS3x1ws91v9PISmO+ZWqEVHOHj0/5HpWVtcrYzOWPeuzFA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -2.62 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: ACAE942023 X-Spam-Score: -2.62 X-Migadu-Scanner: scn0.migadu.com X-TUID: 0b2Ir1KvQ8Ks Hi, Maxime Devos skribis: > Phil Beadling schreef op ma 17-01-2022 om 17:23 [+0000]: >> For each build that is kicked off in quick succession the local cache >> of the repo required updated by update-cached-checkout >> =C2=A0* https://github.com/guix- >> mirror/guix/blob/9f526f5dad5f4af69d158c50369e182305147f3b/guix/git.sc >> m#L476 >> =C2=A0* https://github.com/guix- >> mirror/guix/blob/9f526f5dad5f4af69d158c50369e182305147f3b/guix/git.sc >> m#L279 > > > Maybe 'latest-repository-commit' and 'update-cached-checkout' commit > can be modified to not use 'switch-to-ref', and instead directly ask > libgit =E2=80=98what's the tree structure of commit cabba9e=E2=80=99 and = call a > procedure like 'add-file-tree-to-store'. That would avoid lock files, > creating separate directories for concurrent checkouts, ... That would be ideal. In Guix =E2=80=98write-file-tree=E2=80=99 already sup= ports some sort of virtual file systems, so it should be possible to use it to feed the contents of the Git tree to the store. Ludo=E2=80=99.