From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id /vpqCx8apGD74AAAgWs5BA (envelope-from ) for ; Tue, 18 May 2021 21:48:47 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id GKd7Bh8apGCMGwAA1q6Kng (envelope-from ) for ; Tue, 18 May 2021 19:48:47 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id CF6301998A for ; Tue, 18 May 2021 21:48:46 +0200 (CEST) Received: from localhost ([::1]:49586 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lj5ht-000226-J2 for larch@yhetil.org; Tue, 18 May 2021 15:48:45 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:36464) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lj5fG-0005Wd-AO for guix-patches@gnu.org; Tue, 18 May 2021 15:46:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:45811) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1lj5fF-0006Mt-Ur for guix-patches@gnu.org; Tue, 18 May 2021 15:46:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1lj5fF-0007mv-R5 for guix-patches@gnu.org; Tue, 18 May 2021 15:46:01 -0400 X-Loop: help-debbugs@gnu.org Subject: [bug#48435] Bringing substitutes from the Guix Build Coordinator to users Resent-From: Christopher Baines Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Tue, 18 May 2021 19:46:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 48435 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: patch To: guix-devel@gnu.org, Ludovic =?UTF-8?Q?Court=C3=A8s?= , Andreas Enge , 48435@debbugs.gnu.org Received: via spool by 48435-submit@debbugs.gnu.org id=B48435.162136715829925 (code B ref 48435); Tue, 18 May 2021 19:46:01 +0000 Received: (at 48435) by debbugs.gnu.org; 18 May 2021 19:45:58 +0000 Received: from localhost ([127.0.0.1]:57357 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lj5fC-0007ma-1u for submit@debbugs.gnu.org; Tue, 18 May 2021 15:45:58 -0400 Received: from mira.cbaines.net ([212.71.252.8]:41074) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1lj5f9-0007mR-B2 for 48435@debbugs.gnu.org; Tue, 18 May 2021 15:45:56 -0400 Received: from localhost (unknown [IPv6:2a02:8010:68c1:0:8ac0:b4c7:f5c8:7caa]) by mira.cbaines.net (Postfix) with ESMTPSA id 1035027BC78; Tue, 18 May 2021 20:45:54 +0100 (BST) Received: from capella (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id 20355396; Tue, 18 May 2021 19:45:53 +0000 (UTC) References: <878s4ye116.fsf@cbaines.net> User-agent: mu4e 1.4.15; emacs 27.1 From: Christopher Baines In-reply-to: <878s4ye116.fsf@cbaines.net> Date: Tue, 18 May 2021 20:45:50 +0100 Message-ID: <87lf8bbzbl.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: guix-patches@gnu.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+larch=yhetil.org@gnu.org Sender: "Guix-patches" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1621367326; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post; bh=HqRJllLCS1P+2Pa5tEvj8rxwS3AMvruv/VwT/o5VQ68=; b=ptRxkuhn1Ylj9pmjhtXHc0PvBlMNsPO26RjmFeyCExrJAV/XQWKbfOb05GjyCs6393Gmjm ncoPej4LHfQZvRp8czXDXTq6qD94qotvZdOrzOgw/bQyh/ZnkMpm2pkUN4BB+m8IiX7Ctp EuWFBIQcR+deZYkomSKIst2ERHzJOdWmCMNqqIrgANZ246FNC+JeQh0JS5Keb30v0KoWu6 URkzW9EXSDXLiObQlHHs0KecvqCmYi7GYqTpocEwmo7AuQJJWLiGwGrymjlHXLtDxAQDHd KXLrYME/mnp8ZmzwaRW74vyp8wOAao7K3nRNdeeU8N5KGNSX0Mt2bGmOFwR9xw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1621367326; a=rsa-sha256; cv=none; b=j8j8UvIoZgLG02vQrhRpL4ekhdJe4tLwbZPS5R6KftabDMbP5bb5h4cxvn0VGUMylI+Qpx PI49Mr0ALPdN9nstNNiBO5k/7K4HT/OW8jSzKInZwwzaMcfZ5YKpUlz3UlqKM+xvDROAgt +3syeepARsO6EYhDyZBNTA1JetFq7XRFqnDs0lN2oh62kz/VTtXYF8CXTFEBrxdkcBgOSR iTW4+beltnEvLmfzO+TEHETbKkrN9N2ClN8q+hngmA/KROgMhX/gl1Tit9Yhc9SBCSSucC KQ9b4QQya/Rs5oTAopBXX4lZ0Y78ienWjILcEq8HVoSJUAmqiI8JlMHAiBNBCA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-patches-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-patches-bounces@gnu.org X-Migadu-Spam-Score: -4.54 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-patches-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-patches-bounces@gnu.org X-Migadu-Queue-Id: CF6301998A X-Spam-Score: -4.54 X-Migadu-Scanner: scn0.migadu.com X-TUID: zB20it55njep --=-=-= Content-Type: text/plain Christopher Baines writes: > Is there still a path to bring some of these benefits to users, and if > so, what things need doing? It's been a few weeks now, so to summarise, I think only one path emerged, and that is to get substitutes from bayfront to users. Bayfront was already running the Guix Build Coordinator (although only for the last month), and it's now caught up to the point where I'm seeing similar or better substitute availability percentages for x86_64-linux (and powerpc64le-linux) when compared to ci.guix.gnu.org. It's also building i686-linux and aarch64-linux things, but they're still catching up. Obviously just having the substitutes doesn't magically get them to users, so I've started looking in to the changes to start making that happen. Adding the signing key and changing the defaults in a few places seems like a good step forward [1]. 1: https://issues.guix.gnu.org/48435 I want to push on with this within the next couple of weeks, mostly so I can shift focus to Outreachy and the security related tooling work, but also because I still think this will be a good step forward in terms of substitute availability for users. It's been over a year now since implementation started, so it would be good to actually make a positive difference. There's a few issues still on my mind. Even though the substitute availability percentages are good when compared to ci.guix.gnu.org, as bayfront has much less compute power connected, it might not keep up as well when big sets of changes are merged. I think that's just an argument for using the build coordinator on berlin and the connected machines though. The other thing in comparison to ci.guix.gnu.org is that bayfront only has ~4TB of storage rather than ~37TB, and given that currently none of the generated nars are deleted, that will need thinking about in a few months to avoid running out of space. I've had some plans around this for a while [1], but they still require implementing. 1: https://lists.gnu.org/archive/html/guix-devel/2021-02/msg00104.html Apart from merging the changes in [1], I guess a blog post might be useful. Have I missed anything? Chris --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmCkGW5fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9XesURAAnDB83dBydNri1IFhkMUDhRsr9nyDaEeM TLv3Uo9t3ntpLNp3EBcGTdofUM2TP3XyIK2BpvtjCBbkzgdviWm3+KUW04FNB8rn Ri2EWyTxCU3XSZ+jZsWEUpPvyv8W4npP9sG46f9+6d/1DIApgcJaNUTW4VYXjcOJ P4h109WlRssjuHhzX7EZ3+az5pFrk3ZZwJaJxDj7+zHuFoMsnfnTOpS8PfN0718Q hJC+KU0sXLn7Mp+OSzGuceSaTo+V9iGq2BpMpnmaPxPl5W89w0O3YnUniPxY79YK WoX5nk43h40ZDdkhzj2qQ44yzn3T1DLvYWzHslvh1Qd+g6FWT6WbaXgo0GgI6E8C rdnDrgTb8W8vKGxsM9ptHNOiuHk75InMgaU3DasOkw+vEIYrTaM09oUb9MtJXYmp TRKGTbQ34tc647n90Vdn0e/6fwpt67H3LlKuE/Jw45hoXjpYKFNLoa6yhJUFu12q 9RwcabKLuY8A/2gVvJT6R+X1wOoUPS6AQF7MUdKkU1/pjTw/iFbOxWMoLmQ3OmZ5 c+iv1IbPcyyb/9U7dYQFHMozcxIUV4Z3KXRD0Cr7zXiffXI60ZS46YXEblmLDkKM 1qCQQoUFtKdK5CUQrfI1TB5t8nbjKHqbC5LEmpbXFOVEDLEI2WxLjU/QHQAPppXq oEueR3Pj+oE= =5y08 -----END PGP SIGNATURE----- --=-=-=--