From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms8.migadu.com with LMTPS id EPtGJkhQBGawhgAA62LTzQ:P1 (envelope-from ) for ; Wed, 27 Mar 2024 17:58:48 +0100 Received: from aspmx1.migadu.com ([2001:41d0:303:e224::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1.migadu.com with LMTPS id EPtGJkhQBGawhgAA62LTzQ (envelope-from ) for ; Wed, 27 Mar 2024 17:58:48 +0100 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Seal: i=1; s=key1; d=yhetil.org; t=1711558728; a=rsa-sha256; cv=none; b=PD6aahgpuk2HAro1iEchO7n3M2gX9GvFMaxRkKoJjjipLJ+j2HneqdrLZq8JRc2FQYvbWQ PQjkCfV7/0j181QXZAgbaW7IzNyRnhtriGexu7xKWrXashzoJbFM9oM68Q7aKq/2vXalmB 2QnvhNczbNHzly6dz7EnCSiweJUCo1lWBGAjW7/uCm6RbTeWXL0UMx7L00wXIqyxLDm7Ge tNrwIk7eDew1teIj45dIZlV/VKDik6hdnVK3umb0HLgYvF5jsu4h3IWU1lXpSa6dpLX8er 5iQjXgVHPRxgQO+yFEyCHjloP9oB2aZkbT5q+m+2fz6GunwO6TIZeDvXGSxCEw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1711558728; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=ojkXdbHv7rlnmH3f21OBxKfITghuanmAvAcv90euZuI=; b=OQjjMONQph86iW8ipofvGl711rlHhlvmcmsjFBxsjYyQMX7aLu7/8UgvCMvknj1LQKsV0G qTgwOjYG8AogrSks4wCqLWkqNbJAbq8FvOQsDv2cuF08YP0w4398U9pKG0CxBYTc3UBg0r 6ZlZpJboNXy8lJvhq3aIidyiQ0s1CxhvpjYlR49NgAATHtAwYBP9tEAU0E7jJHSpq2AiNP mFbPyME0sshQECuvfnVPKANYkpzTvYqT6SgjX5YJCXu40MRgRerHMPYbuGmzs9ByoazrYa j5yQf6aOt1zbPAKDARhtmJNcCJIdwYsYzygvAfZe9JLbPP254mGn1FvMoosp3A== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 679D31B79F for ; Wed, 27 Mar 2024 17:58:48 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rpWbZ-0003JF-DD; Wed, 27 Mar 2024 12:58:27 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rpWbN-0003GD-Cy for guix-devel@gnu.org; Wed, 27 Mar 2024 12:58:18 -0400 Received: from mira.cbaines.net ([212.71.252.8]) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rpWbL-0001IP-DP for guix-devel@gnu.org; Wed, 27 Mar 2024 12:58:13 -0400 Received: from localhost (unknown [212.132.255.10]) by mira.cbaines.net (Postfix) with ESMTPSA id 27E1127BBE2 for ; Wed, 27 Mar 2024 16:58:10 +0000 (GMT) Received: from felis (localhost.lan [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id 24f4eac3 for ; Wed, 27 Mar 2024 16:58:09 +0000 (UTC) User-agent: mu4e 1.10.8; emacs 29.1 From: Christopher Baines To: guix-devel@gnu.org Subject: March update on bordeaux.guix.gnu.org Date: Wed, 27 Mar 2024 13:49:07 +0000 Message-ID: <877chnfw81.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=212.71.252.8; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-Spam_score_int: -2 X-Spam_score: -0.3 X-Spam_bar: / X-Spam_report: (-0.3 / 5.0 requ) BAYES_00=-1.9, DATE_IN_PAST_03_06=1.592, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Spam-Score: -8.45 X-Migadu-Queue-Id: 679D31B79F X-Migadu-Scanner: mx12.migadu.com X-Migadu-Spam-Score: -8.45 X-TUID: WM7iXg4BGwvn --=-=-= Content-Type: text/plain Hey! I'm think the last update I sent out was back in April 2023 [1], but it's coming up to 3 years since bordeaux was added as a default substitute server [2]. It's scary how much time has passed! 1: https://lists.gnu.org/archive/html/guix-devel/2023-04/msg00319.html 2: https://guix.gnu.org/en/blog/2021/substitutes-now-also-available-from-bordeauxguixgnuorg/ I've finally got around to starting to address the problems with disappearing nars discussed in [3]. The nar-herder now schedules nars which it's generated for removal and the time for removal is based on the TTL in use. 3: https://issues.guix.gnu.org/63634 Related to this, I've added options to the nar-herder to help change the TTL being used, and reduced the TTL for bordeaux.guix.gnu.org to 10 minutes (from 180 days) [4]. This will at least mean that in the future, the nar-herder on bordeaux will be able to delete zstd compressed nars that it's generated more quickly. 4: https://git.savannah.gnu.org/cgit/guix/maintenance.git/commit/?id=1fc5a1af488cb8838c2f196e07a43f37f2fbf509 I'm really unsure about the need/usefulness of narinfo caching in general, the cost of storing all these narinfos locally is quite high I think and I don't really know why it's done. The mishandling of these zstd nars available from bordeaux was the last thing on my mind blocking proposing to switch the default substitute server ordering, so I've now gone ahead and done that in [5]. 5: https://issues.guix.gnu.org/70028 Obviously the differences to having ci.guix.gnu.org first in the list of substitute URLs is subtle, but I'm hoping this will help with substitute speed issues (as discussed in [6]) plus increase the impact of mirroring work for the bordeaux substitutes in the future. 6: https://lists.gnu.org/archive/html/guix-devel/2023-05/msg00290.html Apart from that, the main thing on my mind for the next year regarding bordeaux substitutes specifically is storage space. We're at 90% capacity on hatysa (one of the two machines storing all the nars) so this will need looking at shortly. I'd also like to finally get removing nars that don't relate to the guix master branch happening, as that should free up a little bit of space at least. Let me know if you have any comments or questions! Thanks, Chris --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmYEUB5fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9Xc8KBAAq5KttSIdRosPmqS/yIjVfUbiQhYiIxHc F6HvtjuPrZr56dwWknAYb83X83PVa4rj47/lIxYsAgSzEfhcTRecTJGGgk1wE9qc ef0Li0pyAX0/Y6vCqW2ag/goYSOv4oL39/ot+49JVrG3IyDPlMGY24goV4np0HMQ hJWvhyzBIdXId1BUIqRmJAftlCganna4urFAbMNh0WZHeclLZxJqCJaT1AE5zkMb hhMDn8u2n2N0nj2NR3cuIth2Wbk5GDW2HRMoZ5vWuHPx1pvLXf43CHVOLuxNE63F zl5w2TFy2aNVFPh9iHDh+v/SHM+9nMLHg71nWfkPdxYvjNzBsc35Um3hnn4GiVhn BEhTpT056h6DoQ0f9Y49OY/zIzWED+a+tujPne7bilru2RS330LhSbHJAl3ZWg3b LEUN2soB4yE5TyKAjKaeEIGw5IcOIs8VvdWAqKrgofLo/+ORXz6IhANW8ur1U1wp znMoF5jInPtnu1ydR8eUaK3ZtfVbil37Ihk8cO4HXWVFw3EiDUEiyGTB296mJPkn kOx1z8NT4ODmujutBPbHptV+Xj31N9EnV1eocST0SU3bZXMlZ4fT34H3W/9yHrMO sQnHXjEtXq1BD9zJ0Vt16l34GQvmuRdGcLhBN9qhTE+nqE8R1oBT/NZZZDJqJrzp htndQi2Rbhk= =YSTe -----END PGP SIGNATURE----- --=-=-=--