From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id 4JLuG+XwHGGUNAEAgWs5BA (envelope-from ) for ; Wed, 18 Aug 2021 13:37:09 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id mEmsF+XwHGGbTQAAbx9fmQ (envelope-from ) for ; Wed, 18 Aug 2021 11:37:09 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 0172D1A050 for ; Wed, 18 Aug 2021 13:37:09 +0200 (CEST) Received: from localhost ([::1]:44102 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mGJsa-0006DP-1v for larch@yhetil.org; Wed, 18 Aug 2021 07:37:08 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:32896) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mGJsP-0006DF-0d for guix-devel@gnu.org; Wed, 18 Aug 2021 07:36:57 -0400 Received: from mira.cbaines.net ([2a01:7e00:e000:2f8:fd4d:b5c7:13fb:3d27]:60329) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mGJsM-0001MW-UI for guix-devel@gnu.org; Wed, 18 Aug 2021 07:36:56 -0400 Received: from localhost (unknown [IPv6:2a02:8010:68c1:0:8ac0:b4c7:f5c8:7caa]) by mira.cbaines.net (Postfix) with ESMTPSA id 2111A27BC6B for ; Wed, 18 Aug 2021 12:36:53 +0100 (BST) Received: from capella (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id 5afaa2c9 for ; Wed, 18 Aug 2021 11:36:52 +0000 (UTC) User-agent: mu4e 1.4.15; emacs 27.2 From: Christopher Baines To: guix-devel@gnu.org Subject: Update on bordeaux.guix.gnu.org Date: Wed, 18 Aug 2021 12:36:49 +0100 Message-ID: <87eeargf1q.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=2a01:7e00:e000:2f8:fd4d:b5c7:13fb:3d27; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1629286629; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=aMr9IWTOptZPbEh92W9Z7xKYlcrD+KXG665QGigI32Y=; b=p5IdLnRaI5r5Mj9sq2VfPwKHyDzKTdgB3vvpHaGjbqWeSQ00tskmV7UYNCGtJIQFfD1o9y 8b/SruP4FoNVAC9muqn28buXIQfsS/Pwmw8mDY3SZ2LelReh06Rzn375ANcjHheVUiwI4j 8kL3P4sViiEe/eO5HxAdqHXd/qwLKt6MlzPGqV1c3Vx2Z+MIS4OH83qyAmIwIe7yA2hf16 7VNM22rTfxl3U7xxG9PR9VFU6HkdD5jAs7gifwYI0fxsBpvz+wpV7oYgnZNT7rEeW+3ddm LwLQxmnn+Fu4DAI9nngQUyPIN7iMQ4hXEczcUSwqW851MqGE08/nrdRsVlXTnQ== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1629286629; a=rsa-sha256; cv=none; b=rdcGc03s3iW96jQZiiF4E9fuv+6RQJAcLAfeheqA/0Z8DO6+IdNyhUcg6K87TolzZ5tlRC EmHlyeaBkqi+A3SCGW33jZc/02lvPys750A3t51vKK6oTzMc7cEgvRjm5yp6pB78mfCkja oiLIGtOek/FCjDjL8ioGXBet5ZK3qjDZyeArgzwHlCq+30gPvYwJ4wg65izsUURlur4xq1 /BontZWArIirDAwwg3PRtw+1QMn6KHGGizA1CGDz9c1L2y7gzo1Y2KnRMyaez8K0ClFegv A07jfVMzXoIPwE5JvTVSLxZ7QDYTTvfAsuEoBLHrNACp4K+Ark573CV0KMe2Bw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -4.52 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 0172D1A050 X-Spam-Score: -4.52 X-Migadu-Scanner: scn0.migadu.com X-TUID: a6B34isICk4X --=-=-= Content-Type: text/plain Hey! Around 2 months ago, bordeaux.guix.gnu.org came in to existence [1][2]. 1: https://guix.gnu.org/en/blog/2021/substitutes-now-also-available-from-bordeauxguixgnuorg/ 2: https://lists.gnu.org/archive/html/guix-devel/2021-06/msg00044.html This took work I'd done on providing substitutes back in 2020 and attempted to bring benefits from that to normal users of Guix. Unfortunately, I don't really know if this has been much of a success. While it should be possible to track requests for substitutes to roughly see if anyone is making use of them, this is something I haven't been doing yet. In terms of the substitute availability stats, I think it's delivered the expected benefits. I recently enabled armhf-linux builds, so now substitute availability for the following 5 architectures should be good: - x86_64-linux - i686-linux - aarch64-linux - armhf-linux - powerpc64le-linux You can use guix weather to check the stats yourself, or look at [3] for an overview (ignore the ci.guix.gnu.org numbers, as they're not currently up to date). 3: https://data.guix.gnu.org/repository/1/branch/master/latest-processed-revision/package-substitute-availability There's still some issues holding substitute availability back. The Guix Build Coordinator still has issues building things that it can't garbage collect. The majority of the issues though are actual problems, like broken fixed output derivations, or generally broken packages. The next steps in my mind remain roughly the same as they were 2 months ago: - It would be good to have something to provide more visibility in to the Guix Build Coordinator as well as the submitting of the builds - Supporting performant mirroring would be great, and I have some ideas of how to go about this - I did previously have some success building things for the Hurd [4], and it would be great to try and replicate this on bordeaux.guix.gnu.org - data.guix.gnu.org performance in processing new revisions is a limiting factor, so improving this would be helpful - Having aggregate statistics on use of substitutes (splitting out machines in the build farm) would be good for assessing use and changes in use - More hardware would be good for build throughput and redundancy. For example, there's currently only two ARM build machines linked up, and I host both of them. 4: https://lists.gnu.org/archive/html/guix-devel/2021-03/msg00074.html If you're interested in getting involved, or have any comments or questions, please just let me know! Thanks, Chris --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmEc8NFfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9XcAkxAAidUxP25nRkaQb6dxOIXcO0/gCx3vLbc3 abP6oC6b7EbTiEl9K/8hUvhoXI7gehArwbpGeNaf4L7eQdkIZUx0hAKrD2KrqRcj geU1hbQ9jbCJ272C2x2sK2+M0Rj4hpMQihkSfjD4VkXRIvxnlOb45kL+kFsUqQZt Ih4q4U41JabOnMPe7yEfOZo7SfqlaM3XiQMFB1MwuIKTaRemPpV2qkJs8mf44RmO sWTYyd89Jz1AUDTL2RkK3EQeyxS4TPrYc+XvCrl3fsSqvnbsUs7C2OGQvRgwLF9L VHaqsCKM7iU4e2M4ummtXq1x8wqNfgyrJJVlK2qKS0IHHXbS824vGdCXiy5yK3SC mjhiCoQeO1Ag2/k74XKpBvKAVn+CHOCN08ziQhnAJ6dO9YC7gwEM4gNTFyw5UUWN KQgC0exH+UaPuOb+/iGRz7lIj2/mqafk/j1YHjGN9BLEidgmjHH1KxSSp6dsFgRu VV1I7OhdrTBVmNDTVIeT21tTMadrlE38sBXp6e8sOX8qmyNi3biIu+NDPN2u0GRX tSwHrXajVKSxXEBCChgQiM8VAnu/VLbLYzOqmm79CL/DLfWuKg8V9oM5lZ30YZ52 NXxsO6UuPpiv78fnoD8Yh0LF5ohGuD9xJAbmuus9BpUYALVf2WzFkKJWccI6NAw/ 7JuZSkOVA8o= =0jxk -----END PGP SIGNATURE----- --=-=-=--