From mboxrd@z Thu Jan  1 00:00:00 1970
Return-Path: <guix-devel-bounces+larch=yhetil.org@gnu.org>
Received: from mp1 ([2001:41d0:2:bcc0::])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	by ms0.migadu.com with LMTPS
	id 4JLuG+XwHGGUNAEAgWs5BA
	(envelope-from <guix-devel-bounces+larch=yhetil.org@gnu.org>)
	for <larch@yhetil.org>; Wed, 18 Aug 2021 13:37:09 +0200
Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::])
	(using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits))
	by mp1 with LMTPS
	id mEmsF+XwHGGbTQAAbx9fmQ
	(envelope-from <guix-devel-bounces+larch=yhetil.org@gnu.org>)
	for <larch@yhetil.org>; Wed, 18 Aug 2021 11:37:09 +0000
Received: from lists.gnu.org (lists.gnu.org [209.51.188.17])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
	(No client certificate requested)
	by aspmx1.migadu.com (Postfix) with ESMTPS id 0172D1A050
	for <larch@yhetil.org>; Wed, 18 Aug 2021 13:37:09 +0200 (CEST)
Received: from localhost ([::1]:44102 helo=lists1p.gnu.org)
	by lists.gnu.org with esmtp (Exim 4.90_1)
	(envelope-from <guix-devel-bounces+larch=yhetil.org@gnu.org>)
	id 1mGJsa-0006DP-1v
	for larch@yhetil.org; Wed, 18 Aug 2021 07:37:08 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:32896)
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <mail@cbaines.net>) id 1mGJsP-0006DF-0d
 for guix-devel@gnu.org; Wed, 18 Aug 2021 07:36:57 -0400
Received: from mira.cbaines.net
 ([2a01:7e00:e000:2f8:fd4d:b5c7:13fb:3d27]:60329)
 by eggs.gnu.org with esmtp (Exim 4.90_1)
 (envelope-from <mail@cbaines.net>) id 1mGJsM-0001MW-UI
 for guix-devel@gnu.org; Wed, 18 Aug 2021 07:36:56 -0400
Received: from localhost (unknown [IPv6:2a02:8010:68c1:0:8ac0:b4c7:f5c8:7caa])
 by mira.cbaines.net (Postfix) with ESMTPSA id 2111A27BC6B
 for <guix-devel@gnu.org>; Wed, 18 Aug 2021 12:36:53 +0100 (BST)
Received: from capella (localhost [127.0.0.1])
 by localhost (OpenSMTPD) with ESMTP id 5afaa2c9
 for <guix-devel@gnu.org>; Wed, 18 Aug 2021 11:36:52 +0000 (UTC)
User-agent: mu4e 1.4.15; emacs 27.2
From: Christopher Baines <mail@cbaines.net>
To: guix-devel@gnu.org
Subject: Update on bordeaux.guix.gnu.org
Date: Wed, 18 Aug 2021 12:36:49 +0100
Message-ID: <87eeargf1q.fsf@cbaines.net>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
 micalg=pgp-sha512; protocol="application/pgp-signature"
Received-SPF: pass client-ip=2a01:7e00:e000:2f8:fd4d:b5c7:13fb:3d27;
 envelope-from=mail@cbaines.net; helo=mira.cbaines.net
X-Spam_score_int: -18
X-Spam_score: -1.9
X-Spam_bar: -
X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-BeenThere: guix-devel@gnu.org
X-Mailman-Version: 2.1.23
Precedence: list
List-Id: "Development of GNU Guix and the GNU System distribution."
 <guix-devel.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/guix-devel>,
 <mailto:guix-devel-request@gnu.org?subject=unsubscribe>
List-Archive: <https://lists.gnu.org/archive/html/guix-devel>
List-Post: <mailto:guix-devel@gnu.org>
List-Help: <mailto:guix-devel-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/guix-devel>,
 <mailto:guix-devel-request@gnu.org?subject=subscribe>
Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org
Sender: "Guix-devel" <guix-devel-bounces+larch=yhetil.org@gnu.org>
X-Migadu-Flow: FLOW_IN
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org;
	s=key1; t=1629286629;
	h=from:from:sender:sender:reply-to:subject:subject:date:date:
	 message-id:message-id:to:to:cc:mime-version:mime-version:
	 content-type:content-type:list-id:list-help:list-unsubscribe:
	 list-subscribe:list-post; bh=aMr9IWTOptZPbEh92W9Z7xKYlcrD+KXG665QGigI32Y=;
	b=p5IdLnRaI5r5Mj9sq2VfPwKHyDzKTdgB3vvpHaGjbqWeSQ00tskmV7UYNCGtJIQFfD1o9y
	8b/SruP4FoNVAC9muqn28buXIQfsS/Pwmw8mDY3SZ2LelReh06Rzn375ANcjHheVUiwI4j
	8kL3P4sViiEe/eO5HxAdqHXd/qwLKt6MlzPGqV1c3Vx2Z+MIS4OH83qyAmIwIe7yA2hf16
	7VNM22rTfxl3U7xxG9PR9VFU6HkdD5jAs7gifwYI0fxsBpvz+wpV7oYgnZNT7rEeW+3ddm
	LwLQxmnn+Fu4DAI9nngQUyPIN7iMQ4hXEczcUSwqW851MqGE08/nrdRsVlXTnQ==
ARC-Seal: i=1; s=key1; d=yhetil.org; t=1629286629; a=rsa-sha256; cv=none;
	b=rdcGc03s3iW96jQZiiF4E9fuv+6RQJAcLAfeheqA/0Z8DO6+IdNyhUcg6K87TolzZ5tlRC
	EmHlyeaBkqi+A3SCGW33jZc/02lvPys750A3t51vKK6oTzMc7cEgvRjm5yp6pB78mfCkja
	oiLIGtOek/FCjDjL8ioGXBet5ZK3qjDZyeArgzwHlCq+30gPvYwJ4wg65izsUURlur4xq1
	/BontZWArIirDAwwg3PRtw+1QMn6KHGGizA1CGDz9c1L2y7gzo1Y2KnRMyaez8K0ClFegv
	A07jfVMzXoIPwE5JvTVSLxZ7QDYTTvfAsuEoBLHrNACp4K+Ark573CV0KMe2Bw==
ARC-Authentication-Results: i=1;
	aspmx1.migadu.com;
	dkim=none;
	spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org
X-Migadu-Spam-Score: -4.52
Authentication-Results: aspmx1.migadu.com;
	dkim=none;
	dmarc=none;
	spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org
X-Migadu-Queue-Id: 0172D1A050
X-Spam-Score: -4.52
X-Migadu-Scanner: scn0.migadu.com
X-TUID: a6B34isICk4X

--=-=-=
Content-Type: text/plain

Hey!

Around 2 months ago, bordeaux.guix.gnu.org came in to existence [1][2].

1: https://guix.gnu.org/en/blog/2021/substitutes-now-also-available-from-bordeauxguixgnuorg/
2: https://lists.gnu.org/archive/html/guix-devel/2021-06/msg00044.html

This took work I'd done on providing substitutes back in 2020 and
attempted to bring benefits from that to normal users of Guix.

Unfortunately, I don't really know if this has been much of a
success. While it should be possible to track requests for substitutes
to roughly see if anyone is making use of them, this is something I
haven't been doing yet.

In terms of the substitute availability stats, I think it's delivered
the expected benefits. I recently enabled armhf-linux builds, so now
substitute availability for the following 5 architectures should be
good:

 - x86_64-linux
 - i686-linux
 - aarch64-linux
 - armhf-linux
 - powerpc64le-linux

You can use guix weather to check the stats yourself, or look at [3] for
an overview (ignore the ci.guix.gnu.org numbers, as they're not
currently up to date).

3: https://data.guix.gnu.org/repository/1/branch/master/latest-processed-revision/package-substitute-availability

There's still some issues holding substitute availability back. The Guix
Build Coordinator still has issues building things that it can't garbage
collect. The majority of the issues though are actual problems, like
broken fixed output derivations, or generally broken packages.

The next steps in my mind remain roughly the same as they were 2 months
ago:

 - It would be good to have something to provide more visibility in to
   the Guix Build Coordinator as well as the submitting of the builds

 - Supporting performant mirroring would be great, and I have some ideas
   of how to go about this

 - I did previously have some success building things for the Hurd [4],
   and it would be great to try and replicate this on
   bordeaux.guix.gnu.org

 - data.guix.gnu.org performance in processing new revisions is a
   limiting factor, so improving this would be helpful

 - Having aggregate statistics on use of substitutes (splitting out
   machines in the build farm) would be good for assessing use and
   changes in use

 - More hardware would be good for build throughput and redundancy. For
   example, there's currently only two ARM build machines linked up, and
   I host both of them.

4: https://lists.gnu.org/archive/html/guix-devel/2021-03/msg00074.html

If you're interested in getting involved, or have any comments or
questions, please just let me know!

Thanks,

Chris

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmEc8NFfFIAAAAAALgAo
aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF
ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh
aW5lcy5uZXQACgkQXiijOwuE9XcAkxAAidUxP25nRkaQb6dxOIXcO0/gCx3vLbc3
abP6oC6b7EbTiEl9K/8hUvhoXI7gehArwbpGeNaf4L7eQdkIZUx0hAKrD2KrqRcj
geU1hbQ9jbCJ272C2x2sK2+M0Rj4hpMQihkSfjD4VkXRIvxnlOb45kL+kFsUqQZt
Ih4q4U41JabOnMPe7yEfOZo7SfqlaM3XiQMFB1MwuIKTaRemPpV2qkJs8mf44RmO
sWTYyd89Jz1AUDTL2RkK3EQeyxS4TPrYc+XvCrl3fsSqvnbsUs7C2OGQvRgwLF9L
VHaqsCKM7iU4e2M4ummtXq1x8wqNfgyrJJVlK2qKS0IHHXbS824vGdCXiy5yK3SC
mjhiCoQeO1Ag2/k74XKpBvKAVn+CHOCN08ziQhnAJ6dO9YC7gwEM4gNTFyw5UUWN
KQgC0exH+UaPuOb+/iGRz7lIj2/mqafk/j1YHjGN9BLEidgmjHH1KxSSp6dsFgRu
VV1I7OhdrTBVmNDTVIeT21tTMadrlE38sBXp6e8sOX8qmyNi3biIu+NDPN2u0GRX
tSwHrXajVKSxXEBCChgQiM8VAnu/VLbLYzOqmm79CL/DLfWuKg8V9oM5lZ30YZ52
NXxsO6UuPpiv78fnoD8Yh0LF5ohGuD9xJAbmuus9BpUYALVf2WzFkKJWccI6NAw/
7JuZSkOVA8o=
=0jxk
-----END PGP SIGNATURE-----
--=-=-=--