From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id AP7bDMRdnGAgHQEAgWs5BA (envelope-from ) for ; Thu, 13 May 2021 00:59:16 +0200 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id KA96CMRdnGBhSAAAB5/wlQ (envelope-from ) for ; Wed, 12 May 2021 22:59:16 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 76B852118D for ; Thu, 13 May 2021 00:59:15 +0200 (CEST) Received: from localhost ([::1]:35490 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lgxov-0006Eh-Vz for larch@yhetil.org; Wed, 12 May 2021 18:59:14 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:47962) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1lgxoh-0006EJ-RP for guix-devel@gnu.org; Wed, 12 May 2021 18:58:59 -0400 Received: from mira.cbaines.net ([212.71.252.8]:52162) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1lgxof-0005Fi-P8; Wed, 12 May 2021 18:58:59 -0400 Received: from localhost (unknown [IPv6:2a02:8010:68c1:0:8ac0:b4c7:f5c8:7caa]) by mira.cbaines.net (Postfix) with ESMTPSA id CC38527BC81; Wed, 12 May 2021 23:58:51 +0100 (BST) Received: from capella (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id 0a4f0262; Wed, 12 May 2021 22:58:50 +0000 (UTC) References: <878s4ye116.fsf@cbaines.net> <87czu6cn63.fsf@cbaines.net> User-agent: mu4e 1.4.15; emacs 27.1 From: Christopher Baines To: guix-devel@gnu.org Subject: Re: Bringing substitutes from the Guix Build Coordinator to users In-reply-to: <87czu6cn63.fsf@cbaines.net> Date: Wed, 12 May 2021 23:58:48 +0100 Message-ID: <87h7j71rvb.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=212.71.252.8; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1620860355; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=M79U880h1kCi00JbxQEzq3MxASJCqPqGcwVL6r5YYvY=; b=gX91JAMg3uoFJdnceWa296v3TlcCLiwmiKw09KThoHLziAgE+GDLkKC1rlhJLllNGf+Wgw YDzSZk7G8Z/WLBf6qgCtkMRZvJALAvO7+hQPuKQo2hi3jQmd+gNnPDhsYhJ6pJSxAi7CS0 6a3PyHGx4ZNjljtKf5rlSXgjya6NqKAEipex5QXXMxLn+SVoRub5ydwqs06Wyt9asWXsBr GAib41ywyU97SjoRZiDGksTWMgoJ3aDouNFeTgOVJ3tyHDTRlhSP8hMXAAZGnTy3sjaRe6 WKL+KTBJFQWZ8Sj4CuVXeZvoGqwYz5/NSaxY7z08tN0IK0K0FoPAZ18me3hNbA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1620860355; a=rsa-sha256; cv=none; b=ilK1peBnbQ0+31fEH1/XJR63y8ElvJulRlW7UgX0LddN14xIiZZdVCaPEf00dVqIaNqydZ 7Fls3k698tloJlojIjLKafG+Vx0fHXWLPcGdQFLRP7VzI6ES/sTW1eFDIEHnpGq3ZN5SXG tZ0JPw9m6z0FAC4NeaxSjULyHnwH11OBV2sC0dWIy3Hg5k56eil42Gah2lHJRvKOaWzUci XyU/OQHYoFree+knY+MxVr2g4rB4YFQ+jslTeezYmtnNI0hWbmbQerwdyITvWF6QY9TVkW VYOTjr2sFAzPFCMPYDxjSBBy1sA/kahfuRvrDfr6Eepy9qGjepHYa58T6BJrrQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -4.55 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 76B852118D X-Spam-Score: -4.55 X-Migadu-Scanner: scn0.migadu.com X-TUID: q4P2bo0ybX3X --=-=-= Content-Type: text/plain Christopher Baines writes: > Andreas Enge writes: > >> Hello Chris, >> >> Am Sat, May 01, 2021 at 07:56:05PM +0100 schrieb Christopher Baines: >>> I think there are some benefits for using the Guix Build Coordinator to >>> build things for substitutes, and it would be good to work out how to >>> get those benefits to users of Guix generally. >> >> my question is a bit tangential, but how can we get the substitutes that >> the build coordinator puts on bayfront? I still have bayfront.guix.info >> in my list of substitute servers, but does it use the same signing key >> as before? It would be nice to document what a user should do. In my >> opinion, a second build farm would be a useful thing, in case one server >> goes down, or needs to be updated, for instance. (And then it allows for >> reproducibility checks.) > > So, bayfront is currently serving substitutes build through the Guix > Build Coordinator, the signing key is the same as it was before. > > It's only been building things at pace since yesterday though, so it'll > be a few days at least until it's caught up. > > I agree that having multiple independent substitute providers would be > nice, and getting bayfront working well is a step towards that. Continuing on the subject of bayfront, it seems like the most feasible way to get substitutes build through the Guix Build Coordinator to users might be through it. At least there hasn't been any other leads yet from this thread. Luckily, from a thread ("Machine things") on guix-sysadmin [1] a number of months ago, the suggestion of using the Guix Build Coordinator on bayfront already came up, so it's actually been running for around a month, and making progress building things for part of that. 1: https://lists.gnu.org/mailman/private/guix-sysadmin/2021-February/003412.html Getting some benefit from the substitutes will require a few things though, firstly getting things in order such that a good proportion and range of substitutes are available, and secondly amending the default configuration to include bayfront. On the default configuration point, what are the prerequsites for that? Beyond having some substitutes to offer, is there any particular criteria to consider, perhaps about the machines involved? On the subject of the machines involved, currently there's: - x86_64-linux + i686-linux - bayfront (coordinator, agent and serving substitutes) - harbourfront - milano-guix-1 - aarch64-linux + armhf-linux - monokuma I'd like to get some childhurd VMs running, they can go on the x86_64 machines, and hopefully there will be enough resources to keep up with x86_64-linux, i686-linux, while doing some i586-gnu builds. If I have some luck, I might also be able to get some powerpc64 hardware, and I do have two Raspberry Pi 4's, but they're not running Guix as the OS yet, so it would be good to work out if they're suitable, or better left to other tasks. There's a few intertangled things, but the main question is, if bayfront can be a source of substitutes, what's the path to actually have that benefit users? --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmCcXahfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9XcATg/8CBX7ZjLTya9MjOHnL/I4uZAeU9hxMrWy 2FmSulVZjSkG9oaUs7ZexC5us5+yd28es/DqFN7Z7VymeSR62mSk9TB7aH8bpTvF yVuanAM22DIW0aZ2WR+q9d7KPuDifW+ytaKg3lvZ2bV/i26u8en/ckJ6xTU7MMbj naEvtmsG8iM/zynmHazBzSTxI24iWngfZuf6BM8Hh/fACzpjtAkbMP/x1NHwI3/6 JY0x6343Nl/+h1NmZxT+gi8tU3pNJhOrNTOf8Bu1M9/X8JsXJEOz9i9Z5u7VjZeF KpBPUyghN3cZV/55C4vyYLRQCpBXaLsaA3GpsV37ep64dx5ViuldV8woFCf2jJHt 3kAb5li8RQEltkzCjUxF1YWt50rKSQ+iCrUB5mJmJjqDQVrkUl75cwT6GHZjimVa PaGUbea2Gc58QQJoJKwz1rHuVrvHBggTbKJjCpe3vJXbiVKcVgDPuGB54sxoQhFw RvePw0ek6ZiSCzowTfeD0CzAQffM149dORHkMzL5QMcYjraUlfQI2XPaLaR4TKcf Tr2D6xJQilhhHLWAqeHJtCuyNON4CzHgJhVY8v99FrV3GPCxGQyn3GTcmYW9sXIJ +9UWXYNmDLVgEa3nJeCZ/r1aZwIrqy9ZlH10sMYvl81sse1t/cAbFcS35M9MUmuU js8C+ggKxSE= =Wul9 -----END PGP SIGNATURE----- --=-=-=--