From mboxrd@z Thu Jan 1 00:00:00 1970 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: Re: Guix infrastructure Date: Fri, 07 Jul 2017 14:19:23 +0200 Message-ID: <87tw2o8mno.fsf@gnu.org> References: <20170701173604.vjzta4fccjfuqxoy@abyayala> <20170701180111.GA29205@jasmine.lan> <86d19dxg42.fsf@gmail.com> <20170707030042.GD1280@jasmine.lan> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:36104) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dTSEN-0007Wi-Qc for guix-devel@gnu.org; Fri, 07 Jul 2017 08:19:33 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dTSEJ-00050Q-3H for guix-devel@gnu.org; Fri, 07 Jul 2017 08:19:31 -0400 In-Reply-To: <20170707030042.GD1280@jasmine.lan> (Leo Famulari's message of "Thu, 6 Jul 2017 23:00:42 -0400") List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: "Guix-devel" To: Leo Famulari Cc: guix-devel@gnu.org, myglc2 Hello Guix! Leo Famulari skribis: > On Thu, Jul 06, 2017 at 08:09:17PM -0400, myglc2 wrote: >> On 07/01/2017 at 14:01 Leo Famulari writes: >> > ... Bayfront is still not fully operational, so hydra.gnu.org is still >> > serving as the front-end of the build farm. We are still relying on the >> > Hydra software. That is, the situation is basically the same as before. >> > Adding build machines will not help very much until the front-end >> > hardware gets faster. >>=20 >> This leaves me wondering ... >>=20 >> Is the hydra/front-end hardware going to be upgraded? > > Yes... > >> Is bayfront/cuirass intended to replace hydra? > > ... and yes. > >> The bayfront hardware described here ... >>=20 >> https://www.gnu.org/software/guix/news/growing-our-build-farm.html >>=20 >> ... seems weak to me. Is there a plan to scale it up and make it redunda= nt? > > It will be a lot more powerful than the current Hydra system. As for > specific plans, I'll let those administering the system chime in. That machine is super powerful=E2=80=A6 but alas, it has also been terribly unstable. Vikings has been kind enough to assist us; they=E2=80=99ve notab= ly provided us with CPU replacements once already. Despite these efforts, the machine is still crashing. We=E2=80=99re investigating with them what = to do next. On top of that, all the testing and all the back and forth takes an awful lot of time, which is in part due to hardware problems being hard to pinpoint and debug in general, and in part due to us here in Bordeaux (where the machine is hosted) being unable to scale up. Infrastructure has been the project=E2=80=99s Achilles=E2=80=99 heel since = we run the crowdfunding campaign in Dec. 2015 (!). Now it=E2=80=99s becoming detrimen= tal to the project. Our initial plan was to buy more Libreboot-based machines like the one above once the first one has proved to work well. However, given the situation, we=E2=80=99ve been discussing on guix-sysadmi= n a change in strategy, at least in the short term; Ricardo has been working on re-purposing used hardware for our needs, and that may well be our short- to medium-term solution. For now, we prefer not to entrust the binaries we deliver to commercial VPS providers. I think we owe it to our users, but it undoubtedly has a cost in terms of system maintenance. I not only sympathize with your frustration, ng0, I feel it even ten times more. ;-) Several of us are determined to come up with a solution quickly, so I hope that will materialize soon! Thanks, Ludo=E2=80=99.