From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id 9EwQOFUiAGCTegAA0tVLHw (envelope-from ) for ; Thu, 14 Jan 2021 10:52:05 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id aOW0M1UiAGAfAgAAB5/wlQ (envelope-from ) for ; Thu, 14 Jan 2021 10:52:05 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 2518A9401C0 for ; Thu, 14 Jan 2021 10:52:04 +0000 (UTC) Received: from localhost ([::1]:34172 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1l00EV-0002FS-TG for larch@yhetil.org; Thu, 14 Jan 2021 05:52:03 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:40590) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1l00EN-0002F9-7h for guix-devel@gnu.org; Thu, 14 Jan 2021 05:51:55 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:48363) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1l00EN-0006ys-0j; Thu, 14 Jan 2021 05:51:55 -0500 Received: from [2a01:e0a:19b:d9a0:1538:87ab:3a95:7600] (port=53114 helo=cervin) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1l00EM-0000sq-Jf; Thu, 14 Jan 2021 05:51:54 -0500 From: Mathieu Othacehe To: Tobias Geerinckx-Rice Subject: Re: Staging branch [substitute availability] References: <87eein6hf6.fsf@gnu.org> <874kjjrf3w.fsf@nckx> Date: Thu, 14 Jan 2021 11:51:53 +0100 In-Reply-To: <874kjjrf3w.fsf@nckx> (Tobias Geerinckx-Rice's message of "Thu, 14 Jan 2021 11:24:03 +0100") Message-ID: <87lfcv4wqe.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -2.86 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 2518A9401C0 X-Spam-Score: -2.86 X-Migadu-Scanner: scn1.migadu.com X-TUID: LeNmZGMhWyVs Hello Tobias, > I don't think it's obvious and I don't think it's true. Well obvious was a poor choice of word. But I've been spending several weeks/months monitoring Berlin and I think I'm starting to have a good overview of the situation. This new page[1] shows what the build machines are doing. There are two workers per machine, and they are always busy as far as I can tell. If you have a look to the "Pending builds" chart here[2], you will see that it took 4 days to absorb the ~7000 builds that were added the 9/10th of January. Building chromium for aarch64 takes more than 24 hours and will take one whole worker down for instance. Now think about Linux, webkitgtk and imagine that we also want to build the core-updates branch and the armhf architecture, I don't see how it could fit without lagging weeks behind. > Only because we don't use the non-emulated hardware. Our (currently 3, one > crashed) Overdrives 1000 sit idle for ~90% of the time. As I said, the new remote building Cuirass mechanism is not yet deployed on those machines and I would need someone with login access to reconfigure those machines for me. > The situation is worse for x86_64: 96% idleness based on /proc/uptime. Am I > misinterpreting? On what machine? If it's on the Berlin main node, it's by design. We don't want the main machine to build things as it interferes too much with the other stuff happening on that machine such as gc'ing a huge store, hosting Cuirass and other services. Thanks, Mathieu [1]: https://ci.guix.gnu.org/workers [2]: https://ci.guix.gnu.org/metrics