From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id kUehLoUDAGC/ZAAA0tVLHw (envelope-from ) for ; Thu, 14 Jan 2021 08:40:37 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id UO33KYUDAGA0IgAAB5/wlQ (envelope-from ) for ; Thu, 14 Jan 2021 08:40:37 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 7D050940503 for ; Thu, 14 Jan 2021 08:40:37 +0000 (UTC) Received: from localhost ([::1]:45792 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kzyBI-00080Y-Go for larch@yhetil.org; Thu, 14 Jan 2021 03:40:36 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:38542) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kzyAS-0007bo-AH for guix-devel@gnu.org; Thu, 14 Jan 2021 03:39:44 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:46621) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kzyAS-00030W-0s; Thu, 14 Jan 2021 03:39:44 -0500 Received: from [2a01:e0a:19b:d9a0:1538:87ab:3a95:7600] (port=51808 helo=cervin) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kzyAR-0004QX-H5; Thu, 14 Jan 2021 03:39:43 -0500 From: Mathieu Othacehe To: Leo Famulari Subject: Re: Staging branch [substitute availability] References: Date: Thu, 14 Jan 2021 09:39:41 +0100 In-Reply-To: (Leo Famulari's message of "Wed, 13 Jan 2021 17:30:53 -0500") Message-ID: <87eein6hf6.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -2.86 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 7D050940503 X-Spam-Score: -2.86 X-Migadu-Scanner: scn0.migadu.com X-TUID: Qv/o8dZIdj/6 Hello Leo, > ------ > master branch > aarch64: 66% > x86_64: 93% > i686: 85% > armhf: 51% > > staging branch > aarch64: 44% > x86_64: 80% > i686: 60% > armhf: 30% > ------ Thanks for the figures. I can comment on some stuff. Until recently it was hard to monitor the build farm status because there were a lot of contention at the main guix-daemon level. Since the introduction of the "wip-offload" branch on Cuirass, the situation has much improved. The workers are constantly building. For now we are building three specifications: * guix-modular-master * guix-master * staging for x86_64, i686 and aarch64. If you look at the "Pending builds" chart here[1], you will see that the CI is barely catching up. That's because the "aarch64" emulated builds are incredibly slow, and monopolizing all the build resources. I deliberately chose to put armhf aside until I have a clearer view of the situation. Now, how to move on? First, I still need to connect the four overdrives machine to the new Cuirass remote building mechanism, and I would need some help for that (asked on guix-sysadmins). But, I'm not sure it will much improve the situation. Longer term, we need to figure out a better solution. It's now obvious that we do not have the computation power to build all our branches for 5 different architectures, relying heavily on emulation for armhf and aarch64. Anyone knows how Nix deals with that? I guess that other major distributions provide only cross-compiled packages for those architectures, but I don't think it's an option for us, Ludo? Thanks, Mathieu [1]: https://ci.guix.gnu.org/metrics