From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:403:478a::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id QLxfEmv7wGR2CwEASxT56A (envelope-from ) for ; Wed, 26 Jul 2023 12:54:35 +0200 Received: from aspmx1.migadu.com ([2001:41d0:403:478a::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id aHAzEmv7wGQL0AAA9RJhRA (envelope-from ) for ; Wed, 26 Jul 2023 12:54:35 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id CBFB1555B8 for ; Wed, 26 Jul 2023 12:54:34 +0200 (CEST) Authentication-Results: aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1690368875; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=bZlEtQ6Qlf/TWrt9FnyCozKgNwO3mcrZG7RRYAejMN8=; b=apQPO8CDWue90ntaXqZ/S5PlytxD+8GxEg4wyyJ9XzKieDfqS4D3K/6NqgWQXsqgMNiYb9 Rkt3FcLMf46YP7iDtKblrcY2z4L+NM2lr7g9qXSdpuodPLf31MIEYW6ZknQIacKKEh75ai IlzGkd9aaKMwmbbQS90ZpwkHFLqgxRW28MN9uSBUJuy1HpJDyqweJgodu3ydOrjSTCMfnv z7f3Gpv9pz3TY6PGL7RCn3ra77bO3vwGIb9/vJSAXYshtcZLSffe2qpa2tcpJ3+5y3w+4k GkI0mHzhhxoLs7c9MVeW9LEmJcq+8enKddu32AAJ/sbLzC4Qpyj7sF7zBHtbAg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none ARC-Seal: i=1; s=key1; d=yhetil.org; t=1690368875; a=rsa-sha256; cv=none; b=C1fQxA+PZnGN/aiZcvjQRPcU+PAEcbHfoaWHZO4sPrt+qn3fuw7rwaKLo7liALl+rS0KCW YroXeiL/QEfBYwnhST5qjEEnRtbwb/AfI76b8tz+MXTdhrpt5J7qfLmh+4Kvy5qo2qneC3 YIfCcKK+lMbj46iuV7pfMgfmmrv1qk6wfCQTvkCx/MaYhLkN6gO8UhzzknZcGkW2cnKopQ RrPo8CQuf+YPA9NYLhfdJ62ElSHH/eNNWlIMCEaSVcb14HzgvkUwOr7BgH+Hzwxcr3TClK noju7kAIuUnFfALSQQksOBTmMr7F41VIIn94d8N6AfncIDYiNCEe6VmxCGk0+Q== Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1qOc9f-00040F-9k; Wed, 26 Jul 2023 06:54:07 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qOc9e-0003ym-49 for guix-devel@gnu.org; Wed, 26 Jul 2023 06:54:06 -0400 Received: from mira.cbaines.net ([212.71.252.8]) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1qOc9c-0006w3-74 for guix-devel@gnu.org; Wed, 26 Jul 2023 06:54:05 -0400 Received: from localhost (unknown [IPv6:2a02:8010:68c1:0:3a91:a0a4:ecee:f157]) by mira.cbaines.net (Postfix) with ESMTPSA id 2E5DD27BBE2 for ; Wed, 26 Jul 2023 11:54:01 +0100 (BST) Received: from felis (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id fea757f0 for ; Wed, 26 Jul 2023 10:54:00 +0000 (UTC) User-agent: mu4e 1.10.5; emacs 28.2 From: Christopher Baines To: guix-devel@gnu.org Subject: July update on qa.guix.gnu.org Date: Wed, 26 Jul 2023 09:44:22 +0100 Message-ID: <878rb36j07.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: text/plain Received-SPF: pass client-ip=212.71.252.8; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Spam-Score: -6.15 X-Migadu-Queue-Id: CBFB1555B8 X-Migadu-Spam-Score: -6.15 X-Migadu-Scanner: mx0.migadu.com X-TUID: sgVblQXueSsb Hey, It's been a while since I sent out the last update on QA things that I've been working on, there was a small update back in May [1] and one before that in March [2]. 1: https://lists.gnu.org/archive/html/guix-devel/2023-05/msg00142.html 2: https://lists.gnu.org/archive/html/guix-devel/2023-03/msg00222.html ## Changes since the last update The QA frontpage processing branches is now automatically handled through creating issues. This seems to be working really well, both as a process for making it clear what's going on with which branch, and also feeding in to the automation and testing. Old builds for patches and branches are now cancelled. This helps the bordeaux build farm work on the most relevant builds. Branch comparisons now are done against the merge base, rather than master, this just helps give relevant feedback. There's also a new package changes page which is linked to from the package changes table on the issue and branch pages. This starts to address the long standing issue where you can't see what the numbers in the package changes table relate to. ## Current state While the software is getting better, the service overall is struggling a bit and that looks to continue for the short term at least. The queue is very large at [3]. The branches for lots of patches could have been rebased due to the tex-team-next merge, although it's possible that the missing i686-linux and armhf-linux derivations recently are causing some patches to be repeatedly rebased. It'll take a few weeks to get back to a point where there's data on lots of patch series. 3: https://data.qa.guix.gnu.org/jobs/queue Discussions ongoing about hosting for data.qa.guix.gnu.org going forward. So far I've been organising and paying for a virtual machine to run this, but I'd like to stop by the end of the year. On the bordeaux build farm side, there's been quite a lot of work recently on growing the available storage for nars. With the recent work on branches though, I think it's easier to feel the impact of not having many available machines. While it's possible to just wait longer for builds to complete, that has it's own disadvantages. harbourfront (one of the 3 x86_64 machines is going away at the end of August) which will further reduce the already limited capacity for x86_64-linux and i686-linux builds. I'm in the progress of drafting a blog post about the qa-frontpage. ## Next steps The qa-frontpage still could do with giving clearer and more actionable feedback. The other big issue on my mind is getting the data service to process revisions in less time, as that'll help give quicker feedback and cope better when rebasing large numbers of patch branches. Apart from that, I'd like to get back to actually using qa.guix.gnu.org to review patches, that's a little difficult at the moment as data is available for very view patches. Also, as mentioned above, more work needs doing on longer term hosting for some of the services, as well as growing the bordeaux build farm so that it can keep up with the growing load. Let me know if you have any questions or comments! Thanks, Chris