From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id sAWTFpwmKGPmJQEAbAwnHQ (envelope-from ) for ; Mon, 19 Sep 2022 10:21:48 +0200 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id EEfEFpwmKGPlxAAA9RJhRA (envelope-from ) for ; Mon, 19 Sep 2022 10:21:48 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 3083C26F87 for ; Mon, 19 Sep 2022 10:21:48 +0200 (CEST) Received: from localhost ([::1]:50070 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1oaC2F-0007Fw-3c for larch@yhetil.org; Mon, 19 Sep 2022 04:21:47 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:53640) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1oaBmD-00084S-Ng for guix-devel@gnu.org; Mon, 19 Sep 2022 04:05:17 -0400 Received: from mira.cbaines.net ([212.71.252.8]:36742) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1oaBmB-00078a-BK for guix-devel@gnu.org; Mon, 19 Sep 2022 04:05:13 -0400 Received: from localhost (unknown [185.238.38.162]) by mira.cbaines.net (Postfix) with ESMTPSA id A2AF127BBE9 for ; Mon, 19 Sep 2022 09:05:09 +0100 (BST) Received: from felis (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id 3aca7a4a for ; Mon, 19 Sep 2022 08:05:09 +0000 (UTC) References: <87mtbc3g5e.fsf@cbaines.net> User-agent: mu4e 1.8.9; emacs 28.1 From: Christopher Baines To: guix-devel@gnu.org Subject: Re: Progress with automating testing of patches Date: Mon, 19 Sep 2022 09:46:51 +0200 In-reply-to: <87mtbc3g5e.fsf@cbaines.net> Message-ID: <87sfkneqmm.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=212.71.252.8; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-To: larch@yhetil.org X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1663575708; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=hFSDdglr66GaC10c95uRRF4t8uh/TQtFHq1XbsG9Sew=; b=jCeAQoohBWNcATSywX3tOQ40y4WuSVsHHGeDLdnNoo1ya0qK/dUxJSXeF7DbiUpQN5mBEi 0CvKvif5CwVoMO4wdB+08uD5vO84Nu1YWNDGVZQMTs1BKtaEvnDztLxiawmWG6Au5LPseT vp+nqu7KNnuhwrdDLWyym/ttIZWqDNZA8IsK0dPeantFotRYFwXnCdIT7jOnMIohHZDYBE 0VeUQmOuxmtYYj0fUfRnkwAnmQam+ybgLpQaLRIryOS6YZ9HFB7uaM6XJcm2e/ofOZSKlr 8Ldm2x+0bQaK3uwceIApG8weUXjm/Rcuc/pBYlsedSXVDUED6FOvTyfc2Hj8Jw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1663575708; a=rsa-sha256; cv=none; b=sk+VzLzN/Zmkqc/F4V57Oj+3Woth2fNkLyP628drgk60nWQebtv/dJ44pd48EVbP5v/cZr r3IjxVd0DW9i/v/KBlflfRU33IZwY4My34/ht53xFH5qo2gs3XA9duU1HVvMesVzKFVen4 aqd5WLk9ymx0RO7S+pk35cp3u/9tK//lL6u81sPM/9G2izSY7NgXSwYdI0PsrzruSH9qfU dhtbqbFsMhJFfWj2h+Vh8OTFjB9iiO5aF7gIwUaIPEXy3wlL7LD5L9X8dDDNVXLhQXPCPl C8h0oXc6GpEDnPN85DpCh6pDMf6OTmyCZ+9/jVaPyMzsK5eP96R+m8v+DFtyMg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -4.74 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 3083C26F87 X-Spam-Score: -4.74 X-Migadu-Scanner: scn1.migadu.com X-TUID: QYwaeuDzp5gE --=-=-= Content-Type: text/plain Christopher Baines writes: > Since it's easier to iterate once there's something visible, I've just > stuck what I've got so far on the internet, it's available at: > > https://qa.guix.gnu.org/ > > The code is here [3] and I've put a list of ideas in the README. > > 3: https://git.cbaines.net/guix/qa-frontpage/about/ > > Currently, there's a page which lists issues, and pages for individual > issues that show build and lint warning changes. Behind the scenes, it's > also submitting builds to the build coordinator for the packages > affected by patches (for x86_64-linux, i686-linux, aarch64-linux and > armhf-linux). > > As I've been developing it, I've been looking at various recent patch > series, and it seems like this is already useful. It's reassuring when > reviewing patches to see that packages still build on the architectures > being tested. Also, unlike earlier prototype patch testing setups, > because the builds are now happening on a default substitute server, > there should be some benefits already with substitutes being available > at the point the patches are merged. > > This is very much still at the prototype stage though, many pages will > timeout or just fail to load due to an error. > > Let me know if you have any comments or questions? If you want to try > and work on adding any features, I should also have time to try and help > out as well, so just let me know you're interested. There's been some more progress now since I sent this email, so I thought I'd send an update. I've started to try and show some overall status for each issue, that's the green circle which can appear on the patches page. I want to try and make this available as an image as well, so that it can be included on the issue page on issues.guix.gnu.org, linking up qa.guix.gnu.org and issues.guix.gnu.org. I've also managed to use the GraphQL API for issues.guix.gnu.org to fetch tags, which is very exciting as it makes it possible to do all kinds of things I think. Starting with showing specific tags on the qa.guix.gnu.org pages, and ending maybe with replacing Patchwork with data provided by Mumi. Also, while builds for patches were happening, there's now support for submitting builds for a branch. This is the case for staging, so these builds are now happening. It'll probably take many days, maybe even weeks for all the builds to happen, but at this point I'm mostly interested in getting the software working so that qa.guix.gnu.org is really useful for working with branches going forward. I also covered this qa.guix.gnu.org thing in the talk I gave yesterday at the 10 Years of Guix event. See the email with this subject [1] for some very rough notes from the discussion that happened in the late afternoon. There's a list of seemingly actionable things in there, some of which relate to the qa.guix.gnu.org site. In particular, I'll try and push the repository to Savannah at some point this week, so let me know if you have thoughts on changing the name (currently qa-frontpage) before I do. 1: Notes from discussion on Quality Assurance from the 10 Years of Guix event Do let me know if you have any comments or questions! Thanks, Chris --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmMoIrFfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9XeltxAAp2IeXq8WrLfFN+Ms+1OPuo+wkF3DR+HX STCH5/GbwbguNVv5wqxchUHamR77u4rvVNefyTEvDpmLg4g4qp0BKdf58W7vDJ8H 9N5iEhGdvh8ta79CFqZ9LhutIjyDIzya+QaFL8X7cLOmNGHn+Rf2aSIy6mJ3ZTS4 ofMHO8ZT4GuQnAXTEQUODrcNoTQpX1swg7YKxEDOtjt4uqovhkNRPO+EIKAzKvME Ka+khCTC0e/G1pvEOdFwkefkKtx3jpyqXaaci/19PhIIdAfgkSAv5dgowYcnadgc sTJgEkAsRlfTtpcmnkbOQV5hiUBYsz5xI0X+8+pfV2WB9dFgOmQlYNtg5+8XCUiy idoRnaT8BXSB/JOWeEujWGdQj+rGJJ7GYKzEwBphkvqVRGnS219nY3xi2F9KnuQa QJcpE+BesyVccsTAwASdiJCPvnVYl7M0PGM0XD6yluc6WHMxkKQtPs8+OioE99FI hMk4MqOLK7mkxW10azX/nJk+tuXoRpYxQoXPf3pwHYq8rhQdmNu4UG0sKuUxWYqx TIZPb/f4AaN5j612s6PFLihDtJ6pJq8M3ndRzL7Di/fiNAKVeJSLQF0QT1HtPyiJ px8J7PUgSeVHB18lUnyeUhrgWYF5I1a8i6PVC+yy2FNVZY5aSB2vjrYVQMD/uhaY Ye0H/aVBc3A= =dkJT -----END PGP SIGNATURE----- --=-=-=--