From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id wIBINYhDF2MdTwEAbAwnHQ (envelope-from ) for ; Tue, 06 Sep 2022 14:56:40 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id IKIrNYhDF2NKAQEAauVa8A (envelope-from ) for ; Tue, 06 Sep 2022 14:56:40 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 9438B2B14D for ; Tue, 6 Sep 2022 14:56:40 +0200 (CEST) Received: from localhost ([::1]:60720 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1oVY85-0000If-DI for larch@yhetil.org; Tue, 06 Sep 2022 08:56:39 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:36272) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1oVWb7-0001Rz-NX for guix-devel@gnu.org; Tue, 06 Sep 2022 07:18:29 -0400 Received: from mira.cbaines.net ([212.71.252.8]:36716) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1oVWb5-0008Ha-6k for guix-devel@gnu.org; Tue, 06 Sep 2022 07:18:29 -0400 Received: from localhost (unknown [IPv6:2a02:8010:68c1:0:54d1:d5d4:280e:f699]) by mira.cbaines.net (Postfix) with ESMTPSA id CAA7327BBE9 for ; Tue, 6 Sep 2022 12:18:23 +0100 (BST) Received: from felis (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id a5c1d2c9 for ; Tue, 6 Sep 2022 11:18:23 +0000 (UTC) User-agent: mu4e 1.6.11; emacs 28.1 From: Christopher Baines To: guix-devel@gnu.org Subject: Progress with automating testing of patches Date: Tue, 06 Sep 2022 11:11:17 +0100 Message-ID: <87mtbc3g5e.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=212.71.252.8; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-To: larch@yhetil.org X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1662469000; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=np7M3ikPsNXwP/rknchdwlqN+9OxTlLQgOVo4efD9Cs=; b=WGXeHjUoQGXtdGbc4/YZPfCsUltvBBj5/6Qp/3HRrvAl3hC9taddxOQ5lvPuelMp2y8zh8 RyoqXqlso4MchL0kk9IUT4gQBuEy6XBr+z4JSGCeh0RlSq1FZtmmbrMkRT/T/a04Julr/t i7WfLhs7du3gg7cQQH+PtxBngJsuDxbsOs2/NNPCqt+78V109+soEjJKEWecsPyC778jyk FlB07WUFK08e2fNNeFj+yUUcHorrg+dmcvIDs8xqoM7YaW6BDZy6bsce2Ex3z5zlG4BKZW YplWGjt+m9L7vRgHeqNikOeXrDf8AKZdQynl2Pcuz4S0ChNZlAeY0BWZcrE3FQ== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1662469000; a=rsa-sha256; cv=none; b=p9gneIEj1DDVjtcU1Z/lPi5rSyT1eIoS9uL0CItwc+TqruuJLTE9MPGx453fvwESrn/vqe +tNF1ojX8kRF1YwnzGXB20OeRBYFNTDwl6qlkLIthn47ivWxSotc9DYhYNOsWxXE8RO6tA 48Uw8XKfyUK7MAl0E1avlqDHeLqol0B4m1xorRZ1swXCQzHOMsScWpXlNkIdysJ++Hx1lI Wkmkep1EHwu0RRKBTh+0mKgCe7Ds4T7h91w/4VibTkfCne4D/88osiibgIRiiaWAFyoeyd TxkquB+EieUvPO+31n0HdKXSvWY+O4K47Uoj7mgVrbf9BdZlo00xsB5J5EXBZg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -3.17 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 9438B2B14D X-Spam-Score: -3.17 X-Migadu-Scanner: scn1.migadu.com X-TUID: 4binZv1opSA4 --=-=-= Content-Type: text/plain Hey! I think I sent the last message to guix-devel on this topic back in February [1]. 1: https://lists.gnu.org/archive/html/guix-devel/2022-02/msg00102.html I haven't had a lot of time or motivation this year, but I've still been trying to chip away at this. The recent new thing is that I've joined up the uncompleted work to test changes (patches and branches) with some thoughts from early last year about a QA page [2]. 2: https://lists.gnu.org/archive/html/guix-devel/2021-02/msg00096.html While the data service solves the hard problem of knowing what's changed with some patches or a branch, and the build coordinator solves the hard problem of building things and doing something with the results, there was a need for something else to address the other hard problem of tying these tools together and communicating the information. I think this QA service is a good fit. Since it's easier to iterate once there's something visible, I've just stuck what I've got so far on the internet, it's available at: https://qa.guix.gnu.org/ The code is here [3] and I've put a list of ideas in the README. 3: https://git.cbaines.net/guix/qa-frontpage/about/ Currently, there's a page which lists issues, and pages for individual issues that show build and lint warning changes. Behind the scenes, it's also submitting builds to the build coordinator for the packages affected by patches (for x86_64-linux, i686-linux, aarch64-linux and armhf-linux). As I've been developing it, I've been looking at various recent patch series, and it seems like this is already useful. It's reassuring when reviewing patches to see that packages still build on the architectures being tested. Also, unlike earlier prototype patch testing setups, because the builds are now happening on a default substitute server, there should be some benefits already with substitutes being available at the point the patches are merged. This is very much still at the prototype stage though, many pages will timeout or just fail to load due to an error. Let me know if you have any comments or questions? If you want to try and work on adding any features, I should also have time to try and help out as well, so just let me know you're interested. Thanks, Chris --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmMXLH1fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9Xex6hAAnu89h2S7JAdDRovRfVv7xUdYlqzphmWb HxxB2Y8MhwQQlOvybC3yorv/Ny7TT4fAKdRXhnaykt8Gv0H0pft4LY55a4g5oRDH qLaXcUAoo2dBf+x/4+aVfOxD32H9gSmUvjoa+9gHh7QEdeONhfVwY/jjGgMZi4NQ J88/g9uyAvnzbMigAJJscOB3uc8FRC+oTZqYaaLq6htVRe461pYvgJoth03RyRbg EB+3q+sN/tej/FeR4HAqkQnqZgs+Bn/GZCmHs6wkLC5NNRsQ4Mg8HkYfGW6kH4RB 1oZvNIFBKHy09JtjKy1XVxJn/2gOnypbtZyWxW3fvumtu8tpd3oHvE9zgGp1mDXN g9OE3r0/SZieHdb04jKx9kcU4mN7FSaKMMmpTnSu/cr9qK5STeeRIXx4CwMdDB5G F/hSItBLmH3HtwwPr6bema9ThTo20l+aauTEpeIM//J2oxcdvhxB+7NGIdgsJT+c r8E2bsMCO1hk7JztwdnIt3QDWhYbmQZWNXp78S+4M3Kc1dqGcpV9R1CiUv2UyqOz LFk3iLhdMiueV3wiKUDN6JIptVRxRHkGS9/OBCwByLq74238WL/nG5BA87PovlEk KAo0Do9K+gvJxs/D0CtAi/rEqLHIrkiwjotABXaTQPfVS7trk1NbN+1wss4B3xJ/ wn5qbLIcKwU= =Q3UX -----END PGP SIGNATURE----- --=-=-=--