From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp12.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id uF8lNsLzEWQK5wAASxT56A (envelope-from ) for ; Wed, 15 Mar 2023 17:35:14 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp12.migadu.com with LMTPS id +E8YNsLzEWSJfAEAauVa8A (envelope-from ) for ; Wed, 15 Mar 2023 17:35:14 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 9A866A101 for ; Wed, 15 Mar 2023 17:35:14 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1pcU5e-0005m7-PS; Wed, 15 Mar 2023 12:35:02 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pcU5c-0005g3-5c for guix-devel@gnu.org; Wed, 15 Mar 2023 12:35:00 -0400 Received: from mira.cbaines.net ([2a01:7e00:e000:2f8:fd4d:b5c7:13fb:3d27]) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1pcU5Z-0005y6-V9 for guix-devel@gnu.org; Wed, 15 Mar 2023 12:34:59 -0400 Received: from localhost (unknown [IPv6:2a02:8010:68c1:0:54d1:d5d4:280e:f699]) by mira.cbaines.net (Postfix) with ESMTPSA id 5642A16961 for ; Wed, 15 Mar 2023 16:34:47 +0000 (GMT) Received: from felis (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id c9fd1982 for ; Wed, 15 Mar 2023 16:34:46 +0000 (UTC) User-agent: mu4e 1.8.13; emacs 28.2 From: Christopher Baines To: guix-devel@gnu.org Subject: March update on qa.guix.gnu.org Date: Wed, 15 Mar 2023 13:06:07 +0000 Message-ID: <87mt4ex9b0.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=2a01:7e00:e000:2f8:fd4d:b5c7:13fb:3d27; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-Spam_score_int: -2 X-Spam_score: -0.3 X-Spam_bar: / X-Spam_report: (-0.3 / 5.0 requ) BAYES_00=-1.9, DATE_IN_PAST_03_06=1.592, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none ARC-Seal: i=1; s=key1; d=yhetil.org; t=1678898114; a=rsa-sha256; cv=none; b=UzS9aLxvNvJ3M0MuREvIpLxe39wuBl2xtRehQ2HS9ZN6lmRK6dlhmnPNF06OUIgKePe4DA YCg9WEFEjg3t8l01By/iR7IgCbdqYeaYdN1td0r9Q+QSL1peMo3W/uxNeb7z113YXG+IQ2 U13CLstZ5Kx4iccEYuD5y6aFHk7Yni9PUdnLGJpVUoareLnPhN2L+i/MuE3L4DDW0ZAjpo AGaZXHUylp6nF9VYG28+u1ExfPU1jnwB5xnIvBUVzG8duA/3Fl6sBoPMUGKGVhyf4GXYV7 tREDBIsJUAEoT7TL1+1/2K/7B8PYekENdRatTu8FLocuiH4syzvIdaSxokb2/g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1678898114; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=raL/cwlf+gc/joQj3ewBAI+qWCsWvKC3a2yC6PqZ8/8=; b=DklH1g7jQotrSlk0wnRUbkDxsg2IxhN8DQFC35A0a2WFFadzUVPgUB2/9a292p0xRK8tam EUOPjKXZrQgM3QIIc7YsDqZF1wGzcbQVUmTeiv3F/Wv1qCmeyei9NRLTqcAQsb3N0/W+ZV SsVLeHn+OhYSgsdSKEey1j+MvGc9Q+4k80WP92IZBHnNA1wIxX+XAoBSB64G4uqBwzDGhE VHz8Bsvc/LIdt5UgrG7xIUDqLxMe5TqBWfUKnIm/t2nJSU083F0ZVLGY5am3HAT5s84bZK e3RBCIMsx9O4mIhSaMVdwMT9jdMhklBStjHUjxa5iV4P/yaB+KpYlJMnbRZv/w== X-Migadu-Spam-Score: -5.13 X-Spam-Score: -5.13 X-Migadu-Queue-Id: 9A866A101 X-Migadu-Scanner: scn1.migadu.com Authentication-Results: aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none X-TUID: sBRDtetZW6tz --=-=-= Content-Type: text/plain Hey, I think it's been quite a while since sending out an update on QA stuff that I'm working on, the last update to guix-devel looks to be back in December [1]. 1: https://lists.gnu.org/archive/html/guix-devel/2022-12/msg00093.html Since then quite a lot of stuff has happened, including meeting people in Brussels again which was great. # Infra stuff There's now a proper system service [2] for the qa-frontpage running on bayfront. 2: https://git.savannah.gnu.org/cgit/guix/maintenance.git/commit/?id=8c17ac564447aa5448fc6eca40001c5b68c17d61 The Git repository is now on Savannah [3] allowing other committers to push changes. 3: https://git.savannah.gnu.org/cgit/guix/qa-frontpage.git/ I've also spent some time fixing and improving the data.qa.guix.gnu.org upkeep stuff, as it needs to regularly clear out the unused data. At some point in the near future, I'd like to not be solely responsible for the financial and administrative part of keeping data.qa.guix.gnu.org (plus Patchwork and Gitolite) running. There's a thread about this on the guix-sysadmin mailing list, but if anyone has any thoughts, please let me know. # Data service The data service provides much of the data to make qa.guix.gnu.org work, and I've been trying to improve it in a few areas recently. I've added something [4] in which seems to make computing the system test derivations happen faster. I'm not quite sure of the impact, but the main benefit at the moment is that revisions are being processed more quickly, which reduces the time to give feedback on patches and branches. 4: https://git.savannah.gnu.org/cgit/guix/data-service.git/commit/?id=bf41c6ebb1c12ec15ee77e727a1ae0d7a1466aef I've also done another deep dive in to PostgreSQL query performance to get the blocking-builds page working. This page still needs a bit more work, as I'm unsure about some of the data it's giving back, and currently it's difficult to see what builds are blocked and why, but I'm hoping that this'll be helpful when it comes to branches like core-updates. Here's the page for armhf-linux builds for a recent core-updates revision [5]. 5: https://data.qa.guix.gnu.org/revision/62ff0b90864c8a4484aa2f14856ff33d05e00b0c/blocking-builds?system=armhf-linux&target=none&limit_results=50 One issue I made surprisingly fast progress on after the Guix Days was the interaction of grafting and the channel instance derivations, there's a patch series needing a second round of review here [6]. Currently data.qa.guix.gnu.org often can't compute the channel instances for all systems, and these changes should resolve that. 6: https://issues.guix.gnu.org/61363 # QA Frontpage I've made various small changes to try and make things faster and take less memory. The memory usage is still an issue, but things like the branch pages now work which is good. Substitute availability information is also now shown on the pages for branches. # Next steps Since starting to build core-updates and increasing the number of patch series tested (both in terms of number and increasing the build limit), the bordeaux build farm has been running flat out. That's good, but it's now even more important to tune how builds are prioritised to try and make better use of the build resources. I think the missing data to do that is some good picture of what's recently been built, currently being built, and queued up. This information is in the build coordinator, so it just needs exposing somewhere so people can easily see it. Another key area for improvement is trying to make any feedback given clearer and more actionable. For example, currently for patches and branches, more failing builds for a particular system will be highlighted, but there's no easy way of just seeing the things that were failing to build that weren't before. It would be good to know what other people submitting or reviewing patches would benefit from though, what things would be most helpful? As always, if you have any comments or questions, just let me know! Thanks, Chris --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmQR86NfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9Xe6LxAAtyaU6D1QsMAKf0yeWLMqz9z09PzY3Rlf JLqgfX7K2WvcUdtglNEwSXp55UqCJyQDQd3whxYIDk4aKx2WsOTncI3L7DR5+pcT qBoU8IlsjWHmrAsm7eLugaas/g1NsQmMyVRoQO8omFMtaNIWDJCdhaFhUPcLJFxr ufhI9Nc6nf6/sZsQ215nWAIZ0xLNtS7pr1XNLAQgywx/lVIgT4SBMca9HvsXEbzj FL8bFBc9d2hEOMZWSDrfWnCP1f8z+FJJsmgYmS4aDMt7veFBFLvixLl5SwSsNoko d5F310Q8oNyHygdC7Waj7SEYFDJF1Voafu4DX0ZwdvE2bJJ9i7SIn7GiWt5+L+HY pj8zvgHqNzPiLWhMd8491RrPog6Kg0VV2JunuF0K7sSuJE/GvKpvW7Qf/l3+H/wm nyKZZdl+o2b1Qu/UcGjzH5R677+W8BItDTS7RPQOiLeT0wDWOEv0V10X6kiyJGWt ZSNTcn09ZOoSp5pfiMTrZPJj/2k3+uHjj8ib/RoEZkSt5TFBgUJKxVuagXSZ6vy2 mFeNUPptN1HmqGxt9/AZhJcOodxJpcJP2vIjegMRuEKVJ4f2kYbmC5rwNZNLhjKq ivII4YTBAQRmvmR/IwqZrgwwvVlljl47qTFwZB16ksKc+5Q2o9xgsA1NjGoSObTF RWXL4t8dSwE= =oPPe -----END PGP SIGNATURE----- --=-=-=--