From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:303:e16b::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms8.migadu.com with LMTPS id WMbqMjVfP2XtTAAAG6o9tA:P1 (envelope-from ) for ; Mon, 30 Oct 2023 08:45:58 +0100 Received: from aspmx1.migadu.com ([2001:41d0:303:e16b::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id WMbqMjVfP2XtTAAAG6o9tA (envelope-from ) for ; Mon, 30 Oct 2023 08:45:57 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id AF84A59CDC for ; Mon, 30 Oct 2023 08:45:57 +0100 (CET) Authentication-Results: aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org"; dmarc=none ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1698651957; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post; bh=Qo/DmnkStbw8VFhdTdPz4HBRV8XhKlLWwdacBjnmOlY=; b=VFWc0JA6QwwDDuoUD/dNnCHIHH9lQ8Z87G8UjvMEPnxfvDE9Rnl0sBnFWG7ULs2GHBxVbb xeE3kKzJ5oWj8iztE4P01iwHY3re9Ddor2GFrQHb1gja6Kclm213ouPRFGJodC+S8ETpgZ nhiruSsXNV7ribTZomMuKJtUeDyvj0iyBkJ92Kg8Bihqq1K5KJ9ZemyZS2x33K3HXU9PpJ RtU1jYzZyVNC9L2RlJWKxqvmGY2522FQWjX3JfqayjEH4UmG9Nd+5WTmCl2RXrUabnlTJE xwts4BbD3DTeR4DyuHlqw+LPjk1+55D/WEP6xWhQC0gIAOvmiAS41bPgU4S2CA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org"; dmarc=none ARC-Seal: i=1; s=key1; d=yhetil.org; t=1698651957; a=rsa-sha256; cv=none; b=Rp865kFb1t37HJeJIeCado0a318UWpPF8hOlpQ+HVxX/D1ydzJ6WbQCjiuTlFUVNTF+O0F 8az9iGIGlp75NVn0mAsE3aaUVlF53PXWvww79uSixsD4gJwaufJvf1cAhBrSXOxM/X/P2A SoLMNVSbbLzEPfMvH3pmitfiQazBiGhW5oKHc7OJGorkEmNXOpKZwew6q94m2FLpaNmlEf hZV3uBGy8v0fYQyOtOpap7nC99KVcQI+ipzhPZwRmOaGS3ej4yTO7o8HGqWqiPxrc6vYHH R+F++BoGbruW1lhKkj+BjGNyVkKy/rIzJ4WH5r9eGz/9yxsYZIw8L+5DfRIwwQ== Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1qxMxo-0003XI-CR; Mon, 30 Oct 2023 03:45:32 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qxMxm-0003Wy-39 for bug-guix@gnu.org; Mon, 30 Oct 2023 03:45:30 -0400 Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1qxMxl-0004iH-P8 for bug-guix@gnu.org; Mon, 30 Oct 2023 03:45:29 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1qxMyI-0004I8-71 for bug-guix@gnu.org; Mon, 30 Oct 2023 03:46:02 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#63414: Evaluation comparison on cuirass Resent-From: Christopher Baines Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 30 Oct 2023 07:46:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 63414 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Cc: Andreas Enge , Josselin Poiret , 63414@debbugs.gnu.org Received: via spool by 63414-submit@debbugs.gnu.org id=B63414.169865194316469 (code B ref 63414); Mon, 30 Oct 2023 07:46:02 +0000 Received: (at 63414) by debbugs.gnu.org; 30 Oct 2023 07:45:43 +0000 Received: from localhost ([127.0.0.1]:44194 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qxMxy-0004HZ-S1 for submit@debbugs.gnu.org; Mon, 30 Oct 2023 03:45:43 -0400 Received: from mira.cbaines.net ([2a01:7e00:e000:2f8:fd4d:b5c7:13fb:3d27]:39079) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1qxMxs-0004HN-Vx for 63414@debbugs.gnu.org; Mon, 30 Oct 2023 03:45:41 -0400 Received: from localhost (unknown [217.110.181.146]) by mira.cbaines.net (Postfix) with ESMTPSA id 35F8B27BBE2; Mon, 30 Oct 2023 07:45:02 +0000 (GMT) Received: from felis (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id b958618b; Mon, 30 Oct 2023 07:45:01 +0000 (UTC) References: <87y1fl74nr.fsf@gnu.org> User-agent: mu4e 1.10.5; emacs 28.2 From: Christopher Baines Date: Mon, 30 Oct 2023 07:32:35 +0000 In-reply-to: <87y1fl74nr.fsf@gnu.org> Message-ID: <87cywwzh8l.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: bug-guix-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Spam-Score: -8.20 X-Spam-Score: -8.20 X-Migadu-Queue-Id: AF84A59CDC X-Migadu-Scanner: mx13.migadu.com X-TUID: HJMb1KKIxubL --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Ludovic Court=C3=A8s writes: > Hello, > > Andreas Enge skribis: > >> When working on a branch and deciding whether to merge it, we need a way >> of comparing its status with that of the master branch. As far as I can = see, >> there is currently no way in cuirass to compare arbitrary evaluations and >> get a list (or a dashboard) of builds that fail in one, but not the othe= r. > > Going back to this, I agree with Josselin that the Data Service does an > excellent job at comparing the status of different revisions; I think we > should leverage that rather than try to implement something similar in > Cuirass. > > Perhaps one thing we can improve though is the information flow from > Cuirass to the Data Service. ISTR that Christopher mentioned that the > Data Service couldn=E2=80=99t easily get information about substitute > availability from ci.guix, or something like that. Substitute availability is easy to get, but there's some difficulties around build information. > Is there still a problem here, Chris? If we need a new HTTP endpoint in > Cuirass to address that, I=E2=80=99m happy to give a hand. The data service used to poll ci.guix.gnu.org for builds and build status information, but I stopped that quite a while ago after the data got messy when the Cuirass database was deleted and recreated. Since the data service stores and uses the build IDs from Cuirass, it's confusing when they're reused. Anyway, even ignoring that, I'm unsure if polling worked well. That's why I started to look at pushing data from Cuirass to the data serivce. I did implement that, but the code on the Cuirass side was never used. It's that same endpoint though that the build coordinator uses to send build information to the data service (both instances). The other blocker to making use of Cuirass data in the data service is making sure it's high quality, in particular that if it says a build has failed, I at least want to know it's started to build that derivation. We don't want things showing up on QA as problems when it's just Cuirass being unable to start builds. Thanks, Chris --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmU/XvpfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9XfiHg//W82VccgptjuwiVAWk89dFf/myKvM0fX4 4V6ExW+B6G3Jp5a4Pq5jOoLmh8rOlc0rflKypfVqY1vCC3jddXEGmzaJnQ54Oa0s ihEjjwz/2L2L5xhnla1joW2O0ESpPgxAuJyNBpDBV4YFgg3Z6e+5gI4WmRHPiECv rMCiad5JBZBsknCjwTjqJ3ceUpdVOVeCVN/ArTRzeWHXeot4IL4YM1ky9EJL6vDz 0AR5te5YybUAtKLmgJXgywDKYJQDGgW/HCdtCI46goSP7k9BDtEsSuHyMiYDqox9 yzIr8dWWgwnMIiTzVgn4Mjy97PAuBcPxmurcxlpeXrrHMdVY0+MWtLE2q0BuxL2O iWry73N1HR7sbgaJaGQSUZxG8ALPl57jzLIVSjbFkkaojIWdoJ+V8wNhR/NwpuP0 pFFIJyQ5vNHuE9HsVMJ8evCJxPCO1idvNHwixywlR4X71INWbG8rXyfG9fcVFmwo qefmdexc4v+FhTU25mCsLn0ExS6Zsq2/4kuDiEO8RbwVMVb8k44T7BvfW3McBPKq FK3ylPnZygheytK6AQq2uMdDoy/5sxiLowUO28y3Wf513JO7S1/DVO1xswRjYNH8 JTGxAMgDbqS6NyOCvoVWQDnJutAMWQnUUjx9XI4v2d0VHkAx2B6JcHT6FboRmkRu YBZZYuq6MrA= =prSg -----END PGP SIGNATURE----- --=-=-=--