From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id OD7KMnoq+15PFQAA0tVLHw (envelope-from ) for ; Tue, 30 Jun 2020 12:05:14 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id aDV6Lnoq+15aawAAbx9fmQ (envelope-from ) for ; Tue, 30 Jun 2020 12:05:14 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 265F49400BB for ; Tue, 30 Jun 2020 12:05:14 +0000 (UTC) Received: from localhost ([::1]:50776 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jqF0i-0001rr-20 for larch@yhetil.org; Tue, 30 Jun 2020 08:05:12 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:34924) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jqF0Y-0001oJ-NK for bug-guix@gnu.org; Tue, 30 Jun 2020 08:05:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:38824) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jqF0Y-0007zO-Dp for bug-guix@gnu.org; Tue, 30 Jun 2020 08:05:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1jqF0Y-0007gi-9G for bug-guix@gnu.org; Tue, 30 Jun 2020 08:05:02 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#42137: cuirass: monitor evaluation status Resent-From: Mathieu Othacehe Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Tue, 30 Jun 2020 12:05:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 42137 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 42137@debbugs.gnu.org X-Debbugs-Original-To: bug-guix@gnu.org Received: via spool by submit@debbugs.gnu.org id=B.159351865729490 (code B ref -1); Tue, 30 Jun 2020 12:05:02 +0000 Received: (at submit) by debbugs.gnu.org; 30 Jun 2020 12:04:17 +0000 Received: from localhost ([127.0.0.1]:50370 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jqEzp-0007fZ-3v for submit@debbugs.gnu.org; Tue, 30 Jun 2020 08:04:17 -0400 Received: from lists.gnu.org ([209.51.188.17]:47906) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jqEzn-0007fS-33 for submit@debbugs.gnu.org; Tue, 30 Jun 2020 08:04:16 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:34830) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jqEzm-0001A0-U9 for bug-guix@gnu.org; Tue, 30 Jun 2020 08:04:14 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:49185) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jqEzm-0007pm-KF for bug-guix@gnu.org; Tue, 30 Jun 2020 08:04:14 -0400 Received: from lfbn-ann-1-356-169.w86-200.abo.wanadoo.fr ([86.200.73.169]:55358 helo=meru) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1jqEzl-0005ns-VT for bug-guix@gnu.org; Tue, 30 Jun 2020 08:04:14 -0400 From: Mathieu Othacehe Date: Tue, 30 Jun 2020 14:04:10 +0200 Message-ID: <875zb82211.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Spam-Score: -3.3 (---) X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Spam-Score: -1.01 X-TUID: 7VehgYSURG/X Hello, With Hydra, it is possible for a derivation to have the status of all "still succeeding jobs", "newly failing jobs", "newly succeeding jobs". In a word, have a quick overview of an evaluation status. You can have a look to https://hydra.nixos.org/jobset/nixos/release-19.09-small where it's easy to see that 1591716 caused two test failures, that were fixed right after. In Cuirass, it's only possible to know the status of triggered builds, for each evaluation. For the last two months, the system installation were almost all broken, I think that if we have had a page showing the full status of system tests evaluation by evaluation, we could have avoided this situation. Also having the "newly failing jobs" list would allow to mail the people that have commited changes between the last evaluation. Of course this is easier said than done, it might imply to update our database structure among other things. WDYT? Thanks, Mathieu