From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id T1lBBojEX1/4JwAA0tVLHw (envelope-from ) for ; Mon, 14 Sep 2020 19:29:12 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id aBRbAIjEX1/7dwAAbx9fmQ (envelope-from ) for ; Mon, 14 Sep 2020 19:29:12 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 84D67940390 for ; Mon, 14 Sep 2020 19:29:11 +0000 (UTC) Received: from localhost ([::1]:47894 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kHuA2-0004Uk-7F for larch@yhetil.org; Mon, 14 Sep 2020 15:29:10 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:47428) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kHu9u-0004U6-Uo for bug-guix@gnu.org; Mon, 14 Sep 2020 15:29:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:44768) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kHu9u-0005or-LV for bug-guix@gnu.org; Mon, 14 Sep 2020 15:29:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1kHu9u-0005GF-Ip for bug-guix@gnu.org; Mon, 14 Sep 2020 15:29:02 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 14 Sep 2020 19:29:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Mathieu Othacehe Received: via spool by 32548-submit@debbugs.gnu.org id=B32548.160011168620124 (code B ref 32548); Mon, 14 Sep 2020 19:29:02 +0000 Received: (at 32548) by debbugs.gnu.org; 14 Sep 2020 19:28:06 +0000 Received: from localhost ([127.0.0.1]:56303 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kHu90-0005EV-90 for submit@debbugs.gnu.org; Mon, 14 Sep 2020 15:28:06 -0400 Received: from eggs.gnu.org ([209.51.188.92]:40424) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kHu8y-0005Dp-Gl for 32548@debbugs.gnu.org; Mon, 14 Sep 2020 15:28:04 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:58804) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kHu8t-0005kf-2v; Mon, 14 Sep 2020 15:27:59 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=33406 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1kHu8r-0001Xz-LA; Mon, 14 Sep 2020 15:27:58 -0400 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> <87y2lmlox2.fsf@cbaines.net> <874koarop0.fsf@gnu.org> <87k0x14vax.fsf@gnu.org> <87tuw05vom.fsf@gnu.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 29 Fructidor an 228 de la =?UTF-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Mon, 14 Sep 2020 21:27:47 +0200 In-Reply-To: <87tuw05vom.fsf@gnu.org> (Mathieu Othacehe's message of "Mon, 14 Sep 2020 15:34:17 +0200") Message-ID: <87o8m8b1l8.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Spam-Score: -3.3 (---) X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 32548@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Spam-Score: -1.01 X-TUID: tjw/RqDSFFam Hi! Mathieu Othacehe skribis: > I just pushed support for computing and displaying metrics in Cuirass. I > started with two metrics: > > * Builds per day > * Average evaluation speed per specification. > > Those metrics can now be seen at: > > https://ci.guix.gnu.org/metrics > > and are updated every hour. This is very cool, thumbs up! > I plan to add more metrics such as: > > - Evaluation completion percentage. > - Evaluation completion speed. > - Failed evaluations percentage. > - Pending builds per day. That=E2=80=99d be awesome. As discussed on IRC, builds per day should be compared to new derivations per day. For example, if on a day there=E2=80=99s 100 new derivations and we only manage to build 10 of them, we have a problem. BTW, in cuirass.log I noticed this: --8<---------------cut here---------------start------------->8--- 2020-09-14T21:16:21 Updating metric average-eval-duration-per-spec (guix-mo= dular-master) to 414.8085106382979. 2020-09-14T21:16:21 Failed to compute metric average-10-last-eval-duration-= per-spec (kernel-updates). 2020-09-14T21:16:21 Failed to compute metric average-100-last-eval-duration= -per-spec (kernel-updates). 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-spec= (kernel-updates). 2020-09-14T21:16:21 Failed to compute metric average-10-last-eval-duration-= per-spec (staging-staging). 2020-09-14T21:16:21 Failed to compute metric average-100-last-eval-duration= -per-spec (staging-staging). 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-spec= (staging-staging). 2020-09-14T21:16:21 Failed to compute metric average-10-last-eval-duration-= per-spec (version-1.0.1). 2020-09-14T21:16:21 Failed to compute metric average-100-last-eval-duration= -per-spec (version-1.0.1). 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-spec= (version-1.0.1). 2020-09-14T21:16:21 Failed to compute metric average-10-last-eval-duration-= per-spec (version-1.1.0). 2020-09-14T21:16:21 Failed to compute metric average-100-last-eval-duration= -per-spec (version-1.1.0). 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-spec= (version-1.1.0). 2020-09-14T21:16:21 Failed to compute metric average-10-last-eval-duration-= per-spec (wip-desktop). 2020-09-14T21:16:21 Failed to compute metric average-100-last-eval-duration= -per-spec (wip-desktop). 2020-09-14T21:16:21 Failed to compute metric average-eval-duration-per-spec= (wip-desktop). --8<---------------cut here---------------end--------------->8--- Perhaps it can=E2=80=99t compute an average yet for these jobsets? Thanks! Ludo=E2=80=99.