From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id 5mPGOix9X19NNAAA0tVLHw (envelope-from ) for ; Mon, 14 Sep 2020 14:24:44 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id 2L+rNCx9X19NRAAAB5/wlQ (envelope-from ) for ; Mon, 14 Sep 2020 14:24:44 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 67CE09408E7 for ; Mon, 14 Sep 2020 14:24:44 +0000 (UTC) Received: from localhost ([::1]:52762 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kHpPP-0001d4-7V for larch@yhetil.org; Mon, 14 Sep 2020 10:24:43 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:48238) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kHpCA-0001I6-7q for bug-guix@gnu.org; Mon, 14 Sep 2020 10:11:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:44111) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kHpC9-0008KR-UA for bug-guix@gnu.org; Mon, 14 Sep 2020 10:11:01 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1kHpC9-00052n-Pf for bug-guix@gnu.org; Mon, 14 Sep 2020 10:11:01 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#32548: Cuirass: Performance monitoring Resent-From: zimoun Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 14 Sep 2020 14:11:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 32548 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Mathieu Othacehe Received: via spool by 32548-submit@debbugs.gnu.org id=B32548.160009263419334 (code B ref 32548); Mon, 14 Sep 2020 14:11:01 +0000 Received: (at 32548) by debbugs.gnu.org; 14 Sep 2020 14:10:34 +0000 Received: from localhost ([127.0.0.1]:55647 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kHpBi-00051m-2r for submit@debbugs.gnu.org; Mon, 14 Sep 2020 10:10:34 -0400 Received: from mail-qv1-f42.google.com ([209.85.219.42]:44917) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kHpBg-00051X-1l for 32548@debbugs.gnu.org; Mon, 14 Sep 2020 10:10:32 -0400 Received: by mail-qv1-f42.google.com with SMTP id j10so8974492qvk.11 for <32548@debbugs.gnu.org>; Mon, 14 Sep 2020 07:10:32 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=i55LgkmmDBkqkA/a1Jn2eWs5v/t9XumfIl1oa/FH2wg=; b=TmtQeAbC6v1doMJa8nJ0hfHs+XQhngrSHCjeYxtOtGw9z+WZd8VR/ICeT8yfM/gM/G iScO3aY6kPw8JtBC/SH5M9fA+toqKPpXB4Qnsp//7PUFsbjX404UFUYHxNHpaD2nE/TS V9uwCX095LlWcLkM7PW72ndS79xFABKTL8G6EkbgLm11rD0xOR0ZGta+Xg5fUNdaIC2H ZMQlZ5/ANIeg88rElv6RGGpZlqFrefXdPx3nNy93NsdmUiaUebJzAkrw87+IReLdc/It wCDwRlyI+gbXHFir3fnsZnDTGybFV5cNE2imeefDPGrT7AzEsbIzDoLtj1JoPplr8STO FRfg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=i55LgkmmDBkqkA/a1Jn2eWs5v/t9XumfIl1oa/FH2wg=; b=puq9QsWqMTzK/wdkL9M9TbB4D+s4ad+DbyYW0+h1yQz/tGJoY2LvsYoislaQD6cXvV 4JAhqjhyXOwlWHcDdeNR6qw5jQnDnrTthr7Zt1xQr0Vt8l7WlkPoSow78JK35SXT4vG5 lROSdbuIWW/tOQAnEUNR5XnseMx7XdM6AWmkHaBbvsvxz4H7PS2nSa9q7z296GyEwOca 8w05NDWeukcJMtsY1jT6RETnRs0H9kzmzjrqMQ6fimwPcch6vy5jEfEB9GeRsWUV6oB+ 2a8vRqTPxoRiqdZkHIYUoQCEJ8uoAOlFFwh7ZTQCudoDtDFvYOgrw3XwnzeG5a5bQ3lS xozg== X-Gm-Message-State: AOAM532AmKRrCosuSyvZmPOVs8mDRiy/afgehoGOhvy7OUL5j5Oo47Fu Zylqg2CFPmutefxWe+wWHA5QoI+V2g6yPJMflbQ= X-Google-Smtp-Source: ABdhPJx7IjxMmVcStKl8sPIGcmKhohYy7rtLSKewEVogwJxAKnqbh/NbcnfvtXaouIUZGnLaxhbFoXzwb0DBtRqpQDc= X-Received: by 2002:a0c:cc13:: with SMTP id r19mr13085927qvk.15.1600092626306; Mon, 14 Sep 2020 07:10:26 -0700 (PDT) MIME-Version: 1.0 References: <87pny3783p.fsf@gnu.org> <87d02zge5e.fsf@gnu.org> <87y2lmlox2.fsf@cbaines.net> <874koarop0.fsf@gnu.org> <87k0x14vax.fsf@gnu.org> <87tuw05vom.fsf@gnu.org> In-Reply-To: <87tuw05vom.fsf@gnu.org> From: zimoun Date: Mon, 14 Sep 2020 16:10:14 +0200 Message-ID: Content-Type: text/plain; charset="UTF-8" X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Spam-Score: -1.0 (-) X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 32548@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=fail (rsa verify failed) header.d=gmail.com header.s=20161025 header.b=TmtQeAbC; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Spam-Score: 0.09 X-TUID: piWsFYaRRsXu Hi Mathieu, Really cool! On Mon, 14 Sep 2020 at 15:35, Mathieu Othacehe wrote: > * Builds per day > * Average evaluation speed per specification. Something interesting could be: min and max (of 100 evaluations). The standard error deviation too but I am not sure it is easy to interpret with a quick look. Instead, the median could be interesting. For example, consider these 2 evaluations: https://ci.guix.gnu.org/build/2094496/details https://ci.guix.gnu.org/build/3035986/details Well, if there is say 99 evaluations of first "kind" and 1 of second kind, the average is: (99*849 + 1_595_796_252) / 100 = 15_958_803.03 which does not really represent the effective workload. Well, I will try to give a look if I can schedule a moment. :-) > Those metrics can now be seen at: > > https://ci.guix.gnu.org/metrics Nice plot! > I plan to add more metrics such as: > > - Evaluation completion percentage. > - Evaluation completion speed. > - Failed evaluations percentage. > - Pending builds per day. Cool! Maybe time between commit time (not author time) and start of the build. Cheers, simon