From mboxrd@z Thu Jan 1 00:00:00 1970 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: =?utf-8?Q?=E2=80=98guix_weather=E2=80=99?= reports CI stats Date: Wed, 28 Mar 2018 16:23:05 +0200 Message-ID: <87in9gth2u.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:39092) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1f1Byr-0004FK-M9 for guix-devel@gnu.org; Wed, 28 Mar 2018 10:23:14 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1f1Byn-0002SX-GZ for guix-devel@gnu.org; Wed, 28 Mar 2018 10:23:13 -0400 Received: from hera.aquilenet.fr ([185.233.100.1]:37840) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1f1Byn-0002SC-9h for guix-devel@gnu.org; Wed, 28 Mar 2018 10:23:09 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id C275F12773 for ; Wed, 28 Mar 2018 16:23:07 +0200 (CEST) Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id tml7dP7pHVGz for ; Wed, 28 Mar 2018 16:23:06 +0200 (CEST) Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 63D5811F0B for ; Wed, 28 Mar 2018 16:23:06 +0200 (CEST) List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: "Guix-devel" To: Guix-devel Hello Guix! With commit 183445a6ed1cbac929ecb65303246945c8ccf39d, =E2=80=98guix weather= =E2=80=99 can now report continuous integration (CI) stats using the Hydra/Cuirass HTTP interface: --8<---------------cut here---------------start------------->8--- $ ./pre-inst-env guix weather --substitute-urls=3D'https://berlin.guixsd.or= g https://hydra.gnu.org' -m ~/src/configuration/user-profile.scm computing 352 package derivations for x86_64-linux... looking for 421 store items on https://berlin.guixsd.org... https://berlin.guixsd.org 76.7% substitutes available (323 out of 421) 753.4 MiB of nars (compressed) 1,805.7 MiB on disk (uncompressed) 0.000 seconds per request (0.2 seconds in total) 2,740.3 requests per second 0.0% (0 out of 98) of the missing items are queued 965 queued builds aarch64-linux: 965 (100.0%) build rate: 23.41 builds per hour x86_64-linux: 11.16 builds per hour i686-linux: 6.03 builds per hour aarch64-linux: 6.41 builds per hour looking for 421 store items on https://hydra.gnu.org... https://hydra.gnu.org 96.7% substitutes available (407 out of 421) 1,296.8 MiB of nars (compressed) 3,158.4 MiB on disk (uncompressed) 0.001 seconds per request (0.5 seconds in total) 808.5 requests per second 867 queued builds x86_64-linux: 518 (59.7%) i686-linux: 221 (25.5%) armhf-linux: 128 (14.8%) build rate: 20.93 builds per hour i686-linux: 9.23 builds per hour armhf-linux: 8.75 builds per hour x86_64-linux: 2.95 builds per hour --8<---------------cut here---------------end--------------->8--- In a way, this adds a forecasting capability to =E2=80=98guix weather=E2=80= =99. In this example we can also see that /api/queue?nr=3D10 returns non-sensical data in the current Cuirass snapshot (the actual queue contains lots of builds, and not only for aarch64!). The build rates are also interesting and surprising. On hydra, the low x86_64 build rate is probably because x86_64 builds completed earlier, so nothing happened lately. On berlin, we have 20 Intel machines and only 1 aarch64 machine, yet the Intel build rate is not 20 times that of aarch64; I=E2=80=99m guessing we could do better. :-) Comments welcome! Ludo=E2=80=99.