From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id qEvBGJW1IWCBXAAA0tVLHw (envelope-from ) for ; Mon, 08 Feb 2021 22:05:09 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id mBCJFJW1IWBLQgAAB5/wlQ (envelope-from ) for ; Mon, 08 Feb 2021 22:05:09 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id CFBCF9402B1 for ; Mon, 8 Feb 2021 22:05:08 +0000 (UTC) Received: from localhost ([::1]:44310 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1l9EeZ-00039d-JO for larch@yhetil.org; Mon, 08 Feb 2021 17:05:07 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:34180) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1l9A78-0005Z7-LN for guix-devel@gnu.org; Mon, 08 Feb 2021 12:14:20 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:53491) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1l9A0V-0004Oq-Bl for guix-devel@gnu.org; Mon, 08 Feb 2021 12:07:30 -0500 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=56190 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1l9A0U-000190-QD for guix-devel@gnu.org; Mon, 08 Feb 2021 12:07:27 -0500 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= To: guix-devel Subject: Guix Day: Notes from the CI session X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 20 =?utf-8?Q?Pluvi=C3=B4se?= an 229 de la =?utf-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Mon, 08 Feb 2021 18:07:25 +0100 Message-ID: <87ft26xzci.fsf@inria.fr> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -1.86 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: CFBCF9402B1 X-Spam-Score: -1.86 X-Migadu-Scanner: scn1.migadu.com X-TUID: +VCUpO+c22QX --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hello Guix! Attached are the notes from the =E2=80=9Ccontinuous integration=E2=80=9D se= ssion held a few hours ago. Thanks, Ludo=E2=80=99. --=-=-= Content-Type: text/plain Content-Disposition: inline; filename=Cuirass-News-and-Look-forward.md Content-Description: notes # Continous integration ## Latest changes in Cuirass - switch from sqlite to PostgreSQL - stop using the built-in offload mechanism - take inspiration from Hydra: offload straight from Cuirass to _workers_ - head node talks to workers over ZMQ - head node feches builds from workers upon build completion, triggers "substitute baking" (for `guix publish`) - new [worker monitoring page](https://ci.guix.gnu.org/workers) - shows what each worker is doing - soon: will be able to view CPU/storage usage - build info now shows a _weather_ icon showing the build status evolution - per-specification RSS feeds allow users to monitor, say, `guix-master` - maybe soon: user accounts on the web interface - new _build priorities_, per spec (`guix-master`, `core-updates`, etc.) - `timeout` and `max-silent-time` properties of packages are now honored - integration with `guix pull`: `channel-with-available-substitutes` - many features in the works (see Mathieu's Org-mode file) ## Open issue: new machines - fast ARM servers available - criteria for hardware? - must run free system (stock Guix System) - hosting? - the MDC (in Berlin) wouldn't host Guix-specific non-x86 servers - could rent space (currently renting space for bayfront.guix in Bordeaux, France), but it's relatively costly - workstations could be in people's homes - https://store.avantek.co.uk/ampere-altra-64bit-arm-workstation.html - (benchmark info: https://www.phoronix.com/scan.php?page=article&item=ampere-altra-q80 - compete with AMD Epyc 7nm 2nd Gen) - - small boards are unreliable or too slow - looking for volunteers to help - pick hardware we could buy - get in touch on `guix-devel` or `guix-sysadmin` (private) mailing lists ## Open issue: branching strategy - currently: building all of `master` + the "core" of `core-updates` - schedule - currently ad-hoc: volunteers get to choose when to freeze/merge - actions - pushes to `core-updates` should cancel all pending builds on that branch (see Guix Build Coordinator) - have a dashboard showing active branches, statuses (wild-west, frozen), and merge deadlines - could be implemented in Cuirass - specs could have extra properties (such as "merge deadline") that Cuirass would display - or it could use status info from the Data Service, as in https://data.guix-patches.cbaines.net/ - naming convention: `core-updates-frozen` vs `core-updates`, etc. ## Open issue: missing CI features - be able to restart builds - detect build return codes: failed because of dependencies, failed because of timeout ... - short-term actions: - allow for more than two builds per worker on `berlin` - set a hard limit on the number of emulated builds by workers on `berlin` --=-=-=--