From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id GEgJLfEWEmExIwEAgWs5BA (envelope-from ) for ; Tue, 10 Aug 2021 08:04:33 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id EKHGKPEWEmHtHwAA1q6Kng (envelope-from ) for ; Tue, 10 Aug 2021 06:04:33 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 6A3081768A for ; Tue, 10 Aug 2021 08:04:33 +0200 (CEST) Received: from localhost ([::1]:37904 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mDKsK-0000Ww-EH for larch@yhetil.org; Tue, 10 Aug 2021 02:04:32 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:38444) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mDKsB-0000WY-NE for guix-devel@gnu.org; Tue, 10 Aug 2021 02:04:23 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:39472) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mDKs8-0001WZ-Gu; Tue, 10 Aug 2021 02:04:20 -0400 Received: from [2a01:e0a:19b:d9a0:45b5:a14a:5c75:5737] (port=42562 helo=meije) by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mDKs8-00025C-42; Tue, 10 Aug 2021 02:04:20 -0400 From: Mathieu Othacehe To: Christopher Baines Subject: Re: Project direction with testing changes (branches and patches) References: <87bl6hbd05.fsf@cbaines.net> <87a6lwoqrs.fsf@gnu.org> <87r1f2i82z.fsf@cbaines.net> Date: Tue, 10 Aug 2021 08:04:18 +0200 In-Reply-To: <87r1f2i82z.fsf@cbaines.net> (Christopher Baines's message of "Mon, 09 Aug 2021 23:09:24 +0100") Message-ID: <87im0d96ot.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org, guix-maintainers@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1628575473; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=8vEAXaNLGB6NU2/OFqhOBp5/dFP3s5f5VitdU6SRTYc=; b=SQI8qu3EeUtvyTA+a8CDTKGFqRxqvT+7K4aY9V0dFJ3ZWb7OervTUrUQAcFQku78HwksfJ YlPHP+Fmqr6EypXWZLXf8cV4dUQdy71w+BIKOg/exwi5Re6897xSzzQcdS8ubEerSJr29Q gxRW9/3MDAOwFqE+QSwYjvLjiO4l/GTvtbXLQb/sSaYwDapB46BSF6Q0cY02Z392XCM/Hj wDb4LLMdGXovXKd37JNPUiOr3VLcnVdeR+8gJoHDE8p4/BVAvBK0VibpjHk9pdKFR5riO8 WC3PuKzDkcjbDCAwlpVGHkw/vZZqPQu1t4mtVoNuSbIZ1fOmAPAqYZgYjdOulQ== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1628575473; a=rsa-sha256; cv=none; b=QWUhSvcMlBpDLlK2pItebko4QpkxqY5QuYpLnxi4L7X9FSxk5L12wpiAPqApN58vOSjETq TwS68FSu62m96QPbzaKmpFmEZyYNcNIimk7UZz4PSdI7fJ58wHGLFjXi5KYRx9OAT5oM01 ZTG2tCbxtzzTmU1kb7meRWY4Ry22QymTeW2dvC7ogyOVvKhxtHaJNFsqAdlE690TTbsI+A w7nmuKHy7E6mejGs4El6W5PCpnPTlw63OzhOeVdlmykTpV6dCH/4NWEO9DqurswgIgViHN UEPfEjm8iV1TYXHIuwHZnzfWYskM6jqrA6PT4JiXrTIeYnkYkfPUrCS+lp4DvQ== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Spam-Score: -2.91 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Migadu-Queue-Id: 6A3081768A X-Spam-Score: -2.91 X-Migadu-Scanner: scn0.migadu.com X-TUID: WFzmQ9/jir7L Hello Chris, > I think trying to change up how branches (staging/core-updates) are > tested is a good place to start. The concrete change I'm proposing is to > use an instance of the Guix Data Service plus an instance of the Guix > Build Coordinator to do the testing and builds, rather than Cuirass on > ci.guix.gnu.org which is the current approach. > > The main advantages of that would be the comparison support from the > Guix Data Service, and the build performance and reliability that the > Guix Build Coordinator brings. The main disadvantage is probably the > lack of an admin like interface similar to that of Cuirass (I think this > can be remedied in the medium term though). We indeed desperately need some more automation. For each new patch series, it would be great to have the following information: * Status of the linter. * Status of the depending derivations. * Status of the unit tests (in the tests/ directory). * Status of the system tests (in the gnu/tests/ directory). I would like to stay focused on the existing, well adopted solutions and build upon them. With Cuirass we already have most of the machinery to provide those information. In addition, we have dashboards, RSS and email notification support which could allow us to extend Cuirass functionalities to provide the expected CI features. We could imagine a new API such as /api/changeset/new that would create temporary Cuirass specifications. The output result could be consulted using a new /api/changeset/status API or directly through the Cuirass web interface. Cuirass could also send email and RSS notifications on that changeset. Those APIs could be used by Mumi to trigger the /api/changeset/new API notification on one hand and to display some status using the /api/changeset/status API on the other hand. I think that this whole infrastructure is just a few Guile modules away and if we could involve more fellow hackers in the process, it would be just great. Thanks, Mathieu