From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id A1eTDrnCI2AAJAAA0tVLHw (envelope-from ) for ; Wed, 10 Feb 2021 11:25:45 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id OJ3LCbnCI2BmegAAbx9fmQ (envelope-from ) for ; Wed, 10 Feb 2021 11:25:45 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 9317D9402B1 for ; Wed, 10 Feb 2021 11:25:44 +0000 (UTC) Received: from localhost ([::1]:55904 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1l9ncs-00089U-Sp for larch@yhetil.org; Wed, 10 Feb 2021 06:25:42 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:55332) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1l9ncE-00087r-By for bug-guix@gnu.org; Wed, 10 Feb 2021 06:25:02 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:44033) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1l9ncD-0000eS-RH for bug-guix@gnu.org; Wed, 10 Feb 2021 06:25:01 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1l9ncD-00035l-La for bug-guix@gnu.org; Wed, 10 Feb 2021 06:25:01 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#46402: Cuirass rebuilds the same packae multiple times Resent-From: Mathieu Othacehe Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Wed, 10 Feb 2021 11:25:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 46402 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Received: via spool by 46402-submit@debbugs.gnu.org id=B46402.161295626311805 (code B ref 46402); Wed, 10 Feb 2021 11:25:01 +0000 Received: (at 46402) by debbugs.gnu.org; 10 Feb 2021 11:24:23 +0000 Received: from localhost ([127.0.0.1]:55575 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1l9nba-00034K-KE for submit@debbugs.gnu.org; Wed, 10 Feb 2021 06:24:23 -0500 Received: from eggs.gnu.org ([209.51.188.92]:37306) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1l9nbW-000344-VF for 46402@debbugs.gnu.org; Wed, 10 Feb 2021 06:24:21 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:41884) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1l9nbP-0000Gx-Ty; Wed, 10 Feb 2021 06:24:11 -0500 Received: from [2a01:e0a:19b:d9a0:3165:bcdf:e1b3:a08d] (port=59850 helo=cervin) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1l9nbP-0004PW-61; Wed, 10 Feb 2021 06:24:11 -0500 From: Mathieu Othacehe References: <20210209141915.40114e57@tachikoma.lepiller.eu> <87lfbxs0w9.fsf@gnu.org> <87zh0c8ajo.fsf@gnu.org> Date: Wed, 10 Feb 2021 12:24:09 +0100 In-Reply-To: <87zh0c8ajo.fsf@gnu.org> ("Ludovic =?UTF-8?Q?Court=C3=A8s?="'s message of "Wed, 10 Feb 2021 11:46:51 +0100") Message-ID: <87o8gs2mjq.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 46402@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN X-Migadu-Spam-Score: -2.86 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Migadu-Queue-Id: 9317D9402B1 X-Spam-Score: -2.86 X-Migadu-Scanner: scn0.migadu.com X-TUID: TqlweO5mf/t8 Hey Ludo, Thanks for sharing your thoughts, it's always useful :). > Seems to me that =E2=80=98BuildSteps=E2=80=99 is an orthogonal concern th= at has little > to do with Cuirass=E2=80=99 job and with its data model. In Hydra I saw = that as > a (necessary) kludge. I'm not sure to follow you here. Cuirass and Hydra have an almost identical database schema and are now working very similarly from what I understand. In Hydra, a JobSet (Specification in Cuirass) has several Builds. Each Build can be broken in several BuildSteps, corresponding to transitive derivation inputs that must be built. Hydra manages to get those BuildSteps to be built in a topological order, in the same way as the Guix Build Coordinator. This makes me think that we could implement this exact same mechanism in Cuirass but I'm maybe missing something. > If Cuirass would instead delegate derivation build requests to a > Coordinator/daemon-like thing, it wouldn=E2=80=99t have to worry about th= ose > details. That would better separate concerns. I think that having Cuirass delegating its builds to the Coordinator is not the right move. That would mean doubling the size of the CI code base, doubling the number of databases, for a feature that we could implement in Cuirass, just by making it catch-up on Hydra. Thanks, Mathieu