From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2.migadu.com ([2001:41d0:403:58f0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms8.migadu.com with LMTPS id WCjJLo2npGVnIQEAe85BDQ:P1 (envelope-from ) for ; Mon, 15 Jan 2024 04:33:34 +0100 Received: from aspmx1.migadu.com ([2001:41d0:403:58f0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2.migadu.com with LMTPS id WCjJLo2npGVnIQEAe85BDQ (envelope-from ) for ; Mon, 15 Jan 2024 04:33:33 +0100 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=OEkFSnkR; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gmail.com ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1705289613; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=Fuf+crzh5ZNuk56Kc1QFz41JYM4NxLkY8Sq4jf4/zSE=; b=pbqUHSq5w+B+n9EvT5u1RmioEg5yXutsKhZpLpB2Spa92YGOQcfrPGa/mQhkePBUxPWOns TljYZuM5BYw7BJ77ql7jeZWwwGbW7EFjdEeQs9px26nQridczdn9QexsE7bZLQYp+F7cNu UU98bPtuvSnOSknBVDn4c5rjGCccaUBkOHOz+RYS/99zbnP99zYPf6ZiN5jYqN8x3+ivrH EcnKZ4PNkBpoHxPRCIrxD6tLZvXfwSc+oUa8YvSCeu//AVVlGUnsUSvn2Jzv7crM4Tgsx/ 6ZZKJMBlStl/cKQnRtDizrI7R5UPK/zvjjxnY0W1vhD/UgpJo2gPTZsues1fxw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20230601 header.b=OEkFSnkR; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gmail.com ARC-Seal: i=1; s=key1; d=yhetil.org; t=1705289613; a=rsa-sha256; cv=none; b=M9prGtMegAVj+TzXdlnpCHrInITqFTxcqrbOKVEg+JUM6QIMKil5Vwq5Nm/Q1Xx0CqZxD5 1AbrCNSmsg6R6JeNPKUVczP0gzjK9w9KJiaZxCaBciSfvTESAH2O+fnBDI3TEhFe7Fk0FS 374GLW0dto4DjQxGRsT7sBhyeJ6Gx+qM8xxMe2Q16Si9PCslfg4tbITND0WQX+UKeHLh3E jQ2SngHFWPa6UC2/noY40HXgMXf6jNJQXAjww/1eTNyXbRXHpUG99EhhSY0Hpuq6GpQ6Yr NwKr7fzeiWSMHN6jmekBwkwXnh0VLgZxCRJzIMhT0BQxJnL5ZxYn3Ur2tVu38g== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 73984474E3 for ; Mon, 15 Jan 2024 04:33:33 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rPDii-0007t1-QN; Sun, 14 Jan 2024 22:33:04 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rPDig-0007r7-NS for guix-devel@gnu.org; Sun, 14 Jan 2024 22:33:02 -0500 Received: from mail-qv1-xf32.google.com ([2607:f8b0:4864:20::f32]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1rPDie-0006WM-V4 for guix-devel@gnu.org; Sun, 14 Jan 2024 22:33:02 -0500 Received: by mail-qv1-xf32.google.com with SMTP id 6a1803df08f44-67f83812a32so37951796d6.3 for ; Sun, 14 Jan 2024 19:32:59 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1705289578; x=1705894378; darn=gnu.org; h=mime-version:user-agent:message-id:date:references:in-reply-to :subject:to:from:from:to:cc:subject:date:message-id:reply-to; bh=Fuf+crzh5ZNuk56Kc1QFz41JYM4NxLkY8Sq4jf4/zSE=; b=OEkFSnkRYL9yB5n7DHa/PLrhGmx/zZwFE7M8Avo1LsbXBGWG9snn6jMvXrwdudnMMF X3ChlvQX2hisp4S9lFweMPrWgJckLeVPRjg53Y4MnzwStAEyCUbO3CV4sTAwVct2irOi QfPyStodwt7+YjV+cZCjI2lR8xtHlYjKGh4cLYbVc0ZT8ZU22p2vYwTPazkJjfo1Lvv3 /bDoDNqrvgKlQDECxRj0iMMsmgdsdmwnj2D/53bLaRH6YbyZqu8YMsuWAS7vrcm4k7GE GXowd1k/mPLgRsLvp7rdaMQAKu2mRSaVcfNmU5JlkFRB2FeEGbEGO2TaXZZU0DageZYc IOsw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1705289578; x=1705894378; h=mime-version:user-agent:message-id:date:references:in-reply-to :subject:to:from:x-gm-message-state:from:to:cc:subject:date :message-id:reply-to; bh=Fuf+crzh5ZNuk56Kc1QFz41JYM4NxLkY8Sq4jf4/zSE=; b=VSpCn8k/45cWjWDNhWsh3GjRAAbwn2M/l08bKcEYZPxBnYh4DSv+38NLhgjGqZ0+MO AbjHUYzhJru7dZpe/opHuioqC0aS3H8KtV4iqPN646ZLwV0CcP17+lDLI4a1TagRjSiM a0kglZFJ4H6902b86a0ssqPtjHaldGCdsuiU1+pojHSNzHA3mW07Pkzqn3Eam5ILiq9p B0DesL0ofyzas8oSpwSV7FaFTRBpPTTykgvZaDfpAG8AN46UgnX7OUm4u7ZIWivXJuR1 q+xwqimaKKOjt6ENa+eWLV3v0t/lXAEbUGH9oX67aG9OOz0XGJcl+2XpiU2jsnrbIUc1 mRMw== X-Gm-Message-State: AOJu0YySEtjOJDlwLVc7vuIbIbqQYTC52jqLqPN+RTKk/G+iXcgj9BF7 K4b7IWdkSBDysYTA4MW3/OoCbaQmf+I= X-Google-Smtp-Source: AGHT+IEYaZIQXQUWLmDLJNW2GS5eQrBLoRTbVSlKJM2DfR3z3kwhWTsJHI+BwSNCFm9ivYtTVJP1Qg== X-Received: by 2002:a05:6214:622:b0:680:d21d:441e with SMTP id a2-20020a056214062200b00680d21d441emr5365040qvx.125.1705289578190; Sun, 14 Jan 2024 19:32:58 -0800 (PST) Received: from hurd (dsl-10-136-68.b2b2c.ca. [72.10.136.68]) by smtp.gmail.com with ESMTPSA id fx15-20020a05622a4acf00b0042987f6874bsm3518076qtb.92.2024.01.14.19.32.57 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Sun, 14 Jan 2024 19:32:57 -0800 (PST) From: Maxim Cournoyer To: guix-devel@gnu.org Subject: Re: When is check-system run? In-Reply-To: (Tomas Volf's message of "Fri, 12 Jan 2024 00:31:28 +0100") References: Date: Sun, 14 Jan 2024 22:32:56 -0500 Message-ID: <874jffs23b.fsf@gmail.com> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain Received-SPF: pass client-ip=2607:f8b0:4864:20::f32; envelope-from=maxim.cournoyer@gmail.com; helo=mail-qv1-xf32.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Spam-Score: -9.00 X-Migadu-Queue-Id: 73984474E3 X-Spam-Score: -9.00 X-Migadu-Scanner: mx11.migadu.com X-TUID: Inavb7UXtDZP Hi Tomas, Tomas Volf <~@wolfsden.cz> writes: > Hello, > > I would like to inquire regarding system tests. There is check-system make > target, however it seems like at least some of them are broken. Can someone > check whether that is case even on their machine? Do they all pass for you? The system tests are run for new Guix revisions periodically by this job set: https://ci.guix.gnu.org/jobset/tests Otherwise we depend on people touching e.g. services running them manually to ensure they pass. Accumulated test failures that have slipped in (we do not have a CI infrastructure gating merges on test failures yet) should ideally be reported and fixed (thanks for working on it!). There is typically an effort to ensure all (or most) tests pass before a new release is made. > I already have patches fixing 4 of them, and debugging 5th, but I would like to > ask when exactly are the those tests run and where are the failures > reported to? Thank you! You can report the failures to bug-guix@gnu.org, if they weren't already; these are Guix bugs. > Since the breakage sneaked into the master, I assume they are not run as part of > the regular patches? Are there any measures the project is planning to take to > prevent this from happening again? It'd be nice to have our CI infrastructure act more like a CI (currently it's more of a build farm than a CI), but I don't know of anyone working on it (though Christopher may have long term plans toward that goal with QA [0]). [0] qa.guix.gnu.org/ -- Thanks, Maxim