From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id 2OTvOSpsoWEZEgAAgWs5BA (envelope-from ) for ; Sat, 27 Nov 2021 00:22:18 +0100 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id WDqcNSpsoWFoLwAAB5/wlQ (envelope-from ) for ; Fri, 26 Nov 2021 23:22:18 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 816202A82A for ; Sat, 27 Nov 2021 00:22:18 +0100 (CET) Received: from localhost ([::1]:48290 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mqkXp-0001MB-AW for larch@yhetil.org; Fri, 26 Nov 2021 18:22:17 -0500 Received: from eggs.gnu.org ([209.51.188.92]:38420) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mqkXb-0001L4-0m for bug-guix@gnu.org; Fri, 26 Nov 2021 18:22:04 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:49215) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mqkXa-00059e-3e for bug-guix@gnu.org; Fri, 26 Nov 2021 18:22:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1mqkXa-0006w9-0Q for bug-guix@gnu.org; Fri, 26 Nov 2021 18:22:02 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#33362: System tests stuck in "shepherd[1]: waiting for udevd..." Resent-From: Mark H Weaver Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Fri, 26 Nov 2021 23:22:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 33362 X-GNU-PR-Package: guix X-GNU-PR-Keywords: moreinfo To: zimoun Received: via spool by 33362-submit@debbugs.gnu.org id=B33362.163796891526637 (code B ref 33362); Fri, 26 Nov 2021 23:22:01 +0000 Received: (at 33362) by debbugs.gnu.org; 26 Nov 2021 23:21:55 +0000 Received: from localhost ([127.0.0.1]:60755 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mqkXT-0006vZ-EA for submit@debbugs.gnu.org; Fri, 26 Nov 2021 18:21:55 -0500 Received: from world.peace.net ([64.112.178.59]:44162) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mqkXR-0006vJ-1z for 33362@debbugs.gnu.org; Fri, 26 Nov 2021 18:21:54 -0500 Received: from mhw by world.peace.net with esmtpsa (TLS1.3:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mqkXK-0007cG-47; Fri, 26 Nov 2021 18:21:46 -0500 From: Mark H Weaver In-Reply-To: <86o867r97l.fsf@gmail.com> References: <871s7pu6k1.fsf@netris.org> <86o867r97l.fsf@gmail.com> Date: Fri, 26 Nov 2021 18:21:09 -0500 Message-ID: <87czmmpkov.fsf@netris.org> MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 33362@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1637968938; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post; bh=lpHyKLzzYSF1Ayfzz5DdDV0eJ5nuybDHcb5nrA/wH64=; b=Z924e4Z5hMFk80Q9IItDKoNA1SOdt+Sptmv/sw+a41i7LxPyG3k1aSTwGCq+OZkSs1MqAo RpzZlJWFfTzuZcb38vpGzglvMVPLIuXzwFiA63NiWUgTaTiuITQJXWqFYeSwd6rFkbIgFQ k4ufoIjwV7KN7oNx0RFwbs8DFmLM8EfO5xaiiLR81fQBIdloevYLus9tfNt5ToT3j/HJ94 tzbFPA1cCB99zau/8YPvIyBJcx6sE5HsVqBeAq4yOuOfQAQMPZ1mxFglrg9AUDWMcmDZJ1 8zJraHCVLVm/0gAQ49kN8gsXeMUNl+1FiwiFfFVddz52ekrO5WUBt4r7v62few== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1637968938; a=rsa-sha256; cv=none; b=ie2VwB1I6s59lwEc6mmh6YiCc4acAianaDK7Ue3Uov1ldJx4GFpvGfmpK8Or6j6qmTh9pk 2x8secrIIkOY/5VoTSSftDHQG5sKdsw1agPiTfOEsu93sik3TJFFKXK+YYGyvPQFeqBcNK H4dpKGX+CGNFfuD6Z/bJS6PwazhqC5fQ39tHowS6BKvyukV5lBhi1XCC9vNbhUoN0IwIOS XZ8M/XUjeg9lDckQ0Uon5pZ3JJSp6rzxMGywoau6VLtRhQm+oDq/qzQbvMSUgym2UUXPdH Aahpz9UK6dSpcvSHxlYtDf6EcESYhGOX3eqJevCc3G3sqyh0jDDTZCMOJdravA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -2.90 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 816202A82A X-Spam-Score: -2.90 X-Migadu-Scanner: scn0.migadu.com X-TUID: rS+NpAIQRfXP Hi Simon, zimoun writes: > On Mon, 12 Nov 2018 at 20:09, Mark H Weaver wrote: > >> As I write this, there are two system test builds that have been stuck >> for many hours, endlessly printing "shepherd[1]: waiting for udevd...": >> >> https://hydra.gnu.org/build/3153725 >> https://hydra.gnu.org/build/3154365 >> >> They are both on i686-linux, and on the 'core-updates' branch, but with >> two different build slaves (hydra.gnunet.org and guix.sjd.se). >> >> I will now abort these builds, to free up build slots for other jobs. > > I am doing bug triage and I hit this old one #33362 [1] from 2018. It > is about hydra which is down now, IIRC. I doubt that this bug was about Hydra. It guess that the bug was in our system test derivations. As far as I know, the only relevance of Hydra to this bug is that Hydra was our CI system at that time, and therefore it was Hydra that brought this bug to my attention. > Does it still make sense to keep it open? Or can we close it? If the bug hasn't occurred recently, then I agree it's okay to close it. It would be good to check our modern Cuirass-based ci.guix.gnu.org to find out whether this failure mode is still occurring in our system tests. I see that Cuirass's web interface has improved quite significantly in the last couple of years, and I'm very grateful to those who've worked on it. However, Cuirass still seems to be missing some important functionality that Hydra had. Most notably, unless I missed something, it seems to lack the ability to compare the results of two evaluations and show the *differences* between those results, i.e. to enumerate the newly failing jobs, the newly succeeding jobs, and the newly aborted jobs. Without that functionality, it's not easy for us to notice when a job starts to fail, unless a user files a bug report. The total list of job failures has always been too large to easily notice changes in that list without assistance. What do you think? Thanks again for your work on this. Regards, Mark -- Disinformation flourishes because many people care deeply about injustice but very few check the facts. Ask me about .