From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id QLk9NxN9pGJ69wAAbAwnHQ (envelope-from ) for ; Sat, 11 Jun 2022 13:31:31 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id gHM5NxN9pGJziQAA9RJhRA (envelope-from ) for ; Sat, 11 Jun 2022 13:31:31 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id A077931636 for ; Sat, 11 Jun 2022 13:31:30 +0200 (CEST) Received: from localhost ([::1]:48292 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nzzKz-00056t-OI for larch@yhetil.org; Sat, 11 Jun 2022 07:31:29 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:44988) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nzyc3-0004DD-31 for bug-guix@gnu.org; Sat, 11 Jun 2022 06:45:03 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:58058) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nzyc2-0007p8-QF for bug-guix@gnu.org; Sat, 11 Jun 2022 06:45:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1nzyc2-0007uS-OC for bug-guix@gnu.org; Sat, 11 Jun 2022 06:45:02 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#55848: [cuirass] workers stalled Resent-From: Tom Fitzhenry Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Sat, 11 Jun 2022 10:45:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 55848 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Greg Hogan Cc: Mathieu Othacehe , 55848@debbugs.gnu.org Received: via spool by 55848-submit@debbugs.gnu.org id=B55848.165494429430365 (code B ref 55848); Sat, 11 Jun 2022 10:45:02 +0000 Received: (at 55848) by debbugs.gnu.org; 11 Jun 2022 10:44:54 +0000 Received: from localhost ([127.0.0.1]:51954 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nzybt-0007tb-RU for submit@debbugs.gnu.org; Sat, 11 Jun 2022 06:44:54 -0400 Received: from out1-smtp.messagingengine.com ([66.111.4.25]:43587) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nzybo-0007tE-UK for 55848@debbugs.gnu.org; Sat, 11 Jun 2022 06:44:50 -0400 Received: from compute4.internal (compute4.nyi.internal [10.202.2.44]) by mailout.nyi.internal (Postfix) with ESMTP id C93A85C00E4; Sat, 11 Jun 2022 06:44:43 -0400 (EDT) Received: from mailfrontend2 ([10.202.2.163]) by compute4.internal (MEProxy); Sat, 11 Jun 2022 06:44:43 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= tom-fitzhenry.me.uk; h=cc:cc:content-type:date:date:from:from :in-reply-to:in-reply-to:message-id:mime-version:references :reply-to:sender:subject:subject:to:to; s=fm2; t=1654944283; x= 1655030683; bh=Harm9+hQKY4Qxssnj+8WoVEWHLVCpyLHdK/iGYysuOQ=; b=I R45o8k/68LYSrCJVjlw5iiu5qaObpnbVxzdiew54gGIbY9wlAryCV1pc1RaiXwi+ qNQ2ORHH1Xk3DA11ZVLx1A9GGmWvLJ/g705ZQCC09b3BLtM7n95FtL4Ou1Mqkgq0 D7NwsQbhCngqvmyZZQ6lYWeUrQHBNZKXfxDX/p0+KxBQg+Nba8ayBk9CD4tjLb9q mzEnD0s57O363dUgFHJ0NHKt+SlyGQTw6+y+2H+/0nb5Coav8/ADxcfshUAncpET axez86H0g4WTimHZgWXshnUAEO108BMMeD44hsjVILoDIcDbbEBHJlsN4zGZkoN1 zYNWkLHpt9Ts779yyR8TQ== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:cc:content-type:date:date:feedback-id :feedback-id:from:from:in-reply-to:in-reply-to:message-id :mime-version:references:reply-to:sender:subject:subject:to:to :x-me-proxy:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s= fm2; t=1654944283; x=1655030683; bh=Harm9+hQKY4Qxssnj+8WoVEWHLVC pyLHdK/iGYysuOQ=; b=T7RkSnbvTO9ism7ynRV4G3/c8P0GD0//QWxYwZ5Mj4pD S+n66O+JBor+v4vrrRw374cGHszf1PfO9c0IysEvOyaqGe0LDh2SRXEeWteWlVtO 3yJK0P2w21UhNSULj8/kXW33li77zqKythyIejq/rb9HLmh8t9ALX9EtTBTji25V Y9781TzLAwAsfy56mTpkoWmLoSF2IznZKILQGSfK9z2EjBZRuWWim8gUR2QEtjup Nb8Dimqu7jgjvNkzZaMnLdYMJH34VJ8HfX0H1h2eb3POSJRIqLDm9E//E4sBxjcN Kbcf2B4Od+JI1ltZd0hMr8zyg29D7eUX7SjlOww1Yg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvfedruddufedgfedtucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne cujfgurhephffvvefufhffjgfkfgggtgesthdtredttdertdenucfhrhhomhepvfhomhcu hfhithiihhgvnhhrhicuoehtohhmsehtohhmqdhfihhtiihhvghnrhihrdhmvgdruhhkqe enucggtffrrghtthgvrhhnpeekfeelteduleekkeehfeejkeduueduhfeugfehtdelgeev veduhfefhfejleekieenucffohhmrghinhepghhnuhdrohhrghenucevlhhushhtvghruf hiiigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehtohhmsehtohhmqdhfihhtiihh vghnrhihrdhmvgdruhhk X-ME-Proxy: Feedback-ID: iefc945ae:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA; Sat, 11 Jun 2022 06:44:42 -0400 (EDT) From: Tom Fitzhenry References: <87h74v2mu7.fsf@gnu.org> Date: Sat, 11 Jun 2022 20:44:16 +1000 In-Reply-To: (Greg Hogan's message of "Wed, 8 Jun 2022 15:07:18 -0400") Message-ID: <878rq3scn3.fsf@tom-fitzhenry.me.uk> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.1 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN X-Migadu-To: larch@yhetil.org X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1654947091; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post: dkim-signature; bh=Harm9+hQKY4Qxssnj+8WoVEWHLVCpyLHdK/iGYysuOQ=; b=kMeRfOBpMHamM99U5F2x66LrQo11/ueHWl5H/aHImfnuXLtWUxh7TivScORenO35OEH0yz 0I/4UQB15nYHs5XzS6C1l+8JYoGgFPyO/pMW7QJ7w53tpXMOX5IYZuEMFHVYmi9R65WetH +dzMd/mOCOSU3QzYEhL7IsB2n+cvMl8V2y7PHc+xPH36fiRDEhN9Frqn3igKdI4CqwpUYv gyK/6Ll2BW1nj/q0VkHMz6rxh2V9Qe11drWbhuyfinZXvRR9nb2rKwEhb6HHOjvh+v06GF pKG6traGtgWMH8UC3eibNtnaghUrl9H9PI8XWvvXGtsadh1ZnMWihPvMkcBHHA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1654947091; a=rsa-sha256; cv=none; b=XDL7ZO1MaIFJhM8YRA5jD6Zx7tBpvAY/UnB5OiQnwIajSxew24D2wA9YxYNhey07D6JXf5 rHpfd0IekpXNEGrWS2MQuQa/G85ZZDOEfl5cgdI+zsorpzeDSxNubl9oPEupg2ZHuj25kz HjAxlJOk7u0ZtnGgxhicFG5jK3JtAFr6jqT+Zlf4zCaG+qQm9WERNpaaGZij1Q4We+Rgd/ iOt155BWfmkRi1JUV8CxMsTeM04Hxp4hUEyZSxiheBzqL3DdCVaiD+MB841cCDSK9A+//k vJrbs+3N0D7bj6tM66Qi+4J9hVsw1KlQxt0dcQvzgQFH/R2gtwPE8wduq3Lbvg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=tom-fitzhenry.me.uk header.s=fm2 header.b="I R45o8k"; dkim=fail ("headers rsa verify failed") header.d=messagingengine.com header.s=fm2 header.b=T7RkSnbv; dmarc=fail reason="SPF not aligned (relaxed)" header.from=tom-fitzhenry.me.uk (policy=none); spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: 5.91 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=tom-fitzhenry.me.uk header.s=fm2 header.b="I R45o8k"; dkim=fail ("headers rsa verify failed") header.d=messagingengine.com header.s=fm2 header.b=T7RkSnbv; dmarc=fail reason="SPF not aligned (relaxed)" header.from=tom-fitzhenry.me.uk (policy=none); spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: A077931636 X-Spam-Score: 5.91 X-Migadu-Scanner: scn1.migadu.com X-TUID: o5HZFJ1WF+nx Greg Hogan writes: > On Wed, Jun 8, 2022 at 11:32 AM Mathieu Othacehe wrote: >> The aarch64 workers were all idle whereas 70k builds were >> available. Once restarted, they started building again. >From following the builds on http://ci.guix.gnu.org/workers , many (all?) builds are failing on the following workers: * grunewald * kreuzberg * pankow The builds are failing with the same error: "substitute: updating substitutes from 'https://ci.guix.gnu.org'... 0.0%guix substitute: error: TLS error in procedure 'handshake': Error in the pull function." Here's some examples: * http://ci.guix.gnu.org/build/998403/details * http://ci.guix.gnu.org/build/978678/details * http://ci.guix.gnu.org/build/978243/details On worker overdrive1, in the raw log of http://ci.guix.gnu.org/build/875908/details we can see this rust-async-mutex build managing to pull substitutes, but it seems to be compiling rust-1.57 itself.