From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2.migadu.com ([2001:41d0:403:58f0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms1.migadu.com with LMTPS id MLsjFM5BDmbwfwAAe85BDQ:P1 (envelope-from ) for ; Thu, 04 Apr 2024 07:59:42 +0200 Received: from aspmx1.migadu.com ([2001:41d0:403:58f0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2.migadu.com with LMTPS id MLsjFM5BDmbwfwAAe85BDQ (envelope-from ) for ; Thu, 04 Apr 2024 07:59:42 +0200 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1712210382; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post; bh=bkZOEsT1coUhkIcvkv0WpLEZnOIESjLoBVZOcqDwiVk=; b=gjd+a5XNhFhe2E/Hrvfx8UqQ1rVz0ofaHQMyS2Ks2dM2r1VCQp//SdRZb9amZACokxQC1i XOPxNCbQ3a317A+HGaajWOGhjC6WhQtKKPEaNa3fWrqVa5Uju551fI1ueImPOtd5kOpXg8 M8/OfCo2NTQHxgsgZVAH3Z1MlnZYyaH16+53uc2xqXx1WxIhS+CN9zsBjcrCG3LDZg+gb6 nxXEQl4Tui0beAx/pz+YO2NIkbl6RGsD/8r9kCJvO+V6f/88Pbp0HnSpFkd6Tzld6HggqH uzpVg0st9S5fLky7RpAxckybFXgcSJyG+pHsswmA3pG8DkATZy7TkssQUZUj6g== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org" ARC-Seal: i=1; s=key1; d=yhetil.org; t=1712210382; a=rsa-sha256; cv=none; b=lNIiIJ7sRKY7hua7nZ1JCZ1MRnQG2gbT8/Vd7GUyKVzT6Bk7MQVot5bOYItqffBVfCR24g 3OYZ+bokWo+P44B51AYc4jKkKJdhmjJhwbB8LY8pyTqpW/bFdzeBjEGET4M9pxaj9WaNS0 VLr68FHngGB3R/KEDdLY0EP9rA1yfwcj5PS6N4wKCIvzEDqJDV/63JYjV5NF+FZ5cePdwY fv8J/kAl/DraTgyqUcss9/39NGrSlXBAfiITi4kdt3f7WZO6e5z5tTizctbZrSDh7q/yh7 LB8owpiC2Zni4rYd09Gxp3z/Pw3XnW+o89EbKi0pQhbsSGN/k/lYaAtEIBx7Zw== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 00C5673D69 for ; Thu, 04 Apr 2024 07:59:42 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1rsG8L-0003Pi-4T; Thu, 04 Apr 2024 01:59:33 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rrZj4-0005Tx-K5 for guix-devel@gnu.org; Tue, 02 Apr 2024 04:42:39 -0400 Received: from mailgate5.ufz.de ([141.65.7.212] helo=mailgate.ufz.de) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1rrZj1-0003kS-2Q; Tue, 02 Apr 2024 04:42:38 -0400 Received: from imap.intranet.ufz.de (dcs1.intranet.ufz.de [141.65.125.135]) by mailgate.ufz.de (Mailgate5-UFZ) with ESMTP id 70F101602C1; Tue, 2 Apr 2024 10:42:18 +0200 (CEST) MIME-version: 1.0 Content-type: text/plain; charset=UTF-8 Received: from conversion-daemon.imap.intranet.ufz.de by imap.intranet.ufz.de (Oracle Communications Messaging Server 8.0.2.6.20200227 64bit (built Feb 27 2020)) id <0SBB007004190200@imap.intranet.ufz.de>; Tue, 02 Apr 2024 10:42:18 +0200 (CEST) Received: from smtp2.ufz.de ([141.65.7.217]) by imap.intranet.ufz.de (Oracle Communications Messaging Server 8.0.2.6.20200227 64bit (built Feb 27 2020)) with ESMTPS id <0SBB00CSF46IVW40@imap.intranet.ufz.de>; Tue, 02 Apr 2024 10:42:18 +0200 (CEST) Received: from [141.65.54.140] (unknown [141.65.34.101]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp2.ufz.de (smtp2-UFZ) with ESMTPSA id 47122E004E; Tue, 2 Apr 2024 10:42:18 +0200 (CEST) Date: Tue, 02 Apr 2024 10:42:18 +0200 From: Lars Bilke Subject: Re: Error handling when 'guix substitute' dies In-reply-to: <878r21gjkl.fsf@gnu.org> To: =?utf-8?q?Ludovic_Court=C3=A8s?= Cc: Ada Stevenson , Guix Devel Message-id: X-Mailer: MailMate (1.14r5937) Content-transfer-encoding: quoted-printable References: <1843db1b-0ed0-7e77-5a31-de8ee9ca56a5@gmail.com> <87le67rica.fsf@gnu.org> <4a012f56-b4d9-5ec6-e062-3f39aff5f055@gmail.com> <878r21gjkl.fsf@gnu.org> Received-SPF: pass client-ip=141.65.7.212; envelope-from=lars.bilke@ufz.de; helo=mailgate.ufz.de X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Mailman-Approved-At: Thu, 04 Apr 2024 01:59:31 -0400 X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Spam-Score: -5.36 X-Migadu-Scanner: mx11.migadu.com X-Spam-Score: -5.36 X-Migadu-Queue-Id: 00C5673D69 X-TUID: gyV2od73Wq2H Dear Ludo, I ran the command in a loop on 4 machines for around 2 hours doing 1 requ= est per machine per second but no errors occured... On 29 Mar 2024, at 16:10, Ludovic Court=C3=A8s wrote: > Hello, > > Ada Stevenson skribis: > >>> diff --git a/guix/scripts/substitute.scm b/guix/scripts/substitute.sc= m >>> index 37cd08e289..3af0bf0019 100755 >>> --- a/guix/scripts/substitute.scm >>> +++ b/guix/scripts/substitute.scm >>> @@ -494,7 +494,9 @@ (define* (download-nar narinfo destination >>> (define (try-fetch choices) >>> (match choices >>> (((uri compression file-size) rest ...) >>> - (guard (c ((and (pair? rest) (http-get-error? c)) >>> + (guard (c ((and (pair? rest) >>> + (or (http-get-error? c) >>> + (network-error? c))) >>> (warning (G_ "download from '~a' failed, trying n= ext URL~%") >>> (uri->string uri)) >>> (try-fetch rest))) >>> >>> I=E2=80=99ll go ahead with this change if there are no objections. >> Looks good to me! Thanks for looking into this :) > > OK, I=E2=80=99ll push it shortly, but=E2=80=A6 > > Lars Bilke skribis: > >> thanks Ada for bringing this issue up again. I get the same error on >> `guix pull` almost always when I am on my enterprise >> network. Re-running `guix pull` a second time also almost always then >> runs fine. I checked with our IT: nothing suspicious on the network, >> i.e. no firewall blocking. >> >> I never experienced the error on my home network. > > =E2=80=A6 your reports make me think there=E2=80=99s a bug lurking some= where that > perhaps only manifests under some precise networking or timing > conditions. > > Could the two of you run the following command in a loop to see whether= > it=E2=80=99s easy to reproduce that GnuTLS error? > > guile -c '(use-modules (guix http-client) (ice-9 binary-ports)) > (get-bytevector-all (http-fetch "https://ci.guix.gnu.org/nix-cache-= info"))' > > If you can reproduce it, could you capture the strace output of the > process? You would run the command above prefixed by: > > strace -o log.strace -s 300 =E2=80=A6 > > Thanks in advance! > > Ludo=E2=80=99.