From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id MLI+LzSvB2HwSgAAgWs5BA (envelope-from ) for ; Mon, 02 Aug 2021 10:39:16 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id +ALVKjSvB2GrYwAAB5/wlQ (envelope-from ) for ; Mon, 02 Aug 2021 08:39:16 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 00B1D1CBFB for ; Mon, 2 Aug 2021 10:39:16 +0200 (CEST) Received: from localhost ([::1]:40910 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mATTd-0005hG-TS for larch@yhetil.org; Mon, 02 Aug 2021 04:39:13 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:46122) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mATTS-0005cV-Bz for bug-guix@gnu.org; Mon, 02 Aug 2021 04:39:03 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:54348) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mATTS-0002cZ-4S for bug-guix@gnu.org; Mon, 02 Aug 2021 04:39:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1mATTS-0008N0-3A for bug-guix@gnu.org; Mon, 02 Aug 2021 04:39:02 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#49781: Successful build on ci.guix not available as substitute Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 02 Aug 2021 08:39:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 49781 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Mathieu Othacehe Received: via spool by 49781-submit@debbugs.gnu.org id=B49781.162789353232154 (code B ref 49781); Mon, 02 Aug 2021 08:39:02 +0000 Received: (at 49781) by debbugs.gnu.org; 2 Aug 2021 08:38:52 +0000 Received: from localhost ([127.0.0.1]:37661 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mATTH-0008MY-Mt for submit@debbugs.gnu.org; Mon, 02 Aug 2021 04:38:52 -0400 Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:8102) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1mATTD-0008MB-Bj for 49781@debbugs.gnu.org; Mon, 02 Aug 2021 04:38:51 -0400 IronPort-HdrOrdr: A9a23:mk+Ij6zuSREUkvaQSL8tKrPwzr1zdoMgy1knxilNoNJuH/Bw8Pre5sjztCWE8wr5N0tQ/exoVJPqfZqYz+8T3WBzB8bbYOCFghrPEGgK1+KL/9SjIULDH4VmuZuIHZIVNDS9NykCse/KpC+DeuxQpeWvweSQq96b4HdrQw1wcrph6BoRMHf4LmRGADBpPN4aGIr03LslmxOQPU04V4CYCmlAf8Wrnb32vaOjWhIYARs69QmJijuy+PrWGwWVty1+bxp/hYsY1AH+/TDE2g== X-IronPort-AV: E=Sophos;i="5.84,288,1620684000"; d="scan'208";a="522444856" Received: from unknown (HELO ribbon) ([193.50.110.238]) by mail2-relais-roc.national.inria.fr with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 02 Aug 2021 10:38:40 +0200 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= References: <87tukcyybm.fsf@inria.fr> <87eebgjem2.fsf@gnu.org> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 15 Thermidor an 229 de la =?UTF-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Mon, 02 Aug 2021 10:38:39 +0200 In-Reply-To: <87eebgjem2.fsf@gnu.org> (Mathieu Othacehe's message of "Fri, 30 Jul 2021 12:11:17 +0200") Message-ID: <87pmuww8a8.fsf@inria.fr> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 49781@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1627893556; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding:resent-cc: resent-from:resent-sender:resent-message-id:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post; bh=R0Yq1syynRM7pvmpT/llQiVrvqYqZeVsOEsWdWREb/w=; b=d/mVRh/EkRgMzF9Lf4CUj7ucsJOHrtgf0YLpCul8o7nVO5SHaCCE1J9iSgrZbdVuDJ5jge f6zXX6Y5Pdqc2oJWhMd7oLF95bWFv6uxLVZXmfaturLckKAFZAL0xo3rvdBu7yx5Bh1Hnx t+//y+y9PFUPOLPCGd2DPkk1e1LRF5Q0B1jYFNUSJiK4Av2f85dNaiZkNbUHIoXzMGeoTR WU6jgalTsx4R2BkmGdEHLVvCP+cRzozEdavrfPCqCJVZzfN3NRHc7OQHJIZ6xzFnmN5kJe AXF4xgfMot1Y4pVybMO0G3S68BZeJDj4VmW0a+6XoKPC9S27Cb2X2xc7GShelg== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1627893556; a=rsa-sha256; cv=none; b=HLg/14VKe3+bTEr9V///zWqhBUWpUPb5xsVzfsrTJYIuegmEeh+4WbHILZNd44nVk3479w tJVN9XzuLqUgYPBt8f4h/wIT3VxjVqqUnlT40rfIvL0xzVAixQ2mAiIVfpTvbnp5eq03AI 6HI27IC+LkJjqOz46MKv8PRR1uvozJXhOGbHgnf+RCPO0oH2/T0xlOvz+Kwdg8ERz8TpHl zhA9PlA8TS5f34wkRhT2sjvpfn4+jg2eHWrmaaYjFRPNbUMousJ289aLNFVylXjtDv7dWm gE5OkMacWKNQdt/uQtT2YCAVdLJzoomSAf7fKnNP3Mqih3QJ9goz9ZeC/CWtSw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Migadu-Spam-Score: -2.42 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Migadu-Queue-Id: 00B1D1CBFB X-Spam-Score: -2.42 X-Migadu-Scanner: scn0.migadu.com X-TUID: HQKOHtelRQ+5 Hello! Mathieu Othacehe skribis: > Your understanding is correct :). However, looking at the > cuirass-remote-server.log file, I found: > > 2021-07-29T22:31:48 fetching '/gnu/store/hrn9hj7v1img3il6afh3r036aczvwnyd= -xnnpack-0.0-1.bbe8824.drv' from http://141.80.167.185:5558 > 2021-07-29T22:31:48 Failed to add /gnu/store/slm0x0j05vyl3vqbjhgc0nch6jca= 9fp3-xnnpack-0.0-1.bbe8824 to store. > > > There are quite a few other "Failed to add" traces in the log, and they > all seem to involve the machine behind the .185 IP address. Ah ha! > Fetching the substitute manually from Berlin works: > > wget http://141.80.167.185:5558/nar/slm0x0j05vyl3vqbjhgc0nch6jca9fp3-xnn= pack-0.0-1.bbe8824 --no-http-keep-alive > > > but using "ensure-path" fails this way: > > scheme@(guix-user)> (set-build-options* s "http://141.80.167.185:5558") > $1 =3D #t > scheme@(guix-user)> (ensure-path s "/gnu/store/slm0x0j05vyl3vqbjhgc0nch6j= ca9fp3-xnnpack-0.0-1.bbe8824") > substitute: updating substitutes from 'http://141.80.167.185:5558'... 100= .0% > substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% > ice-9/boot-9.scm:1669:16: In procedure raise-exception: > ERROR: > 1. &store-protocol-error: > message: "path `/gnu/store/slm0x0j05vyl3vqbjhgc0nch6jca9fp3-xnnpack= -0.0-1.bbe8824' does not exist and cannot be created" > status: 1 > > Entering a new prompt. Type `,bt' for a backtrace or `,q' to continue. > > Do you see any reason why ensure-path would fail while wget works? The cache on berlin says this substitute is available from .185: --8<---------------cut here---------------start------------->8--- ludo@berlin ~$ sudo cat /var/guix/substitute/cache/mlcrs6tdmrqacbxadjqt4svm= a66gjcemoqjydai2vxshcokzw3fa/slm0x0j05vyl3vqbjhgc0nch6jca9fp3; echo (narinfo (version 2) (cache-uri "http://141.80.167.185:5558") (date 1627639= 693) (ttl 129600) (value "StorePath: /gnu/store/slm0x0j05vyl3vqbjhgc0nch6jc= a9fp3-xnnpack-0.0-1.bbe8824\nURL: nar/slm0x0j05vyl3vqbjhgc0nch6jca9fp3-xnnp= ack-0.0-1.bbe8824\nCompression: none\nFileSize: 924872\nNarHash: sha256:0ym= 303zq7shxgrl0p797bpfr8iymdwg6gc3vq85b6ms1akmj396b\nNarSize: 924872\nReferen= ces: 01b4w3m6mp55y531kyi1g8shh722kwqm-gcc-7.5.0-lib 4lgnc0s0h6zpdfbv7ccgj50= ya6m6gy4j-pthreadpool-0.1-1.1787867 dv8kki4psjqyf01y0s0vf6j5hw3sm5wk-cpuinf= o-0.0-1.866ae6e fa6wj5bxkj5ll1d7292a70knmyl7a0cr-glibc-2.31 slm0x0j05vyl3vq= bjhgc0nch6jca9fp3-xnnpack-0.0-1.bbe8824\nSystem: x86_64-linux\nDeriver: hrn= 9hj7v1img3il6afh3r036aczvwnyd-xnnpack-0.0-1.bbe8824.drv\nSignature: 1;hydra= -guix-128;KHNpZ25hdHVyZSAKIChkYXRhIAogIChmbGFncyByZmM2OTc5KQogIChoYXNoIHNoY= TI1NiAjRjQzQTYyOTFERTM5QjY4MUVCRTQxNEZGRTE0NUNGQ0E5RDhEREQ5OTc3QTM0RUUzOTIx= Qzg3OEQ3N0JBMkFEOCMpCiAgKQogKHNpZy12YWwgCiAgKGVjZHNhIAogICAociAjMEVGNTIzNkI= yNDk5QzAzQ0NBREIzODg2QUMwQUQzODg4QTUyOEU2NTQ3NTIxM0Q0ODYyNjYwMUJEODE1RDdGQy= MpCiAgIChzICMwQTQ0ODU5N0VBNUJFODFFOEJFRDlDRkM2MkFFRTEwMUIxQjdGN0U1RUM5RTlFR= Dc1Q0Q0NjQ4NkYyQUVGNThFIykKICAgKQogICkKIChwdWJsaWMta2V5IAogIChlY2MgCiAgIChj= dXJ2ZSBFZDI1NTE5KQogICAocSAjRkQyMEI1QjVFMDkwQjVBMzYzMTI0OTA1RTJDQjAyMEZCOUI= zQzk3QTU0NTUxMDI4REYwQTM2NEU0QzRDNjY1MyMpCiAgICkKICApCiApCg=3D=3D\n")) --8<---------------cut here---------------end--------------->8--- Yet, I=E2=80=99m also stumbling upon the =E2=80=98ensure-path=E2=80=99 fail= ure above, but now the substitute seems to have vanished: --8<---------------cut here---------------start------------->8--- scheme@(guix-user)> ,use(guix store) scheme@(guix-user)> (define s (open-connection )) scheme@(guix-user)> (set-build-options s #:substitute-urls '("http://141.80= .167.185:5558")) $1 =3D #t scheme@(guix-user)> (ensure-path s "/gnu/store/slm0x0j05vyl3vqbjhgc0nch6jca= 9fp3-xnnpack-0.0-1.bbe8824") substitute: updating substitutes from 'http://141.80.167.185:5558'... 100.0% ice-9/boot-9.scm:1685:16: In procedure raise-exception: ERROR: 1. &store-protocol-error: message: "path `/gnu/store/slm0x0j05vyl3vqbjhgc0nch6jca9fp3-xnnpack-0= .0-1.bbe8824' does not exist and cannot be created" status: 1 Entering a new prompt. Type `,bt' for a backtrace or `,q' to continue. scheme@(guix-user) [1]> ,q scheme@(guix-user)> (substitutable-path-info s '("/gnu/store/slm0x0j05vyl3v= qbjhgc0nch6jca9fp3-xnnpack-0.0-1.bbe8824")) substitute: updating substitutes from 'http://141.80.167.185:5558'... 100.0% $2 =3D () scheme@(guix-user)>=20 [1]+ Stopped guix repl ludo@berlin ~$ sudo cat /var/guix/substitute/cache/mlcrs6tdmrqacbxadjqt4svm= a66gjcemoqjydai2vxshcokzw3fa/slm0x0j05vyl3vqbjhgc0nch6jca9fp3; echo (narinf= o (version 2) (cache-uri "http://141.80.167.185:5558") (date 1627892782) (t= tl 0) (value #f)) ludo@berlin ~$ fg guix repl scheme@(guix-user)> (substitutable-path-info s '("/gnu/store/slm0x0j05vyl3v= qbjhgc0nch6jca9fp3-xnnpack-0.0-1.bbe8824")) substitute: updating substitutes from 'http://141.80.167.185:5558'... 100.0% $3 =3D () scheme@(guix-user)> (substitutable-path-info s '("/gnu/store/slm0x0j05vyl3v= qbjhgc0nch6jca9fp3-xnnpack-0.0-1.bbe8824")) substitute: updating substitutes from 'http://141.80.167.185:5558'... 100.0% $4 =3D () scheme@(guix-user)> ,q ludo@berlin ~$ wget -O - http://141.80.167.185:5558/slm0x0j05vyl3vqbjhgc0nc= h6jca9fp3.narinfo --2021-08-02 10:28:22-- http://141.80.167.185:5558/slm0x0j05vyl3vqbjhgc0nc= h6jca9fp3.narinfo Connecting to 141.80.167.185:5558... connected. HTTP request sent, awaiting response... 404 Not Found 2021-08-02 10:28:22 ERROR 404: Not Found. --8<---------------cut here---------------end--------------->8--- And indeed, the store item no longer is on .185: --8<---------------cut here---------------start------------->8--- ludo@berlin ~$ sudo ssh hydra@141.80.167.185 -bash-5.0$ ls /gnu/store/slm0x0j05vyl3vqbjhgc0nch6jca9fp3-xnnpack-0.0-1.bbe= 8824 ls: cannot access '/gnu/store/slm0x0j05vyl3vqbjhgc0nch6jca9fp3-xnnpack-0.0-= 1.bbe8824': No such file or directory --8<---------------cut here---------------end--------------->8--- One of the problems is that .185 did not advertise a TTL on its narinfos, hence the default of (* 36 3600) =3D 129600 that we saw above. That in turn explains some discrepancies: =E2=80=98guix substitute=E2=80=99= thinks the nar is still around but the corresponding /nar request fails because it has disappeared in the meantime. But perhaps the core issue is that .185 did not keep the build result long enough, perhaps because GC ran right after the build? Is that plausible? Thanks, Ludo=E2=80=99.