From mboxrd@z Thu Jan 1 00:00:00 1970 From: Mark H Weaver Subject: bug#26705: guix publish daemon on Hydra became dysfunctional; needed restart Date: Fri, 28 Apr 2017 18:33:30 -0400 Message-ID: <877f24xiv9.fsf@netris.org> Mime-Version: 1.0 Content-Type: text/plain Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:55509) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1d4ETj-0004kz-3g for bug-guix@gnu.org; Fri, 28 Apr 2017 18:35:08 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1d4ETe-0007IC-5T for bug-guix@gnu.org; Fri, 28 Apr 2017 18:35:07 -0400 Received: from debbugs.gnu.org ([208.118.235.43]:47013) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1d4ETe-0007Hl-2i for bug-guix@gnu.org; Fri, 28 Apr 2017 18:35:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1d4ETd-00085p-UB for bug-guix@gnu.org; Fri, 28 Apr 2017 18:35:01 -0400 Sender: "Debbugs-submit" Resent-Message-ID: Received: from eggs.gnu.org ([2001:4830:134:3::10]:55334) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1d4ESb-0004X5-FC for bug-guix@gnu.org; Fri, 28 Apr 2017 18:33:58 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1d4ESW-0006a3-DC for bug-guix@gnu.org; Fri, 28 Apr 2017 18:33:57 -0400 Received: from world.peace.net ([50.252.239.5]:38201) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1d4ESW-0006NL-9Q for bug-guix@gnu.org; Fri, 28 Apr 2017 18:33:52 -0400 List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org Sender: "bug-Guix" To: 26705@debbugs.gnu.org While trying to update my GuixSD system in the last hour, I found that every attempt by the substituter to download NARs resulted in a 500 "Internal Server Error": --8<---------------cut here---------------start------------->8--- mhw@jojen ~$ guix package -u substitute: ^Msubstitute: updating list of substitutes from 'https://mirror.hydra.gnu.org'... 0.0%^Msubstitute: updating list of substitutes from 'https://mirror.hydra.gnu.org'... 100.0% Downloading https://mirror.hydra.gnu.org/guix/nar/qz4mg7sid6avdav158lhr6wziqswpjmx-gnome-calendar-3.22.2.tar.xz (2.3MiB installed)... guix substitute: error: download from 'https://mirror.hydra.gnu.org/guix/nar/qz4mg7sid6avdav158lhr6wziqswpjmx-gnome-calendar-3.22.2.tar.xz' failed: 500, "Internal Server Error" guix package: error: build failed: some substitutes for the outputs of derivation `/gnu/store/l58cq0l2j2ikyimjvxyv1dakha2ai6rx-gnome-calendar-3.22.2.tar.xz.drv' failed (usually happens due to networking issues); try `--fallback' to build derivation from source mhw@jojen ~$ guix package -u Downloading https://mirror.hydra.gnu.org/guix/nar/qz4mg7sid6avdav158lhr6wziqswpjmx-gnome-calendar-3.22.2.tar.xz (2.3MiB installed)... guix substitute: error: download from 'https://mirror.hydra.gnu.org/guix/nar/qz4mg7sid6avdav158lhr6wziqswpjmx-gnome-calendar-3.22.2.tar.xz' failed: 500, "Internal Server Error" guix package: error: build failed: some substitutes for the outputs of derivation `/gnu/store/l58cq0l2j2ikyimjvxyv1dakha2ai6rx-gnome-calendar-3.22.2.tar.xz.drv' failed (usually happens due to networking issues); try `--fallback' to build derivation from source --8<---------------cut here---------------end--------------->8--- Bypassing the mirror didn't help: --8<---------------cut here---------------start------------->8--- mhw@jojen ~$ guix package -u . --substitute-urls=https://hydra.gnu.org substitute: ^Msubstitute: updating list of substitutes from 'https://hydra.gnu.org'... 0.0%^Msubstitute: updating list of substitutes from 'https://hydra.gnu.org'... 100.0% substitute: ^Msubstitute: updating list of substitutes from 'https://hydra.gnu.org'... 0.0%^Msubstitute: updating list of substitutes from 'https://hydra.gnu.org'... 100.0% Downloading https://hydra.gnu.org/guix/nar/qz4mg7sid6avdav158lhr6wziqswpjmx-gnome-calendar-3.22.2.tar.xz (2.3MiB installed)... guix substitute: error: download from 'https://hydra.gnu.org/guix/nar/qz4mg7sid6avdav158lhr6wziqswpjmx-gnome-calendar-3.22.2.tar.xz' failed: 500, "Internal Server Error" guix package: error: build failed: some substitutes for the outputs of derivation `/gnu/store/l58cq0l2j2ikyimjvxyv1dakha2ai6rx-gnome-calendar-3.22.2.tar.xz.drv' failed (usually happens due to networking issues); try `--fallback' to build derivation from source --8<---------------cut here---------------end--------------->8--- Here's what I found in the recent output of the 'guix publish' server on Hydra (running in root's screen session): --8<---------------cut here---------------start------------->8--- GET /74ch6nvjfkj3i56nygwijnaghlpi01d4.narinfo In guix/scripts/publish.scm: 393:2 2 (render-narinfo/cached # ...) In guix/store.scm: 663:9 1 (query-path-from-hash-part # #) In unknown file: 0 (put-bytevector # #vu8(# ...) ...) ERROR: In procedure fport_write: Broken pipe GET /guix/nar/qz4mg7sid6avdav158lhr6wziqswpjmx-gnome-calendar-3.22.2.tar.xz In guix/scripts/publish.scm: 491:8 2 (render-nar # #< ...) In guix/store.scm: 648:0 1 (valid-path? # "/gnu/sto...") In unknown file: 0 (put-bytevector # #vu8(1 ...) ...) ERROR: In procedure fport_write: Broken pipe GET /zhxab8rkbbalgrlhg86q8pzpqi3s6q36.narinfo In guix/scripts/publish.scm: 393:2 2 (render-narinfo/cached # ...) In guix/store.scm: 663:9 1 (query-path-from-hash-part # #) In unknown file: 0 (put-bytevector # #vu8(# ...) ...) ERROR: In procedure fport_write: Broken pipe GET /z2rygpahxbpkwx8k164bi5lr5lann357.narinfo In guix/scripts/publish.scm: 393:2 2 (render-narinfo/cached # ...) In guix/store.scm: 663:9 1 (query-path-from-hash-part # #) In unknown file: 0 (put-bytevector # #vu8(# ...) ...) ERROR: In procedure fport_write: Broken pipe GET /yw635wxpm4ac40khzd9w6j9v3n72a708.narinfo In guix/scripts/publish.scm: 393:2 2 (render-narinfo/cached # ...) In guix/store.scm: 663:9 1 (query-path-from-hash-part # #) In unknown file: 0 (put-bytevector # #vu8(# ...) ...) ERROR: In procedure fport_write: Broken pipe --8<---------------cut here---------------end--------------->8--- I killed the process, restarted it, and now things seem to be working again, but it would be good to know what went wrong here. Mark