From mboxrd@z Thu Jan 1 00:00:00 1970 From: Mikael Djurfeldt Subject: bug#40125: Problem with guix offload: Remote channel closed Date: Sun, 22 Mar 2020 19:21:02 +0100 Message-ID: References: <87eetl1zce.fsf@gnu.org> <87pnd5wdyq.fsf@gnu.org> Reply-To: mikael@djurfeldt.com Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="0000000000006bc56605a17595e8" Return-path: Received: from eggs.gnu.org ([2001:470:142:3::10]:56683) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jG5Ea-0000EP-4F for bug-guix@gnu.org; Sun, 22 Mar 2020 14:22:06 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1jG5EY-0001kB-DJ for bug-guix@gnu.org; Sun, 22 Mar 2020 14:22:04 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:44925) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1jG5EY-0001k3-Ak for bug-guix@gnu.org; Sun, 22 Mar 2020 14:22:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1jG5EY-00011R-75 for bug-guix@gnu.org; Sun, 22 Mar 2020 14:22:02 -0400 Sender: "Debbugs-submit" Resent-Message-ID: In-Reply-To: <87pnd5wdyq.fsf@gnu.org> List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+gcggb-bug-guix=m.gmane-mx.org@gnu.org Sender: "bug-Guix" To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Cc: 40125@debbugs.gnu.org --0000000000006bc56605a17595e8 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I did this. What is a bit strange is that the error message seemingly randomly alters between what I already reported above and the following: mdj@hat:~/prusa$ guix offload test guix offload: testing 1 build machines defined in '/etc/guix/machines.scm'... guix offload: Guix is usable on 'wand.pdc.kth.se' (test returned "/gnu/store/883yjkl46dxw9mzykykmbs0yzwyxm17z-test") guix offload: 'wand.pdc.kth.se' is running GNU Guile 3.0.1 sending 1 store item (0 MiB) to 'wand.pdc.kth.se'... exporting path `/gnu/store/kw12ny565xl5p05ag6ysgshc9mhh4rz2-export-test' guix offload: error: unknown error while sending files over SSH This error message is more common. In this case, I couldn't see anything obviously strange except the following backtrace which contains strange characters: 31963 write(2, "Backtrace:\n 13 (apply-smob/1 #)\nIn ice-9/boot-9.scm:\n 718:2 12 (call-with-prompt (\"prompt\") # \342\200\246)\nIn ice-9/eval.scm:\n 619:8 11 (_ #(#(#)))\nIn ice-9/command-line.scm:\n 181:18 10 (_ #)\nIn unknown file:\n 9 (eval (begin (use-modules (guix) (srfi srfi-34) # #) \342\200\246) #)\nIn ice-9/eval.scm:\n 721:20 8 (primitive-eval (begin (use-modules (guix) (srfi \342\200\246) \342"..., 1150 I have also noticed that the above (the error message) happens inside the function send-files. It is the last error clause at the end of the function which reports the error message. I'd like to be able to, e.g., modify the function send-files to give some debugging output. How can I easily do that? Should I checkout guix with git and try to run it in the source tree? Or do you have other suggestions? Best regards, Mikael On Sat, Mar 21, 2020 at 11:16 PM Ludovic Court=C3=A8s wrote: > Hi Mikael, > > Mikael Djurfeldt skribis: > > > I will look at the other buh reports. Meanwhile, do you have any hint o= n > > where to look/insert logging code in order to see what is going on? > > On =E2=80=98wand=E2=80=99, can you run something like: > > sudo strace -s 500 -p $(pidof sshd) -f -o sshd.log > > After that, run =E2=80=98guix offload test=E2=80=99 from the other host, = and check what > =E2=80=98sshd.log=E2=80=99 contains. If would in particular look for all= the =E2=80=98execve=E2=80=99 > syscalls as well as what happens right before =E2=80=98exit_group=E2=80= =99 syscalls. > There are probably error messages lurking there. :-) > > You can share excerpts of the log but note that it will contain > sensitive crypto material, so beware. > > Thanks in advance, > Ludo=E2=80=99. > --0000000000006bc56605a17595e8 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I did this.

What is a bit st= range is that the error message seemingly randomly alters between what I al= ready reported above and the following:

mdj@hat:~/= prusa$ guix offload test
guix offload: testing 1 build machines defined = in '/etc/guix/machines.scm'...
guix offload: Guix is usable on &= #39;wand.pdc.kth.se' (test retur= ned "/gnu/store/883yjkl46dxw9mzykykmbs0yzwyxm17z-test")
guix o= ffload: 'wand.pdc.kth.se' is= running GNU Guile 3.0.1
sending 1 store item (0 MiB) to 'wand.pdc.kth.se'...
exporting path `/gn= u/store/kw12ny565xl5p05ag6ysgshc9mhh4rz2-export-test'
guix offload: = error: unknown error while sending files over SSH

<= div>This error message is more common. In this case, I couldn't see any= thing obviously strange except the following backtrace which contains stran= ge characters:

31963 write(2, "Backtrace:\n = =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A013 (apply-smob/1 #<catch-closure 56464= c2232a0>)\nIn ice-9/boot-9.scm:\n =C2=A0 =C2=A0718:2 12 (call-with-promp= t (\"prompt\") #<procedure 56464c2407e0 \342\200\246> \342\= 200\246)\nIn ice-9/eval.scm:\n =C2=A0 =C2=A0619:8 11 (_ #(#(#<directory = (guile-user) 56464c2c4750>)))\nIn ice-9/command-line.scm:\n =C2=A0 181:1= 8 10 (_ #<input: string 56464c2d2bd0>)\nIn unknown file:\n =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 9 (eval (begin (use-modules (guix) (srfi srfi-34) = # #) \342\200\246) #)\nIn ice-9/eval.scm:\n =C2=A0 721:20 =C2=A08 (primitiv= e-eval (begin (use-modules (guix) (srfi \342\200\246) \342"..., 1150 &= lt;unfinished ...>

I have also noticed that the= above (the error message) happens inside the function send-files. It is th= e last error clause at the end of the function which reports the error mess= age.

I'd like to be able to, e.g., modify = the function send-files to give some debugging output. How can I easily do = that? Should I checkout guix with git and try to run it in the source tree?= Or do you have other suggestions?

Best regards,
Mikael

On Sat, Mar 21, 2020 at 11:16 PM Ludovic Court=C3= =A8s <ludo@gnu.org= > wrote:
Hi M= ikael,

Mikael Djurfeldt <mikael@djurfeldt.com> skribis:

> I will look at the other buh reports. Meanwhile, do you have any hint = on
> where to look/insert logging code in order to see what is going on?
On =E2=80=98wand=E2=80=99, can you run something like:

=C2=A0 sudo strace -s 500 -p $(pidof sshd) -f -o sshd.log

After that, run =E2=80=98guix offload test=E2=80=99 from the other host, an= d check what
=E2=80=98sshd.log=E2=80=99 contains.=C2=A0 If would in particular look for = all the =E2=80=98execve=E2=80=99
syscalls as well as what happens right before =E2=80=98exit_group=E2=80=99 = syscalls.
There are probably error messages lurking there.=C2=A0 :-)

You can share excerpts of the log but note that it will contain
sensitive crypto material, so beware.

Thanks in advance,
Ludo=E2=80=99.
--0000000000006bc56605a17595e8--