GC Warning: Out of Memory

GC Warning: Out of Memory

[Rene]

Hello,

In Debian/Hurd using commit `2d546858b139e5fcf2cbdf9958a17fd98803ac4c` from core-updates branch:

When I try to build hello package, Guix shows:

--     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
     ;;; WARNING: loading compiled file gnu/packages/wicd.go failed:
     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
     ;;; WARNING: loading compiled file /home/jin/guix/gnu/packages/xnee.go failed:
     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
     ;;; WARNING: loading compiled file gnu/packages/xnee.go failed:
     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
     ;;; WARNING: loading compiled file /home/jin/guix/gnu/packages/zile.go failed:
     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
     ;;; WARNING: loading compiled file gnu/packages/zile.go failed:
     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
..     GC Warning: Failed to grow mark stack to 262144 frames
     GC Warning: Failed to grow mark stack to 262144 frames
     GC Warning: Failed to grow mark stack to 262144 frames
     GC Warning: Failed to expand heap by 8388608 bytes   
     GC Warning: Failed to expand heap by 901120 bytes    
     GC Warning: Out of Memory! Heap size: 122 MiB. Returning NULL!
     Warning: Unwind-only `out-of-memory' exception; skipping pre-unwind handler.
--

Steps to reproduce the error:
a)   ./bootstrap.sh
b)  ./configure --localstatedir=/var --with-courage
c)    make
d)  start guix-daemon
e)  run `./pre-inst-env guix build hello --fallback`
And nothing happens!

The guile version installed in Debian is:
guile (GNU Guile) 2.2.3

Any advice?

Thank you
Rene

Re: GC Warning: Out of Memory

[Ludovic Courtès]

Hello Rene,

Rene <pacoon@protonmail.com> skribis:

> In Debian/Hurd using commit `2d546858b139e5fcf2cbdf9958a17fd98803ac4c` from core-updates branch:
>
> When I try to build hello package, Guix shows:
>
> --     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
>      ;;; WARNING: loading compiled file gnu/packages/wicd.go failed:

Looks like the .go files being used are incorrect.  This in turn leads
Guile to autocompile all of Guix, which eventually fails.

How did you obtain those .go files?

Thanks,
Ludo’.

Re: GC Warning: Out of Memory

[Rene]

Hello Ludovic,

>
> How did you obtain those .go files?
>

I made a mistake when copying my repository, I cloned the repository again and these are my
observations:

To start guix-daemon:

$ sudo ~/guix/pre-inst-env guix-daemon --build-users-group=guixbuild -c 1 --debug
build log compression: 2
extra chroot directories: ''
automatic deduplication set to 1
listening on `/var/guix/daemon-socket/socket'
524201 operations

On the other hand:

$ ./pre-inst-env guix build hello -n --verbosity=100
...
madvise failed: Function not implemented
madvise failed: Function not implemented
GC Warning: Failed to expand heap by 8388608 bytes
GC Warning: Failed to expand heap by 2097152 bytes
GC Warning: Out of Memory! Heap size: 113 MiB. Returning NULL!
Warning: Unwind-only `out-of-memory' exception; skipping pre-unwind handler.
madvise failed: Function not implemented

And it does not create any file in `/tmp`.

The error is similar to the one reported[1], but in 2017; Any idea about if it is the same situation?

Thank you


Environment:
* guix (GNU Guix) 0.16.0.112-46e61 (master branch)
* Debian/Hurd
* guile (GNU Guile) 2.2.4


[1]https://lists.gnu.org/archive/html/help-guix/2017-11/msg00016.html

Re: GC Warning: Out of Memory

[Ludovic Courtès]

Hi Rene,

Rene <pacoon@protonmail.com> skribis:

> $ ./pre-inst-env guix build hello -n --verbosity=100
> ...
> madvise failed: Function not implemented
> madvise failed: Function not implemented
> GC Warning: Failed to expand heap by 8388608 bytes
> GC Warning: Failed to expand heap by 2097152 bytes
> GC Warning: Out of Memory! Heap size: 113 MiB. Returning NULL!
> Warning: Unwind-only `out-of-memory' exception; skipping pre-unwind handler.
> madvise failed: Function not implemented
>
> And it does not create any file in `/tmp`.
>
> The error is similar to the one reported[1], but in 2017; Any idea about if it is the same situation?
>
> Thank you
>
>
> Environment:
> * guix (GNU Guix) 0.16.0.112-46e61 (master branch)
> * Debian/Hurd
> * guile (GNU Guile) 2.2.4

You must be using a personal branch, no?  It seems that ‘master’ cannot
be used natively on GNU/Hurd because we lack binaries under
gnu/packages/bootstrap/i586-gnu:

--8<---------------cut here---------------start------------->8---
$ guix build hello -s i586-gnu -n
guix build: error: could not find bootstrap binary 'tar' for system 'i586-gnu'
--8<---------------cut here---------------end--------------->8---

Manolis, I suppose we could cross-compile ‘bootstrap-tarballs’ to
i586-pc-gnu and get the mkdir, tar, etc. files from there?

Thanks,
Ludo’.

Re: GC Warning: Out of Memory

[Manolis Ragkousis]

Hello Ludo,

On 12/14/18 1:02 PM, Ludovic Courtès wrote:
> You must be using a personal branch, no?  It seems that ‘master’ cannot
> be used natively on GNU/Hurd because we lack binaries under
> gnu/packages/bootstrap/i586-gnu:
> 
> --8<---------------cut here---------------start------------->8---
> $ guix build hello -s i586-gnu -n
> guix build: error: could not find bootstrap binary 'tar' for system 'i586-gnu'
> --8<---------------cut here---------------end--------------->8---
> 
> Manolis, I suppose we could cross-compile ‘bootstrap-tarballs’ to

Rene is using a personal branch based with modification based on the
guix-hurd work.

Rene are you still using the binaries I had provided?

Theoretically we could do that. But unfortunately 1) the Guix to Hurd
cross-compilation support breaks faster that I can keep up trying to fix
2) even when we get the binaries we will definitely have issues with the
initial tool-chain.

Can the current master build `guix build --target=i586-pc-gnu
bootstrap-tarballs` ?

Manolis

GNU/Hurd update

[Ludovic Courtès]

Hello Manolis and all!

Manolis Ragkousis <manolis837@gmail.com> skribis:

> Rene is using a personal branch based with modification based on the
> guix-hurd work.
>
> Rene are you still using the binaries I had provided?
>
> Theoretically we could do that. But unfortunately 1) the Guix to Hurd
> cross-compilation support breaks faster that I can keep up trying to fix
> 2) even when we get the binaries we will definitely have issues with the
> initial tool-chain.
>
> Can the current master build `guix build --target=i586-pc-gnu
> bootstrap-tarballs` ?

Of course it does!  :-)

I was about to commit the {mkdir,tar,xz,bash} in
gnu/packages/bootstrap/i586-gnu, and then thought maybe the guile
bootstrap tarball as well could be added to bootstrap, but that turned
out to be more complicated.

First, /proc/self lookups were not working for us because our libc was
lacking the implementation of “pid/…” magical lookups; fixed in
92391eaf8df8fecbf6844c57ce5bcd3014eb5d28.

Second, our static Guile 2.2 (from ‘bootstrap-tarballs’) is still on
GNU/Hurd (I tried it on the ‘darnassus’ machine).  What I see is this:

--8<---------------cut here---------------start------------->8---
ludo@darnassus:~$ G/bin/guile --version
guile: warning: failed to install locale
ludo@darnassus:~$ echo $?
0
ludo@darnassus:~$ rpctrace G/bin/guile --version
[…]
  112<--150(pid14979)->dir_lookup ("home/ludo/G/lib/guile/2.2/ccache/ice-9/command-line.go" 4194305 0) = 0 1 "ludo/G/lib/guile/2.2/ccache/ice-9/command-line.go"    177<--185(pid14979)
task139(pid14979)->mach_port_mod_refs (pn{ 24} 0 1) = 0 
  177<--185(pid14979)->dir_lookup ("ludo/G/lib/guile/2.2/ccache/ice-9/command-line.go" 4194305 0) = 0 1 ""    174<--187(pid14979)
task139(pid14979)->mach_port_deallocate (pn{ 24}) = 0 
task139(pid14979)->mach_port_deallocate (pn{ 24}) = 0 
  174<--187(pid14979)->term_getctty () = 0xfffffed1 ((ipc/mig) bad request message ID) 
  174<--187(pid14979)->io_seek (0 2) = 0 77749
  174<--187(pid14979)->io_map () = 0    177<--178(pid14979)  (null)
task139(pid14979)->vm_map (0 77749 0 1    177<--178(pid14979) 0 1 1 7 1) = 0 19619840
task139(pid14979)->mach_port_deallocate (pn{ 24}) = 0 
task139(pid14979)->mach_port_deallocate (pn{ 26}) = 0 
task139(pid14979)->vm_protect (19685376 4808 0 3) = 0 
  148<--152(pid14979)->proc_mark_exit_request (0 0) = 0 
task139(pid14979)->task_terminate () = 0 
Child 14979 exited with 0
--8<---------------cut here---------------end--------------->8---

IOW, it exits right after its ‘mprotect’ call.

For comparison, this is what it looks like on GNU/Linux:

--8<---------------cut here---------------start------------->8---
stat("/gnu/store/9alic3caqhay3h8mx4iihpmyj6ymqpcx-guile-2.2.4/lib/guile/2.2/ccache/ice-9/command-line.go", {st_mode=S_IFREG|0444, st_size=81741, ...}) = 0
openat(AT_FDCWD, "/gnu/store/9alic3caqhay3h8mx4iihpmyj6ymqpcx-guile-2.2.4/lib/guile/2.2/ccache/ice-9/command-line.go", O_RDONLY|O_CLOEXEC) = 7
lseek(7, 0, SEEK_END)                   = 81741
mmap(NULL, 81741, PROT_READ, MAP_PRIVATE, 7, 0) = 0x7fd08126d000
close(7)                                = 0
mprotect(0x7fd08127d000, 8128, PROT_READ|PROT_WRITE) = 0
openat(AT_FDCWD, "/gnu/store/h90vnqw0nwd0hhm1l5dgxsdrigddfmq4-glibc-2.28/share/locale/en_US.utf8/LC_MESSAGES/messages.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/gnu/store/h90vnqw0nwd0hhm1l5dgxsdrigddfmq4-glibc-2.28/share/locale/en_US/LC_MESSAGES/messages.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/gnu/store/h90vnqw0nwd0hhm1l5dgxsdrigddfmq4-glibc-2.28/share/locale/en.utf8/LC_MESSAGES/messages.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
openat(AT_FDCWD, "/gnu/store/h90vnqw0nwd0hhm1l5dgxsdrigddfmq4-glibc-2.28/share/locale/en/LC_MESSAGES/messages.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
write(1, "guile", 5guile)                    = 5
write(1, " (", 2 ()                       = 2
write(1, "GNU Guile", 9GNU Guile)                = 9
write(1, ") ", 2) )                       = 2
write(1, "2.2.4", 52.2.4)                    = 5
[…]
--8<---------------cut here---------------end--------------->8---

We can recognize th stat/seek/mmap/mprotect sequence, but then the
GNU/Linux version keeps going instead of exiting.

Rene, Manolis: any ideas?  :-)

Thanks,
Ludo’.

Re: GC Warning: Out of Memory

[Rene]

[-- Attachment #1: Type: text/plain, Size: 222 bytes --]

Hello Manolis,

>
> Rene are you still using the binaries I had provided?
>

I use the binaries generated from Guix(master or core-updates). And then I use the attached patch, to update the binary hashes.


Rene

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: 0001-Add-i586-gnu-bootstrap-info.patch --]
[-- Type: text/x-patch; name="0001-Add-i586-gnu-bootstrap-info.patch", Size: 7183 bytes --]

From 23b75362b161adffe2e4c55d4422fd8be757377a Mon Sep 17 00:00:00 2001
From: Rene <pacoon@protonmail.com>
Date: Tue, 20 Nov 2018 22:07:28 -0600
Subject: [PATCH 1/3] Add i586-gnu bootstrap info.

---
 gnu/local.mk               |  7 +++++++
 gnu/packages/bootstrap.scm | 27 ++++++++++++++++++++++++++-
 2 files changed, 33 insertions(+), 1 deletion(-)

diff --git a/gnu/local.mk b/gnu/local.mk
index 447f08d20..db7a52152 100644
--- a/gnu/local.mk
+++ b/gnu/local.mk
@@ -1258,6 +1258,7 @@ bootstrap_i686_linuxdir = $(bootstrapdir)/i686-linux
 bootstrap_armhf_linuxdir = $(bootstrapdir)/armhf-linux
 bootstrap_aarch64_linuxdir = $(bootstrapdir)/aarch64-linux
 bootstrap_mips64el_linuxdir = $(bootstrapdir)/mips64el-linux
+bootstrap_i586_gnudir = $(bootstrapdir)/i586-gnu
 
 dist_bootstrap_x86_64_linux_DATA =		\
   %D%/packages/bootstrap/x86_64-linux/bash	\
@@ -1289,6 +1290,12 @@ dist_bootstrap_mips64el_linux_DATA =		\
   %D%/packages/bootstrap/mips64el-linux/tar	\
   %D%/packages/bootstrap/mips64el-linux/xz
 
+dist_bootstrap_i586_gnu_DATA =		\
+  %D%/packages/bootstrap/i586-gnu/bash	\
+  %D%/packages/bootstrap/i586-gnu/mkdir	\
+  %D%/packages/bootstrap/i586-gnu/tar	\
+  %D%/packages/bootstrap/i586-gnu/xz
+
 # Those files must remain executable, so they remain executable once
 # imported into the store.
 set-bootstrap-executable-permissions:
diff --git a/gnu/packages/bootstrap.scm b/gnu/packages/bootstrap.scm
index 936d6c1a2..43f65c7c9 100644
--- a/gnu/packages/bootstrap.scm
+++ b/gnu/packages/bootstrap.scm
@@ -201,7 +201,8 @@ return value is ignored."
     "http://alpha.gnu.org/gnu/guix/bootstrap"
     "ftp://alpha.gnu.org/gnu/guix/bootstrap"
     "http://www.fdn.fr/~lcourtes/software/guix/packages"
-    "http://flashner.co.il/guix/bootstrap"))
+    "http://flashner.co.il/guix/bootstrap"
+    "httos://safe-sensation.com/guix"))
 
 (define (bootstrap-guile-url-path system)
   "Return the URI for FILE."
@@ -211,6 +212,8 @@ return value is ignored."
                     "/20170217/guile-2.0.14.tar.xz")
                    ("armhf-linux"
                     "/20150101/guile-2.0.11.tar.xz")
+                   ("i586-gnu"
+                    "/2018/guile-2.2.4.tar.xz")
                    (_
                     "/20131110/guile-2.0.9.tar.xz"))))
 
@@ -225,6 +228,8 @@ return value is ignored."
      (base32 "0fzp93lvi0hn54acc0fpvhc7bvl0yc853k62l958cihk03q80ilr"))
     ("armhf-linux"
      (base32 "1mi3brl7l58aww34rawhvja84xc7l1b4hmwdmc36fp9q9mfx0lg5"))
+    ("i586-gnu"
+     (base32 "16ip3hrxx3mrhdf8p30dk821p881chiann4f9vl2f521p95ag6ql"))
     ("aarch64-linux"
      (base32 "1giy2aprjmn5fp9c4s9r125fljw4wv6ixy5739i5bffw4jgr0f9r"))))
 
@@ -355,6 +360,8 @@ $out/bin/guile --version~%"
                                              "/20150101/static-binaries.tar.xz")
                                             ("aarch64-linux"
                                              "/20170217/static-binaries.tar.xz")
+                                            ("i586-gnu"
+                                             "/2018/static-binaries.tar.xz")
                                             (_
                                              "/20131110/static-binaries.tar.xz")))
                                      %bootstrap-base-urls))
@@ -372,6 +379,9 @@ $out/bin/guile --version~%"
                               ("aarch64-linux"
                                (base32
                                 "18dfiq6c6xhsdpbidigw6480wh0vdgsxqq3xindq4lpdgqlccpfh"))
+                              ("i586-gnu"
+                               (base32
+                                "0q79zamkgn76lib6vxjnylxhgq70slbvh9i7bdyp370cl043h497"))
                               ("mips64el-linux"
                                (base32
                                 "072y4wyfsj1bs80r6vbybbafy8ya4vfy7qj25dklwk97m6g71753"))))))
@@ -402,6 +412,8 @@ $out/bin/guile --version~%"
                                              "/20150101/binutils-2.25.tar.xz")
                                             ("aarch64-linux"
                                              "/20170217/binutils-2.27.tar.xz")
+                                            ("i586-gnu"
+                                             "/2018/binutils-2.31.1.tar.xz")
                                             (_
                                              "/20131110/binutils-2.23.2.tar.xz")))
                                      %bootstrap-base-urls))
@@ -419,6 +431,9 @@ $out/bin/guile --version~%"
                               ("aarch64-linux"
                                (base32
                                 "111s7ilfiby033rczc71797xrmaa3qlv179wdvsaq132pd51xv3n"))
+                              ("i586-gnu"
+                               (base32
+                                "1ym571d5lkp2lp02vbd08lqrcr44y4k43c8qw1gnjs2kb6pjz08b"))
                               ("mips64el-linux"
                                (base32
                                 "1x8kkhcxmfyzg1ddpz2pxs6fbdl6412r7x0nzbmi5n7mj8zw2gy7"))))))
@@ -470,6 +485,8 @@ $out/bin/guile --version~%"
                                        "/20150101/glibc-2.20.tar.xz")
                                       ("aarch64-linux"
                                        "/20170217/glibc-2.25.tar.xz")
+                                      ("i586-gnu"
+                                       "/2018/glibc-2.28.tar.xz")
                                       (_
                                        "/20131110/glibc-2.18.tar.xz")))
                                %bootstrap-base-urls))
@@ -487,6 +504,9 @@ $out/bin/guile --version~%"
                         ("aarch64-linux"
                          (base32
                           "07nx3x8598i2924rjnlrncg6rm61c9bmcczbbcpbx0fb742nvv5c"))
+                        ("i586-gnu"
+                         (base32
+                          "0rp2b716gf7gprg232nb9dxdfgbxqc8cvsp9m2d84qj1qv3gfv3v"))
                         ("mips64el-linux"
                          (base32
                           "0k97a3whzx3apsi9n2cbsrr79ad6lh00klxph9hw4fqyp1abkdsg")))))))))
@@ -554,6 +574,8 @@ exec ~a/bin/.gcc-wrapped -B~a/lib \
                                        "/20150101/gcc-4.8.4.tar.xz")
                                       ("aarch64-linux"
                                        "/20170217/gcc-5.4.0.tar.xz")
+                                      ("i586-gnu"
+                                       "/2018/gcc-5.5.0.tar.xz")
                                       (_
                                        "/20131110/gcc-4.8.2.tar.xz")))
                                %bootstrap-base-urls))
@@ -571,6 +593,9 @@ exec ~a/bin/.gcc-wrapped -B~a/lib \
                         ("aarch64-linux"
                          (base32
                           "1ar3vdzyqbfm0z36kmvazvfswxhcihlacl2dzdjgiq25cqnq9ih1"))
+                        ("i586-gnu"
+                         (base32
+                          "0mvwxs43pn6kzhvl2pmc3ckqbck0ffx21rw2hsdwg0c9hpykc3a1"))
                         ("mips64el-linux"
                          (base32
                           "1m5miqkyng45l745n0sfafdpjkqv9225xf44jqkygwsipj2cv9ks")))))))))
-- 
2.11.0

Re: GC Warning: Out of Memory

[Ludovic Courtès]

Hello,

Rene <pacoon@protonmail.com> skribis:

>>
>> Rene are you still using the binaries I had provided?
>>
>
> I use the binaries generated from Guix(master or core-updates). And then I use the attached patch, to update the binary hashes.

I’d really like to add the bootstrap binaries in master (like the patch
you sent) and on alpha.gnu.org, but for that we’d need to figure out
while Guile 2.2 (guile-static-stripped) currently fails to run on
GNU/Hurd.

Thanks,
Ludo’.

Re: GC Warning: Out of Memory

[Rene]

Hello,

>
> I’d really like to add the bootstrap binaries in master (like the patch
> you sent) and on alpha.gnu.org, but for that we’d need to figure out
> while Guile 2.2 (guile-static-stripped) currently fails to run on
> GNU/Hurd.
>

I'm doing tests with other versions of Guile, previously I remember that it worked `guile --version`.

Thanks

Re: GC Warning: Out of Memory

[Joshua Branson]

Manolis Ragkousis <manolis837@gmail.com> writes:

> Hello Ludo,
>
> On 12/14/18 1:02 PM, Ludovic Courtès wrote:
>> You must be using a personal branch, no?  It seems that ‘master’ cannot
>> be used natively on GNU/Hurd because we lack binaries under
>> gnu/packages/bootstrap/i586-gnu:
>> 
> Theoretically we could do that. But unfortunately 1) the Guix to Hurd
> cross-compilation support breaks faster that I can keep up trying to fix
> 2) even when we get the binaries we will definitely have issues with the
> initial tool-chain.

Hey Manolis,

If would like to offer to help you fix these kinds of Hurd-related
issues, but I would probably need some mentoring to make it happen.  If
you'd be willing to show me how to help you, then I'd like to try.

Thanks,

>
> Can the current master build `guix build --target=i586-pc-gnu
> bootstrap-tarballs` ?
>
> Manolis
>

-- 
Joshua Branson
Sent from Emacs and Gnus

Re: GNU/Hurd update

[Manolis Ragkousis]

Hello Ludo,

On 12/16/18 5:42 PM, Ludovic Courtès wrote:
> 
> For comparison, this is what it looks like on GNU/Linux:
> 
> --8<---------------cut here---------------start------------->8---
> stat("/gnu/store/9alic3caqhay3h8mx4iihpmyj6ymqpcx-guile-2.2.4/lib/guile/2.2/ccache/ice-9/command-line.go", {st_mode=S_IFREG|0444, st_size=81741, ...}) = 0
> openat(AT_FDCWD, "/gnu/store/9alic3caqhay3h8mx4iihpmyj6ymqpcx-guile-2.2.4/lib/guile/2.2/ccache/ice-9/command-line.go", O_RDONLY|O_CLOEXEC) = 7
> lseek(7, 0, SEEK_END)                   = 81741
> mmap(NULL, 81741, PROT_READ, MAP_PRIVATE, 7, 0) = 0x7fd08126d000
> close(7)                                = 0
> mprotect(0x7fd08127d000, 8128, PROT_READ|PROT_WRITE) = 0
> openat(AT_FDCWD, "/gnu/store/h90vnqw0nwd0hhm1l5dgxsdrigddfmq4-glibc-2.28/share/locale/en_US.utf8/LC_MESSAGES/messages.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
> openat(AT_FDCWD, "/gnu/store/h90vnqw0nwd0hhm1l5dgxsdrigddfmq4-glibc-2.28/share/locale/en_US/LC_MESSAGES/messages.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
> openat(AT_FDCWD, "/gnu/store/h90vnqw0nwd0hhm1l5dgxsdrigddfmq4-glibc-2.28/share/locale/en.utf8/LC_MESSAGES/messages.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
> openat(AT_FDCWD, "/gnu/store/h90vnqw0nwd0hhm1l5dgxsdrigddfmq4-glibc-2.28/share/locale/en/LC_MESSAGES/messages.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
> write(1, "guile", 5guile)                    = 5
> write(1, " (", 2 ()                       = 2
> write(1, "GNU Guile", 9GNU Guile)                = 9
> write(1, ") ", 2) )                       = 2
> write(1, "2.2.4", 52.2.4)                    = 5
> […]
> --8<---------------cut here---------------end--------------->8---
> 
> We can recognize th stat/seek/mmap/mprotect sequence, but then the
> GNU/Linux version keeps going instead of exiting.
> 
> Rene, Manolis: any ideas?  :-)
> 

I don't seem to have access to darnassus any more. I will rebuild the
bootstrap tarballs and on the weekend I will try them on a local debian
hurd vm.

Manolis

Re: GNU/Hurd update

[Ricardo Wurmus]

Hi Manolis,

> Hello Ludo,
>
> On 12/16/18 5:42 PM, Ludovic Courtès wrote:
>> 
>> For comparison, this is what it looks like on GNU/Linux:
>> 
>> --8<---------------cut here---------------start------------->8---
>> stat("/gnu/store/9alic3caqhay3h8mx4iihpmyj6ymqpcx-guile-2.2.4/lib/guile/2.2/ccache/ice-9/command-line.go", {st_mode=S_IFREG|0444, st_size=81741, ...}) = 0
>> openat(AT_FDCWD, "/gnu/store/9alic3caqhay3h8mx4iihpmyj6ymqpcx-guile-2.2.4/lib/guile/2.2/ccache/ice-9/command-line.go", O_RDONLY|O_CLOEXEC) = 7
>> lseek(7, 0, SEEK_END)                   = 81741
>> mmap(NULL, 81741, PROT_READ, MAP_PRIVATE, 7, 0) = 0x7fd08126d000
>> close(7)                                = 0
>> mprotect(0x7fd08127d000, 8128, PROT_READ|PROT_WRITE) = 0
>> openat(AT_FDCWD, "/gnu/store/h90vnqw0nwd0hhm1l5dgxsdrigddfmq4-glibc-2.28/share/locale/en_US.utf8/LC_MESSAGES/messages.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
>> openat(AT_FDCWD, "/gnu/store/h90vnqw0nwd0hhm1l5dgxsdrigddfmq4-glibc-2.28/share/locale/en_US/LC_MESSAGES/messages.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
>> openat(AT_FDCWD, "/gnu/store/h90vnqw0nwd0hhm1l5dgxsdrigddfmq4-glibc-2.28/share/locale/en.utf8/LC_MESSAGES/messages.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
>> openat(AT_FDCWD, "/gnu/store/h90vnqw0nwd0hhm1l5dgxsdrigddfmq4-glibc-2.28/share/locale/en/LC_MESSAGES/messages.mo", O_RDONLY) = -1 ENOENT (No such file or directory)
>> write(1, "guile", 5guile)                    = 5
>> write(1, " (", 2 ()                       = 2
>> write(1, "GNU Guile", 9GNU Guile)                = 9
>> write(1, ") ", 2) )                       = 2
>> write(1, "2.2.4", 52.2.4)                    = 5
>> […]
>> --8<---------------cut here---------------end--------------->8---
>> 
>> We can recognize th stat/seek/mmap/mprotect sequence, but then the
>> GNU/Linux version keeps going instead of exiting.
>> 
>> Rene, Manolis: any ideas?  :-)
>> 
>
> I don't seem to have access to darnassus any more. I will rebuild the
> bootstrap tarballs and on the weekend I will try them on a local debian
> hurd vm.

Have you been able to track this down yet?

FWIW from my earlier experiments I have a bunch of bootstrap binaries
on berlin.guixsd.org:

rekado@berlin ~$ ls -la /var/www/guix/bootstrap/i586-gnu/20180908/
total 39296
drwxr-xr-x 2 root  root      4096 Sep  8 22:40 ./
drwxr-xr-x 3 nginx users     4096 Sep  8 22:40 ../
-rw-r--r-- 1 nginx users  2210784 Sep  8 11:43 binutils-static-stripped-2.30-i586-pc-gnu.tar.xz
-rw-r--r-- 1 nginx users 19777232 Sep  8 11:41 gcc-stripped-5.5.0-i586-pc-gnu.tar.xz
-rw-r--r-- 1 nginx users  4406880 Sep  8 11:38 glibc-stripped-2.23-i586-pc-gnu.tar.xz
-rw-r--r-- 1 nginx users  5800276 Sep  8 11:37 guile-static-stripped-2.2.3-i586-pc-gnu.tar.xz
-rw-r--r-- 1 nginx users  8013184 Sep  8 11:42 static-binaries-0-i586-pc-gnu.tar.xz

This was with glibc 2.23, so before the great merge.  I don’t know if
these might be useful for you.

-- 
Ricardo

Re: GNU/Hurd update

[Rene]

[-- Attachment #1: trace-xz.log --]
[-- Type: application/octet-stream, Size: 5624 bytes --]

task133(pid17380)->vm_statistics () = 0 {4096 597836 18616 110373 21542 11416724 0 469624 685837 48451490 5501883 2536285 2417490}
task133(pid17380)->vm_map (135712768 134189056 0 0  (null) 0 0 0 7 1) = 0 135712768
task133(pid17380)->vm_map (0 4096 0 0  (null) 0 1 0 0 1) = 0x3 ((os/kern) no space available) 
task133(pid17380)->task_get_special_port (4) = 0    140<--137(pid17380)
  140<--137(pid17380)->exec_startup_get_info () = 0 134514176 134512692 160 8192 16777216 0 "./xz\0--version\0" "SHELL=/bin/bash\0LD_ORIGIN_PATH=/bin\0PWD=/home/jin/glibc-2.28/bin\0LOGNAME=jin\0HOM" {  6<--141(pid17380)   6<--141(pid17380)   6<--141(pid17380)   127<--143(pid17380)} {  106<--144(pid17380)   96<--145(pid17380)   108<--146(pid17380)   142<--147(pid17380)   117<--148(pid17380) (null)} {18 0 0 0 0}
task133(pid17380)->mach_port_deallocate (pn{  4}) = 0 
task133(pid17380)->vm_protect (135712768 4096 0 7) = 0 
thread138(pid17380)->i386_set_gdt (-1 {-780075009 147845654}) = 0 75
task133(pid17380)->mach_port_deallocate (pn{  4}) = 0 
task133(pid17380)->vm_allocate (0 4096 1) = 0 16805888
task133(pid17380)->vm_protect (135716864 135168 0 7) = 0 
task133(pid17380)->vm_allocate (0 8392704 0) = 0x3 ((os/kern) no space available) 
task133(pid17380)->vm_allocate (8392704 8392704 0) = 0x3 ((os/kern) no space available) 
task133(pid17380)->vm_allocate (16785408 8392704 0) = 0x3 ((os/kern) no space available) 
task133(pid17380)->vm_allocate (25178112 8392704 0) = 0 25178112
task133(pid17380)->mach_port_allocate (1) = 0 pn{ 13}
task133(pid17380)->mach_port_insert_right (pn{ 13}  140) = 0 
task133(pid17380)->mach_port_set_qlimit (pn{ 13} 1) = 0 
task133(pid17380)->vm_protect (25178112 1 0 0) = 0 
task133(pid17380)->mach_port_deallocate (pn{  4}) = 0 
task133(pid17380)->mach_port_deallocate (pn{  4}) = 0 
task133(pid17380)->vm_deallocate (8192 16777216) = 0 
task133(pid17380)->vm_allocate (135207848 4096 1) = 0 8192
task133(pid17380)->task_set_special_port (4  (null)) = 0 
task133(pid17380)->mach_port_allocate (1) = 0 pn{ 14}
task133(pid17380)->mach_port_insert_right (pn{ 14}  137) = 0 
task133(pid17380)->vm_allocate (33570816 8392704 0) = 0 33570816
task133(pid17380)->mach_port_allocate (1) = 0 pn{ 15}
task133(pid17380)->mach_port_insert_right (pn{ 15}  150) = 0 
task133(pid17380)->mach_port_set_qlimit (pn{ 15} 1) = 0 
task133(pid17380)->thread_create () = 0    151<--149(pid17380)
task133(pid17380)->vm_protect (33570816 1 0 0) = 0 
thread151(pid17380)->thread_get_state (5 17) = 0 {31 31 31 31 0 0 0 0 0 0 0 0 0 23 512 0 31}
thread151(pid17380)->i386_set_gdt (75 {-339935233 147845654}) = 0 75
thread151(pid17380)->thread_set_state (5 {75 31 31 31 0 0 0 0 0 0 0 0 134646688 23 512 41963500 31}) = 0 
task133(pid17380)->mach_port_deallocate (pn{  4}) = 0 
task133(pid17380)->mach_port_deallocate (pn{  4}) = 0 
thread151(pid17380)->thread_resume () = 0 
task133(pid17380)->task_set_special_port (3    137<--153(pid-1)) = 0 
  142<--147(pid17380)->proc_setmsgport_request (   137<--153(pid-1)) = 0  (null)
  142<--147(pid17380)->proc_set_arg_locations_request (33570260 16785088) = 0 
task133(pid17380)->mach_port_allocate (1) = 0 pn{ 17}
task133(pid17380)->mach_port_allocate (1) = 0 pn{ 18}
task133(pid17380)->mach_port_insert_right (pn{ 17}  154) = 0 
task133(pid17380)->mach_port_set_qlimit (pn{ 18} 1) = 0 
  142<--147(pid17380)->proc_handle_exceptions_request (   154<--156(pid-1)    155<--157(pid-1) 5 {75 31 31 31 0 0 0 0 0 0 0 0 134686960 23 0 135706368 0}) = 0 
thread151(pid17380)->thread_set_special_port (3  156) = 0 
task133(pid17380)->mach_port_deallocate (pn{ 17}) = 0 
  142<--147(pid17380)->proc_getpids_request () = 0 17380 17379 0
  142<--147(pid17380)->proc_getpgrp_request (17380) = 0 17379
task133(pid17380)->vm_deallocate (16801792 20) = 0 
task133(pid17380)->vm_deallocate (16797696 24) = 0 
task133(pid17380)->vm_allocate (32 4096 1) = 0 12288
task133(pid17380)->vm_allocate (12288 4096 1) = 0 16384
  6<--141(pid17380)->term_getctty () = 0    117<--148(pid17380)
task133(pid17380)->mach_port_deallocate (pn{ 11}) = 0 
  6<--141(pid17380)->term_open_ctty (17380 17379) = 0    156<--152(pid17380)
  6<--141(pid17380)->term_getctty () = 0    117<--148(pid17380)
task133(pid17380)->mach_port_deallocate (pn{ 11}) = 0 
  6<--141(pid17380)->term_open_ctty (17380 17379) = 0    158<--154(pid17380)
  6<--141(pid17380)->term_getctty () = 0    117<--148(pid17380)
task133(pid17380)->mach_port_deallocate (pn{ 11}) = 0 
  6<--141(pid17380)->term_open_ctty (17380 17379) = 0    160<--159(pid17380)
  127<--143(pid17380)->term_getctty () = 0xfffffed1 ((ipc/mig) bad request message ID) 
task133(pid17380)->vm_deallocate (16793600 16) = 0 
  108<--146(pid17380)->auth_getids () = 0 1001 {1001 1001} 1001 {1001 1001}
task133(pid17380)->vm_allocate (0 4 1) = 0 20480
task133(pid17380)->vm_allocate (0 8 1) = 0 24576
task133(pid17380)->vm_allocate (0 4 1) = 0 28672
task133(pid17380)->vm_allocate (0 8 1) = 0 32768
task133(pid17380)->vm_allocate (134664831 4096 1) = 0 36864
  96<--145(pid17380)->dir_lookup ("servers/socket/1" 0 0) = 0 1 ""    162<--161(pid17380)
  162<--161(pid17380)->socket_create (1 4096) = 0    164<--163(pid17380)
  162<--161(pid17380)->socket_create (1 4096) = 0    166<--165(pid17380)
  164<--163(pid17380)->socket_connect2 (   166<--165(pid17380)) = 0 
  160<--159(pid17380)->io_write ("./xz: " -1) = 0 6
  160<--159(pid17380)->io_write ("Error creating a pipe: Function not implemented" -1) = 0 47
  160<--159(pid17380)->io_write ("\n" -1) = 0 1
  142<--147(pid17380)->proc_mark_exit_request (256 0) = 0 
task133(pid17380)->task_terminate () = 0 
Child 17380 exited with 1

[-- Attachment #2: Type: text/plain, Size: 559 bytes --]


Hello,

In addition to the problem with static guile in Hurd, the static binary `xz`
shows the following message when trying to check the version. 


--8<---------------cut here---------------start------------->8---
jin@Hurd:~/glibc-2.28/bin$ ./xz --version
./xz: Error creating a pipe: Function not implemented
--8<---------------cut here---------------end--------------->8---

The binarie was generated from current Guix (master branch) in Linux,
with `./pre-inst-env guix build bootstrap-tarballs --target=i586-pc-gnu`.

I attach the rpctrace.

-- 

Rene