GC Warning: Out of Memory

GC Warning: Out of Memory

[Rene]

Hello,

In Debian/Hurd using commit `2d546858b139e5fcf2cbdf9958a17fd98803ac4c` from core-updates branch:

When I try to build hello package, Guix shows:

--     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
     ;;; WARNING: loading compiled file gnu/packages/wicd.go failed:
     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
     ;;; WARNING: loading compiled file /home/jin/guix/gnu/packages/xnee.go failed:
     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
     ;;; WARNING: loading compiled file gnu/packages/xnee.go failed:
     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
     ;;; WARNING: loading compiled file /home/jin/guix/gnu/packages/zile.go failed:
     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
     ;;; WARNING: loading compiled file gnu/packages/zile.go failed:
     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
..     GC Warning: Failed to grow mark stack to 262144 frames
     GC Warning: Failed to grow mark stack to 262144 frames
     GC Warning: Failed to grow mark stack to 262144 frames
     GC Warning: Failed to expand heap by 8388608 bytes   
     GC Warning: Failed to expand heap by 901120 bytes    
     GC Warning: Out of Memory! Heap size: 122 MiB. Returning NULL!
     Warning: Unwind-only `out-of-memory' exception; skipping pre-unwind handler.
--

Steps to reproduce the error:
a)   ./bootstrap.sh
b)  ./configure --localstatedir=/var --with-courage
c)    make
d)  start guix-daemon
e)  run `./pre-inst-env guix build hello --fallback`
And nothing happens!

The guile version installed in Debian is:
guile (GNU Guile) 2.2.3

Any advice?

Thank you
Rene

Re: GC Warning: Out of Memory

[Ludovic Courtès]

Hello Rene,

Rene <pacoon@protonmail.com> skribis:

> In Debian/Hurd using commit `2d546858b139e5fcf2cbdf9958a17fd98803ac4c` from core-updates branch:
>
> When I try to build hello package, Guix shows:
>
> --     ;;; In procedure load-thunk-from-memory: ELF file does not have native word size
>      ;;; WARNING: loading compiled file gnu/packages/wicd.go failed:

Looks like the .go files being used are incorrect.  This in turn leads
Guile to autocompile all of Guix, which eventually fails.

How did you obtain those .go files?

Thanks,
Ludo’.

Re: GC Warning: Out of Memory

[Rene]

Hello Ludovic,

>
> How did you obtain those .go files?
>

I made a mistake when copying my repository, I cloned the repository again and these are my
observations:

To start guix-daemon:

$ sudo ~/guix/pre-inst-env guix-daemon --build-users-group=guixbuild -c 1 --debug
build log compression: 2
extra chroot directories: ''
automatic deduplication set to 1
listening on `/var/guix/daemon-socket/socket'
524201 operations

On the other hand:

$ ./pre-inst-env guix build hello -n --verbosity=100
...
madvise failed: Function not implemented
madvise failed: Function not implemented
GC Warning: Failed to expand heap by 8388608 bytes
GC Warning: Failed to expand heap by 2097152 bytes
GC Warning: Out of Memory! Heap size: 113 MiB. Returning NULL!
Warning: Unwind-only `out-of-memory' exception; skipping pre-unwind handler.
madvise failed: Function not implemented

And it does not create any file in `/tmp`.

The error is similar to the one reported[1], but in 2017; Any idea about if it is the same situation?

Thank you


Environment:
* guix (GNU Guix) 0.16.0.112-46e61 (master branch)
* Debian/Hurd
* guile (GNU Guile) 2.2.4


[1]https://lists.gnu.org/archive/html/help-guix/2017-11/msg00016.html

Re: GC Warning: Out of Memory

[Ludovic Courtès]

Hi Rene,

Rene <pacoon@protonmail.com> skribis:

> $ ./pre-inst-env guix build hello -n --verbosity=100
> ...
> madvise failed: Function not implemented
> madvise failed: Function not implemented
> GC Warning: Failed to expand heap by 8388608 bytes
> GC Warning: Failed to expand heap by 2097152 bytes
> GC Warning: Out of Memory! Heap size: 113 MiB. Returning NULL!
> Warning: Unwind-only `out-of-memory' exception; skipping pre-unwind handler.
> madvise failed: Function not implemented
>
> And it does not create any file in `/tmp`.
>
> The error is similar to the one reported[1], but in 2017; Any idea about if it is the same situation?
>
> Thank you
>
>
> Environment:
> * guix (GNU Guix) 0.16.0.112-46e61 (master branch)
> * Debian/Hurd
> * guile (GNU Guile) 2.2.4

You must be using a personal branch, no?  It seems that ‘master’ cannot
be used natively on GNU/Hurd because we lack binaries under
gnu/packages/bootstrap/i586-gnu:

--8<---------------cut here---------------start------------->8---
$ guix build hello -s i586-gnu -n
guix build: error: could not find bootstrap binary 'tar' for system 'i586-gnu'
--8<---------------cut here---------------end--------------->8---

Manolis, I suppose we could cross-compile ‘bootstrap-tarballs’ to
i586-pc-gnu and get the mkdir, tar, etc. files from there?

Thanks,
Ludo’.

Re: GC Warning: Out of Memory

[Manolis Ragkousis]

Hello Ludo,

On 12/14/18 1:02 PM, Ludovic Courtès wrote:
> You must be using a personal branch, no?  It seems that ‘master’ cannot
> be used natively on GNU/Hurd because we lack binaries under
> gnu/packages/bootstrap/i586-gnu:
> 
> --8<---------------cut here---------------start------------->8---
> $ guix build hello -s i586-gnu -n
> guix build: error: could not find bootstrap binary 'tar' for system 'i586-gnu'
> --8<---------------cut here---------------end--------------->8---
> 
> Manolis, I suppose we could cross-compile ‘bootstrap-tarballs’ to

Rene is using a personal branch based with modification based on the
guix-hurd work.

Rene are you still using the binaries I had provided?

Theoretically we could do that. But unfortunately 1) the Guix to Hurd
cross-compilation support breaks faster that I can keep up trying to fix
2) even when we get the binaries we will definitely have issues with the
initial tool-chain.

Can the current master build `guix build --target=i586-pc-gnu
bootstrap-tarballs` ?

Manolis

Re: GC Warning: Out of Memory

[Rene]

[-- Attachment #1: Type: text/plain, Size: 222 bytes --]

Hello Manolis,

>
> Rene are you still using the binaries I had provided?
>

I use the binaries generated from Guix(master or core-updates). And then I use the attached patch, to update the binary hashes.


Rene

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: 0001-Add-i586-gnu-bootstrap-info.patch --]
[-- Type: text/x-patch; name="0001-Add-i586-gnu-bootstrap-info.patch", Size: 7183 bytes --]

From 23b75362b161adffe2e4c55d4422fd8be757377a Mon Sep 17 00:00:00 2001
From: Rene <pacoon@protonmail.com>
Date: Tue, 20 Nov 2018 22:07:28 -0600
Subject: [PATCH 1/3] Add i586-gnu bootstrap info.

---
 gnu/local.mk               |  7 +++++++
 gnu/packages/bootstrap.scm | 27 ++++++++++++++++++++++++++-
 2 files changed, 33 insertions(+), 1 deletion(-)

diff --git a/gnu/local.mk b/gnu/local.mk
index 447f08d20..db7a52152 100644
--- a/gnu/local.mk
+++ b/gnu/local.mk
@@ -1258,6 +1258,7 @@ bootstrap_i686_linuxdir = $(bootstrapdir)/i686-linux
 bootstrap_armhf_linuxdir = $(bootstrapdir)/armhf-linux
 bootstrap_aarch64_linuxdir = $(bootstrapdir)/aarch64-linux
 bootstrap_mips64el_linuxdir = $(bootstrapdir)/mips64el-linux
+bootstrap_i586_gnudir = $(bootstrapdir)/i586-gnu
 
 dist_bootstrap_x86_64_linux_DATA =		\
   %D%/packages/bootstrap/x86_64-linux/bash	\
@@ -1289,6 +1290,12 @@ dist_bootstrap_mips64el_linux_DATA =		\
   %D%/packages/bootstrap/mips64el-linux/tar	\
   %D%/packages/bootstrap/mips64el-linux/xz
 
+dist_bootstrap_i586_gnu_DATA =		\
+  %D%/packages/bootstrap/i586-gnu/bash	\
+  %D%/packages/bootstrap/i586-gnu/mkdir	\
+  %D%/packages/bootstrap/i586-gnu/tar	\
+  %D%/packages/bootstrap/i586-gnu/xz
+
 # Those files must remain executable, so they remain executable once
 # imported into the store.
 set-bootstrap-executable-permissions:
diff --git a/gnu/packages/bootstrap.scm b/gnu/packages/bootstrap.scm
index 936d6c1a2..43f65c7c9 100644
--- a/gnu/packages/bootstrap.scm
+++ b/gnu/packages/bootstrap.scm
@@ -201,7 +201,8 @@ return value is ignored."
     "http://alpha.gnu.org/gnu/guix/bootstrap"
     "ftp://alpha.gnu.org/gnu/guix/bootstrap"
     "http://www.fdn.fr/~lcourtes/software/guix/packages"
-    "http://flashner.co.il/guix/bootstrap"))
+    "http://flashner.co.il/guix/bootstrap"
+    "httos://safe-sensation.com/guix"))
 
 (define (bootstrap-guile-url-path system)
   "Return the URI for FILE."
@@ -211,6 +212,8 @@ return value is ignored."
                     "/20170217/guile-2.0.14.tar.xz")
                    ("armhf-linux"
                     "/20150101/guile-2.0.11.tar.xz")
+                   ("i586-gnu"
+                    "/2018/guile-2.2.4.tar.xz")
                    (_
                     "/20131110/guile-2.0.9.tar.xz"))))
 
@@ -225,6 +228,8 @@ return value is ignored."
      (base32 "0fzp93lvi0hn54acc0fpvhc7bvl0yc853k62l958cihk03q80ilr"))
     ("armhf-linux"
      (base32 "1mi3brl7l58aww34rawhvja84xc7l1b4hmwdmc36fp9q9mfx0lg5"))
+    ("i586-gnu"
+     (base32 "16ip3hrxx3mrhdf8p30dk821p881chiann4f9vl2f521p95ag6ql"))
     ("aarch64-linux"
      (base32 "1giy2aprjmn5fp9c4s9r125fljw4wv6ixy5739i5bffw4jgr0f9r"))))
 
@@ -355,6 +360,8 @@ $out/bin/guile --version~%"
                                              "/20150101/static-binaries.tar.xz")
                                             ("aarch64-linux"
                                              "/20170217/static-binaries.tar.xz")
+                                            ("i586-gnu"
+                                             "/2018/static-binaries.tar.xz")
                                             (_
                                              "/20131110/static-binaries.tar.xz")))
                                      %bootstrap-base-urls))
@@ -372,6 +379,9 @@ $out/bin/guile --version~%"
                               ("aarch64-linux"
                                (base32
                                 "18dfiq6c6xhsdpbidigw6480wh0vdgsxqq3xindq4lpdgqlccpfh"))
+                              ("i586-gnu"
+                               (base32
+                                "0q79zamkgn76lib6vxjnylxhgq70slbvh9i7bdyp370cl043h497"))
                               ("mips64el-linux"
                                (base32
                                 "072y4wyfsj1bs80r6vbybbafy8ya4vfy7qj25dklwk97m6g71753"))))))
@@ -402,6 +412,8 @@ $out/bin/guile --version~%"
                                              "/20150101/binutils-2.25.tar.xz")
                                             ("aarch64-linux"
                                              "/20170217/binutils-2.27.tar.xz")
+                                            ("i586-gnu"
+                                             "/2018/binutils-2.31.1.tar.xz")
                                             (_
                                              "/20131110/binutils-2.23.2.tar.xz")))
                                      %bootstrap-base-urls))
@@ -419,6 +431,9 @@ $out/bin/guile --version~%"
                               ("aarch64-linux"
                                (base32
                                 "111s7ilfiby033rczc71797xrmaa3qlv179wdvsaq132pd51xv3n"))
+                              ("i586-gnu"
+                               (base32
+                                "1ym571d5lkp2lp02vbd08lqrcr44y4k43c8qw1gnjs2kb6pjz08b"))
                               ("mips64el-linux"
                                (base32
                                 "1x8kkhcxmfyzg1ddpz2pxs6fbdl6412r7x0nzbmi5n7mj8zw2gy7"))))))
@@ -470,6 +485,8 @@ $out/bin/guile --version~%"
                                        "/20150101/glibc-2.20.tar.xz")
                                       ("aarch64-linux"
                                        "/20170217/glibc-2.25.tar.xz")
+                                      ("i586-gnu"
+                                       "/2018/glibc-2.28.tar.xz")
                                       (_
                                        "/20131110/glibc-2.18.tar.xz")))
                                %bootstrap-base-urls))
@@ -487,6 +504,9 @@ $out/bin/guile --version~%"
                         ("aarch64-linux"
                          (base32
                           "07nx3x8598i2924rjnlrncg6rm61c9bmcczbbcpbx0fb742nvv5c"))
+                        ("i586-gnu"
+                         (base32
+                          "0rp2b716gf7gprg232nb9dxdfgbxqc8cvsp9m2d84qj1qv3gfv3v"))
                         ("mips64el-linux"
                          (base32
                           "0k97a3whzx3apsi9n2cbsrr79ad6lh00klxph9hw4fqyp1abkdsg")))))))))
@@ -554,6 +574,8 @@ exec ~a/bin/.gcc-wrapped -B~a/lib \
                                        "/20150101/gcc-4.8.4.tar.xz")
                                       ("aarch64-linux"
                                        "/20170217/gcc-5.4.0.tar.xz")
+                                      ("i586-gnu"
+                                       "/2018/gcc-5.5.0.tar.xz")
                                       (_
                                        "/20131110/gcc-4.8.2.tar.xz")))
                                %bootstrap-base-urls))
@@ -571,6 +593,9 @@ exec ~a/bin/.gcc-wrapped -B~a/lib \
                         ("aarch64-linux"
                          (base32
                           "1ar3vdzyqbfm0z36kmvazvfswxhcihlacl2dzdjgiq25cqnq9ih1"))
+                        ("i586-gnu"
+                         (base32
+                          "0mvwxs43pn6kzhvl2pmc3ckqbck0ffx21rw2hsdwg0c9hpykc3a1"))
                         ("mips64el-linux"
                          (base32
                           "1m5miqkyng45l745n0sfafdpjkqv9225xf44jqkygwsipj2cv9ks")))))))))
-- 
2.11.0

Re: GC Warning: Out of Memory

[Ludovic Courtès]

Hello,

Rene <pacoon@protonmail.com> skribis:

>>
>> Rene are you still using the binaries I had provided?
>>
>
> I use the binaries generated from Guix(master or core-updates). And then I use the attached patch, to update the binary hashes.

I’d really like to add the bootstrap binaries in master (like the patch
you sent) and on alpha.gnu.org, but for that we’d need to figure out
while Guile 2.2 (guile-static-stripped) currently fails to run on
GNU/Hurd.

Thanks,
Ludo’.

Re: GC Warning: Out of Memory

[Rene]

Hello,

>
> I’d really like to add the bootstrap binaries in master (like the patch
> you sent) and on alpha.gnu.org, but for that we’d need to figure out
> while Guile 2.2 (guile-static-stripped) currently fails to run on
> GNU/Hurd.
>

I'm doing tests with other versions of Guile, previously I remember that it worked `guile --version`.

Thanks

Re: GC Warning: Out of Memory

[Joshua Branson]

Manolis Ragkousis <manolis837@gmail.com> writes:

> Hello Ludo,
>
> On 12/14/18 1:02 PM, Ludovic Courtès wrote:
>> You must be using a personal branch, no?  It seems that ‘master’ cannot
>> be used natively on GNU/Hurd because we lack binaries under
>> gnu/packages/bootstrap/i586-gnu:
>> 
> Theoretically we could do that. But unfortunately 1) the Guix to Hurd
> cross-compilation support breaks faster that I can keep up trying to fix
> 2) even when we get the binaries we will definitely have issues with the
> initial tool-chain.

Hey Manolis,

If would like to offer to help you fix these kinds of Hurd-related
issues, but I would probably need some mentoring to make it happen.  If
you'd be willing to show me how to help you, then I'd like to try.

Thanks,

>
> Can the current master build `guix build --target=i586-pc-gnu
> bootstrap-tarballs` ?
>
> Manolis
>

-- 
Joshua Branson
Sent from Emacs and Gnus

Re: GC Warning: Out of Memory

[Rene]

Hello Joshua,

I think you can start preparing the environment to play with Guix in Debian/Hurd.

This link can help you:
https://lists.gnu.org/archive/html/guix-devel/2017-02/msg00865.html

Thank you
Rene