guile-hoot install reproducibly crashes at 41% build

guile-hoot install reproducibly crashes at 41% build

[Mortimer Cladwell]

Hi,

I did a git pull https://gitlab.com/spritely/guile-hoot.git
I am following installation instructions at
https://spritely.institute/files/docs/guile-hoot/0.1.0/Installation.html
I am using guix
The first attempt installs lots of stuff but at the build stage crashes at
41%. I need to reboot and retry:

mbc@ins3910:~/projects/guile-hoot$ guix shell
guix shell: loading environment from
'/home/mbc/projects/guile-hoot/guix.scm'...
The following derivation will be built:
  /gnu/store/lfx6a7a16jydk0zzlppwgv9ajsa92wia-v8-11.7-1.155ea5c.drv

building
/gnu/store/lfx6a7a16jydk0zzlppwgv9ajsa92wia-v8-11.7-1.155ea5c.drv...
 41% ▕█████████████████████████████▋
    ▏guix shell: error: corrupt input while restoring archive from
#<closed: file 7f0871094d20>

To recover I must reboot and do a 'guix pull' but I get the same results:
crash at ~41%

I tried:
guix package --delete-generations
guix gc
cd ./projects/guile-hoot
guix shell

Seems to re-initiate the entire build process but same results -crash at
41% build
I am using Ubuntu on an Intel i5-12400 processor with 8GB RAM

Has anyone had success with this install process? Suggestions?
Thanks
Mortimer

Re: guile-hoot install reproducibly crashes at 41% build

[Thompson, David]

Hi Mortimer,

On Fri, Oct 27, 2023 at 7:01 AM Mortimer Cladwell <mbcladwell@gmail.com> wrote:
>
> Hi,
>
> I did a git pull https://gitlab.com/spritely/guile-hoot.git
> I am following installation instructions at
> https://spritely.institute/files/docs/guile-hoot/0.1.0/Installation.html
> I am using guix
> The first attempt installs lots of stuff but at the build stage crashes at
> 41%. I need to reboot and retry:
>
> mbc@ins3910:~/projects/guile-hoot$ guix shell
> guix shell: loading environment from
> '/home/mbc/projects/guile-hoot/guix.scm'...
> The following derivation will be built:
>   /gnu/store/lfx6a7a16jydk0zzlppwgv9ajsa92wia-v8-11.7-1.155ea5c.drv
>
> building
> /gnu/store/lfx6a7a16jydk0zzlppwgv9ajsa92wia-v8-11.7-1.155ea5c.drv...
>  41% ▕█████████████████████████████▋
>     ▏guix shell: error: corrupt input while restoring archive from
> #<closed: file 7f0871094d20>
>
> To recover I must reboot and do a 'guix pull' but I get the same results:
> crash at ~41%
>
> I tried:
> guix package --delete-generations
> guix gc
> cd ./projects/guile-hoot
> guix shell
>
> Seems to re-initiate the entire build process but same results -crash at
> 41% build
> I am using Ubuntu on an Intel i5-12400 processor with 8GB RAM
>
> Has anyone had success with this install process? Suggestions?

Couple of things:

1) The Hoot docs describe building from source via a Git checkout.
That gets you the same environment we use to develop Hoot, but it
requires building V8 which is pretty intense. Looks like that's where
your build is getting stuck. You'll need to increase verbosity to get
a pointer to the build log to see details about the failure. Could be
that 8GB of RAM is simply not enough to build V8.

2) Hoot is available in Guix now. If you just want to use Hoot, just
do `guix shell guile-next guile-hoot`. We'll have this in the manual
for the next release now that it's packaged for Guix officially.

Hope this helps,

- Dave

Re: guile-hoot install reproducibly crashes at 41% build

[Mortimer Cladwell]

Thanks Dave.
I gave 'guix shell guile-next guile-hoot' a try.
Please see the error below: In procedure resolve-interface: no binding
`define-custom-primcall-converter' in module (language tree-il compile-cps)
and note that the reflect.wasm file was not generated.
Thanks
Mortimer

mbc@ins3910:~/projects/guile-hoot$ guix shell guile-next guile-hoot
45.4 MB will be downloaded
 glibc-2.35  8.5MiB
                                       5.5MiB/s 00:02 ▕██████████████████▏
100.0%
 guile-next-3.0.9-0.79e836b  7.2MiB
                                       1.5MiB/s 00:05 ▕██████████████████▏
100.0%
 glibc-2.35-static  1.4MiB
                                        3.8MiB/s 00:00 ▕██████████████████▏
100.0%
 guile-next-3.0.9-0.79e836b-debug  6.9MiB
                                       3.6MiB/s 00:02 ▕██████████████████▏
100.0%
 glibc-2.35-debug  19.3MiB
                                        6.2MiB/s 00:03 ▕██████████████████▏
100.0%
substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
The following derivation will be built:
  /gnu/store/0vyk4cd0y1zj8bkrifmg73hd3jbgjffd-profile.drv

3.4 MB will be downloaded
 module-import-compiled  107KiB
                                       440KiB/s 00:00 ▕██████████████████▏
100.0%
 guile-2.0.14  3.0MiB
                                       1.6MiB/s 00:02 ▕██████████████████▏
100.0%
 module-import-compiled  47KiB
                                        8.3MiB/s 00:00 ▕██████████████████▏
100.0%
 module-import-compiled  57KiB
                                        8.4MiB/s 00:00 ▕██████████████████▏
100.0%
 module-import-compiled  72KiB
                                       10.8MiB/s 00:00 ▕██████████████████▏
100.0%
applying 8 grafts for guile-next-3.0.9-0.79e836b ...
applying 2 grafts for libffi-3.4.4 ...
applying 3 grafts for libfontenc-1.1.4 ...
applying 2 grafts for libgc-8.2.2 ...
applying 2 grafts for libunistring-1.0 ...
applying 8 grafts for mkfontscale-1.2.2 ...
applying 2 grafts for pkg-config-0.29.2 ...
applying 2 grafts for mkfontdir-1.0.7 ...
applying 7 grafts for guile-3.0.9 ...
applying 6 grafts for texinfo-6.8 ...
building CA certificate bundle...
listing Emacs sub-directories...
building fonts directory...
building directory of Info manuals...
building profile with 2 packages...
mbc@ins3910:~/projects/guile-hoot [env]$ guile
GNU Guile 3.0.9
Copyright (C) 1995-2023 Free Software Foundation, Inc.

Guile comes with ABSOLUTELY NO WARRANTY; for details type `,show w'.
This program is free software, and you are welcome to redistribute it
under certain conditions; type `,show c' for details.

Enter `,help' for help.
scheme@(guile-user)> ,use (hoot compile)
While executing meta-command:
In procedure resolve-interface: no binding
`define-custom-primcall-converter' in module (language tree-il compile-cps)
scheme@(guile-user)>  (define the-answer (compile 42))
scheme@(guile-user)> ,use (wasm parse)
scheme@(guile-user)> (define reflector
                       (call-with-input-file
"/home/mbc/projects/guile-hoot/js-runtime/reflect.wasm"
                         parse-wasm))
ice-9/boot-9.scm:1685:16: In procedure raise-exception:
In procedure open-file: No such file or directory:
"/home/mbc/projects/guile-hoot/js-runtime/reflect.wasm"

Entering a new prompt.  Type `,bt' for a backtrace or `,q' to continue.
scheme@(guile-user) [1]>

On Fri, Oct 27, 2023 at 9:22 AM Thompson, David <dthompson2@worcester.edu>
wrote:

> Hi Mortimer,
>
> On Fri, Oct 27, 2023 at 7:01 AM Mortimer Cladwell <mbcladwell@gmail.com>
> wrote:
> >
> > Hi,
> >
> > I did a git pull https://gitlab.com/spritely/guile-hoot.git
> > I am following installation instructions at
> > https://spritely.institute/files/docs/guile-hoot/0.1.0/Installation.html
> > I am using guix
> > The first attempt installs lots of stuff but at the build stage crashes
> at
> > 41%. I need to reboot and retry:
> >
> > mbc@ins3910:~/projects/guile-hoot$ guix shell
> > guix shell: loading environment from
> > '/home/mbc/projects/guile-hoot/guix.scm'...
> > The following derivation will be built:
> >   /gnu/store/lfx6a7a16jydk0zzlppwgv9ajsa92wia-v8-11.7-1.155ea5c.drv
> >
> > building
> > /gnu/store/lfx6a7a16jydk0zzlppwgv9ajsa92wia-v8-11.7-1.155ea5c.drv...
> >  41% ▕█████████████████████████████▋
> >     ▏guix shell: error: corrupt input while restoring archive from
> > #<closed: file 7f0871094d20>
> >
> > To recover I must reboot and do a 'guix pull' but I get the same results:
> > crash at ~41%
> >
> > I tried:
> > guix package --delete-generations
> > guix gc
> > cd ./projects/guile-hoot
> > guix shell
> >
> > Seems to re-initiate the entire build process but same results -crash at
> > 41% build
> > I am using Ubuntu on an Intel i5-12400 processor with 8GB RAM
> >
> > Has anyone had success with this install process? Suggestions?
>
> Couple of things:
>
> 1) The Hoot docs describe building from source via a Git checkout.
> That gets you the same environment we use to develop Hoot, but it
> requires building V8 which is pretty intense. Looks like that's where
> your build is getting stuck. You'll need to increase verbosity to get
> a pointer to the build log to see details about the failure. Could be
> that 8GB of RAM is simply not enough to build V8.
>
> 2) Hoot is available in Guix now. If you just want to use Hoot, just
> do `guix shell guile-next guile-hoot`. We'll have this in the manual
> for the next release now that it's packaged for Guix officially.
>
> Hope this helps,
>
> - Dave
>

Re: guile-hoot install reproducibly crashes at 41% build

[Thompson, David]

Hi again,

I see a couple more issues...

On Fri, Oct 27, 2023 at 3:27 PM Mortimer Cladwell <mbcladwell@gmail.com> wrote:
>
> Thanks Dave.
> I gave 'guix shell guile-next guile-hoot' a try.
> Please see the error below: In procedure resolve-interface: no binding `define-custom-primcall-conver
ter' in module (language tree-il compile-cps) and note that the
reflect.wasm file was not generated.
> Thanks
> Mortimer
>
> mbc@ins3910:~/projects/guile-hoot$ guix shell guile-next guile-hoot
> 45.4 MB will be downloaded
>  glibc-2.35  8.5MiB                                                                                                5.5MiB/s 00:02 ▕██████████████████▏ 100.0%
>  guile-next-3.0.9-0.79e836b  7.2MiB                                                                                1.5MiB/s 00:05 ▕██████████████████▏ 100.0%
>  glibc-2.35-static  1.4MiB                                                                                         3.8MiB/s 00:00 ▕██████████████████▏ 100.0%
>  guile-next-3.0.9-0.79e836b-debug  6.9MiB                                                                          3.6MiB/s 00:02 ▕██████████████████▏ 100.0%
>  glibc-2.35-debug  19.3MiB                                                                                         6.2MiB/s 00:03 ▕██████████████████▏ 100.0%
> substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
> The following derivation will be built:
>   /gnu/store/0vyk4cd0y1zj8bkrifmg73hd3jbgjffd-profile.drv
>
> 3.4 MB will be downloaded
>  module-import-compiled  107KiB                                                                                    440KiB/s 00:00 ▕██████████████████▏ 100.0%
>  guile-2.0.14  3.0MiB                                                                                              1.6MiB/s 00:02 ▕██████████████████▏ 100.0%
>  module-import-compiled  47KiB                                                                                     8.3MiB/s 00:00 ▕██████████████████▏ 100.0%
>  module-import-compiled  57KiB                                                                                     8.4MiB/s 00:00 ▕██████████████████▏ 100.0%
>  module-import-compiled  72KiB                                                                                    10.8MiB/s 00:00 ▕██████████████████▏ 100.0%
> applying 8 grafts for guile-next-3.0.9-0.79e836b ...
> applying 2 grafts for libffi-3.4.4 ...
> applying 3 grafts for libfontenc-1.1.4 ...
> applying 2 grafts for libgc-8.2.2 ...
> applying 2 grafts for libunistring-1.0 ...
> applying 8 grafts for mkfontscale-1.2.2 ...
> applying 2 grafts for pkg-config-0.29.2 ...
> applying 2 grafts for mkfontdir-1.0.7 ...
> applying 7 grafts for guile-3.0.9 ...
> applying 6 grafts for texinfo-6.8 ...
> building CA certificate bundle...
> listing Emacs sub-directories...
> building fonts directory...
> building directory of Info manuals...
> building profile with 2 packages...
> mbc@ins3910:~/projects/guile-hoot [env]$ guile
> GNU Guile 3.0.9

Looks like your shell environment is clobbering the Guix environment.
This is Guile 3.0.9 stable, not the Guile provided by Guile next.  The
version string should look like this:

    guile (GNU Guile) 3.0.9-0.c2cba86

You can try using the --pure or --container flag to isolate guix shell
from the rest of your system more.

> Copyright (C) 1995-2023 Free Software Foundation, Inc.
>
> Guile comes with ABSOLUTELY NO WARRANTY; for details type `,show w'.
> This program is free software, and you are welcome to redistribute it
> under certain conditions; type `,show c' for details.
>
> Enter `,help' for help.
> scheme@(guile-user)> ,use (hoot compile)
> While executing meta-command:
> In procedure resolve-interface: no binding `define-custom-primcall-converter' in module (language tree-il compile-cps)
> scheme@(guile-user)>  (define the-answer (compile 42))
> scheme@(guile-user)> ,use (wasm parse)
> scheme@(guile-user)> (define reflector
>                        (call-with-input-file "/home/mbc/projects/guile-hoot/js-runtime/reflect.wasm"
>                          parse-wasm))

reflect.wasm is a build artifact. Since you haven't built Hoot from
the Git checkout, there is no reflect.wasm for you to use there.
Instead, use the one installed by Guix. The file name for it can be
computed like so:

   echo $(guix build guile-hoot)/share/guile-hoot/js/js-runtime/reflect.wasm

> ice-9/boot-9.scm:1685:16: In procedure raise-exception:
> In procedure open-file: No such file or directory: "/home/mbc/projects/guile-hoot/js-runtime/reflect.wasm"

If you'd like to build Hoot from the Git checkout but skip V8, you
could try this:

  guix shell guile-next autoconf automake pkg-config texinfo

Or remove v8 from the package inputs at the bottom of the guix.scm
file.  We only use V8 for the test suite.

Hope this helps,

- Dave

Re: guile-hoot install reproducibly crashes at 41% build

[Mortimer Cladwell]

Thanks Dave. That did the trick.


mbc@ins3910:~$ guix shell --container guile-next guile-hoot
substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
1.6 MB will be downloaded
 bash-5.1.16-doc  301KiB
                                  365KiB/s 00:01 ▕██████████████████▏ 100.0%
 bash-5.1.16-include  67KiB
                                 3.1MiB/s 00:00 ▕██████████████████▏ 100.0%
applying 4 grafts for bash-5.1.16 ...
mbc@ins3910 ~ [env]$ guile
GNU Guile 3.0.9-0.79e836b
Copyright (C) 1995-2023 Free Software Foundation, Inc.

Guile comes with ABSOLUTELY NO WARRANTY; for details type `,show w'.
This program is free software, and you are welcome to redistribute it
under certain conditions; type `,show c' for details.

Enter `,help' for help.
scheme@(guile-user)> ,use (hoot compile)
scheme@(guile-user)> (define the-answer (compile 42))
WARNING: (guile-user): `compile' imported from both (system base compile)
and (hoot compile)
WARNING: (guile-user): `compile' imported from both (system base compile)
and (hoot compile)
scheme@(guile-user)> ,use (wasm parse)
scheme@(guile-user)> (define reflector
    (call-with-input-file
"/gnu/store/57g1w197sgyk7z8fpr4051j0qrr2m29s-guile-hoot-0.1.0/share/guile-hoot/js/js-runtime/reflect.wasm"
       parse-wasm))
scheme@(guile-user)> ,use (hoot reflect)
scheme@(guile-user)>  (define instance (hoot-instantiate reflector
the-answer))
scheme@(guile-user)> (hoot-load instance)
$1 = 42
scheme@(guile-user)>

On Fri, Oct 27, 2023 at 4:34 PM Thompson, David <dthompson2@worcester.edu>
wrote:

> Hi again,
>
> I see a couple more issues...
>
> On Fri, Oct 27, 2023 at 3:27 PM Mortimer Cladwell <mbcladwell@gmail.com>
> wrote:
> >
> > Thanks Dave.
> > I gave 'guix shell guile-next guile-hoot' a try.
> > Please see the error below: In procedure resolve-interface: no binding
> `define-custom-primcall-conver
> ter' in module (language tree-il compile-cps) and note that the
> reflect.wasm file was not generated.
> > Thanks
> > Mortimer
> >
> > mbc@ins3910:~/projects/guile-hoot$ guix shell guile-next guile-hoot
> > 45.4 MB will be downloaded
> >  glibc-2.35  8.5MiB
>                                           5.5MiB/s 00:02
> ▕██████████████████▏ 100.0%
> >  guile-next-3.0.9-0.79e836b  7.2MiB
>                                           1.5MiB/s 00:05
> ▕██████████████████▏ 100.0%
> >  glibc-2.35-static  1.4MiB
>                                            3.8MiB/s 00:00
> ▕██████████████████▏ 100.0%
> >  guile-next-3.0.9-0.79e836b-debug  6.9MiB
>                                           3.6MiB/s 00:02
> ▕██████████████████▏ 100.0%
> >  glibc-2.35-debug  19.3MiB
>                                            6.2MiB/s 00:03
> ▕██████████████████▏ 100.0%
> > substitute: updating substitutes from 'https://ci.guix.gnu.org'...
> 100.0%
> > The following derivation will be built:
> >   /gnu/store/0vyk4cd0y1zj8bkrifmg73hd3jbgjffd-profile.drv
> >
> > 3.4 MB will be downloaded
> >  module-import-compiled  107KiB
>                                           440KiB/s 00:00
> ▕██████████████████▏ 100.0%
> >  guile-2.0.14  3.0MiB
>                                           1.6MiB/s 00:02
> ▕██████████████████▏ 100.0%
> >  module-import-compiled  47KiB
>                                            8.3MiB/s 00:00
> ▕██████████████████▏ 100.0%
> >  module-import-compiled  57KiB
>                                            8.4MiB/s 00:00
> ▕██████████████████▏ 100.0%
> >  module-import-compiled  72KiB
>                                           10.8MiB/s 00:00
> ▕██████████████████▏ 100.0%
> > applying 8 grafts for guile-next-3.0.9-0.79e836b ...
> > applying 2 grafts for libffi-3.4.4 ...
> > applying 3 grafts for libfontenc-1.1.4 ...
> > applying 2 grafts for libgc-8.2.2 ...
> > applying 2 grafts for libunistring-1.0 ...
> > applying 8 grafts for mkfontscale-1.2.2 ...
> > applying 2 grafts for pkg-config-0.29.2 ...
> > applying 2 grafts for mkfontdir-1.0.7 ...
> > applying 7 grafts for guile-3.0.9 ...
> > applying 6 grafts for texinfo-6.8 ...
> > building CA certificate bundle...
> > listing Emacs sub-directories...
> > building fonts directory...
> > building directory of Info manuals...
> > building profile with 2 packages...
> > mbc@ins3910:~/projects/guile-hoot [env]$ guile
> > GNU Guile 3.0.9
>
> Looks like your shell environment is clobbering the Guix environment.
> This is Guile 3.0.9 stable, not the Guile provided by Guile next.  The
> version string should look like this:
>
>     guile (GNU Guile) 3.0.9-0.c2cba86
>
> You can try using the --pure or --container flag to isolate guix shell
> from the rest of your system more.
>
> > Copyright (C) 1995-2023 Free Software Foundation, Inc.
> >
> > Guile comes with ABSOLUTELY NO WARRANTY; for details type `,show w'.
> > This program is free software, and you are welcome to redistribute it
> > under certain conditions; type `,show c' for details.
> >
> > Enter `,help' for help.
> > scheme@(guile-user)> ,use (hoot compile)
> > While executing meta-command:
> > In procedure resolve-interface: no binding
> `define-custom-primcall-converter' in module (language tree-il compile-cps)
> > scheme@(guile-user)>  (define the-answer (compile 42))
> > scheme@(guile-user)> ,use (wasm parse)
> > scheme@(guile-user)> (define reflector
> >                        (call-with-input-file
> "/home/mbc/projects/guile-hoot/js-runtime/reflect.wasm"
> >                          parse-wasm))
>
> reflect.wasm is a build artifact. Since you haven't built Hoot from
> the Git checkout, there is no reflect.wasm for you to use there.
> Instead, use the one installed by Guix. The file name for it can be
> computed like so:
>
>    echo $(guix build
> guile-hoot)/share/guile-hoot/js/js-runtime/reflect.wasm
>
> > ice-9/boot-9.scm:1685:16: In procedure raise-exception:
> > In procedure open-file: No such file or directory:
> "/home/mbc/projects/guile-hoot/js-runtime/reflect.wasm"
>
> If you'd like to build Hoot from the Git checkout but skip V8, you
> could try this:
>
>   guix shell guile-next autoconf automake pkg-config texinfo
>
> Or remove v8 from the package inputs at the bottom of the guix.scm
> file.  We only use V8 for the test suite.
>
> Hope this helps,
>
> - Dave
>

Re: guile-hoot install reproducibly crashes at 41% build

[Felix Lechner via]

Hi Dave,

On Fri, Oct 27 2023, Thompson, David wrote:

> Or remove v8 from the package inputs at the bottom of the guix.scm
> file.  We only use V8 for the test suite.

I know it's impolite to quote oneself, but please grant me a brief plug
to drop build-time tests everywhere. [1]

Package declarations would list (test-inputs ...) separately. For many
packages, it has the potential to reduce the prerequisites actually
needed to build them.

Kind regards
Felix

[1] https://lists.gnu.org/archive/html/guix-devel/2023-10/msg00060.html

Re: guile-hoot install reproducibly crashes at 41% build

[Thompson, David]

Hi Felix,

On Sat, Oct 28, 2023 at 11:29 PM Felix Lechner
<felix.lechner@lease-up.com> wrote:
>
> Hi Dave,
>
> On Fri, Oct 27 2023, Thompson, David wrote:
>
> > Or remove v8 from the package inputs at the bottom of the guix.scm
> > file.  We only use V8 for the test suite.
>
> I know it's impolite to quote oneself, but please grant me a brief plug
> to drop build-time tests everywhere. [1]
>
> Package declarations would list (test-inputs ...) separately. For many
> packages, it has the potential to reduce the prerequisites actually
> needed to build them.

That's good to know! Thanks for the tip. I'm behind the times on that
detail. In this particular case, though, Mortimer was trying to build
our development environment, in which we definitely want V8.  The
package in Guix core doesn't use it. :)

- Dave

Re: guile-hoot install reproducibly crashes at 41% build

[Felix Lechner via]

Hi Dave,

On Sun, Oct 29 2023, Thompson, David wrote:

> That's good to know! Thanks for the tip. I'm behind the times on that
> detail.

Your humility makes me feel ashamed for confusing you.

My proposal to adopt a framework testing for installed programs similar
to Debian's autopkgtest---while dropping build-time tests in unpacked
source trees---was merely a proposal and received no positive or
supportive comments so far.

Sorry that my message was phrased so carelessly.

Kind regards
Felix