bug#30602: guix pull failures at and after 0458ab53f6ab58c42f379b8e7d55d130df4232e3

bug#30602: guix pull failures at and after 0458ab53f6ab58c42f379b8e7d55d130df4232e3

[Alex ter Weele]

Hello,

I and at least one other person on #guix observered guix pull failing
around 2018-02-25. I am using this commit:

    $ guix --version
    guix (GNU Guix) f09cb93e3a2310f7726cb98fa5679c1a8483c39f
    Copyright (C) 2018 the Guix authors
    License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
    This is free software: you are free to change and redistribute it.
    There is NO WARRANTY, to the extent permitted by law.


Pulling commit 0458ab53f6ab58c42f379b8e7d55d130df4232e3 is failing
reliably for me, but other people were unable to reproduce. Here is the
output:

    $ guix pull --commit=0458ab53f6ab58c42f379b8e7d55d130df4232e3
    Updating from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
    Building from Git commit 0458ab53f6ab58c42f379b8e7d55d130df4232e3...
    substitute: updating list of substitutes from 'https://mirror.hydra.gnu.org'... 100.0%
    The following derivation will be built:
    /gnu/store/ciawm53ygcvs7gfpb54wpzb4kkgnag9i-guix-latest.drv
    copying and compiling to '/gnu/store/r82flrikwwd6ir0qlbc8ssm1n1m2z9dw-guix-latest' with Guile 2.2.3...
    loading...       25.9% of 667 filesrandom seed for tests: 1519531629
    compiling...    100.0% of 667 files
    Backtrace:
    Exception thrown while printing backtrace:
    In procedure public-lookup: Module named (system repl debug) does not exist


    Some deprecated features have been used.  Set the environment
    variable GUILE_WARN_DEPRECATED to "detailed" and rerun the
    program to get more information.  Set it to "no" to suppress
    this message.
    builder for `/gnu/store/ciawm53ygcvs7gfpb54wpzb4kkgnag9i-guix-latest.drv' failed with exit code 1
    guix pull: error: build failed: build of `/gnu/store/ciawm53ygcvs7gfpb54wpzb4kkgnag9i-guix-latest.drv' failed

Pulling the current tip also fails:

    $ guix pull --commit=0181df537ffb4e4273b2ca005738fdb7bd3d73f5
    Updating from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
    Building from Git commit 0181df537ffb4e4273b2ca005738fdb7bd3d73f5...
    The following derivation will be built:
    /gnu/store/l4zlr66svshwhp5mmv597mr0s5rj3hvi-guix-latest.drv
    copying and compiling to '/gnu/store/aqqlcynpjv7lm0f6icvg35m2nvp05vrg-guix-latest' with Guile 2.2.3...
    loading...       25.9% of 667 filesrandom seed for tests: 1519530903
    compiling...    100.0% of 667 files
    Backtrace:
    Exception thrown while printing backtrace:
    In procedure public-lookup: Module named (system repl debug) does not exist


    Some deprecated features have been used.  Set the environment
    variable GUILE_WARN_DEPRECATED to "detailed" and rerun the
    program to get more information.  Set it to "no" to suppress
    this message.
    builder for `/gnu/store/l4zlr66svshwhp5mmv597mr0s5rj3hvi-guix-latest.drv' failed with exit code 1
    guix pull: error: build failed: build of `/gnu/store/l4zlr66svshwhp5mmv597mr0s5rj3hvi-guix-latest.drv' failed

I tried to reproduce the problem by building locally, but a clean build
from that commit succeeds.

    git rev-parse HEAD && guix environment guix -- make -j4
    0458ab53f6ab58c42f379b8e7d55d130df4232e3
    GEN      doc/os-config-bare-bones.texi
    GEN      doc/os-config-lightweight-desktop.texi
    GEN      nix/libstore/schema.sql.hh
    GEN      doc/os-config-desktop.texi
    echo 0.14.0.2563-0458a > ".version-t" && mv ".version-t" ".version"
    make  all-recursive
    make[1]: Entering directory '/home/alex/src/guix'
    ...
    Some deprecated features have been used.  Set the environment
    variable GUILE_WARN_DEPRECATED to "detailed" and rerun the
    program to get more information.  Set it to "no" to suppress
    this message.
    make[2]: Leaving directory '/home/alex/src/guix'
    make[1]: Leaving directory '/home/alex/src/guix'

    Compilation finished at Sat Feb 24 22:31:18

Anything else I can try? The commits in question have nothing to do with
the mechanics of guix pull, AFAICT, which makes this even stranger.

bug#30602: Status: guix pull failures at and after 0458ab53f6ab58c42f379b8e7d55d130df4232e3

[Alex ter Weele]

I pulled an earlier commit to sanity-check myself:

    $ guix pull --commit=5a227e7c5c2054af036d95895c92dd56ec88338d
    Updating from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
    Building from Git commit 5a227e7c5c2054af036d95895c92dd56ec88338d...
    substitute: updating list of substitutes from 'https://mirror.hydra.gnu.org'... 100.0%
    The following derivation will be built:
    /gnu/store/lgk59hz0ca5zff7ffcxmicyvr8146gb9-guix-latest.drv
    copying and compiling to '/gnu/store/ix9nini4rs7b4m5k335vdbdhz303f4lh-guix-latest' with Guile 2.2.3...
    loading...	 25.9% of 667 filesrandom seed for tests: 1519536908
    compiling...	100.0% of 667 files

    Some deprecated features have been used.  Set the environment
    variable GUILE_WARN_DEPRECATED to "detailed" and rerun the
    program to get more information.  Set it to "no" to suppress
    this message.
    updated GNU Guix successfully deployed under `/home/alex/.config/guix/latest'

Then I pulled again to get the tip of the repository, and it worked:

    $ guix pull
    Updating from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
    Building from Git commit 0181df537ffb4e4273b2ca005738fdb7bd3d73f5...
    substitute: updating list of substitutes from 'https://mirror.hydra.gnu.org'... 100.0%
    The following derivation will be built:
    /gnu/store/l4zlr66svshwhp5mmv597mr0s5rj3hvi-guix-latest.drv
    copying and compiling to '/gnu/store/aqqlcynpjv7lm0f6icvg35m2nvp05vrg-guix-latest' with Guile 2.2.3...
    loading...	 25.9% of 667 filesrandom seed for tests: 1519538816
    compiling...	100.0% of 667 files

    Some deprecated features have been used.  Set the environment
    variable GUILE_WARN_DEPRECATED to "detailed" and rerun the
    program to get more information.  Set it to "no" to suppress
    this message.
    updated GNU Guix successfully deployed under `/home/alex/.config/guix/latest'
    $ guix --version
    guix (GNU Guix) 0181df537ffb4e4273b2ca005738fdb7bd3d73f5
    Copyright (C) 2018 the Guix authors
    License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
    This is free software: you are free to change and redistribute it.
    There is NO WARRANTY, to the extent permitted by law.

bug#30602: guix pull failures at and after 0458ab53f6ab58c42f379b8e7d55d130df4232e3

[Ludovic Courtès]

Hi Alex,

Alex ter Weele <alex.ter.weele@gmail.com> skribis:

>     The following derivation will be built:
>     /gnu/store/ciawm53ygcvs7gfpb54wpzb4kkgnag9i-guix-latest.drv
>     copying and compiling to '/gnu/store/r82flrikwwd6ir0qlbc8ssm1n1m2z9dw-guix-latest' with Guile 2.2.3...
>     loading...       25.9% of 667 filesrandom seed for tests: 1519531629
>     compiling...    100.0% of 667 files
>     Backtrace:
>     Exception thrown while printing backtrace:
>     In procedure public-lookup: Module named (system repl debug) does not exist

I’m afraid this is a non-deterministic build failure having to do with
multithreading in the compilation process.

Let’s see what can be done…

Thanks,
Ludo’.

bug#30602: guix pull failures at and after 0458ab53f6ab58c42f379b8e7d55d130df4232e3

[Ludovic Courtès]

Hi again,

Alex ter Weele <alex.ter.weele@gmail.com> skribis:

>     The following derivation will be built:
>     /gnu/store/ciawm53ygcvs7gfpb54wpzb4kkgnag9i-guix-latest.drv
>     copying and compiling to '/gnu/store/r82flrikwwd6ir0qlbc8ssm1n1m2z9dw-guix-latest' with Guile 2.2.3...
>     loading...       25.9% of 667 filesrandom seed for tests: 1519531629
>     compiling...    100.0% of 667 files
>     Backtrace:
>     Exception thrown while printing backtrace:
>     In procedure public-lookup: Module named (system repl debug) does not exist

Looking more closely, (system repl debug) is used in one place, (guix ui),
where it’s an #:autoload.

Here the (guix ui) code is failing to load that module, and thus failing
to provide a good backtrace and error message.

However I’m unclear whether the error is on the client side (the ‘guix
pull’ process), or whether it’s on the build side (in the guile process
that builds the derivation.)

Can you paste the output of:

  cat $(guix build --log-file /gnu/store/ciawm53ygcvs7gfpb54wpzb4kkgnag9i-guix-latest.drv)

?

Thanks,
Ludo’.

bug#30602: guix pull failures at and after 0458ab53f6ab58c42f379b8e7d55d130df4232e3

[Alex ter Weele]

Here it is:

    $ bzcat $(guix build --log-file /gnu/store/ciawm53ygcvs7gfpb54wpzb4kkgnag9i-guix-latest.drv)
    copying and compiling to '/gnu/store/r82flrikwwd6ir0qlbc8ssm1n1m2z9dw-guix-latest' with Guile 2.2.3...
    loading...	 25.9% of 667 filesrandom seed for tests: 1519531629
    compiling...	100.0% of 667 files
    Backtrace:
    Exception thrown while printing backtrace:
    In procedure public-lookup: Module named (system repl debug) does not exist


    Some deprecated features have been used.  Set the environment
    variable GUILE_WARN_DEPRECATED to "detailed" and rerun the
    program to get more information.  Set it to "no" to suppress
    this message.

bug#30602: guix pull failures at and after 0458ab53f6ab58c42f379b8e7d55d130df4232e3

[Ludovic Courtès]

Hello,

Alex ter Weele <alex.ter.weele@gmail.com> skribis:

>     $ bzcat $(guix build --log-file /gnu/store/ciawm53ygcvs7gfpb54wpzb4kkgnag9i-guix-latest.drv)
>     copying and compiling to '/gnu/store/r82flrikwwd6ir0qlbc8ssm1n1m2z9dw-guix-latest' with Guile 2.2.3...
>     loading...	 25.9% of 667 filesrandom seed for tests: 1519531629
>     compiling...	100.0% of 667 files
>     Backtrace:
>     Exception thrown while printing backtrace:
>     In procedure public-lookup: Module named (system repl debug) does not exist

With Guile 2.2.4, which includes several thread-safety fixes in the
module system and VM, and which ‘guix pull’ uses since commit
084f64cb032b6ab4ce326b088d230bd1ead53ee2, the problem appears to be
gone.

Closing!

Ludo’.