bug#40518: guix pull: Dependency guix-packages-base fails

bug#40518: guix pull: Dependency guix-packages-base fails

[elaexuotee--- via Bug reports for GNU Guix]

[-- Attachment #1.1: Type: text/plain, Size: 1451 bytes --]

From a relatively fresh system install, guix pull fails with the following error:

    |   @ build-started /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv - x86_64-linux /var/log/guix/drvs/wa//isnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv.bz2 2701
    Backtrace:
               1 (primitive-load "/home/x/.config/guix/current/bin/guix")
    In guix/ui.scm:
      1936:12  0 (run-guix-command _ . _)
    
    guix/ui.scm:1936:12: In procedure run-guix-command:
    In procedure struct-vtable: Wrong type argument in position 1 (expecting struct): #f

Attached is the full output of `guix build --debug=3'. The contents of
/var/log/guix/drvs/wa//isnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv.bz2
consist of just the single following line:

    [280/554] compiling...    1.1% of 277 files

Finally, my current generation is as follows:

    x@nash ~$ guix describe
    Generation 1     4月 08 2020 21:11:46   (current)
      guix 8c04471
        repository URL: https://git.savannah.gnu.org/git/guix.git
        branch: master
        commit: 8c04471f2403f05bcbea740e3722030e2b8311ec

This is my first bug report here, so if the above is grossly inadequate, I apologize.
Previously, on a different system, I encountered a similar issue and was able to
work around it by pulling twice, once with --commit=8c88e24229 and once normally.
This was suggested by brendyyn on #guix.

Cheers!


[-- Attachment #1.2: pull.log --]
[-- Type: text/plain, Size: 2929 bytes --]

Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
Building from this channel:
  guix      https://git.savannah.gnu.org/git/guix.git	7bc7102
Computing Guix derivation for 'x86_64-linux'...  
The following derivations will be built:
   /gnu/store/zi8g9y7199ykhijgrqck7njwd72ir5p1-profile.drv
   /gnu/store/pfj9zf11wjpw0sww9klbajn7h3jzpx6d-guix-7bc71025c.drv
   /gnu/store/6f8kf80j5922s54sfb16mnj1dbwzxckh-guix-command.drv
   /gnu/store/vq91v03qz8xin19044wzl0fkygz2wppb-guix-module-union.drv
   /gnu/store/dip3zigki8rl5dj2w92j08wz250y5w38-guix-7bc71025c-modules.drv
   /gnu/store/4836hfb7pziyb7g6xxzmh1gmc2yhaa5p-guix-system-tests-modules.drv
   /gnu/store/2r9r8nf3s10zf3iyxw40nrjxbwp0gilb-guix-system-tests.drv
   /gnu/store/1kng78420lr18zabfl2g468rasi14n98-guix-system.drv
   /gnu/store/8c576bfw3ga5vb4ldyizjpc3vgnbvss5-guix-packages.drv
   /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv
   /gnu/store/lrss9p0iah2f6r21k5lh7ahn5bilgqlr-guix-cli.drv
   /gnu/store/5rqww0gfrqilvl44zi2psc8i7rbip1sp-guix-packages-base-modules.drv
   /gnu/store/668ydaglhfdrliw8rari7m9rdfkv8bgr-guix-system-modules.drv
   /gnu/store/fyjdc9qwz1am2gaavdfm4am6l84snrbs-guix-cli-modules.drv
   /gnu/store/q851snasfkv2gf27nivrzldykhv1g42d-guix-config-modules.drv
   /gnu/store/mlfqpizm70bbbxn6lqr1ssaa51n5r5dp-guix-config-source.drv
   /gnu/store/s16fcsxckhd790c04db4mmckrbmp3i63-config.scm.drv
   /gnu/store/w0jmhj5ndvy40bxk0krmqs8lls1zbs1l-guix-config.drv
   /gnu/store/w8dpdp6ncka9cc1kmcljpv7cwh46frml-guix-packages-modules.drv
   /gnu/store/9v4nmfqq16paw0sjc5l1354pjf453w7y-guix-daemon.drv
   /gnu/store/1wd5h5p2chik2if1kq31qpnj8c52ihmp-profile.drv
   /gnu/store/q72cl0pv2q6c5qd1ngj129zm2mdaqwr5-inferior-script.scm.drv
The following profile hooks will be built:
   /gnu/store/09w0hkgciyx5l3jjkghxirqi75rd02aq-manual-database.drv
   /gnu/store/icjxqlrisjk5w21n4ml032j6yid3nahz-info-dir.drv
   /gnu/store/jp324wgx6vnx1igb8g9z75gbipadjxyg-ca-certificate-bundle.drv
   /gnu/store/p4fc6mc77bfb8d86fpijm40dpbcngbx6-guix-package-cache.drv
   /gnu/store/zrhfp01i61d8s6lgppccpvmg8b4kc1f7-fonts-dir.drv
building path(s) `/gnu/store/fvj5xn5ymk486abbppv9csdnlc106fwp-guix-packages-base'
|   setting up chroot environment in `/gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv.chroot'
|   executing builder `/gnu/store/5780x8w59lg898p9a45c2i18lx6r25yb-guile-next-3.0.2/bin/guile'
|   @ build-started /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv - x86_64-linux /var/log/guix/drvs/wa//isnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv.bz2 2701
Backtrace:
           1 (primitive-load "/home/x/.config/guix/current/bin/guix")
In guix/ui.scm:
  1936:12  0 (run-guix-command _ . _)

guix/ui.scm:1936:12: In procedure run-guix-command:
In procedure struct-vtable: Wrong type argument in position 1 (expecting struct): #f

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

bug#40518: guix pull: Dependency guix-packages-base fails

[Ludovic Courtès]

Hello,

elaexuotee--- via Bug reports for GNU Guix <bug-guix@gnu.org> skribis:

>     guix/ui.scm:1936:12: In procedure run-guix-command:
>     In procedure struct-vtable: Wrong type argument in position 1 (expecting struct): #f
>
> Attached is the full output of `guix build --debug=3'. The contents of
> /var/log/guix/drvs/wa//isnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv.bz2
> consist of just the single following line:

I’m pretty sure the issue is caused by ‘--debug=3’.  Could you try
simply:

  guix build /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv

?

I thought there was an open bug report about this issue but I can’t find it.

In short, ‘--debug’ is almost never something you want to use, even as a
Guix developer.

Thanks in advance,
Ludo’.

bug#40518: guix pull: Dependency guix-packages-base fails

[elaexuotee--- via Bug reports for GNU Guix]

[-- Attachment #1.1: Type: text/plain, Size: 1587 bytes --]

> I’m pretty sure the issue is caused by ‘--debug=3’.  Could you try
> simply:
>
>   guix build /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv

Oh! I had no idea the --debug flag could affect build success. The original issue I
encountered was with a plain `guix pull', but in an attempt to provide the most useful
diagnostics, I tried including --debug=3. In any event, it just so happens that I
saved the output from the original pull command, which I am attaching in case it
happens to prove helpful.

As it turns out, I tried another pull just a bit earlier, which ended up succeeding;
however, I went ahead and tried running the build you suggest like this:

    $ guix pull -S 1  # broken build happened with generation 1
    $ guix build --check /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv
    The following derivation will be built:
       /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv
    building /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv...
    [321/554] compiling...   15.9% of 277 filesbuilder for `/gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv' failed due to signal 9 (Killed)
    build of /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv failed
    View build log at '/var/log/guix/drvs/wa/isnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv.bz2'.
    guix build: error: build of `/gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv' failed

What could be causing the build to receive SIGKILL?


[-- Attachment #1.2: pull.log --]
[-- Type: text/plain, Size: 4034 bytes --]

x@gnu ~$ guix pull
Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
Building from this channel:
  guix      https://git.savannah.gnu.org/git/guix.git   7bc7102
Computing Guix derivation for 'x86_64-linux'... |
substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
The following derivations will be built:
   /gnu/store/zi8g9y7199ykhijgrqck7njwd72ir5p1-profile.drv
   /gnu/store/pfj9zf11wjpw0sww9klbajn7h3jzpx6d-guix-7bc71025c.drv
   /gnu/store/6f8kf80j5922s54sfb16mnj1dbwzxckh-guix-command.drv
   /gnu/store/vq91v03qz8xin19044wzl0fkygz2wppb-guix-module-union.drv
   /gnu/store/dip3zigki8rl5dj2w92j08wz250y5w38-guix-7bc71025c-modules.drv
   /gnu/store/4836hfb7pziyb7g6xxzmh1gmc2yhaa5p-guix-system-tests-modules.drv
   /gnu/store/2r9r8nf3s10zf3iyxw40nrjxbwp0gilb-guix-system-tests.drv
   /gnu/store/1kng78420lr18zabfl2g468rasi14n98-guix-system.drv
   /gnu/store/8c576bfw3ga5vb4ldyizjpc3vgnbvss5-guix-packages.drv
   /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv
   /gnu/store/lrss9p0iah2f6r21k5lh7ahn5bilgqlr-guix-cli.drv
   /gnu/store/5rqww0gfrqilvl44zi2psc8i7rbip1sp-guix-packages-base-modules.drv
   /gnu/store/668ydaglhfdrliw8rari7m9rdfkv8bgr-guix-system-modules.drv
   /gnu/store/fyjdc9qwz1am2gaavdfm4am6l84snrbs-guix-cli-modules.drv
   /gnu/store/q851snasfkv2gf27nivrzldykhv1g42d-guix-config-modules.drv
   /gnu/store/mlfqpizm70bbbxn6lqr1ssaa51n5r5dp-guix-config-source.drv
   /gnu/store/s16fcsxckhd790c04db4mmckrbmp3i63-config.scm.drv
   /gnu/store/w0jmhj5ndvy40bxk0krmqs8lls1zbs1l-guix-config.drv
   /gnu/store/w8dpdp6ncka9cc1kmcljpv7cwh46frml-guix-packages-modules.drv
   /gnu/store/9v4nmfqq16paw0sjc5l1354pjf453w7y-guix-daemon.drv
   /gnu/store/1wd5h5p2chik2if1kq31qpnj8c52ihmp-profile.drv
   /gnu/store/q72cl0pv2q6c5qd1ngj129zm2mdaqwr5-inferior-script.scm.drv
The following profile hooks will be built:
   /gnu/store/09w0hkgciyx5l3jjkghxirqi75rd02aq-manual-database.drv
   /gnu/store/icjxqlrisjk5w21n4ml032j6yid3nahz-info-dir.drv
   /gnu/store/jp324wgx6vnx1igb8g9z75gbipadjxyg-ca-certificate-bundle.drv
   /gnu/store/p4fc6mc77bfb8d86fpijm40dpbcngbx6-guix-package-cache.drv
   /gnu/store/zrhfp01i61d8s6lgppccpvmg8b4kc1f7-fonts-dir.drv
building /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv...
 51% [###############################################################################################################                                                                                                             ]builder for `/gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv' failed due to signal 9 (Killed)
build of /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv failed
View build log at '/var/log/guix/drvs/wa/isnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv.bz2'.
building /gnu/store/s16fcsxckhd790c04db4mmckrbmp3i63-config.scm.drv...
cannot build derivation `/gnu/store/lrss9p0iah2f6r21k5lh7ahn5bilgqlr-guix-cli.drv': 1 dependencies couldn't be built
cannot build derivation `/gnu/store/5rqww0gfrqilvl44zi2psc8i7rbip1sp-guix-packages-base-modules.drv': 1 dependencies couldn't be built
cannot build derivation `/gnu/store/8c576bfw3ga5vb4ldyizjpc3vgnbvss5-guix-packages.drv': 1 dependencies couldn't be built
cannot build derivation `/gnu/store/2r9r8nf3s10zf3iyxw40nrjxbwp0gilb-guix-system-tests.drv': 1 dependencies couldn't be built
cannot build derivation `/gnu/store/1kng78420lr18zabfl2g468rasi14n98-guix-system.drv': 1 dependencies couldn't be built
cannot build derivation `/gnu/store/dip3zigki8rl5dj2w92j08wz250y5w38-guix-7bc71025c-modules.drv': 1 dependencies couldn't be built
cannot build derivation `/gnu/store/pfj9zf11wjpw0sww9klbajn7h3jzpx6d-guix-7bc71025c.drv': 1 dependencies couldn't be built
cannot build derivation `/gnu/store/zi8g9y7199ykhijgrqck7njwd72ir5p1-profile.drv': 1 dependencies couldn't be built
guix pull: error: build of `/gnu/store/zi8g9y7199ykhijgrqck7njwd72ir5p1-profile.drv' failed

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

bug#40518: guix pull: Dependency guix-packages-base fails

[Ludovic Courtès]

elaexuotee@wilsonb.com skribis:

>> I’m pretty sure the issue is caused by ‘--debug=3’.  Could you try
>> simply:
>>
>>   guix build /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv
>
> Oh! I had no idea the --debug flag could affect build success. The original issue I
> encountered was with a plain `guix pull', but in an attempt to provide the most useful
> diagnostics, I tried including --debug=3. In any event, it just so happens that I
> saved the output from the original pull command, which I am attaching in case it
> happens to prove helpful.

Yeah, that ‘--debug=3’ leads to breakage is a bug.

> As it turns out, I tried another pull just a bit earlier, which ended up succeeding;
> however, I went ahead and tried running the build you suggest like this:
>
>     $ guix pull -S 1  # broken build happened with generation 1
>     $ guix build --check /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv
>     The following derivation will be built:
>        /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv
>     building /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv...
>     [321/554] compiling...   15.9% of 277 filesbuilder for `/gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv' failed due to signal 9 (Killed)
>     build of /gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv failed
>     View build log at '/var/log/guix/drvs/wa/isnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv.bz2'.
>     guix build: error: build of `/gnu/store/waisnnl9nbmlbpfwbn50pif79fsdknf9-guix-packages-base.drv' failed
>
> What could be causing the build to receive SIGKILL?

It could be an out-of-memory (OOM) condition: this build phase is
unfortunately very demanding currently (at least 2 GiB or RAM I think).
How much RAM do you have?

(Of course it’s OK if you get substitutes for that and don’t have to
build it locally, which hopefully is often the case.)

Thanks,
Ludo’.

bug#40518: guix pull: Dependency guix-packages-base fails

[elaexuotee--- via Bug reports for GNU Guix]

[-- Attachment #1.1: Type: text/plain, Size: 528 bytes --]

> It could be an out-of-memory (OOM) condition: this build phase is
> unfortunately very demanding currently (at least 2 GiB or RAM I think).
> How much RAM do you have?

I think we have a winner. This is running on a VM and I just realized it
it only runs with 500MB of ram.

So, if I am understanding correctly, for some reason the original pull
didn't have an available substitute; however, when I later tried again
the new HEAD referenced a guix-packages-base which *did* have a
substitute available?

Cheers.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

bug#40518: guix pull: Dependency guix-packages-base fails

[Ludovic Courtès]

Hi,

elaexuotee@wilsonb.com skribis:

>> It could be an out-of-memory (OOM) condition: this build phase is
>> unfortunately very demanding currently (at least 2 GiB or RAM I think).
>> How much RAM do you have?
>
> I think we have a winner. This is running on a VM and I just realized it
> it only runs with 500MB of ram.

OK.

> So, if I am understanding correctly, for some reason the original pull
> didn't have an available substitute; however, when I later tried again
> the new HEAD referenced a guix-packages-base which *did* have a
> substitute available?

That’s probably what happened, yes: if someone just pushed to repo, then
substitutes aren’t available yet; a few minutes later, they’re
available.

You can drop the attached file in ~/.config/guix/channels.scm to pull
from the latest commit that has been fully built (which is not exactly
equivalent to “substitutes available”, but as close to it as it gets):

--8<---------------cut here---------------start------------->8---
(use-modules (guix ci)
             (srfi srfi-1)
             (ice-9 match))

(define (latest-commit-successfully-built)
  "Return the latest commit for which substitutes are (potentially)
available."
  (let* ((evaluations (filter (lambda (evaluation)
                                (and (evaluation-complete? evaluation)
                                     (string=? "guix-modular-master"
                                               (evaluation-spec
                                                evaluation))))
                              (latest-evaluations "https://ci.guix.gnu.org"))))
    (any (lambda (evaluation)
           (match (evaluation-checkouts evaluation)
             ((checkout)
              (checkout-commit checkout))
             (_ #f)))
         evaluations)))

;; Pull the latest commit fully built on berlin.guixsd.org.
;; WARNING: This could downgrade your system!
(list (channel
       (name 'guix)
       (url "https://git.savannah.gnu.org/git/guix.git")
       (commit (pk 'commit (latest-commit-successfully-built)))))
--8<---------------cut here---------------end--------------->8---

Use with care! If the ci.guix.gnu.org is lagging or compromised, you
could find yourself not upgrading at all, or not upgrading to the latest
commit.

Ludo’.

bug#40518: guix pull: Dependency guix-packages-base fails

[elaexuotee--- via Bug reports for GNU Guix]

[-- Attachment #1.1: Type: text/plain, Size: 101 bytes --]

Thank you for hand holding me through this, and thank you for all the
amazing dev work.

Cheers.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

bug#40518: guix pull: Dependency guix-packages-base fails

[Ludovic Courtès]

Hi,

elaexuotee@wilsonb.com skribis:

> Thank you for hand holding me through this, and thank you for all the
> amazing dev work.

Heh, thanks, closing the bug!

Ludo’.