bug#41384: failing to build util-linux 2.35.1

bug#41384: failing to build util-linux 2.35.1

[Josh]

I'm consistently running into this error when running `guix pull`.
What can I do to help debug?

Test suite failed, dumping logs.
@ build-log 30965 53
command "make" "check" "-j" "4" failed with status 2
/builder for `/gnu/store/c70j91pkiv8qyazpv357ccc2jfjz91yw-util-linux-2.35.1.drv' failed with exit code 1
@ build-failed /gnu/store/c70j91pkiv8qyazpv357ccc2jfjz91yw-util-linux-2.35.1.drv - 1 builder for `/gnu/store/c70j91pkiv8qyazpv357ccc2jfjz91yw-util-linux-2.35.1.drv' failed with exit code 1
cannot build derivation `/gnu/store/mmipgmshkcxiqfcz72pnyisxacxajjna-ghostscript-9.52.drv': 1 dependencies couldn't be built
cannot build derivation `/gnu/store/6jax52mlkbf4akjn07cb6jdwyvvafr0z-gnutls-3.6.12.drv': 1 dependencies couldn't be built
cannot build derivation `/gnu/store/bzl3nk0ryxxq3ailxa1n999qi8c1vgy1-openldap-2.4.50.drv': 1 dependencies couldn't be built
Backtrace:
           11 (primitive-load "/gnu/store/9arpm9f4xrkdfhxqvp9x36iyh7axpawc-compute-guix-derivation")
In ice-9/eval.scm:
     155:9 10 (_ _)
     159:9  9 (_ #(#(#(#(#(#(#(#(#(#(#(#(#(#<directory (guile-user) 7f7f9c9d81?> ?) ?) ?) ?) ?) ?) ?) ?) ?) ?) ?) ?) ?))
In ./guix/store.scm:
   2017:24  8 (run-with-store #<store-connection 256.99 7f7f9b5ad6c0> _ #:guile-for-build _ #:system _ #:target _)
    1851:8  7 (_ _)
In ./guix/gexp.scm:
    242:18  6 (_ _)
    1058:2  5 (_ _)
     918:2  4 (_ _)
     779:4  3 (_ _)
In ./guix/store.scm:
   1899:12  2 (_ #<store-connection 256.99 7f7f9b5ad6c0>)
    1352:5  1 (map/accumulate-builds #<store-connection 256.99 7f7f9b5ad6c0> _ _)
   1363:15  0 (_ #<store-connection 256.99 7f7f9b5ad6c0> _ _)

./guix/store.scm:1363:15: Throw to key `srfi-34' with args `(#<condition &store-protocol-error [message: "build of `/gnu/store/bzl3nk0ryxxq3ailxa1n999qi8c1vgy1-openldap-2.4.50.drv' failed" status: 100] 7f7f9885dea0>)'.
guix pull: error: You found a bug: the program '/gnu/store/9arpm9f4xrkdfhxqvp9x36iyh7axpawc-compute-guix-derivation'
failed to compute the derivation for Guix (version: "782cc119f52f28ea808a3ef0e63f80f7440b5b53"; system: "x86_64-linux";
host version: "1.1.0-2.619f918"; pull-version: 1).
Please report it by email to <bug-guix@gnu.org>.

bug#41384: failing to build util-linux 2.35.1

[Marius Bakke]

[-- Attachment #1: Type: text/plain, Size: 318 bytes --]

Josh <randomenduser@fastmail.com> writes:

> I'm consistently running into this error when running `guix pull`.
> What can I do to help debug?

Try using 'guix pull --keep-failed' and inspect the util-linux test
suite logs in /tmp/guix-build-util-linux-2.35.1.drv-0.

Did you intentionally disable binary substitutes?

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 487 bytes --]

bug#41384: failing to build util-linux 2.35.1

[Josh]

[-- Attachment #1: Type: text/plain, Size: 274 bytes --]

>[+ debbugs, please keep it in CC]

Will do, sorry about that.

>Can you attach
>/var/log/guix/drvs/c7/0j91pkiv8qyazpv357ccc2jfjz91yw-util-linux-2.35.1.drv.bz2
>to this bug report?

Attached. Looks like those three that I mentioned. Anything else look
interesting in there?

[-- Attachment #2: 0j91pkiv8qyazpv357ccc2jfjz91yw-util-linux-2.35.1.drv.bz2 --]
[-- Type: application/octet-stream, Size: 28695 bytes --]

bug#41384: failing to build util-linux 2.35.1

[Marius Bakke]

[-- Attachment #1: Type: text/plain, Size: 1639 bytes --]

Hi Josh,

[+ debbugs, please keep it in CC]

Josh <randomenduser@fastmail.com> writes:

>>Try using 'guix pull --keep-failed' and inspect the util-linux test
>>suite logs in /tmp/guix-build-util-linux-2.35.1.drv-0.
>
> I don't see much...
>
> In /tmp/guix-build-util-linux-2.35.1.drv-0/util-linux-2.35.1, the only tests with something in "diff" (which assumes means failures) are the following:

Can you attach
/var/log/guix/drvs/c7/0j91pkiv8qyazpv357ccc2jfjz91yw-util-linux-2.35.1.drv.bz2
to this bug report?

There should be a test suite summary that we can use to corroborate the
below results with.

> tests/diff/ipcs:
> mk-rm-msg.err  mk-rm-sem.err  mk-rm-shm.err
>
>
> tests/diff/misc:
> mbsencode-invalid-utf8	mbsencode-safe-utf8
>
> tests/diff/script:
> replay-live
>
> And the only ones that appear to indicate an error are these:
>
> --- /dev/null	2020-05-20 19:14:36.552027894 +0000
> +++ /tmp/guix-build-util-linux-2.35.1.drv-0/util-linux-2.35.1/tests/output/ipcs/mk-rm-msg.err	2020-05-20 19:18:45.988022283 +0000
> @@ -0,0 +1,2 @@
> +ipcrm: failed to parse argument: '0xd6733c2c
> +0xd6733c2c'
> --- /dev/null	2020-05-20 19:14:36.552027894 +0000
> +++ /tmp/guix-build-util-linux-2.35.1.drv-0/util-linux-2.35.1/tests/output/ipcs/mk-rm-sem.err	2020-05-20 19:18:46.040022282 +0000
> @@ -0,0 +1,2 @@
> +ipcrm: failed to parse argument: '0xd0de0de7
> +0xd0de0de7'
> --- /dev/null	2020-05-20 19:14:36.552027894 +0000
> +++ /tmp/guix-build-util-linux-2.35.1.drv-0/util-linux-2.35.1/tests/output/ipcs/mk-rm-shm.err	2020-05-20 19:18:46.092022281 +0000
> @@ -0,0 +1,2 @@
> +ipcrm: failed to parse argument: '0x4cec9993
> +0x4cec9993'
>

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 487 bytes --]

bug#41384: failing to build util-linux 2.35.1

[Marius Bakke]

[-- Attachment #1: Type: text/plain, Size: 718 bytes --]

Josh <randomenduser@fastmail.com> writes:

>>[+ debbugs, please keep it in CC]
>
> Will do, sorry about that.
>
>>Can you attach
>>/var/log/guix/drvs/c7/0j91pkiv8qyazpv357ccc2jfjz91yw-util-linux-2.35.1.drv.bz2
>>to this bug report?
>
> Attached. Looks like those three that I mentioned. Anything else look
> interesting in there?

Thanks to a great coordinated effort on #guix, we tracked this problem
down to a regression in kernels 5.4.36 through 5.4.41 (or 5.6.8 through
5.6.13 for users tracking that branch).

You are running 5.4.38 according to the build log.

It has been fixed in the latest kernel releases (5.4.42 and 5.6.14).

I'm afraid you will have to downgrade your kernel in order to upgrade
Guix!  :-/

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 487 bytes --]

bug#41384: failing to build util-linux 2.35.1

[Josh]

>I'm afraid you will have to downgrade your kernel in order to upgrade
>Guix!  :-/

Ahh. Thanks for the response!

How do I do that? I would assume it would be documented here[0], but I
can't seem to find it anywhere in the manual.

[0] https://guix.gnu.org/manual/en/html_node/operating_002dsystem-Reference.html

bug#41384: failing to build util-linux 2.35.1

[Marius Bakke]

[-- Attachment #1: Type: text/plain, Size: 1415 bytes --]

Josh <randomenduser@fastmail.com> writes:

>>I'm afraid you will have to downgrade your kernel in order to upgrade
>>Guix!  :-/
>
> Ahh. Thanks for the response!
>
> How do I do that? I would assume it would be documented here[0], but I
> can't seem to find it anywhere in the manual.
>
> [0] https://guix.gnu.org/manual/en/html_node/operating_002dsystem-Reference.html

There are a couple of options.  The easiest way is to boot into an older
generation before running 'guix pull', if you have any generations with
kernel < 5.4.36 lying around.

Another is to pin the kernel to an older revision of Guix using an
"inferior".  You would have to update your system configuration along
these lines:

--8<---------------cut here---------------start------------->8---
(use-modules (guix inferior)
             (guix channels))

;; A channel with Linux-Libre 5.4.35.
(define channels
  (list (channel
         (name 'guix)
         (url "https://git.savannah.gnu.org/git/guix.git")
         (commit "851a3a779a7173807683e0a3c4e118ef4d8eb0b7"))))

(define inferior
  ;; An inferior representing the above channel.
  (inferior-for-channels channels))

(define linux-libre-5.4.35
  (lookup-inferior-packages inferior "linux-libre@5.4.35"))

(operating-system
  [...]
  (kernel linux-libre-5.4.35))
--8<---------------cut here---------------end--------------->8---

Then reconfigure and reboot, of course.

Hope this helps!

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 487 bytes --]

bug#41384: failing to build util-linux 2.35.1

[Josh]

>There are a couple of options.  The easiest way is to boot into an older
>generation before running 'guix pull', if you have any generations with
>kernel < 5.4.36 lying around.

This worked! Thanks for the response. Sorry for the delay.. it took
awhile to update :)

bug#41384: failing to build util-linux 2.35.1

[Marius Bakke]

[-- Attachment #1: Type: text/plain, Size: 369 bytes --]

Josh <randomenduser@fastmail.com> writes:

>>There are a couple of options.  The easiest way is to boot into an older
>>generation before running 'guix pull', if you have any generations with
>>kernel < 5.4.36 lying around.
>
> This worked! Thanks for the response. Sorry for the delay.. it took
> awhile to update :)

Great, thanks for confirming.  Closing the issue!

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 487 bytes --]