bug#40447: guix pull failure on master.

bug#40447: guix pull failure on master.

[Brendan Tildesley]

I'm getting this error running guix pull.

build of 
/gnu/store/yfy990mq3ikmkhawgc35z2f2ryqdxn09-guix-system-tests.drv failed


it appears to be caused by the latest commit. using --commit to switch 
to the previous commit work.

I've CC'd the author and commiter.



044d1478c9 master origin/master gnu: Add kernel-module-loader-service.

bug#40447: Acknowledgement (guix pull failure on master.)

[Brendan Tildesley]

8c88e2422 builds successfull.

This is the error message with --debug=3


downloading from 
https://ci.guix.gnu.org/nar/lzip/cranhffh2ym9bdcr05xzpcqi9rf4mjsg-guix-4391fefc5...
  guix-4391fefc5 12KiB 2.3MiB/s 00:00 [##################] 100.0%

linking 
‘/gnu/store/cranhffh2ym9bdcr05xzpcqi9rf4mjsg-guix-4391fefc5/etc/bash_completion.d/guix’ 
to ‘/gnu/store/.links/0qqf3ra512hi0q7wcypyi3q77p5hl7zaha10s6g8ylxl86nr7lb6’
linking 
‘/gnu/store/cranhffh2ym9bdcr05xzpcqi9rf4mjsg-guix-4391fefc5/etc/bash_completion.d/guix-daemon’ 
to ‘/gnu/store/.links/0hswry7194cymm6z7lwxaas4x67z9awscjxkxd8c5f24hgd1bqqp’
linking 
‘/gnu/store/cranhffh2ym9bdcr05xzpcqi9rf4mjsg-guix-4391fefc5/share/fish/vendor_completions.d/guix.fish’ 
to ‘/gnu/store/.links/1jgbpimy1brxn96zcacw3s1hx8flcjjld9j890k3z9r5bdpyblg6’
linking 
‘/gnu/store/cranhffh2ym9bdcr05xzpcqi9rf4mjsg-guix-4391fefc5/share/zsh/site-functions/_guix’ 
to ‘/gnu/store/.links/0p6y6hgk9f3smhw1alad44vrhvf9dqlrlp2vb5c8m9wc5yxfhapl’
linking 
‘/gnu/store/cranhffh2ym9bdcr05xzpcqi9rf4mjsg-guix-4391fefc5/share/guix/berlin.guixsd.org.pub’ 
to ‘/gnu/store/.links/0yapygnwdhx6dyi0fz8dkpxlafz8mjkljrrsdpkcwvdpp4is162w’
linking 
‘/gnu/store/cranhffh2ym9bdcr05xzpcqi9rf4mjsg-guix-4391fefc5/share/guix/ci.guix.info.pub’ 
to ‘/gnu/store/.links/0yapygnwdhx6dyi0fz8dkpxlafz8mjkljrrsdpkcwvdpp4is162w’
linking 
‘/gnu/store/cranhffh2ym9bdcr05xzpcqi9rf4mjsg-guix-4391fefc5/share/guix/ci.guix.gnu.org.pub’ 
to ‘/gnu/store/.links/0yapygnwdhx6dyi0fz8dkpxlafz8mjkljrrsdpkcwvdpp4is162w’
substitution of path 
`/gnu/store/cranhffh2ym9bdcr05xzpcqi9rf4mjsg-guix-4391fefc5' succeeded
building path(s) 
`/gnu/store/mh45f32sh1jgx2n93x6dvih9szgfrlhj-ca-certificate-bundle'
|   setting up chroot environment in 
`/gnu/store/5nr79x4mpq5fwy5b0y7njpsgcx38938g-ca-certificate-bundle.drv.chroot'
|   executing builder 
`/gnu/store/sc7z07gim1iq5zvfz1amdwf2irxrzifg-guile-2.2.6/bin/guile'
|   @ build-started 
/gnu/store/5nr79x4mpq5fwy5b0y7njpsgcx38938g-ca-certificate-bundle.drv - 
x86_64-linux 
/var/log/guix/drvs/5n//r79x4mpq5fwy5b0y7njpsgcx38938g-ca-certificate-bundle.drv.bz2 
5610
scanning for references inside 
`/gnu/store/mh45f32sh1jgx2n93x6dvih9szgfrlhj-ca-certificate-bundle'
building path(s) `/gnu/store/8nkjk7i7nrp8lmjwjkkfzcjd898nib55-fonts-dir'
|   setting up chroot environment in 
`/gnu/store/dyrnbchg0lywly7pgaw25krdp5lb32y8-fonts-dir.drv.chroot'
|   executing builder 
`/gnu/store/sc7z07gim1iq5zvfz1amdwf2irxrzifg-guile-2.2.6/bin/guile'
|   @ build-started 
/gnu/store/dyrnbchg0lywly7pgaw25krdp5lb32y8-fonts-dir.drv - x86_64-linux 
/var/log/guix/drvs/dy//rnbchg0lywly7pgaw25krdp5lb32y8-fonts-dir.drv.bz2 5621
scanning for references inside 
`/gnu/store/8nkjk7i7nrp8lmjwjkkfzcjd898nib55-fonts-dir'
building path(s) `/gnu/store/almrh1463h6ncn4vz7s140y0lay3ncz4-info-dir'
|   setting up chroot environment in 
`/gnu/store/shrlnaigds9j2w4z8cfbp4gkf5a40w83-info-dir.drv.chroot'
|   executing builder 
`/gnu/store/sc7z07gim1iq5zvfz1amdwf2irxrzifg-guile-2.2.6/bin/guile'
|   @ build-started 
/gnu/store/shrlnaigds9j2w4z8cfbp4gkf5a40w83-info-dir.drv - x86_64-linux 
/var/log/guix/drvs/sh//rlnaigds9j2w4z8cfbp4gkf5a40w83-info-dir.drv.bz2 5636
scanning for references inside 
`/gnu/store/almrh1463h6ncn4vz7s140y0lay3ncz4-info-dir'
|   linking 
‘/gnu/store/almrh1463h6ncn4vz7s140y0lay3ncz4-info-dir/share/info/dir.zh_CN’ 
to ‘/gnu/store/.links/1y68a5nnimmnjmc91dvizkswaprxj453pfpplqj4rniamqjf3dki’
|   linking 
‘/gnu/store/almrh1463h6ncn4vz7s140y0lay3ncz4-info-dir/share/info/dir.es’ 
to ‘/gnu/store/.links/11kg8i5p3c3hfz3550f0xwj7n4admbb8xvfz081p4q61axc4gwgg’
|   linking 
‘/gnu/store/almrh1463h6ncn4vz7s140y0lay3ncz4-info-dir/share/info/dir’ to 
‘/gnu/store/.links/1xf2pkw314q8ss02xx803ph7hkvylh8n7rlrg2pcp07zfw32il9n’
|   linking 
‘/gnu/store/almrh1463h6ncn4vz7s140y0lay3ncz4-info-dir/share/info/dir.de’ 
to ‘/gnu/store/.links/0xmywz6hn92r5m4ciimgdwvaja6ar6csmmgqaqbcj5ryzsnq5cnn’
|   linking 
‘/gnu/store/almrh1463h6ncn4vz7s140y0lay3ncz4-info-dir/share/info/dir.ru’ 
to ‘/gnu/store/.links/0nhppi8ghkay2sc81yd23nykndjmk64hchyikzslsr68fms71c4q’
|   linking 
‘/gnu/store/almrh1463h6ncn4vz7s140y0lay3ncz4-info-dir/share/info/dir.fr’ 
to ‘/gnu/store/.links/0xwkb3qbahsff75zmm4309m353i2dxlvs6cgcjd0vl14yk8d01j2’
building path(s) 
`/gnu/store/872s54736grg3k4r1g4p05i4l8i28614-manual-database'
|   setting up chroot environment in 
`/gnu/store/4gkwyizdwx52x8vgcb6divvw1xy8zzi9-manual-database.drv.chroot'
|   executing builder 
`/gnu/store/sc7z07gim1iq5zvfz1amdwf2irxrzifg-guile-2.2.6/bin/guile'
|   @ build-started 
/gnu/store/4gkwyizdwx52x8vgcb6divvw1xy8zzi9-manual-database.drv - 
x86_64-linux 
/var/log/guix/drvs/4g//kwyizdwx52x8vgcb6divvw1xy8zzi9-manual-database.drv.bz2 
5671
\Backtrace:
            1 (primitive-load "/home/b/.config/guix/current/bin/guix")
In guix/ui.scm:
   1936:12  0 (run-guix-command _ . _)

guix/ui.scm:1936:12: In procedure run-guix-command:
In procedure struct-vtable: Wrong type argument in position 1 (expecting 
struct): #f
b@ui ~$

bug#40447: Acknowledgement (guix pull failure on master.)

[Danny Milosavljevic]

[-- Attachment #1: Type: text/plain, Size: 383 bytes --]

make check-system TESTS="loadable-kernel-modules-0 loadable-kernel-modules-1 loadable-kernel-modules-2" does work fine.

So I'm guessing it's another system test.  I'm running them all now.

>guix/ui.scm:1936:12: In procedure run-guix-command:
>In procedure struct-vtable: Wrong type argument in position 1 (expecting 
>struct): #f

Uhhh--we haven't changed anything there.

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 488 bytes --]

bug#40447:

[Brendan Tildesley]

Closing since it seems to unrelated. Sorry for wasting your time. I 
think it may have been my ext4 having too many files. i deleted all my 
system generations and gc'd a lot of stuff, and it seems to be miss 
behaving. perhaps it is a different kind of guix bug that it doesnt cope 
with this issue:


[ 7862.196231] EXT4-fs warning (device sdb1): ext4_dx_add_entry:2343: 
Directory (ino: 24903688) index full, reach max htree level :2
[ 7862.196241] EXT4-fs warning (device sdb1): ext4_dx_add_entry:2347: 
Large directory feature is not enabled on this filesystem

bug#40447:

[Tobias Geerinckx-Rice via Bug reports for GNU Guix]

[-- Attachment #1: Type: text/plain, Size: 1630 bytes --]

Brendan,

Brendan Tildesley 写道：
> Closing since it seems to unrelated. Sorry for wasting your 
> time. I
> think it may have been my ext4 having too many files. i deleted 
> all my
> system generations and gc'd a lot of stuff, and it seems to be 
> miss
> behaving. perhaps it is a different kind of guix bug that it 
> doesnt
> cope with this issue:

Worse: it's an ext4 bug (well, behaviour).

> [ 7862.196231] EXT4-fs warning (device sdb1): 
> ext4_dx_add_entry:2343:
> Directory (ino: 24903688) index full, reach max htree level :2

This happens when a directory, almost certainly /gnu/store/.links, 
contains more entries than can fit in ext4's ‘dir_index’ hash 
table.  The file system simply punts.

You can disable this optimisation with tune2fs -O ^dir_index …. 
You'll lose some theoretical performance but I haven't heard 
complaints in practice.  You're not the first one to encounter 
this problem.

If that's unacceptable, you can reconfigure your guix-daemon with 
‘--disable-deduplication’ in exchange for more storage space for 
newer generations.

Or switch to btrfs for a newer, shinier set of pathological 
gotchas but not this one :-)

One could work around this in Guix if one were motivated:
- Ignore file system failure instead of making it fatal, falling 
  back to ‘--disable-deduplication’ behaviour, which is probably 
  the right thing to do; or
- store .links in ./n/e/sted directories, which will degrade 
  performance on file systems that handle collisions properly and 
  is probably not worth the headache.

Kind regards,

T G-R

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

bug#40447:

[Danny Milosavljevic]

[-- Attachment #1: Type: text/plain, Size: 982 bytes --]

Hi Brendan,

On Mon, 6 Apr 2020 00:46:48 +1000
Brendan Tildesley <mail@brendan.scot> wrote:

> Closing since it seems to unrelated. Sorry for wasting your time. 

No, if in doubt, please always report.

>I 
> think it may have been my ext4 having too many files. i deleted all my 
> system generations and gc'd a lot of stuff, and it seems to be miss 
> behaving. perhaps it is a different kind of guix bug that it doesnt cope 
> with this issue:
> 
> 
> [ 7862.196231] EXT4-fs warning (device sdb1): ext4_dx_add_entry:2343: 
> Directory (ino: 24903688) index full, reach max htree level :2
> [ 7862.196241] EXT4-fs warning (device sdb1): ext4_dx_add_entry:2347: 
> Large directory feature is not enabled on this filesystem

Is there already a bug report for that problem?  I think the least we
could do is check on startup if that ext4 option is set or not--or
better yet, automatically degrade deduplication to duplication when it
doesn't work otherwise.

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 488 bytes --]

bug#40447: Acknowledgement (guix pull failure on master.)

[Brendan Tildesley]

Ok I may have jumped the gun a little. the first error I had looked like 
it was related to it but my battery died before i could post it, so i 
reran it and got another error, which didnt seem so related. It was odd 
that 8c88e2422 succeeded but later commits failed twice, and another irc 
user found their guix pull failing at the same time.
However, I had these errors in dmesg so I ran guix gc followed by guix 
pull and it worked. it may be because my ext4 is hitting limits and guix 
isnt coping with that well.

[ 7485.656995] EXT4-fs warning (device sdb1): ext4_dx_add_entry:2343: 
Directory (ino: 24903688) index full, reach max htree level :2
[ 7485.656998] EXT4-fs warning (device sdb1): ext4_dx_add_entry:2347: 
Large directory feature is not enabled on this filesystem






Another error I got building again:


guix offload: warning: '/etc/guix/machines.scm' did not return a list of 
build machines; ignoring it
building path(s) 
`/gnu/store/wx1wwqawh7193bvrrwqz41c2jr0c38gl-guix-packages-base'
|   setting up chroot environment in 
`/gnu/store/cgn8cvga3rsbyk0qqi334nqrq25g6kgk-guix-packages-base.drv.chroot'
|   executing builder 
`/gnu/store/5780x8w59lg898p9a45c2i18lx6r25yb-guile-next-3.0.2/bin/guile'
|   @ build-started 
/gnu/store/cgn8cvga3rsbyk0qqi334nqrq25g6kgk-guix-packages-base.drv - 
x86_64-linux 
/var/log/guix/drvs/cg//n8cvga3rsbyk0qqi334nqrq25g6kgk-guix-packages-base.drv.bz2 
7199
Backtrace:
            1 (primitive-load "/home/b/.config/guix/current/bin/guix")
In guix/ui.scm:
   1936:12  0 (run-guix-command _ . _)

guix/ui.scm:1936:12: In procedure run-guix-command:
In procedure struct-vtable: Wrong type argument in position 1 (expecting 
struct): #f

bug#40447: guix pull failure on master.

[Ludovic Courtès]

Hi Brendan,

Brendan Tildesley <mail@brendan.scot> skribis:

> I'm getting this error running guix pull.
>
> build of
> /gnu/store/yfy990mq3ikmkhawgc35z2f2ryqdxn09-guix-system-tests.drv
> failed
>
>
> it appears to be caused by the latest commit. using --commit to switch
> to the previous commit work.
>
> I've CC'd the author and commiter.
>
>
>
> 044d1478c9 master origin/master gnu: Add kernel-module-loader-service.

AFAICS this problem is now fixed (I just pulled to
0e8564f8f0f51535b9fd7893082d12eef769a7fc).  Closing!

Ludo’.