* bug#40790: OOM error in graphical installer tests.
@ 2020-04-23 9:49 Mathieu Othacehe
2020-04-24 14:27 ` Ludovic Courtès
0 siblings, 1 reply; 7+ messages in thread
From: Mathieu Othacehe @ 2020-04-23 9:49 UTC (permalink / raw)
To: 40790
[-- Attachment #1: Type: text/plain, Size: 153 bytes --]
Hello,
The "gui-installed-os" test fails on master because "guix system init"
command is OOM killed. Log of the failure is attached.
Thanks,
Mathieu
[-- Attachment #2: oom.log --]
[-- Type: application/octet-stream, Size: 16302 bytes --]
Apr 23 11:30:48 localhost vmunix: [ 33.178657] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
Apr 23 11:30:48 localhost installer[230]: running form #<newt-form 1502690> ("Configuration file") with 1 clients
Apr 23 11:30:48conversation expecting pattern ((quote pause))
localhost installer[230]: form #<newt-form 1502690> ("Configuration file"): client 19 replied #t
Apr 23 11:30:49 localhost shepherd[1]: Service cow-store has been started.
Apr 23 11:30:49 localhost installer[230]: running command ("guix" "system" "init" "--fallback" "--no-grafts" "--no-substitutes" "/mnt/etc/config.scm" "/mnt")
^[OQkaza [ 789.166897] syslogd invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
[ 789.176935] CPU: 0 PID: 186 Comm: syslogd Not tainted 5.4.34-gnu #1
[ 789.178028] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.12.0-59-gc9ba5276e321-prebuilt.qemu.org 04/01/2014
[ 789.179829] Call Trace:
[ 789.180123] dump_stack+0x6d/0x8d
[ 789.180487] dump_header+0x4f/0x200
[ 789.180863] oom_kill_process+0xe7/0x120
[ 789.181284] out_of_memory+0x109/0x4d0
[ 789.181699] __alloc_pages_slowpath+0xaaf/0xe60
[ 789.182185] __alloc_pages_nodemask+0x2d0/0x320
[ 789.182671] alloc_pages_current+0x6b/0xd0
[ 789.183124] __page_cache_alloc+0x6c/0xa0
[ 789.183539] pagecache_get_page+0xab/0x2c0
[ 789.183977] filemap_fault+0x696/0xb90
[ 789.184357] ? xas_find+0x17b/0x1c0
[ 789.184711] ? filemap_map_pages+0x182/0x3b0
[ 789.185139] __do_fault+0x57/0x11b
[ 789.185484] __handle_mm_fault+0xdde/0x12b0
[ 789.186121] handle_mm_fault+0xcc/0x200
[ 789.186731] __do_page_fault+0x2a1/0x4d0
[ 789.187348] do_page_fault+0x2c/0xe0
[ 789.187911] do_async_page_fault+0x64/0x90
[ 789.188557] async_page_fault+0x34/0x40
[ 789.189165] RIP: 0033:0x405f20
[ 789.189664] Code: Bad RIP value.
[ 789.190175] RSP: 002b:00007ffc49cee3b8 EFLAGS: 00010246
[ 789.191004] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00007fb5bd871744
[ 789.191897] RDX: 00007ffc49cee3c0 RSI: 00007ffc49cee4f0 RDI: 000000000000000e
[ 789.192580] RBP: 00000000009b8fc0 R08: fefefefefefefeff R09: ffffff0000000000
[ 789.193263] R10: 0000000000000008 R11: 0000000000000246 R12: 00007ffc49ceedb0
[ 789.193964] R13: 00000000009b8fc0 R14: 00007ffc49ceee0a R15: 00007ffc49cee9a0
[ 789.194693] Mem-Info:
[ 789.194941] active_anon:155980 inactive_anon:2486 isolated_anon:0
[ 789.194941] active_file:7481 inactive_file:7464 isolated_file:64
[ 789.194941] unevictable:0 dirty:0 writeback:0 unstable:0
[ 789.194941] slab_reclaimable:7698 slab_unreclaimable:3517
[ 789.194941] mapped:83 shmem:34652 pagetables:571 bounce:0
[ 789.194941] free:5623 free_pcp:59 free_cma:0
[ 789.198668] Node 0 active_anon:623920kB inactive_anon:9944kB active_file:29924kB inactive_file:29856kB unevictable:0kB isolated(anon):0kB isolated(file):256kB mapped:332kB dirty:0kB writeback:0kB shmem:13860s
[ 789.202572] Node 0 DMA32 free:22492kB min:22528kB low:28160kB high:33792kB active_anon:623920kB inactive_anon:9944kB active_file:29924kB inactive_file:29856kB unevictable:0kB writepending:0kB present:818668kB
[ 789.205398] lowmem_reserve[]: 0 0 0 0
[ 789.205778] Node 0 DMA32: 897*4kB (UE) 1111*8kB (UME) 336*16kB (UME) 107*32kB (UME) 19*64kB (UME) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 22492kB
[ 789.207194] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[ 789.208007] 49661 total pagecache pages
[ 789.208409] 0 pages in swap cache
[ 789.208779] Swap cache stats: add 0, delete 0, find 0/0
[ 789.209366] Free swap = 0kB
[ 789.209704] Total swap = 0kB
[ 789.210033] 204667 pages RAM
[ 789.210360] 0 pages HighMem/MovableOnly
[ 789.210806] 9753 pages reserved
[ 789.211176] 0 pages cma reserved
[ 789.211544] 0 pages hwpoisoned
[ 789.211860] Tasks state (memory values in pages):
[ 789.212340] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
[ 789.213205] [ 168] 0 168 1051 242 49152 0 0 udevd
[ 789.214006] [ 186] 0 186 632 35 40960 0 0 syslogd
[ 789.214885] [ 190] 999 190 877 65 45056 0 0 dbus-daemon
[ 789.215733] [ 192] 0 192 2239 117 53248 0 0 wpa_supplicant
[ 789.217023] [ 193] 0 193 2592 187 57344 0 0 connmand
[ 789.218465] [ 194] 0 194 5039 67 69632 0 0 nscd
[ 789.219752] [ 203] 0 203 935 29 49152 0 0 gpm
[ 789.220849] [ 204] 0 204 8206 594 77824 0 0 kmscon
[ 789.221781] [ 212] 0 212 591 11 45056 0 0 mingetty
[ 789.222684] [ 215] 0 215 591 12 45056 0 0 mingetty
[ 789.223801] [ 218] 0 218 591 12 40960 0 0 mingetty
[ 789.224620] [ 221] 0 221 591 12 45056 0 0 mingetty
[ 789.225434] [ 224] 0 224 2980 127 61440 0 0 guix-daemon
[ 789.226289] [ 225] 0 225 14206 3338 118784 0 0 shepherd
[ 789.227341] [ 230] 0 230 76992 21776 495616 0 0 6da4vp09728wrqv
[ 789.228595] [ 233] 987 233 1667 229 45056 0 0 info
[ 789.229746] [ 285] 0 285 146161 82420 1060864 0 0 guix
[ 789.230931] [ 288] 0 288 5650 1024 73728 0 0 guix-daemon
[ 789.232172] [ 454] 997 454 37661 13065 188416 0 0 guile
[ 789.233292] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/,task=guix,pid=285,uid=0
[ 789.235033] Out of memory: Killed process 285 (guix) total-vm:584644kB, anon-rss:329616kB, file-rss:0kB, shmem-rss:64kB, UID:0 pgtables:1036kB oom_score_adj:0
[ 789.315521] oom_reaper: reaped process 285 (guix), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
conversation expecting pattern ((quote installation-complete))
warning: failed to delete /mnt/tmp/guix-inst/dqfyzhyl4kldb53vlirmmf6wpkjm6iy2-module-import-compiled.drv.chroot: No such file or directory
Apr 23 11:43:25 localhost vmunix: [ 789.166897] syslogd invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Apr 23 11:43:25 localhost vmunix: [ 789.176935] CPU: 0 PID: 186 Comm: syslogd Not tainted 5.4.34-gnu #1
Apr 23 11:43:25 localhost vmunix: [ 789.178028] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.12.0-59-gc9ba5276e321-prebuilt.qemu.org 04/01/2014
Apr 23 11:43:25 localhost vmunix: [ 789.179829] Call Trace:
Apr 23 11:43:25 localhost vmunix: [ 789.180123] dump_stack+0x6d/0x8d
Apr 23 11:43:25 localhost vmunix: [ 789.180487] dump_header+0x4f/0x200
Apr 23 11:43:25 localhost vmunix: [ 789.180863] oom_kill_process+0xe7/0x120
Apr 23 11:43:25 localhost vmunix: [ 789.181284] out_of_memory+0x109/0x4d0
Apr 23 11:43:25 localhost vmunix: [ 789.181699] __alloc_pages_slowpath+0xaaf/0xe60
Apr 23 11:43:25 localhost vmunix: [ 789.182185] __alloc_pages_nodemask+0x2d0/0x320
Apr 23 11:43:25 localhost vmunix: [ 789.182671] alloc_pages_current+0x6b/0xd0
Apr 23 11:43:25 localhost vmunix: [ 789.183124] __page_cache_alloc+0x6c/0xa0
Apr 23 11:43:25 localhost vmunix: [ 789.183539] pagecache_get_page+0xab/0x2c0
Apr 23 11:43:25 localhost vmunix: [ 789.183977] filemap_fault+0x696/0xb90
Apr 23 11:43:25 localhost vmunix: [ 789.184357] ? xas_find+0x17b/0x1c0
Apr 23 11:43:25 localhost vmunix: [ 789.184711] ? filemap_map_pages+0x182/0x3b0
Apr 23 11:43:25 localhost vmunix: [ 789.185139] __do_fault+0x57/0x11b
Apr 23 11:43:25 localhost vmunix: [ 789.185484] __handle_mm_fault+0xdde/0x12b0
Apr 23 11:43:25 localhost vmunix: [ 789.186121] handle_mm_fault+0xcc/0x200
Apr 23 11:43:25 localhost vmunix: [ 789.186731] __do_page_fault+0x2a1/0x4d0
Apr 23 11:43:25 localhost vmunix: [ 789.187348] do_page_fault+0x2c/0xe0
Apr 23 11:43:25 localhost vmunix: [ 789.187911] do_async_page_fault+0x64/0x90
Apr 23 11:43:25 localhost vmunix: [ 789.188557] async_page_fault+0x34/0x40
Apr 23 11:43:25 localhost vmunix: [ 789.189165] RIP: 0033:0x405f20
Apr 23 11:43:25 localhost vmunix: [ 789.189664] Code: Bad RIP value.
Apr 23 11:43:25 localhost vmunix: [ 789.190175] RSP: 002b:00007ffc49cee3b8 EFLAGS: 00010246
Apr 23 11:43:25 localhost vmunix: [ 789.191004] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00007fb5bd871744
Apr 23 11:43:25 localhost vmunix: [ 789.191897] RDX: 00007ffc49cee3c0 RSI: 00007ffc49cee4f0 RDI: 000000000000000e
Apr 23 11:43:25 localhost vmunix: [ 789.192580] RBP: 00000000009b8fc0 R08: fefefefefefefeff R09: ffffff0000000000
Apr 23 11:43:25 localhost vmunix: [ 789.193263] R10: 0000000000000008 R11: 0000000000000246 R12: 00007ffc49ceedb0
Apr 23 11:43:25 localhost vmunix: [ 789.193964] R13: 00000000009b8fc0 R14: 00007ffc49ceee0a R15: 00007ffc49cee9a0
Apr 23 11:43:25 localhost vmunix: [ 789.194693] Mem-Info:
Apr 23 11:43:25 localhost vmunix: [ 789.194941] active_anon:155980 inactive_anon:2486 isolated_anon:0
Apr 23 11:43:25 localhost vmunix: [ 789.194941] active_file:7481 inactive_file:7464 isolated_file:64
Apr 23 11:43:25 localhost vmunix: [ 789.194941] unevictable:0 dirty:0 writeback:0 unstable:0
Apr 23 11:43:25 localhost vmunix: [ 789.194941] slab_reclaimable:7698 slab_unreclaimable:3517
Apr 23 11:43:25 localhost vmunix: [ 789.194941] mapped:83 shmem:34652 pagetables:571 bounce:0
Apr 23 11:43:25 localhost vmunix: [ 789.194941] free:5623 free_pcp:59 free_cma:0
Apr 23 11:43:25 localhost vmunix: [ 789.198668] Node 0 active_anon:623920kB inactive_anon:9944kB active_file:29924kB inactive_file:29856kB unevictable:0kB isolated(anon):0kB isolated(file):256kB mapped:332kB ds
Apr 23 11:43:25 localhost vmunix: [ 789.202572] Node 0 DMA32 free:22492kB min:22528kB low:28160kB high:33792kB active_anon:623920kB inactive_anon:9944kB active_file:29924kB inactive_file:29856kB unevictable:0kB
Apr 23 11:43:25 localhost vmunix: [ 789.205398] lowmem_reserve[]: 0 0 0 0
Apr 23 11:43:25 localhost vmunix: [ 789.205778] Node 0 DMA32: 897*4kB (UE) 1111*8kB (UME) 336*16kB (UME) 107*32kB (UME) 19*64kB (UME) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 22492kB
Apr 23 11:43:25 localhost vmunix: [ 789.207194] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Apr 23 11:43:25 localhost vmunix: [ 789.208007] 49661 total pagecache pages
Apr 23 11:43:25 localhost vmunix: [ 789.208409] 0 pages in swap cache
Apr 23 11:43:25 localhost vmunix: [ 789.208779] Swap cache stats: add 0, delete 0, find 0/0
Apr 23 11:43:25 localhost vmunix: [ 789.209366] Free swap = 0kB
Apr 23 11:43:25 localhost vmunix: [ 789.209704] Total swap = 0kB
Apr 23 11:43:25 localhost vmunix: [ 789.210033] 204667 pages RAM
Apr 23 11:43:25 localhost vmunix: [ 789.210360] 0 pages HighMem/MovableOnly
Apr 23 11:43:25 localhost vmunix: [ 789.210806] 9753 pages reserved
Apr 23 11:43:25 localhost vmunix: [ 789.211176] 0 pages cma reserved
Apr 23 11:43:25 localhost vmunix: [ 789.211544] 0 pages hwpoisoned
Apr 23 11:43:25 localhost vmunix: [ 789.211860] Tasks state (memory values in pages):
Apr 23 11:43:25 localhost vmunix: [ 789.212340] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
Apr 23 11:43:25 localhost vmunix: [ 789.213205] [ 168] 0 168 1051 242 49152 0 0 udevd
Apr 23 11:43:25 localhost vmunix: [ 789.214006] [ 186] 0 186 632 35 40960 0 0 syslogd
Apr 23 11:43:25 localhost vmunix: [ 789.214885] [ 190] 999 190 877 65 45056 0 0 dbus-daemon
Apr 23 11:43:25 localhost vmunix: [ 789.215733] [ 192] 0 192 2239 117 53248 0 0 wpa_supplicant
Apr 23 11:43:25 localhost vmunix: [ 789.217023] [ 193] 0 193 2592 187 57344 0 0 connmand
Apr 23 11:43:25 localhost vmunix: [ 789.218465] [ 194] 0 194 5039 67 69632 0 0 nscd
Apr 23 11:43:25 localhost vmunix: [ 789.219752] [ 203] 0 203 935 29 49152 0 0 gpm
Apr 23 11:43:25 localhost vmunix: [ 789.220849] [ 204] 0 204 8206 594 77824 0 0 kmscon
Apr 23 11:43:25 localhost vmunix: [ 789.221781] [ 212] 0 212 591 11 45056 0 0 mingetty
Apr 23 11:43:25 localhost vmunix: [ 789.222684] [ 215] 0 215 591 12 45056 0 0 mingetty
Apr 23 11:43:25 localhost vmunix: [ 789.223801] [ 218] 0 218 591 12 40960 0 0 mingetty
Apr 23 11:43:25 localhost vmunix: [ 789.224620] [ 221] 0 221 591 12 45056 0 0 mingetty
Apr 23 11:43:25 localhost vmunix: [ 789.225434] [ 224] 0 224 2980 127 61440 0 0 guix-daemon
Apr 23 11:43:25 localhost vmunix: [ 789.226289] [ 225] 0 225 14206 3338 118784 0 0 shepherd
Apr 23 11:43:25 localhost vmunix: [ 789.227341] [ 230] 0 230 76992 21776 495616 0 0 6da4vp09728wrqv
Apr 23 11:43:25 localhost vmunix: [ 789.228595] [ 233] 987 233 1667 229 45056 0 0 info
Apr 23 11:43:25 localhost vmunix: [ 789.229746] [ 285] 0 285 146161 82420 1060864 0 0 guix
Apr 23 11:43:25 localhost vmunix: [ 789.230931] [ 288] 0 288 5650 1024 73728 0 0 guix-daemon
Apr 23 11:43:25 localhost vmunix: [ 789.232172] [ 454] 997 454 37661 13065 188416 0 0 guile
Apr 23 11:43:25 localhost vmunix: [ 789.233292] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/,task=guix,pid=285,uid=0
Apr 23 11:43:25 localhost vmunix: [ 789.235033] Out of memory: Killed process 285 (guix) total-vm:584644kB, anon-rss:329616kB, file-rss:0kB, shmem-rss:64kB, UID:0 pgtables:1036kB oom_score_adj:0
Apr 23 11:43:25 localhost vmunix: [ 789.315521] oom_reaper: reaped process 285 (guix), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
Apr 23 11:43:25 localhost shepherd[1]: Service cow-store has been stopped.
Apr 23 11:43:25 localhost shepherd[1]: Service guix-daemon has been stopped.
Apr 23 11:43:25 localhost shepherd[1]: Service guix-daemon has been started.
Apr 23 11:43:27 localhost installer[230]: command ("guix" "system" "init" "--fallback" "--no-grafts" "--no-substitutes" "/mnt/etc/config.scm" "/mnt") failed with exit code #finstaller[230]: Umounted /remove suc
Apr 23 11:43:27 localhost installer[230]: unmounting "/mnt/"
Apr 23 11:43:27 localhost installer[230]: closing LUKS entry "cryptroot"
/gnu/store/n563kilv1669dyv9p3d77hf4q884vy7y-shepherd-marionette.scm:1:1718: Throw to key `srfi-34' with args `(#<condition &pattern-not-matched [pattern: ((quote installation-complete)) sexp: (installation-fail.
Backtrace:
2 (primitive-load "/gnu/store/lvzc6hf6fpyxgp5zbmnsgnk0zfn?")
In ice-9/eval.scm:
191:35 1 (_ #f)
619:8 0 (_ #(#<directory (guile-user) 7ffff3c6c140> #<variabl?>))
ice-9/eval.scm:619:8: Throw to key `marionette-eval-failure' with args `((quote (conclude-installation installer-socket)))'.
note: keeping build directory `/tmp/guix-build-installation.drv-0'
builder for `/gnu/store/w1ic8pg8s786h5mr8xjx60zmklyqhlrb-installation.drv' failed with exit code 1
build of /gnu/store/w1ic8pg8s786h5mr8xjx60zmklyqhlrb-installation.drv failed
View build log at '/var/log/guix/drvs/w1/ic8pg8s786h5mr8xjx60zmklyqhlrb-installation.drv.bz2'.
cannot build derivation `/gnu/store/y3a1hx36n92xzp6rm5hrsi4lmk10syvb-gui-installed-os-encrypted.drv': 1 dependencies couldn't be built
guix build: error: build of `/gnu/store/y3a1hx36n92xzp6rm5hrsi4lmk10syvb-gui-installed-os-encrypted.drv' failed
make: *** [Makefile:5857: check-system] Error 1
^ permalink raw reply [flat|nested] 7+ messages in thread* bug#40790: OOM error in graphical installer tests.
2020-04-23 9:49 bug#40790: OOM error in graphical installer tests Mathieu Othacehe
@ 2020-04-24 14:27 ` Ludovic Courtès
2020-04-29 8:21 ` Mathieu Othacehe
0 siblings, 1 reply; 7+ messages in thread
From: Ludovic Courtès @ 2020-04-24 14:27 UTC (permalink / raw)
To: Mathieu Othacehe; +Cc: 40790
Hi Mathieu,
Mathieu Othacehe <m.othacehe@gmail.com> skribis:
> The "gui-installed-os" test fails on master because "guix system init"
> command is OOM killed. Log of the failure is attached.
[...]
> Apr 23 11:43:27 localhost installer[230]: command ("guix" "system" "init" "--fallback" "--no-grafts" "--no-substitutes" "/mnt/etc/config.scm" "/mnt") failed with exit code #finstaller[230]: Umounted /remove suc
Can we throw a little bit more memory at it? :-)
Is there a commit that trigger this failure?
Thanks,
Ludo’.
^ permalink raw reply [flat|nested] 7+ messages in thread* bug#40790: OOM error in graphical installer tests.
2020-04-24 14:27 ` Ludovic Courtès
@ 2020-04-29 8:21 ` Mathieu Othacehe
2020-04-29 15:32 ` Mathieu Othacehe
2020-04-30 21:10 ` Ludovic Courtès
0 siblings, 2 replies; 7+ messages in thread
From: Mathieu Othacehe @ 2020-04-29 8:21 UTC (permalink / raw)
To: Ludovic Courtès; +Cc: 40790-done
Hello,
> Can we throw a little bit more memory at it? :-)
That's what I did with ae1a0f758 :)
> Is there a commit that trigger this failure?
I didn't have the courage to bisect it, given how long this test
is. Fixing it, I discovered two more issues:
* "sherpherd services" test was failing because a wrong swap device was
used (fixed with be3abf28a).
* I have some hangs when doing the final testing in marionette. Still
trying to understand why.
Thanks,
Mathieu
^ permalink raw reply [flat|nested] 7+ messages in thread
* bug#40790: OOM error in graphical installer tests.
2020-04-29 8:21 ` Mathieu Othacehe
@ 2020-04-29 15:32 ` Mathieu Othacehe
2020-05-02 13:54 ` Ludovic Courtès
2020-04-30 21:10 ` Ludovic Courtès
1 sibling, 1 reply; 7+ messages in thread
From: Mathieu Othacehe @ 2020-04-29 15:32 UTC (permalink / raw)
To: Ludovic Courtès; +Cc: 40790-done
> * I have some hangs when doing the final testing in marionette. Still
> trying to understand why.
Fixed with c537d2bcb7c652b4776435cd1e2a5119af43dd78. Still an issue
remaining. "gui-installed-desktop-os-encrypted" closure is about 5.5GiB
which makes too much files for libisofs:
--8<---------------cut here---------------start------------->8---
xorriso : UPDATE : 427934 files added in 19 seconds
libisofs: FAILURE : HFS+ map nodes aren't implemented
libisofs: FAILURE : Too much files to mangle, cannot guarantee unique file names
xorriso : FAILURE : Failed to prepare session write run
xorriso : NOTE : -return_with SORRY 32 triggered by problem severity FAILURE
--8<---------------cut here---------------end--------------->8---
Not sure how to fix it. Someone?
Thanks,
Mathieu
^ permalink raw reply [flat|nested] 7+ messages in thread
* bug#40790: OOM error in graphical installer tests.
2020-04-29 15:32 ` Mathieu Othacehe
@ 2020-05-02 13:54 ` Ludovic Courtès
0 siblings, 0 replies; 7+ messages in thread
From: Ludovic Courtès @ 2020-05-02 13:54 UTC (permalink / raw)
To: Mathieu Othacehe; +Cc: 40790
[-- Attachment #1: Type: text/plain, Size: 1758 bytes --]
Hi,
Mathieu Othacehe <m.othacehe@gmail.com> skribis:
>> * I have some hangs when doing the final testing in marionette. Still
>> trying to understand why.
>
> Fixed with c537d2bcb7c652b4776435cd1e2a5119af43dd78.
Cool, sorry for breaking things. :-/
> Still an issue remaining. "gui-installed-desktop-os-encrypted" closure
> is about 5.5GiB which makes too much files for libisofs:
>
> xorriso : UPDATE : 427934 files added in 19 seconds
> libisofs: FAILURE : HFS+ map nodes aren't implemented
> libisofs: FAILURE : Too much files to mangle, cannot guarantee unique file names
> xorriso : FAILURE : Failed to prepare session write run
> xorriso : NOTE : -return_with SORRY 32 triggered by problem severity FAILURE
>
> Not sure how to fix it. Someone?
I tried the attached patch, which would select just one desktop
environments, thinking it might appease Xorriso, but actually it still
OOMs at the very last step:
--8<---------------cut here---------------start------------->8---
xorriso : UPDATE : 141879 file filters processed in 848 seconds
xorriso : UPDATE : 142026 file filters processed in 849 seconds
xorriso : UPDATE : 142102 file filters processed in 850 seconds
xorriso : NOTE : Copying to System Area: 512 bytes from file '/gnu/store/dvfl5ax7pj6c62f1ccc27qcrcb8nafr7-grub-hybrid-2.04/lib/grub/i386-pc/boot_hybrid.img'
[13266.747348] xorriso invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
[13266.749415] CPU: 0 PID: 251 Comm: xorriso Not tainted 5.4.36-gnu #1
[13266.750777] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.12.0-59-gc9ba5276e321-prebuilt.qemu.org 04/01/2014
--8<---------------cut here---------------end--------------->8---
Testing again with this extra patch:
[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: Type: text/x-patch, Size: 440 bytes --]
diff --git a/gnu/system/vm.scm b/gnu/system/vm.scm
index 6f81ac16ff..9f240b50ee 100644
--- a/gnu/system/vm.scm
+++ b/gnu/system/vm.scm
@@ -356,7 +356,7 @@ INPUTS is a list of inputs (as for packages)."
#:substitutable? substitutable?
;; Xorriso seems to be quite memory-hungry, so increase the VM's RAM size.
- #:memory-size 512))
+ #:memory-size 1024))
(define* (qemu-image #:key
(name "qemu-image")
[-- Attachment #3: Type: text/plain, Size: 199 bytes --]
I wonder if why it’s taking so much memory, and whether there’s
something else at play, like temporary files written to the overlaid
tmpfs and thus eating memory.
Thoughts?
Ludo’.
[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #4: Type: text/x-patch, Size: 3164 bytes --]
diff --git a/gnu/tests/install.scm b/gnu/tests/install.scm
index 019e21fd39..941958d698 100644
--- a/gnu/tests/install.scm
+++ b/gnu/tests/install.scm
@@ -957,7 +957,7 @@ build (current-guix) and then store a couple of full system images.")
(define* (gui-test-program marionette
#:key
- (desktop? #f)
+ (desktops '())
(encrypted? #f))
#~(let ()
(define (screenshot file)
@@ -971,7 +971,9 @@ build (current-guix) and then store a couple of full system images.")
(setvbuf (current-output-port) 'none)
(setvbuf (current-error-port) 'none)
- (marionette-eval* '(use-modules (gnu installer tests))
+ (marionette-eval* '(use-modules (gnu installer tests)
+ (srfi srfi-1)
+ (srfi srfi-26))
#$marionette)
;; Arrange so that 'converse' prints debugging output to the console.
@@ -1016,7 +1018,9 @@ build (current-guix) and then store a couple of full system images.")
(marionette-eval* '(choose-services installer-socket
#:choose-desktop-environment?
- (const #$desktop?)
+ (lambda (desktop)
+ (any (cut string-contains desktop <>)
+ '#$desktops))
#:choose-network-service?
(const #f))
#$marionette)
@@ -1110,7 +1114,7 @@ build (current-guix) and then store a couple of full system images.")
(define* (guided-installation-test name
#:key
- (desktop? #f)
+ (desktops '())
(encrypted? #f)
target-os
(install-size 'guess)
@@ -1132,7 +1136,7 @@ build (current-guix) and then store a couple of full system images.")
(lambda (marionette)
(gui-test-program
marionette
- #:desktop? desktop?
+ #:desktops desktops
#:encrypted? encrypted?))))
(command (qemu-command/writable-image image)))
(run-basic-test target-os command name
@@ -1155,7 +1159,7 @@ build (current-guix) and then store a couple of full system images.")
;; desktop environments in a single test to reduce the overhead.
(define %test-gui-installed-desktop-os-encrypted
(guided-installation-test "gui-installed-desktop-os-encrypted"
- #:desktop? #t
+ #:desktops '("GNOME")
#:encrypted? #t
#:target-os
(installation-target-desktop-os-for-gui-tests
^ permalink raw reply related [flat|nested] 7+ messages in thread
* bug#40790: OOM error in graphical installer tests.
2020-04-29 8:21 ` Mathieu Othacehe
2020-04-29 15:32 ` Mathieu Othacehe
@ 2020-04-30 21:10 ` Ludovic Courtès
2020-05-01 10:13 ` Bengt Richter
1 sibling, 1 reply; 7+ messages in thread
From: Ludovic Courtès @ 2020-04-30 21:10 UTC (permalink / raw)
To: Mathieu Othacehe; +Cc: 40790-done
Hi,
Mathieu Othacehe <m.othacehe@gmail.com> skribis:
>> Can we throw a little bit more memory at it? :-)
>
> That's what I did with ae1a0f758 :)
Oh, good.
Next we should of course find out why ‘guix system init’ is consuming so
much memory. I haven’t tried GC-profiling that yet, but here’s a rough
figure:
--8<---------------cut here---------------start------------->8---
$ GUIX_PROFILING=gc GUIX_PROFILING_EVENTS=exit guix system build -d --no-grafts gnu/system/examples/desktop.tmpl
/gnu/store/2by26x4pvvp9vi1f0lmrq39wqqkj0s0f-system.drv
Garbage collection statistics:
heap size: 98.80 MiB
allocated: 548.35 MiB
GC times: 26
time spent in GC: 1.84 seconds (36% of user time)
$ guix describe
Generacio 140 Apr 29 2020 19:43:22 (nuna)
guix 19987f5
repository URL: https://git.savannah.gnu.org/git/guix.git
branch: master
commit: 19987f5efe0acb65918802681f3a18cbb6a07c2a
--8<---------------cut here---------------end--------------->8---
So at first sight, it’s surprising that it couldn’t fit in the VM with
800 MiB of RAM. Oh well, we’ll see!
Nitpick: please include the canonical bug URL in commit logs rather
than a link to the mailing list, like so:
Fixes <https://bugs.gnu.org/40790>.
That makes it easier to grep for fixed bugs.
> I didn't have the courage to bisect it, given how long this test
> is. Fixing it, I discovered two more issues:
>
> * "sherpherd services" test was failing because a wrong swap device was
> used (fixed with be3abf28a).
Good catch!
> * I have some hangs when doing the final testing in marionette. Still
> trying to understand why.
Oh.
Thank you!
Ludo’.
^ permalink raw reply [flat|nested] 7+ messages in thread* bug#40790: OOM error in graphical installer tests.
2020-04-30 21:10 ` Ludovic Courtès
@ 2020-05-01 10:13 ` Bengt Richter
0 siblings, 0 replies; 7+ messages in thread
From: Bengt Richter @ 2020-05-01 10:13 UTC (permalink / raw)
To: Ludovic Courtès; +Cc: 40790-done
Hi Ludo, et al,
On +2020-04-30 23:10:05 +0200, Ludovic Courtès wrote:
[...]
rc1: best-practice: commit logs: message syntax
--8<---------------cut here---------------start------------->8---
> Nitpick: please include the canonical bug URL in commit logs rather
> than a link to the mailing list, like so:
>
> Fixes <https://bugs.gnu.org/40790>.
>
> That makes it easier to grep for fixed bugs.
--8<---------------cut here---------------end--------------->8---
ISTM your "nit-pick" is a good example of an embedded mail-list nugget.
Here's my wish:
If you and other developers notice (without false modesty ;-) that you
are posting a good example of something, then if you would enclose it
in guix snippet-delimiters as above, with a single prefixed line
starting with "primary-focus-subject:" and optionally followed by other
greppable (or list-matchable) sub-categories or ad-hoc words or names or tags,
then these nuggets would be easy to extract automatically, to
create a treasure-trove of searchable useful goodies.
I would hope to see useful one-liners and examples of package definition,
system configs, debugging methods, small scripts, and good info-URLs etc.
delimited and prefixed.
(The "primary-focus-subject:" of "rc1:" would permit us to invent improved
syntaxes and evolve them as "rc2" etc until we settle on a canonical set
for primary foci, (and PEG grammar for the rest, if we want to get fancy).
Perhaps the servers could have a gem-and-nugget-bot authoring an html
blog of these things, with automatic attibutions etc from email headers?
--
Regards,
Bengt Richter
^ permalink raw reply [flat|nested] 7+ messages in thread
end of thread, other threads:[~2020-05-02 13:55 UTC | newest]
Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-04-23 9:49 bug#40790: OOM error in graphical installer tests Mathieu Othacehe
2020-04-24 14:27 ` Ludovic Courtès
2020-04-29 8:21 ` Mathieu Othacehe
2020-04-29 15:32 ` Mathieu Othacehe
2020-05-02 13:54 ` Ludovic Courtès
2020-04-30 21:10 ` Ludovic Courtès
2020-05-01 10:13 ` Bengt Richter
Code repositories for project(s) associated with this external index
https://git.savannah.gnu.org/cgit/guix.git
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.