unofficial mirror of bug-guix@gnu.org 
 help / color / mirror / code / Atom feed
* bug#40790: OOM error in graphical installer tests.
@ 2020-04-23  9:49 Mathieu Othacehe
  2020-04-24 14:27 ` Ludovic Courtès
  0 siblings, 1 reply; 7+ messages in thread
From: Mathieu Othacehe @ 2020-04-23  9:49 UTC (permalink / raw)
  To: 40790

[-- Attachment #1: Type: text/plain, Size: 153 bytes --]


Hello,

The "gui-installed-os" test fails on master because "guix system init"
command is OOM killed. Log of the failure is attached.

Thanks,

Mathieu

[-- Attachment #2: oom.log --]
[-- Type: application/octet-stream, Size: 16302 bytes --]

Apr 23 11:30:48 localhost vmunix: [   33.178657] EXT4-fs (dm-0): mounted filesystem with ordered data mode. Opts: (null)
Apr 23 11:30:48 localhost installer[230]: running form #<newt-form 1502690> ("Configuration file") with 1 clients 
Apr 23 11:30:48conversation expecting pattern ((quote pause))
 localhost installer[230]: form #<newt-form 1502690> ("Configuration file"): client 19 replied #t 
Apr 23 11:30:49 localhost shepherd[1]: Service cow-store has been started. 
Apr 23 11:30:49 localhost installer[230]: running command ("guix" "system" "init" "--fallback" "--no-grafts" "--no-substitutes" "/mnt/etc/config.scm" "/mnt") 
^[OQkaza        [  789.166897] syslogd invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
[  789.176935] CPU: 0 PID: 186 Comm: syslogd Not tainted 5.4.34-gnu #1
[  789.178028] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.12.0-59-gc9ba5276e321-prebuilt.qemu.org 04/01/2014
[  789.179829] Call Trace:
[  789.180123]  dump_stack+0x6d/0x8d
[  789.180487]  dump_header+0x4f/0x200
[  789.180863]  oom_kill_process+0xe7/0x120
[  789.181284]  out_of_memory+0x109/0x4d0
[  789.181699]  __alloc_pages_slowpath+0xaaf/0xe60
[  789.182185]  __alloc_pages_nodemask+0x2d0/0x320
[  789.182671]  alloc_pages_current+0x6b/0xd0
[  789.183124]  __page_cache_alloc+0x6c/0xa0
[  789.183539]  pagecache_get_page+0xab/0x2c0
[  789.183977]  filemap_fault+0x696/0xb90
[  789.184357]  ? xas_find+0x17b/0x1c0
[  789.184711]  ? filemap_map_pages+0x182/0x3b0
[  789.185139]  __do_fault+0x57/0x11b
[  789.185484]  __handle_mm_fault+0xdde/0x12b0
[  789.186121]  handle_mm_fault+0xcc/0x200
[  789.186731]  __do_page_fault+0x2a1/0x4d0
[  789.187348]  do_page_fault+0x2c/0xe0
[  789.187911]  do_async_page_fault+0x64/0x90
[  789.188557]  async_page_fault+0x34/0x40
[  789.189165] RIP: 0033:0x405f20
[  789.189664] Code: Bad RIP value.
[  789.190175] RSP: 002b:00007ffc49cee3b8 EFLAGS: 00010246
[  789.191004] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00007fb5bd871744
[  789.191897] RDX: 00007ffc49cee3c0 RSI: 00007ffc49cee4f0 RDI: 000000000000000e
[  789.192580] RBP: 00000000009b8fc0 R08: fefefefefefefeff R09: ffffff0000000000
[  789.193263] R10: 0000000000000008 R11: 0000000000000246 R12: 00007ffc49ceedb0
[  789.193964] R13: 00000000009b8fc0 R14: 00007ffc49ceee0a R15: 00007ffc49cee9a0
[  789.194693] Mem-Info:
[  789.194941] active_anon:155980 inactive_anon:2486 isolated_anon:0
[  789.194941]  active_file:7481 inactive_file:7464 isolated_file:64
[  789.194941]  unevictable:0 dirty:0 writeback:0 unstable:0
[  789.194941]  slab_reclaimable:7698 slab_unreclaimable:3517
[  789.194941]  mapped:83 shmem:34652 pagetables:571 bounce:0
[  789.194941]  free:5623 free_pcp:59 free_cma:0
[  789.198668] Node 0 active_anon:623920kB inactive_anon:9944kB active_file:29924kB inactive_file:29856kB unevictable:0kB isolated(anon):0kB isolated(file):256kB mapped:332kB dirty:0kB writeback:0kB shmem:13860s
[  789.202572] Node 0 DMA32 free:22492kB min:22528kB low:28160kB high:33792kB active_anon:623920kB inactive_anon:9944kB active_file:29924kB inactive_file:29856kB unevictable:0kB writepending:0kB present:818668kB
[  789.205398] lowmem_reserve[]: 0 0 0 0
[  789.205778] Node 0 DMA32: 897*4kB (UE) 1111*8kB (UME) 336*16kB (UME) 107*32kB (UME) 19*64kB (UME) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 22492kB
[  789.207194] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[  789.208007] 49661 total pagecache pages
[  789.208409] 0 pages in swap cache
[  789.208779] Swap cache stats: add 0, delete 0, find 0/0
[  789.209366] Free swap  = 0kB
[  789.209704] Total swap = 0kB
[  789.210033] 204667 pages RAM
[  789.210360] 0 pages HighMem/MovableOnly
[  789.210806] 9753 pages reserved
[  789.211176] 0 pages cma reserved
[  789.211544] 0 pages hwpoisoned
[  789.211860] Tasks state (memory values in pages):
[  789.212340] [  pid  ]   uid  tgid total_vm      rss pgtables_bytes swapents oom_score_adj name
[  789.213205] [    168]     0   168     1051      242    49152        0             0 udevd
[  789.214006] [    186]     0   186      632       35    40960        0             0 syslogd
[  789.214885] [    190]   999   190      877       65    45056        0             0 dbus-daemon
[  789.215733] [    192]     0   192     2239      117    53248        0             0 wpa_supplicant
[  789.217023] [    193]     0   193     2592      187    57344        0             0 connmand
[  789.218465] [    194]     0   194     5039       67    69632        0             0 nscd
[  789.219752] [    203]     0   203      935       29    49152        0             0 gpm
[  789.220849] [    204]     0   204     8206      594    77824        0             0 kmscon
[  789.221781] [    212]     0   212      591       11    45056        0             0 mingetty
[  789.222684] [    215]     0   215      591       12    45056        0             0 mingetty
[  789.223801] [    218]     0   218      591       12    40960        0             0 mingetty
[  789.224620] [    221]     0   221      591       12    45056        0             0 mingetty
[  789.225434] [    224]     0   224     2980      127    61440        0             0 guix-daemon
[  789.226289] [    225]     0   225    14206     3338   118784        0             0 shepherd
[  789.227341] [    230]     0   230    76992    21776   495616        0             0 6da4vp09728wrqv
[  789.228595] [    233]   987   233     1667      229    45056        0             0 info
[  789.229746] [    285]     0   285   146161    82420  1060864        0             0 guix
[  789.230931] [    288]     0   288     5650     1024    73728        0             0 guix-daemon
[  789.232172] [    454]   997   454    37661    13065   188416        0             0 guile
[  789.233292] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/,task=guix,pid=285,uid=0
[  789.235033] Out of memory: Killed process 285 (guix) total-vm:584644kB, anon-rss:329616kB, file-rss:0kB, shmem-rss:64kB, UID:0 pgtables:1036kB oom_score_adj:0
[  789.315521] oom_reaper: reaped process 285 (guix), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
conversation expecting pattern ((quote installation-complete))
warning: failed to delete /mnt/tmp/guix-inst/dqfyzhyl4kldb53vlirmmf6wpkjm6iy2-module-import-compiled.drv.chroot: No such file or directory
Apr 23 11:43:25 localhost vmunix: [  789.166897] syslogd invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
Apr 23 11:43:25 localhost vmunix: [  789.176935] CPU: 0 PID: 186 Comm: syslogd Not tainted 5.4.34-gnu #1
Apr 23 11:43:25 localhost vmunix: [  789.178028] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.12.0-59-gc9ba5276e321-prebuilt.qemu.org 04/01/2014
Apr 23 11:43:25 localhost vmunix: [  789.179829] Call Trace:
Apr 23 11:43:25 localhost vmunix: [  789.180123]  dump_stack+0x6d/0x8d
Apr 23 11:43:25 localhost vmunix: [  789.180487]  dump_header+0x4f/0x200
Apr 23 11:43:25 localhost vmunix: [  789.180863]  oom_kill_process+0xe7/0x120
Apr 23 11:43:25 localhost vmunix: [  789.181284]  out_of_memory+0x109/0x4d0
Apr 23 11:43:25 localhost vmunix: [  789.181699]  __alloc_pages_slowpath+0xaaf/0xe60
Apr 23 11:43:25 localhost vmunix: [  789.182185]  __alloc_pages_nodemask+0x2d0/0x320
Apr 23 11:43:25 localhost vmunix: [  789.182671]  alloc_pages_current+0x6b/0xd0
Apr 23 11:43:25 localhost vmunix: [  789.183124]  __page_cache_alloc+0x6c/0xa0
Apr 23 11:43:25 localhost vmunix: [  789.183539]  pagecache_get_page+0xab/0x2c0
Apr 23 11:43:25 localhost vmunix: [  789.183977]  filemap_fault+0x696/0xb90
Apr 23 11:43:25 localhost vmunix: [  789.184357]  ? xas_find+0x17b/0x1c0
Apr 23 11:43:25 localhost vmunix: [  789.184711]  ? filemap_map_pages+0x182/0x3b0
Apr 23 11:43:25 localhost vmunix: [  789.185139]  __do_fault+0x57/0x11b
Apr 23 11:43:25 localhost vmunix: [  789.185484]  __handle_mm_fault+0xdde/0x12b0
Apr 23 11:43:25 localhost vmunix: [  789.186121]  handle_mm_fault+0xcc/0x200
Apr 23 11:43:25 localhost vmunix: [  789.186731]  __do_page_fault+0x2a1/0x4d0
Apr 23 11:43:25 localhost vmunix: [  789.187348]  do_page_fault+0x2c/0xe0
Apr 23 11:43:25 localhost vmunix: [  789.187911]  do_async_page_fault+0x64/0x90
Apr 23 11:43:25 localhost vmunix: [  789.188557]  async_page_fault+0x34/0x40
Apr 23 11:43:25 localhost vmunix: [  789.189165] RIP: 0033:0x405f20
Apr 23 11:43:25 localhost vmunix: [  789.189664] Code: Bad RIP value.
Apr 23 11:43:25 localhost vmunix: [  789.190175] RSP: 002b:00007ffc49cee3b8 EFLAGS: 00010246
Apr 23 11:43:25 localhost vmunix: [  789.191004] RAX: 0000000000000000 RBX: 0000000000000000 RCX: 00007fb5bd871744
Apr 23 11:43:25 localhost vmunix: [  789.191897] RDX: 00007ffc49cee3c0 RSI: 00007ffc49cee4f0 RDI: 000000000000000e
Apr 23 11:43:25 localhost vmunix: [  789.192580] RBP: 00000000009b8fc0 R08: fefefefefefefeff R09: ffffff0000000000
Apr 23 11:43:25 localhost vmunix: [  789.193263] R10: 0000000000000008 R11: 0000000000000246 R12: 00007ffc49ceedb0
Apr 23 11:43:25 localhost vmunix: [  789.193964] R13: 00000000009b8fc0 R14: 00007ffc49ceee0a R15: 00007ffc49cee9a0
Apr 23 11:43:25 localhost vmunix: [  789.194693] Mem-Info:
Apr 23 11:43:25 localhost vmunix: [  789.194941] active_anon:155980 inactive_anon:2486 isolated_anon:0
Apr 23 11:43:25 localhost vmunix: [  789.194941]  active_file:7481 inactive_file:7464 isolated_file:64
Apr 23 11:43:25 localhost vmunix: [  789.194941]  unevictable:0 dirty:0 writeback:0 unstable:0
Apr 23 11:43:25 localhost vmunix: [  789.194941]  slab_reclaimable:7698 slab_unreclaimable:3517
Apr 23 11:43:25 localhost vmunix: [  789.194941]  mapped:83 shmem:34652 pagetables:571 bounce:0
Apr 23 11:43:25 localhost vmunix: [  789.194941]  free:5623 free_pcp:59 free_cma:0
Apr 23 11:43:25 localhost vmunix: [  789.198668] Node 0 active_anon:623920kB inactive_anon:9944kB active_file:29924kB inactive_file:29856kB unevictable:0kB isolated(anon):0kB isolated(file):256kB mapped:332kB ds
Apr 23 11:43:25 localhost vmunix: [  789.202572] Node 0 DMA32 free:22492kB min:22528kB low:28160kB high:33792kB active_anon:623920kB inactive_anon:9944kB active_file:29924kB inactive_file:29856kB unevictable:0kB
Apr 23 11:43:25 localhost vmunix: [  789.205398] lowmem_reserve[]: 0 0 0 0
Apr 23 11:43:25 localhost vmunix: [  789.205778] Node 0 DMA32: 897*4kB (UE) 1111*8kB (UME) 336*16kB (UME) 107*32kB (UME) 19*64kB (UME) 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 22492kB
Apr 23 11:43:25 localhost vmunix: [  789.207194] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
Apr 23 11:43:25 localhost vmunix: [  789.208007] 49661 total pagecache pages
Apr 23 11:43:25 localhost vmunix: [  789.208409] 0 pages in swap cache
Apr 23 11:43:25 localhost vmunix: [  789.208779] Swap cache stats: add 0, delete 0, find 0/0
Apr 23 11:43:25 localhost vmunix: [  789.209366] Free swap  = 0kB
Apr 23 11:43:25 localhost vmunix: [  789.209704] Total swap = 0kB
Apr 23 11:43:25 localhost vmunix: [  789.210033] 204667 pages RAM
Apr 23 11:43:25 localhost vmunix: [  789.210360] 0 pages HighMem/MovableOnly
Apr 23 11:43:25 localhost vmunix: [  789.210806] 9753 pages reserved
Apr 23 11:43:25 localhost vmunix: [  789.211176] 0 pages cma reserved
Apr 23 11:43:25 localhost vmunix: [  789.211544] 0 pages hwpoisoned
Apr 23 11:43:25 localhost vmunix: [  789.211860] Tasks state (memory values in pages):
Apr 23 11:43:25 localhost vmunix: [  789.212340] [  pid  ]   uid  tgid total_vm      rss pgtables_bytes swapents oom_score_adj name
Apr 23 11:43:25 localhost vmunix: [  789.213205] [    168]     0   168     1051      242    49152        0             0 udevd
Apr 23 11:43:25 localhost vmunix: [  789.214006] [    186]     0   186      632       35    40960        0             0 syslogd
Apr 23 11:43:25 localhost vmunix: [  789.214885] [    190]   999   190      877       65    45056        0             0 dbus-daemon
Apr 23 11:43:25 localhost vmunix: [  789.215733] [    192]     0   192     2239      117    53248        0             0 wpa_supplicant
Apr 23 11:43:25 localhost vmunix: [  789.217023] [    193]     0   193     2592      187    57344        0             0 connmand
Apr 23 11:43:25 localhost vmunix: [  789.218465] [    194]     0   194     5039       67    69632        0             0 nscd
Apr 23 11:43:25 localhost vmunix: [  789.219752] [    203]     0   203      935       29    49152        0             0 gpm
Apr 23 11:43:25 localhost vmunix: [  789.220849] [    204]     0   204     8206      594    77824        0             0 kmscon
Apr 23 11:43:25 localhost vmunix: [  789.221781] [    212]     0   212      591       11    45056        0             0 mingetty
Apr 23 11:43:25 localhost vmunix: [  789.222684] [    215]     0   215      591       12    45056        0             0 mingetty
Apr 23 11:43:25 localhost vmunix: [  789.223801] [    218]     0   218      591       12    40960        0             0 mingetty
Apr 23 11:43:25 localhost vmunix: [  789.224620] [    221]     0   221      591       12    45056        0             0 mingetty
Apr 23 11:43:25 localhost vmunix: [  789.225434] [    224]     0   224     2980      127    61440        0             0 guix-daemon
Apr 23 11:43:25 localhost vmunix: [  789.226289] [    225]     0   225    14206     3338   118784        0             0 shepherd
Apr 23 11:43:25 localhost vmunix: [  789.227341] [    230]     0   230    76992    21776   495616        0             0 6da4vp09728wrqv
Apr 23 11:43:25 localhost vmunix: [  789.228595] [    233]   987   233     1667      229    45056        0             0 info
Apr 23 11:43:25 localhost vmunix: [  789.229746] [    285]     0   285   146161    82420  1060864        0             0 guix
Apr 23 11:43:25 localhost vmunix: [  789.230931] [    288]     0   288     5650     1024    73728        0             0 guix-daemon
Apr 23 11:43:25 localhost vmunix: [  789.232172] [    454]   997   454    37661    13065   188416        0             0 guile
Apr 23 11:43:25 localhost vmunix: [  789.233292] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/,task=guix,pid=285,uid=0
Apr 23 11:43:25 localhost vmunix: [  789.235033] Out of memory: Killed process 285 (guix) total-vm:584644kB, anon-rss:329616kB, file-rss:0kB, shmem-rss:64kB, UID:0 pgtables:1036kB oom_score_adj:0
Apr 23 11:43:25 localhost vmunix: [  789.315521] oom_reaper: reaped process 285 (guix), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
Apr 23 11:43:25 localhost shepherd[1]: Service cow-store has been stopped. 
Apr 23 11:43:25 localhost shepherd[1]: Service guix-daemon has been stopped. 
Apr 23 11:43:25 localhost shepherd[1]: Service guix-daemon has been started. 
Apr 23 11:43:27 localhost installer[230]: command ("guix" "system" "init" "--fallback" "--no-grafts" "--no-substitutes" "/mnt/etc/config.scm" "/mnt") failed with exit code #finstaller[230]: Umounted /remove suc 
Apr 23 11:43:27 localhost installer[230]: unmounting "/mnt/" 
Apr 23 11:43:27 localhost installer[230]: closing LUKS entry "cryptroot" 
/gnu/store/n563kilv1669dyv9p3d77hf4q884vy7y-shepherd-marionette.scm:1:1718: Throw to key `srfi-34' with args `(#<condition &pattern-not-matched [pattern: ((quote installation-complete)) sexp: (installation-fail.
Backtrace:
           2 (primitive-load "/gnu/store/lvzc6hf6fpyxgp5zbmnsgnk0zfn?")
In ice-9/eval.scm:
   191:35  1 (_ #f)
    619:8  0 (_ #(#<directory (guile-user) 7ffff3c6c140> #<variabl?>))

ice-9/eval.scm:619:8: Throw to key `marionette-eval-failure' with args `((quote (conclude-installation installer-socket)))'.
note: keeping build directory `/tmp/guix-build-installation.drv-0'
builder for `/gnu/store/w1ic8pg8s786h5mr8xjx60zmklyqhlrb-installation.drv' failed with exit code 1
build of /gnu/store/w1ic8pg8s786h5mr8xjx60zmklyqhlrb-installation.drv failed
View build log at '/var/log/guix/drvs/w1/ic8pg8s786h5mr8xjx60zmklyqhlrb-installation.drv.bz2'.
cannot build derivation `/gnu/store/y3a1hx36n92xzp6rm5hrsi4lmk10syvb-gui-installed-os-encrypted.drv': 1 dependencies couldn't be built
guix build: error: build of `/gnu/store/y3a1hx36n92xzp6rm5hrsi4lmk10syvb-gui-installed-os-encrypted.drv' failed
make: *** [Makefile:5857: check-system] Error 1

^ permalink raw reply	[flat|nested] 7+ messages in thread

* bug#40790: OOM error in graphical installer tests.
  2020-04-23  9:49 bug#40790: OOM error in graphical installer tests Mathieu Othacehe
@ 2020-04-24 14:27 ` Ludovic Courtès
  2020-04-29  8:21   ` Mathieu Othacehe
  0 siblings, 1 reply; 7+ messages in thread
From: Ludovic Courtès @ 2020-04-24 14:27 UTC (permalink / raw)
  To: Mathieu Othacehe; +Cc: 40790

Hi Mathieu,

Mathieu Othacehe <m.othacehe@gmail.com> skribis:

> The "gui-installed-os" test fails on master because "guix system init"
> command is OOM killed. Log of the failure is attached.

[...]

> Apr 23 11:43:27 localhost installer[230]: command ("guix" "system" "init" "--fallback" "--no-grafts" "--no-substitutes" "/mnt/etc/config.scm" "/mnt") failed with exit code #finstaller[230]: Umounted /remove suc 

Can we throw a little bit more memory at it?  :-)

Is there a commit that trigger this failure?

Thanks,
Ludo’.

^ permalink raw reply	[flat|nested] 7+ messages in thread

* bug#40790: OOM error in graphical installer tests.
  2020-04-24 14:27 ` Ludovic Courtès
@ 2020-04-29  8:21   ` Mathieu Othacehe
  2020-04-29 15:32     ` Mathieu Othacehe
  2020-04-30 21:10     ` Ludovic Courtès
  0 siblings, 2 replies; 7+ messages in thread
From: Mathieu Othacehe @ 2020-04-29  8:21 UTC (permalink / raw)
  To: Ludovic Courtès; +Cc: 40790-done


Hello,

> Can we throw a little bit more memory at it?  :-)

That's what I did with ae1a0f758 :)

> Is there a commit that trigger this failure?

I didn't have the courage to bisect it, given how long this test
is. Fixing it, I discovered two more issues:

* "sherpherd services" test was failing because a wrong swap device was
  used (fixed with be3abf28a).

* I have some hangs when doing the final testing in marionette. Still
  trying to understand why.

Thanks,

Mathieu




^ permalink raw reply	[flat|nested] 7+ messages in thread

* bug#40790: OOM error in graphical installer tests.
  2020-04-29  8:21   ` Mathieu Othacehe
@ 2020-04-29 15:32     ` Mathieu Othacehe
  2020-05-02 13:54       ` Ludovic Courtès
  2020-04-30 21:10     ` Ludovic Courtès
  1 sibling, 1 reply; 7+ messages in thread
From: Mathieu Othacehe @ 2020-04-29 15:32 UTC (permalink / raw)
  To: Ludovic Courtès; +Cc: 40790-done


> * I have some hangs when doing the final testing in marionette. Still
>   trying to understand why.

Fixed with c537d2bcb7c652b4776435cd1e2a5119af43dd78. Still an issue
remaining. "gui-installed-desktop-os-encrypted" closure is about 5.5GiB
which makes too much files for libisofs:

--8<---------------cut here---------------start------------->8---
xorriso : UPDATE :  427934 files added in 19 seconds
libisofs: FAILURE : HFS+ map nodes aren't implemented
libisofs: FAILURE : Too much files to mangle, cannot guarantee unique file names
xorriso : FAILURE : Failed to prepare session write run
xorriso : NOTE : -return_with SORRY 32 triggered by problem severity FAILURE
--8<---------------cut here---------------end--------------->8---

Not sure how to fix it. Someone?

Thanks,

Mathieu




^ permalink raw reply	[flat|nested] 7+ messages in thread

* bug#40790: OOM error in graphical installer tests.
  2020-04-29  8:21   ` Mathieu Othacehe
  2020-04-29 15:32     ` Mathieu Othacehe
@ 2020-04-30 21:10     ` Ludovic Courtès
  2020-05-01 10:13       ` Bengt Richter
  1 sibling, 1 reply; 7+ messages in thread
From: Ludovic Courtès @ 2020-04-30 21:10 UTC (permalink / raw)
  To: Mathieu Othacehe; +Cc: 40790-done

Hi,

Mathieu Othacehe <m.othacehe@gmail.com> skribis:

>> Can we throw a little bit more memory at it?  :-)
>
> That's what I did with ae1a0f758 :)

Oh, good.

Next we should of course find out why ‘guix system init’ is consuming so
much memory.  I haven’t tried GC-profiling that yet, but here’s a rough
figure:

--8<---------------cut here---------------start------------->8---
$ GUIX_PROFILING=gc GUIX_PROFILING_EVENTS=exit guix system build -d --no-grafts gnu/system/examples/desktop.tmpl
/gnu/store/2by26x4pvvp9vi1f0lmrq39wqqkj0s0f-system.drv
Garbage collection statistics:
  heap size:        98.80 MiB
  allocated:        548.35 MiB
  GC times:         26
  time spent in GC: 1.84 seconds (36% of user time)
$ guix describe
Generacio 140	Apr 29 2020 19:43:22	(nuna)
  guix 19987f5
    repository URL: https://git.savannah.gnu.org/git/guix.git
    branch: master
    commit: 19987f5efe0acb65918802681f3a18cbb6a07c2a
--8<---------------cut here---------------end--------------->8---

So at first sight, it’s surprising that it couldn’t fit in the VM with
800 MiB of RAM.  Oh well, we’ll see!

Nitpick: please include the canonical bug URL in commit logs rather
than a link to the mailing list, like so:

  Fixes <https://bugs.gnu.org/40790>.

That makes it easier to grep for fixed bugs.

> I didn't have the courage to bisect it, given how long this test
> is. Fixing it, I discovered two more issues:
>
> * "sherpherd services" test was failing because a wrong swap device was
>   used (fixed with be3abf28a).

Good catch!

> * I have some hangs when doing the final testing in marionette. Still
>   trying to understand why.

Oh.

Thank you!

Ludo’.




^ permalink raw reply	[flat|nested] 7+ messages in thread

* bug#40790: OOM error in graphical installer tests.
  2020-04-30 21:10     ` Ludovic Courtès
@ 2020-05-01 10:13       ` Bengt Richter
  0 siblings, 0 replies; 7+ messages in thread
From: Bengt Richter @ 2020-05-01 10:13 UTC (permalink / raw)
  To: Ludovic Courtès; +Cc: 40790-done

Hi Ludo, et al,

On +2020-04-30 23:10:05 +0200, Ludovic Courtès wrote:
[...]

rc1: best-practice: commit logs: message syntax
--8<---------------cut here---------------start------------->8---
> Nitpick: please include the canonical bug URL in commit logs rather
> than a link to the mailing list, like so:
> 
>   Fixes <https://bugs.gnu.org/40790>.
> 
> That makes it easier to grep for fixed bugs.
--8<---------------cut here---------------end--------------->8---

ISTM your "nit-pick" is a good example of an embedded mail-list nugget.

Here's my wish:
If you and other developers notice (without false modesty ;-) that you
are posting a good example of something, then if you would enclose it
in guix snippet-delimiters as above, with a single prefixed line
starting with "primary-focus-subject:" and optionally followed by other
greppable (or list-matchable) sub-categories or ad-hoc words or names or tags,
then these nuggets would be easy to extract automatically, to
create a treasure-trove of searchable useful goodies.

I would hope to see useful one-liners and examples of package definition,
system configs, debugging methods, small scripts, and good info-URLs etc.
delimited and prefixed.

(The "primary-focus-subject:" of "rc1:" would permit us to invent improved
syntaxes and evolve them as "rc2" etc until we settle on a canonical set
for primary foci, (and PEG grammar for the rest, if we want to get fancy).

Perhaps the servers could have a gem-and-nugget-bot authoring an html
blog of these things, with automatic attibutions etc from email headers?

-- 
Regards,
Bengt Richter




^ permalink raw reply	[flat|nested] 7+ messages in thread

* bug#40790: OOM error in graphical installer tests.
  2020-04-29 15:32     ` Mathieu Othacehe
@ 2020-05-02 13:54       ` Ludovic Courtès
  0 siblings, 0 replies; 7+ messages in thread
From: Ludovic Courtès @ 2020-05-02 13:54 UTC (permalink / raw)
  To: Mathieu Othacehe; +Cc: 40790

[-- Attachment #1: Type: text/plain, Size: 1758 bytes --]

Hi,

Mathieu Othacehe <m.othacehe@gmail.com> skribis:

>> * I have some hangs when doing the final testing in marionette. Still
>>   trying to understand why.
>
> Fixed with c537d2bcb7c652b4776435cd1e2a5119af43dd78.

Cool, sorry for breaking things.  :-/

> Still an issue remaining. "gui-installed-desktop-os-encrypted" closure
> is about 5.5GiB which makes too much files for libisofs:
>
> xorriso : UPDATE :  427934 files added in 19 seconds
> libisofs: FAILURE : HFS+ map nodes aren't implemented
> libisofs: FAILURE : Too much files to mangle, cannot guarantee unique file names
> xorriso : FAILURE : Failed to prepare session write run
> xorriso : NOTE : -return_with SORRY 32 triggered by problem severity FAILURE
>
> Not sure how to fix it. Someone?

I tried the attached patch, which would select just one desktop
environments, thinking it might appease Xorriso, but actually it still
OOMs at the very last step:

--8<---------------cut here---------------start------------->8---
xorriso : UPDATE :  141879 file filters processed in 848 seconds
xorriso : UPDATE :  142026 file filters processed in 849 seconds
xorriso : UPDATE :  142102 file filters processed in 850 seconds
xorriso : NOTE : Copying to System Area: 512 bytes from file '/gnu/store/dvfl5ax7pj6c62f1ccc27qcrcb8nafr7-grub-hybrid-2.04/lib/grub/i386-pc/boot_hybrid.img'
[13266.747348] xorriso invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0
[13266.749415] CPU: 0 PID: 251 Comm: xorriso Not tainted 5.4.36-gnu #1
[13266.750777] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.12.0-59-gc9ba5276e321-prebuilt.qemu.org 04/01/2014
--8<---------------cut here---------------end--------------->8---

Testing again with this extra patch:


[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: Type: text/x-patch, Size: 440 bytes --]

diff --git a/gnu/system/vm.scm b/gnu/system/vm.scm
index 6f81ac16ff..9f240b50ee 100644
--- a/gnu/system/vm.scm
+++ b/gnu/system/vm.scm
@@ -356,7 +356,7 @@ INPUTS is a list of inputs (as for packages)."
    #:substitutable? substitutable?
 
    ;; Xorriso seems to be quite memory-hungry, so increase the VM's RAM size.
-   #:memory-size 512))
+   #:memory-size 1024))
 
 (define* (qemu-image #:key
                      (name "qemu-image")

[-- Attachment #3: Type: text/plain, Size: 199 bytes --]


I wonder if why it’s taking so much memory, and whether there’s
something else at play, like temporary files written to the overlaid
tmpfs and thus eating memory.

Thoughts?

Ludo’.


[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #4: Type: text/x-patch, Size: 3164 bytes --]

diff --git a/gnu/tests/install.scm b/gnu/tests/install.scm
index 019e21fd39..941958d698 100644
--- a/gnu/tests/install.scm
+++ b/gnu/tests/install.scm
@@ -957,7 +957,7 @@ build (current-guix) and then store a couple of full system images.")
 
 (define* (gui-test-program marionette
                            #:key
-                           (desktop? #f)
+                           (desktops '())
                            (encrypted? #f))
   #~(let ()
       (define (screenshot file)
@@ -971,7 +971,9 @@ build (current-guix) and then store a couple of full system images.")
       (setvbuf (current-output-port) 'none)
       (setvbuf (current-error-port) 'none)
 
-      (marionette-eval* '(use-modules (gnu installer tests))
+      (marionette-eval* '(use-modules (gnu installer tests)
+                                      (srfi srfi-1)
+                                      (srfi srfi-26))
                         #$marionette)
 
       ;; Arrange so that 'converse' prints debugging output to the console.
@@ -1016,7 +1018,9 @@ build (current-guix) and then store a couple of full system images.")
 
       (marionette-eval* '(choose-services installer-socket
                                           #:choose-desktop-environment?
-                                          (const #$desktop?)
+                                          (lambda (desktop)
+                                            (any (cut string-contains desktop <>)
+                                                 '#$desktops))
                                           #:choose-network-service?
                                           (const #f))
                         #$marionette)
@@ -1110,7 +1114,7 @@ build (current-guix) and then store a couple of full system images.")
 
 (define* (guided-installation-test name
                                    #:key
-                                   (desktop? #f)
+                                   (desktops '())
                                    (encrypted? #f)
                                    target-os
                                    (install-size 'guess)
@@ -1132,7 +1136,7 @@ build (current-guix) and then store a couple of full system images.")
                                (lambda (marionette)
                                  (gui-test-program
                                   marionette
-                                  #:desktop? desktop?
+                                  #:desktops desktops
                                   #:encrypted? encrypted?))))
          (command (qemu-command/writable-image image)))
       (run-basic-test target-os command name
@@ -1155,7 +1159,7 @@ build (current-guix) and then store a couple of full system images.")
 ;; desktop environments in a single test to reduce the overhead.
 (define %test-gui-installed-desktop-os-encrypted
   (guided-installation-test "gui-installed-desktop-os-encrypted"
-                            #:desktop? #t
+                            #:desktops '("GNOME")
                             #:encrypted? #t
                             #:target-os
                             (installation-target-desktop-os-for-gui-tests

^ permalink raw reply related	[flat|nested] 7+ messages in thread

end of thread, other threads:[~2020-05-02 13:55 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2020-04-23  9:49 bug#40790: OOM error in graphical installer tests Mathieu Othacehe
2020-04-24 14:27 ` Ludovic Courtès
2020-04-29  8:21   ` Mathieu Othacehe
2020-04-29 15:32     ` Mathieu Othacehe
2020-05-02 13:54       ` Ludovic Courtès
2020-04-30 21:10     ` Ludovic Courtès
2020-05-01 10:13       ` Bengt Richter

Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/guix.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).