From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id oIV6GcJ7rV6TeAAA0tVLHw (envelope-from ) for ; Sat, 02 May 2020 13:55:14 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id 2NA6Nct7rV68WAAA1q6Kng (envelope-from ) for ; Sat, 02 May 2020 13:55:23 +0000 Received: from lists.gnu.org (lists.gnu.org [IPv6:2001:470:142::17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id CA5B994205D for ; Sat, 2 May 2020 13:55:22 +0000 (UTC) Received: from localhost ([::1]:58916 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jUsbz-0004L0-1J for larch@yhetil.org; Sat, 02 May 2020 09:55:23 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:53808) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jUsbg-0003rb-4c for bug-guix@gnu.org; Sat, 02 May 2020 09:55:04 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.90_1) (envelope-from ) id 1jUsbf-0003Qe-Fh for bug-guix@gnu.org; Sat, 02 May 2020 09:55:03 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:40100) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jUsbf-0003QI-37 for bug-guix@gnu.org; Sat, 02 May 2020 09:55:03 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1jUsbe-0005Re-VN for bug-guix@gnu.org; Sat, 02 May 2020 09:55:02 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#40790: OOM error in graphical installer tests. Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Sat, 02 May 2020 13:55:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 40790 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Mathieu Othacehe Received: via spool by 40790-submit@debbugs.gnu.org id=B40790.158842769220884 (code B ref 40790); Sat, 02 May 2020 13:55:02 +0000 Received: (at 40790) by debbugs.gnu.org; 2 May 2020 13:54:52 +0000 Received: from localhost ([127.0.0.1]:51641 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jUsbR-0005Qj-1s for submit@debbugs.gnu.org; Sat, 02 May 2020 09:54:52 -0400 Received: from eggs.gnu.org ([209.51.188.92]:50670) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jUsbP-0005QU-1X for 40790@debbugs.gnu.org; Sat, 02 May 2020 09:54:47 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:57790) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jUsbJ-00039F-1O; Sat, 02 May 2020 09:54:41 -0400 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=47662 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1jUsbI-0000vN-J2; Sat, 02 May 2020 09:54:40 -0400 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= References: <877dy6o7kl.fsf@gmail.com> <87wo65gdry.fsf@gnu.org> <87v9lisnwm.fsf@gmail.com> <874kt2xq74.fsf@gmail.com> X-URL: http://www.fdn.fr/~lcourtes/ X-Revolutionary-Date: 13 =?UTF-8?Q?Flor=C3=A9al?= an 228 de la =?UTF-8?Q?R=C3=A9volution?= X-PGP-Key-ID: 0x090B11993D9AEBB5 X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4 0CFB 090B 1199 3D9A EBB5 X-OS: x86_64-pc-linux-gnu Date: Sat, 02 May 2020 15:54:38 +0200 In-Reply-To: <874kt2xq74.fsf@gmail.com> (Mathieu Othacehe's message of "Wed, 29 Apr 2020 17:32:47 +0200") Message-ID: <87imhe7881.fsf@gnu.org> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="=-=-=" X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Received-From: 209.51.188.43 X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 40790@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Scanner: scn0 X-Spam-Score: -1.01 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 2001:470:142::17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Scan-Result: default: False [-1.01 / 13.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; GENERIC_REPUTATION(0.00)[-0.4950139917045]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:142::/48:c]; IP_REPUTATION_HAM(0.00)[asn: 22989(0.15), country: US(-0.00), ip: 2001:470:142::17(-0.50)]; DWL_DNSWL_FAIL(0.00)[2001:470:142::17:server fail]; MX_GOOD(-0.50)[cached: eggs.gnu.org]; RCPT_COUNT_TWO(0.00)[2]; MAILLIST(-0.20)[mailman]; FREEMAIL_TO(0.00)[gmail.com]; RCVD_IN_DNSWL_FAIL(0.00)[2001:470:142::17:server fail]; RCVD_TLS_LAST(0.00)[]; R_DKIM_NA(0.00)[]; ASN(0.00)[asn:22989, ipnet:2001:470:142::/48, country:US]; MID_RHS_MATCH_FROM(0.00)[]; TAGGED_FROM(0.00)[larch=yhetil.org]; ARC_NA(0.00)[]; FORGED_RECIPIENTS_MAILLIST(0.00)[]; FROM_NEQ_ENVFROM(0.00)[ludo@gnu.org,bug-guix-bounces@gnu.org]; FROM_HAS_DN(0.00)[]; URIBL_BLOCKED(0.00)[qemu.org:url]; TAGGED_RCPT(0.00)[]; MIME_GOOD(-0.10)[multipart/mixed,text/plain,text/x-patch]; DMARC_NA(0.00)[gnu.org]; HAS_LIST_UNSUB(-0.01)[]; MIME_TRACE(0.00)[0:+,1:+,2:+,3:+,4:+]; RCVD_COUNT_SEVEN(0.00)[10]; FORGED_SENDER_MAILLIST(0.00)[] X-TUID: HHjrO4M59cRq --=-=-= Content-Type: text/plain Hi, Mathieu Othacehe skribis: >> * I have some hangs when doing the final testing in marionette. Still >> trying to understand why. > > Fixed with c537d2bcb7c652b4776435cd1e2a5119af43dd78. Cool, sorry for breaking things. :-/ > Still an issue remaining. "gui-installed-desktop-os-encrypted" closure > is about 5.5GiB which makes too much files for libisofs: > > xorriso : UPDATE : 427934 files added in 19 seconds > libisofs: FAILURE : HFS+ map nodes aren't implemented > libisofs: FAILURE : Too much files to mangle, cannot guarantee unique file names > xorriso : FAILURE : Failed to prepare session write run > xorriso : NOTE : -return_with SORRY 32 triggered by problem severity FAILURE > > Not sure how to fix it. Someone? I tried the attached patch, which would select just one desktop environments, thinking it might appease Xorriso, but actually it still OOMs at the very last step: --8<---------------cut here---------------start------------->8--- xorriso : UPDATE : 141879 file filters processed in 848 seconds xorriso : UPDATE : 142026 file filters processed in 849 seconds xorriso : UPDATE : 142102 file filters processed in 850 seconds xorriso : NOTE : Copying to System Area: 512 bytes from file '/gnu/store/dvfl5ax7pj6c62f1ccc27qcrcb8nafr7-grub-hybrid-2.04/lib/grub/i386-pc/boot_hybrid.img' [13266.747348] xorriso invoked oom-killer: gfp_mask=0x100cca(GFP_HIGHUSER_MOVABLE), order=0, oom_score_adj=0 [13266.749415] CPU: 0 PID: 251 Comm: xorriso Not tainted 5.4.36-gnu #1 [13266.750777] Hardware name: QEMU Standard PC (i440FX + PIIX, 1996), BIOS rel-1.12.0-59-gc9ba5276e321-prebuilt.qemu.org 04/01/2014 --8<---------------cut here---------------end--------------->8--- Testing again with this extra patch: --=-=-= Content-Type: text/x-patch Content-Disposition: inline diff --git a/gnu/system/vm.scm b/gnu/system/vm.scm index 6f81ac16ff..9f240b50ee 100644 --- a/gnu/system/vm.scm +++ b/gnu/system/vm.scm @@ -356,7 +356,7 @@ INPUTS is a list of inputs (as for packages)." #:substitutable? substitutable? ;; Xorriso seems to be quite memory-hungry, so increase the VM's RAM size. - #:memory-size 512)) + #:memory-size 1024)) (define* (qemu-image #:key (name "qemu-image") --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable I wonder if why it=E2=80=99s taking so much memory, and whether there=E2=80= =99s something else at play, like temporary files written to the overlaid tmpfs and thus eating memory. Thoughts? Ludo=E2=80=99. --=-=-= Content-Type: text/x-patch Content-Disposition: inline diff --git a/gnu/tests/install.scm b/gnu/tests/install.scm index 019e21fd39..941958d698 100644 --- a/gnu/tests/install.scm +++ b/gnu/tests/install.scm @@ -957,7 +957,7 @@ build (current-guix) and then store a couple of full system images.") (define* (gui-test-program marionette #:key - (desktop? #f) + (desktops '()) (encrypted? #f)) #~(let () (define (screenshot file) @@ -971,7 +971,9 @@ build (current-guix) and then store a couple of full system images.") (setvbuf (current-output-port) 'none) (setvbuf (current-error-port) 'none) - (marionette-eval* '(use-modules (gnu installer tests)) + (marionette-eval* '(use-modules (gnu installer tests) + (srfi srfi-1) + (srfi srfi-26)) #$marionette) ;; Arrange so that 'converse' prints debugging output to the console. @@ -1016,7 +1018,9 @@ build (current-guix) and then store a couple of full system images.") (marionette-eval* '(choose-services installer-socket #:choose-desktop-environment? - (const #$desktop?) + (lambda (desktop) + (any (cut string-contains desktop <>) + '#$desktops)) #:choose-network-service? (const #f)) #$marionette) @@ -1110,7 +1114,7 @@ build (current-guix) and then store a couple of full system images.") (define* (guided-installation-test name #:key - (desktop? #f) + (desktops '()) (encrypted? #f) target-os (install-size 'guess) @@ -1132,7 +1136,7 @@ build (current-guix) and then store a couple of full system images.") (lambda (marionette) (gui-test-program marionette - #:desktop? desktop? + #:desktops desktops #:encrypted? encrypted?)))) (command (qemu-command/writable-image image))) (run-basic-test target-os command name @@ -1155,7 +1159,7 @@ build (current-guix) and then store a couple of full system images.") ;; desktop environments in a single test to reduce the overhead. (define %test-gui-installed-desktop-os-encrypted (guided-installation-test "gui-installed-desktop-os-encrypted" - #:desktop? #t + #:desktops '("GNOME") #:encrypted? #t #:target-os (installation-target-desktop-os-for-gui-tests --=-=-=--