From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id 2OAaLIo4kGCcgAAAgWs5BA (envelope-from ) for ; Mon, 03 May 2021 19:53:14 +0200 Received: from aspmx1.migadu.com ([2001:41d0:2:bcc0::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id aLbNJ4o4kGDmWwAA1q6Kng (envelope-from ) for ; Mon, 03 May 2021 17:53:14 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 22BFC2091D for ; Mon, 3 May 2021 19:53:14 +0200 (CEST) Received: from localhost ([::1]:32770 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ldckr-0002SB-4y for larch@yhetil.org; Mon, 03 May 2021 13:53:13 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:56230) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1ldcgo-0005R5-67 for bug-guix@gnu.org; Mon, 03 May 2021 13:49:02 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:36258) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1ldcgn-0007Ci-S2 for bug-guix@gnu.org; Mon, 03 May 2021 13:49:01 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1ldcgn-0003PI-Qm for bug-guix@gnu.org; Mon, 03 May 2021 13:49:01 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#48178: Out of memory error when generating a docker-image. Resent-From: Roel Janssen Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 03 May 2021 17:49:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 48178 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Leo Famulari Received: via spool by 48178-submit@debbugs.gnu.org id=B48178.162006409013083 (code B ref 48178); Mon, 03 May 2021 17:49:01 +0000 Received: (at 48178) by debbugs.gnu.org; 3 May 2021 17:48:10 +0000 Received: from localhost ([127.0.0.1]:47797 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ldcfn-0003OL-MA for submit@debbugs.gnu.org; Mon, 03 May 2021 13:48:10 -0400 Received: from eggs.gnu.org ([209.51.188.92]:47598) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ldcfm-0003OF-JL for 48178@debbugs.gnu.org; Mon, 03 May 2021 13:47:58 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]:58972) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ldcfh-0006VW-3e; Mon, 03 May 2021 13:47:53 -0400 Received: from 2001-1c02-0b18-2900-222e-248e-9586-e52d.cable.dynamic.v6.ziggo.nl ([2001:1c02:b18:2900:222e:248e:9586:e52d]:51834) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1ldcfg-0002EX-Ib; Mon, 03 May 2021 13:47:52 -0400 Message-ID: <5578dcab6d15ae85a544b92f03b6a5d89223967c.camel@gnu.org> From: Roel Janssen Date: Mon, 03 May 2021 19:47:49 +0200 In-Reply-To: References: <2f30ed4cd1e7154fc49f800a2d8950df2ac6bc8f.camel@gnu.org> Content-Type: multipart/mixed; boundary="=-swkkBTttV/DnquynaZsu" User-Agent: Evolution 3.40.0 (3.40.0-1.fc34) MIME-Version: 1.0 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 48178@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1620064394; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type:resent-cc:resent-from:resent-sender: resent-message-id:in-reply-to:in-reply-to:references:references: list-id:list-help:list-unsubscribe:list-subscribe:list-post; bh=NOuwjqKjAmG5A2qA/eJK2NPrGgIq/HJOgslYwznDuMY=; b=r1rpyp10CXqklP2Eg7XV2rV8sNqoLsMoRrWYbNmGk7uYYSrGHC1fCVzMzcoRFGy+jowjvY /oKzdQIcVFshRtg60AhyZqvHzpUax8ya4cGsgz0e3n76yUD0aZs/m/Sav3EiXM4BuuwpaW F34LvTSq7vRiTnCDcAH6tcWmzRMT92/ix66mNeT3UJqw/Ez83zALWQZxMCM7yFWBraD5UN Ws1p8zvZcgl6ndVKja6sESD6oi1Wdspkt6enX7YEc9zjxapG84sFAQ6AEU7QPyqpYL/BRc G1nqm8dwUi0Fa1kuBxsEbQkpTG16s0AwfGcIcfscjI7ONR9x3saxuy731qhHRA== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1620064394; a=rsa-sha256; cv=none; b=J+3vW1mxIdFhdRU+BDr1qFvvbWdR7Pn+QXel9Ovbz31hbqBaTyMHCyZEfxiko4E2hMj6dm 3bWXFYNH422DMr7EgQplgEPKF4XgrhmBcevyk6fQigOobW/K+fvBaDKFm1fVKlOi3rZ917 GT3iEx5uN4vxapX05Ji2o9wICz4Dq8fZKNE0ENrXYcXVbbTxPPLu30Cuo8COhiXvlsHXKw C7hV9EqPOty6IEt6s8SUyou72teDWjw1haaC+Kc956aUecfq0NlJ0J9WfgiOe1c4pVqL41 7anyOf6eRD77vRMP3xBIR3IwaMnL8FpAJcJE+3ZaN9/q9vhWkdCx8mEhqcckgg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=none; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Migadu-Spam-Score: -1.86 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=pass (policy=none) header.from=gnu.org; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Migadu-Queue-Id: 22BFC2091D X-Spam-Score: -1.86 X-Migadu-Scanner: scn0.migadu.com X-TUID: Yydg0oVcfVYt --=-swkkBTttV/DnquynaZsu Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit On Mon, 2021-05-03 at 12:39 -0400, Leo Famulari wrote: > On Mon, May 03, 2021 at 12:09:36AM +0200, Roel Janssen wrote: > > Looking at 'guix/scripts/system.scm', it seems that we always pass > > 256M > > of memory to the VM.  After bumping that to 4096M, I was able to > > produce a docker image. > > Can you test somes values that are in between? Like, 512M, 1024M, > etc, > until we know how much is actually required? If 512M is enough, I > don't > see a problem with increasing the hard-coded value to that. > I monitored the VM's memory usage and it peaked at 1.6G. But after testing, it seems 1024 also works. I tested with 2048 (worked), 1024 (worked), and 512 (didn't work). > > I'd like to see what we can do here.  Assigning too little memory > > leads > > to problems generating the container, but assigning too much memory > > wil > > l cause problems for computing machines that don't have much memory > > to > > spare. > In that case... The attached patch would only increase the size when generating a Docker container image. Would that be acceptable? > There are some use cases for this code that we'd like to work on > low-resource machines (`guix system vm`), and other use cases (like > building Docker images) that shouldn't be expected to work on > machines > with limited RAM. > > > Would it be a good idea to make it configurable at run-time? > > Yeah, maybe. > I think it'd be better to have it somehow dynamically increase, but I don't see how I could determine the VM size needed for a given system configuration. So perhaps the attached patch is an acceptable compromise. Kind regards, Roel Janssen --=-swkkBTttV/DnquynaZsu Content-Disposition: attachment; filename*0=0001-guix-scripts-system-Increase-the-size-for-generating.pat; filename*1=ch Content-Type: text/x-patch; name="0001-guix-scripts-system-Increase-the-size-for-generating.patch"; charset="UTF-8" Content-Transfer-Encoding: base64 RnJvbSAwZGNhZjVjZmM1MjlmMGNlMzFhZjQ2ZDRmMzAzOWY0YjdkYmViYjliIE1vbiBTZXAgMTcg MDA6MDA6MDAgMjAwMQpGcm9tOiBSb2VsIEphbnNzZW4gPHJvZWxAZ251Lm9yZz4KRGF0ZTogTW9u LCAzIE1heSAyMDIxIDE4OjU0OjA4ICswMjAwClN1YmplY3Q6IFtQQVRDSF0gZ3VpeDogc2NyaXB0 cyBzeXN0ZW06IEluY3JlYXNlIHRoZSBzaXplIGZvciBnZW5lcmF0aW5nIERvY2tlcgogY29udGFp bmVyIGltYWdlcy4KCiogZ3VpeC9zY3JpcHRzL3N5c3RlbS5zY206IE92ZXJyaWRlIHRoZSBkZWZh dWx0IG9mIDI1Ni4KLS0tCiBndWl4L3NjcmlwdHMvc3lzdGVtLnNjbSB8IDEgKwogMSBmaWxlIGNo YW5nZWQsIDEgaW5zZXJ0aW9uKCspCgpkaWZmIC0tZ2l0IGEvZ3VpeC9zY3JpcHRzL3N5c3RlbS5z Y20gYi9ndWl4L3NjcmlwdHMvc3lzdGVtLnNjbQppbmRleCAwYTA1MWVlNGUzLi5hMjVlMGRhYzUy IDEwMDY0NAotLS0gYS9ndWl4L3NjcmlwdHMvc3lzdGVtLnNjbQorKysgYi9ndWl4L3NjcmlwdHMv c3lzdGVtLnNjbQpAQCAtNzE3LDYgKzcxNyw3IEBAIGNoZWNraW5nIHRoaXMgYnkgdGhlbXNlbHZl cyBpbiB0aGVpciAnY2hlY2snIHByb2NlZHVyZS4iCiAgICAgICAgKGxvd2VyLW9iamVjdCAoc3lz dGVtLWltYWdlIGltYWdlKSkpCiAgICAgICAoKGRvY2tlci1pbWFnZSkKICAgICAgICAoc3lzdGVt LWRvY2tlci1pbWFnZSBvcworICAgICAgICAgICAgICAgICAgICAgICAgICAgICM6bWVtb3J5LXNp emUgMTAyNAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICM6c2hhcmVkLW5ldHdvcms/IGNv bnRhaW5lci1zaGFyZWQtbmV0d29yaz8pKSkpKQogCiAoZGVmaW5lIChtYXliZS1zdWdnZXN0LXJ1 bm5pbmctZ3VpeC1wdWxsKQotLSAKMi4zMS4xCgo= --=-swkkBTttV/DnquynaZsu--