From mboxrd@z Thu Jan  1 00:00:00 1970
From: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludo@gnu.org>
Subject: bug#38167: guix pull takes over 8 GiB of memory to finish if there
 are no substitutes
Date: Fri, 27 Dec 2019 19:11:08 +0100
Message-ID: <871rsphc5f.fsf@gnu.org>
References: <20191111080635.14f7b39a@scratchpost.org>
 <87eeyec18l.fsf@cbaines.net> <878somno0f.fsf@gnu.org>
 <20191226204555.1abe4d21@scratchpost.org>
 <20191226204828.239470dd@scratchpost.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Return-path: <bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org>
Received: from eggs.gnu.org ([2001:470:142:3::10]:53217)
 by lists.gnu.org with esmtp (Exim 4.90_1)
 (envelope-from <Debian-debbugs@debbugs.gnu.org>) id 1iku5j-00058r-CX
 for bug-guix@gnu.org; Fri, 27 Dec 2019 13:12:04 -0500
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <Debian-debbugs@debbugs.gnu.org>) id 1iku5i-0000sj-Fw
 for bug-guix@gnu.org; Fri, 27 Dec 2019 13:12:03 -0500
Received: from debbugs.gnu.org ([209.51.188.43]:51811)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16)
 (Exim 4.71) (envelope-from <Debian-debbugs@debbugs.gnu.org>)
 id 1iku5i-0000sY-Cj
 for bug-guix@gnu.org; Fri, 27 Dec 2019 13:12:02 -0500
Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2)
 (envelope-from <Debian-debbugs@debbugs.gnu.org>) id 1iku5i-0000Eg-8e
 for bug-guix@gnu.org; Fri, 27 Dec 2019 13:12:02 -0500
Sender: "Debbugs-submit" <debbugs-submit-bounces@debbugs.gnu.org>
Resent-Message-ID: <handler.38167.B38167.1577470279856@debbugs.gnu.org>
In-Reply-To: <20191226204828.239470dd@scratchpost.org> (Danny Milosavljevic's
 message of "Thu, 26 Dec 2019 20:48:28 +0100")
List-Id: Bug reports for GNU Guix <bug-guix.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/bug-guix>,
 <mailto:bug-guix-request@gnu.org?subject=unsubscribe>
List-Archive: <https://lists.gnu.org/archive/html/bug-guix>
List-Post: <mailto:bug-guix@gnu.org>
List-Help: <mailto:bug-guix-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/bug-guix>,
 <mailto:bug-guix-request@gnu.org?subject=subscribe>
Errors-To: bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org
Sender: "bug-Guix" <bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org>
To: Danny Milosavljevic <dannym@scratchpost.org>
Cc: 38167@debbugs.gnu.org

Hi!

Danny Milosavljevic <dannym@scratchpost.org> skribis:

> USER       PID %CPU %MEM    VSZ   RSS TTY      STAT START   TIME COMMAND
> dannym   19221 20.8 87.4 9404812 6884184 pts/0 Tl   20:34   2:40 /gnu/sto=
re/sc7z07gim1iq5zvfz1amdwf2irxrzifg-guile-2.2.6/bin/guile --no-auto-compile=
 /home/dannym/.config/guix/current/bin/guix pull

Oh, that=E2=80=99s an RSS of 6=C2=A0GiB for =E2=80=98guix pull=E2=80=99 its=
elf?  Weird, I don=E2=80=99t see
how that can happen.

Could it be that ~/.cache/guix/checkouts/THE-THING is too big, which in
turn causes libgit2 to consume too much memory somehow?

What happens if you attach strace to this process at the moment where
it=E2=80=99s consuming a lot of memory?  Is it traversing Git pack files or
something like that?

TIA,
Ludo=E2=80=99.