From mboxrd@z Thu Jan 1 00:00:00 1970 From: Danny Milosavljevic Subject: bug#38167: guix pull takes over 8 GiB of memory to finish if there are no substitutes Date: Sat, 28 Dec 2019 12:01:28 +0100 Message-ID: <20191228120128.010d72ee@scratchpost.org> References: <20191111080635.14f7b39a@scratchpost.org> <87eeyec18l.fsf@cbaines.net> <878somno0f.fsf@gnu.org> <20191226204555.1abe4d21@scratchpost.org> <20191226204828.239470dd@scratchpost.org> <871rsphc5f.fsf@gnu.org> Mime-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/o6co90RDkT9eU31SvUBc8oP"; protocol="application/pgp-signature"; micalg=pgp-sha256 Return-path: Received: from eggs.gnu.org ([2001:470:142:3::10]:54996) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1il9r9-00078i-8S for bug-guix@gnu.org; Sat, 28 Dec 2019 06:02:04 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1il9r7-0003ii-Um for bug-guix@gnu.org; Sat, 28 Dec 2019 06:02:03 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:52013) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1il9r7-0003hv-Pb for bug-guix@gnu.org; Sat, 28 Dec 2019 06:02:01 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1il9r7-00010Y-Mc for bug-guix@gnu.org; Sat, 28 Dec 2019 06:02:01 -0500 Sender: "Debbugs-submit" Resent-Message-ID: In-Reply-To: <871rsphc5f.fsf@gnu.org> List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org Sender: "bug-Guix" To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Cc: 38167@debbugs.gnu.org --Sig_/o6co90RDkT9eU31SvUBc8oP Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Hi Ludo, On Fri, 27 Dec 2019 19:11:08 +0100 Ludovic Court=C3=A8s wrote: > Danny Milosavljevic skribis: >=20 > > USER PID %CPU %MEM VSZ RSS TTY STAT START TIME COMMAND > > dannym 19221 20.8 87.4 9404812 6884184 pts/0 Tl 20:34 2:40 /gnu/s= tore/sc7z07gim1iq5zvfz1amdwf2irxrzifg-guile-2.2.6/bin/guile --no-auto-compi= le /home/dannym/.config/guix/current/bin/guix pull =20 >=20 > Oh, that=E2=80=99s an RSS of 6=C2=A0GiB for =E2=80=98guix pull=E2=80=99 i= tself? Weird, I don=E2=80=99t see > how that can happen. >=20 > Could it be that ~/.cache/guix/checkouts/THE-THING is too big, which in > turn causes libgit2 to consume too much memory somehow? $ du -hs ~/.cache/guix/checkouts/ 395M /home/dannym/.cache/guix/checkouts/ > What happens if you attach strace to this process at the moment where > it=E2=80=99s consuming a lot of memory? Is it traversing Git pack files = or > something like that? Right now the process is in a paused state and I think when I attach strace it will continue. Should I still do it? I don't want to destroy our debug= ging opportunity. I could also attach gdb--I think that won't resume. --Sig_/o6co90RDkT9eU31SvUBc8oP Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQEzBAEBCAAdFiEEds7GsXJ0tGXALbPZ5xo1VCwwuqUFAl4HNggACgkQ5xo1VCww uqUoCgf/dedhx4ebaT7yd84A94olBrOLaeJwXTAqsP+u/lCPiGpFvDm9fZ70C+aU D1ZhblaXPwuzOAxMYxuASjGqCJFu6XO7Rf534FT1MixcO3RZNRiDARHMne+PQeRi 3GVXVvBrhkeNq5IJdFKM/Buc3Xd2vlAKkXkZyl6RbYDINhz6oi5Cfco6703N2BMW KdGhh24j0s0+6MFWDmFQS0oOgjxGTshZpMU0D9TF+HND2NbSj6deIBx1PMFM4Ipp Mc6jD57TcUsYNsqN/vMjke+Bh3REQH/eSzIEknB4uZQQgsdGN5JHL6WQ7crczfhn oYmihNwb6C0sWI8kQTkNammXDmgKwQ== =gyEu -----END PGP SIGNATURE----- --Sig_/o6co90RDkT9eU31SvUBc8oP--