From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED.blaine.gmane.org!not-for-mail From: Peter Ludemann Newsgroups: gmane.emacs.bugs Subject: bug#38629: 25.2; garbage-collect doesn't reclaim large *compilation* Date: Mon, 16 Dec 2019 15:37:55 -0800 Message-ID: References: <87a77scprp.fsf@gmail.com> Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="000000000000952fee0599dab59d" Injection-Info: blaine.gmane.org; posting-host="blaine.gmane.org:195.159.176.226"; logging-data="98032"; mail-complaints-to="usenet@blaine.gmane.org" Cc: 38629@debbugs.gnu.org To: Noam Postavsky Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Tue Dec 17 00:44:44 2019 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([209.51.188.17]) by blaine.gmane.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from ) id 1ih02d-000PNG-GE for geb-bug-gnu-emacs@m.gmane.org; Tue, 17 Dec 2019 00:44:43 +0100 Original-Received: from localhost ([::1]:33434 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ih02c-0001Tr-99 for geb-bug-gnu-emacs@m.gmane.org; Mon, 16 Dec 2019 18:44:42 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:51393) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1igzx9-0002vi-U7 for bug-gnu-emacs@gnu.org; Mon, 16 Dec 2019 18:39:05 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1igzx8-0006sN-Hg for bug-gnu-emacs@gnu.org; Mon, 16 Dec 2019 18:39:03 -0500 Original-Received: from debbugs.gnu.org ([209.51.188.43]:34554) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1igzx8-0006rX-Do for bug-gnu-emacs@gnu.org; Mon, 16 Dec 2019 18:39:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1igzx8-00024F-94 for bug-gnu-emacs@gnu.org; Mon, 16 Dec 2019 18:39:02 -0500 X-Loop: help-debbugs@gnu.org Resent-From: Peter Ludemann Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Mon, 16 Dec 2019 23:39:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 38629 X-GNU-PR-Package: emacs Original-Received: via spool by 38629-submit@debbugs.gnu.org id=B38629.15765395207899 (code B ref 38629); Mon, 16 Dec 2019 23:39:02 +0000 Original-Received: (at 38629) by debbugs.gnu.org; 16 Dec 2019 23:38:40 +0000 Original-Received: from localhost ([127.0.0.1]:40527 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1igzwl-00023L-Oy for submit@debbugs.gnu.org; Mon, 16 Dec 2019 18:38:39 -0500 Original-Received: from mail-lj1-f171.google.com ([209.85.208.171]:36733) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1igzwj-000238-Vu for 38629@debbugs.gnu.org; Mon, 16 Dec 2019 18:38:38 -0500 Original-Received: by mail-lj1-f171.google.com with SMTP id r19so8769023ljg.3 for <38629@debbugs.gnu.org>; Mon, 16 Dec 2019 15:38:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=Y0FRIngfqQ50L8KJwyVvjcdwRxUP08BaSYZ9KvdrYg0=; b=scd7YuiHrOBU1AlrKNupZvYehRnJ3W5s0/rM4np9RUjPVVMgWZPVW8KCnzlqVfmXtc I7CVqIagxd6iLBkh6vNeBNnLW5MbAVIe1boqzTwFbl6AdU8Fx4YZTDz69wpxZX0G0pq2 ey32qaqzVRdBKe78JytSCi3i541atKNDIeBs8MPALdXjH1pqekZnd+2tTaasx53bI6+5 496qxpsy89SuZWed1CRfTZCJ4QodB195dvC+X5yikWrtdVX3dOLmhEnmFXRnLQX8L0tk 6ZJ3cqb5hHdYJmuNttYJs57KhezbC9hOlPBpWbTCXsO9M/J8hcr7z7NouiOBdj9VGkE3 gsbw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=Y0FRIngfqQ50L8KJwyVvjcdwRxUP08BaSYZ9KvdrYg0=; b=LaX3UY0LZXxGe8m8OjUcx9GhFiK/bFOLceeFAxPrL/nbAKOJdb/CCO+ztVkbSSvetD VXqVV3JR44xckpxhQkRfVTtTys/LxsTWCzgP4g/4kdBdi5JuMDDjnq7WWFz+GDzMXYsQ Dyy+Bi44GVU9sgyeHHe661UbeVL0HGcUp0zf88HJxpN9jeSr+FPzB6u8MwYoFRcP0OoF EHzVPYArnuk8YCmsphOAo43VBLk7we0b4RxJq16Adn3G0EhW5ynyl9zeeU8APA2Vh5NF hLbqNE9BEGBtxa0p38NVvpqckizxOLeDnadwtSRMtCTC/Eje8rRitzvkFcrizum6sBg5 dA9w== X-Gm-Message-State: APjAAAV4YruWbvRbUTdRGknPqA8Tsy7YiuBEBS0msn5N4Rw8QdDk+Tnk ogmpRW7NbBNMnOOlN35nom1ieWmTnN4h+icBSkU= X-Google-Smtp-Source: APXvYqznvB269J3M2wMl9LLMrmrIC0nE1mGBFRhCjXAz7mC4ekpdO4Bwe843/CG9LfSlMUgTiBIYyjCmooSk7B0wBEI= X-Received: by 2002:a2e:7311:: with SMTP id o17mr1128686ljc.197.1576539511925; Mon, 16 Dec 2019 15:38:31 -0800 (PST) In-Reply-To: <87a77scprp.fsf@gmail.com> X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.51.188.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.org gmane.emacs.bugs:173460 Archived-At: --000000000000952fee0599dab59d Content-Type: text/plain; charset="UTF-8" Upgrading to Emacs 26.3 seems to have fixed the memory problem but now there's another problem ... emacs becomes incredibly sluggish (almost unuseable) -- top(1) shows 70-100% CPU utilization even when the compilation step isn't outputting anything. (I use GNU parallel on the tests, with options to preserve the output order, so output happens at intervals.) The compilation command is "find ... | sort | nice parallel -j 8 --keep-order --group -L80" (on a 4 CPU machine). I tried reducing the number of parallel jobs to 3, but that didn't help. Should I open a new bug for this? If so, what information can I collect, to help determine the cause? On Mon, 16 Dec 2019 at 06:24, Noam Postavsky wrote: > Peter Ludemann writes: > > > I ran a large compilation (to the *compilation* buffer) (232,701 lines, > > 52M). > > > In GNU Emacs 25.2.2 (x86_64-pc-linux-gnu, GTK+ Version 3.22.21) > > of 2017-09-22, modified by Debian built on lgw01-amd64-050 > > Windowing system distributor 'The X.Org Foundation', version > 11.0.11906000 > > System Description: Ubuntu 18.04.3 LTS > > I think this is a variant of Bug#26952 - "repeated buffer insertion > (e.g. yank-rectangle) consumes excessive memory (4GB+ for 90MB of > text)". I recommend upgrading to version 26. > > > --000000000000952fee0599dab59d Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Upgrading to Emacs 26.3 seems to have fixed the memory problem = but now there's another problem ... emacs becomes incredibly sluggish (= almost unuseable) -- top(1) shows 70-100% CPU utilization even when the com= pilation step isn't outputting anything. (I use GNU parallel on the tes= ts, with options to preserve the output order, so output happens at interva= ls.)

The compilation command is "find ... | sort | nice parallel = -j 8 --keep-order --group -L80" (on a 4 CPU machine).=C2=A0
I tried re= ducing the number of parallel jobs to 3, but that didn't help.

Sho= uld I open a new bug for this? If so, what information can I collect, to he= lp determine the cause?

On Mon, 16 Dec 2019 at 06:24, Noam Postavsky = <npostavs@gmail.com> wrote:=
Peter Ludemann = <peter.lud= emann@gmail.com> writes:

> I ran a large compilation (to the *compilation* buffer) (232,701 lines= ,
> 52M).

> In GNU Emacs 25.2.2 (x86_64-pc-linux-gnu, GTK+ Version 3.22.21)
>=C2=A0 of 2017-09-22, modified by Debian built on lgw01-amd64-050
> Windowing system distributor 'The X.Org Foundation', version 1= 1.0.11906000
> System Description: Ubuntu 18.04.3 LTS

I think this is a variant of Bug#26952 - "repeated buffer insertion (e.g. yank-rectangle) consumes excessive memory (4GB+ for 90MB of
text)".=C2=A0 I recommend upgrading to version 26.


--000000000000952fee0599dab59d--