From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED.blaine.gmane.org!not-for-mail From: Peter Ludemann Newsgroups: gmane.emacs.bugs Subject: bug#26952: Possible regression of Bug#26952 - "repeated buffer insertion consumes excessive memory" Date: Wed, 8 Jan 2020 08:45:38 -0800 Message-ID: References: Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="000000000000789374059ba3a117" Injection-Info: blaine.gmane.org; posting-host="blaine.gmane.org:195.159.176.226"; logging-data="262915"; mail-complaints-to="usenet@blaine.gmane.org" To: 26952@debbugs.gnu.org Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Wed Jan 08 17:47:39 2020 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by blaine.gmane.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from ) id 1ipEUI-000pJ6-Lx for geb-bug-gnu-emacs@m.gmane-mx.org; Wed, 08 Jan 2020 17:47:18 +0100 Original-Received: from localhost ([::1]:46610 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ipEUH-0006oJ-Gf for geb-bug-gnu-emacs@m.gmane-mx.org; Wed, 08 Jan 2020 11:47:17 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:39840) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ipEU4-0006ks-KP for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 11:47:06 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ipEU2-0000Y8-A8 for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 11:47:04 -0500 Original-Received: from debbugs.gnu.org ([209.51.188.43]:45250) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1ipEU2-0000Xm-7C for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 11:47:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1ipEU2-00038c-4v for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 11:47:02 -0500 X-Loop: help-debbugs@gnu.org In-Reply-To: Resent-From: Peter Ludemann Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 08 Jan 2020 16:47:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 26952 X-GNU-PR-Package: emacs X-Debbugs-Original-To: bug-gnu-emacs@gnu.org Original-Received: via spool by submit@debbugs.gnu.org id=B.157850198312013 (code B ref -1); Wed, 08 Jan 2020 16:47:02 +0000 Original-Received: (at submit) by debbugs.gnu.org; 8 Jan 2020 16:46:23 +0000 Original-Received: from localhost ([127.0.0.1]:51223 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ipETP-00037f-5Y for submit@debbugs.gnu.org; Wed, 08 Jan 2020 11:46:23 -0500 Original-Received: from lists.gnu.org ([209.51.188.17]:37697) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ipETN-00037Y-Ul for submit@debbugs.gnu.org; Wed, 08 Jan 2020 11:46:22 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:39251) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ipETL-0006DI-LB for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 11:46:21 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ipETJ-0007sY-FE for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 11:46:19 -0500 Original-Received: from mail-lf1-x131.google.com ([2a00:1450:4864:20::131]:46685) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1ipETJ-0007ot-2w for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 11:46:17 -0500 Original-Received: by mail-lf1-x131.google.com with SMTP id f15so2922391lfl.13 for ; Wed, 08 Jan 2020 08:46:16 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=4oEWKX56BUmCxg46hQ+3ewHW0kxqjnXvmagVBbyujbE=; b=Qm+PqxwgHn8BV0LbNeDCwqh4TrPAP8QQZ6L+N1O2phpjjCwagFqhMaU9aWQhWNMeoL nDKCS+DOdDta30A/zJpnruAjDysa+AR5W93W3UghgcD9ZRdVvYULVdyg1V6OWtxeGd1C t9lBRAtHSQ3LboaoTOfubJY+GucZHWhD44jpzqQW/b8f9rfdYzuI6kDSh0zzV3bsdrPV 0Cqwn6Uro5hY+PcmzLtSzRchDl3bKNI4Fs3o9SxIjFVTXQ8+8fyjB98ox5PkkYf5bLA1 Gaivj5lzzAEMccV3Hfv7OS5fyMMrrAHZFdtmM0V8UJjXlPXyXaauH/77YdkFq6bfmpmA rCBA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=4oEWKX56BUmCxg46hQ+3ewHW0kxqjnXvmagVBbyujbE=; b=Mo6sc2Jnh0mpntr9lEoHwRFv2o87An2BcYzuGYVh2DWMdgVsEOZEp9GAhBa2DYQEVx 5hKQ3VgDuvX6bBsoEeXGgwrI/RcfE96mgtvs6L3WylU7mlInrWrAp3Ap9yMDgmqVxN3/ ELDhmCCfqAM+XEkvYhkoHtH0+wueFdKkANfHmfKpgHXqNAz+vTeeVl2s+9iZpzqSfb0B 6imYu4fc0KQew3Wf070JWfrHzb/VM2ZOos5Ba3pAm3bn+0xvPdXahDLJweXxuFR0Nlcj hK3gZ01Lh5g+Qu4dkduVPbO7gFaJhNGiFu4mt8r0UEXLytg3xCCfk18HluPqNtj8pYeO fNiA== X-Gm-Message-State: APjAAAVSOmbfHc6LaN8nXLlvp1o5W5ZT9wskoCE05ILQ5TkUT/JEOLEb ciILEx306a93idUbknLu92y5xifKWgALuVDzBoR4INDBPOQ= X-Google-Smtp-Source: APXvYqxIv3eee3fQ2MGVDXCeTH9H+QI/JK6yR5NU39XxV3xjnUAhip4em5mHQa9tdvjLABZh+oc5xe3xlxcqsBdgcPE= X-Received: by 2002:a19:cb54:: with SMTP id b81mr3333047lfg.188.1578501974559; Wed, 08 Jan 2020 08:46:14 -0800 (PST) X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.51.188.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.org gmane.emacs.bugs:174367 Archived-At: --000000000000789374059ba3a117 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I'm observing creeping memory increase (at one point, emacs was using over 3.8GB before I restarted it), possibly related to running compilations with large amounts of output. Seems related to Bug#26952 (which my Bug#38629 seemed to be a duplicate of), and which was fixed in emacs 26.3. It seems to have reappeared in emacs 28.0.50, but with a difference -- I'm not seeing the high CPU usage that I previously observed with the high memory use (perhaps this is because global-auto-revert has been improved in 28.0.50). What information should I collect to confirm this problem and to help someone debug it? In GNU Emacs 28.0.50 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.22.30) of 2020-01-07 built on wistaria5b Repository revision: 724af7671590cd91df37f64df6be73f6dca0144d Repository branch: master Windowing system distributor 'The X.Org Foundation', version 11.0.11906000 System Description: Ubuntu 18.04.3 LTS Recent messages: Reverting buffer =E2=80=98pykythe_utils.pl=E2=80=99. You can run the command =E2=80=98compile=E2=80=99 with C-x C-g g Reverting buffer =E2=80=98TAGS=E2=80=99. Reverting buffer =E2=80=98FILES.js=E2=80=99. [2 times] Reverting buffer =E2=80=98t10.kythe.json-decoded=E2=80=99. [2 times] Compilation finished You can run the command =E2=80=98garbage-collect=E2=80=99 with M-x ga RET x is undefined [3 times] Making completion list... Quit Quit Configured using: 'configure --prefix=3D/home/peter/emacs-2019-12-17' Configured features: XPM JPEG TIFF GIF PNG RSVG SOUND DBUS GSETTINGS GLIB NOTIFY INOTIFY GNUTLS LIBXML2 FREETYPE HARFBUZZ M17N_FLT LIBOTF XFT ZLIB TOOLKIT_SCROLL_BARS GTK3 X11 XDBE XIM MODULES THREADS PDUMPER GMP Important settings: value of $LC_MONETARY: en_CA.UTF-8 value of $LC_NUMERIC: en_CA.UTF-8 value of $LC_TIME: en_CA.UTF-8 value of $LANG: en_US.UTF-8 value of $XMODIFIERS: @im=3Dibus locale-coding-system: utf-8-unix Major mode: Compilation Minor modes in effect: shell-dirtrack-mode: t global-auto-revert-mode: t show-paren-mode: t display-time-mode: t savehist-mode: t desktop-save-mode: t tooltip-mode: t global-eldoc-mode: t electric-indent-mode: t mouse-wheel-mode: t menu-bar-mode: t file-name-shadow-mode: t global-font-lock-mode: t font-lock-mode: t auto-composition-mode: t auto-encryption-mode: t auto-compression-mode: t buffer-read-only: t column-number-mode: t line-number-mode: t transient-mark-mode: t Load-path shadows: ~/emacs/prolog hides /home/peter/emacs-2019-12-17/share/emacs/28.0.50/lisp/progmodes/prolog Features: (shadow mail-extr emacsbug message rmc rfc822 mml mml-sec epa derived epg epg-config mm-decode mm-bodies mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader sendmail sort pulse vc vc-dispatcher misearch multi-isearch tabify man pcmpl-unix pcmpl-gnu mule-util server asm-mode conf-mode tar-mode arc-mode archive-mode add-log rst haskell-mode haskell-cabal haskell-utils haskell-font-lock haskell-indentation haskell-string haskell-sort-imports haskell-lexeme rx haskell-align-imports haskell-compat haskell-complete-module haskell-ghc-support flymake-proc flymake warnings dabbrev haskell-customize doc-view jka-compr image-mode exif go-mode find-file ffap etags fileloop generator xref project mhtml-mode css-mode sgml-mode eww mm-url gnus nnheader gnus-util rmail rmail-loaddefs rfc2047 rfc2045 ietf-drums mail-utils wid-edit mm-util mail-prsvr url-queue url url-proxy url-privacy url-expand url-methods url-history mailcap shr text-property-search url-cookie url-domsuf url-util puny svg xml dom sh-script smie executable markdown-mode color thingatpt noutline outline dired dired-loaddefs js cc-mode cc-fonts cc-guess cc-menus cc-cmds cc-styles cc-align cc-engine cc-vars cc-defs make-mode smerge-mode diff prolog align imenu vc-git diff-mode easy-mmode python tramp-sh tramp tramp-loaddefs trampver tramp-integration files-x tramp-compat shell pcomplete parse-time iso8601 time-date ls-lisp format-spec finder-inf cl-extra help-mode autorevert filenotify grep compile comint ansi-color ring cus-start cus-load paren time savehist desktop frameset info package easymenu browse-url url-handlers url-parse auth-source cl-seq eieio eieio-core cl-macs eieio-loaddefs password-cache json subr-x map url-vars seq byte-opt gv bytecomp byte-compile cconv cl-loaddefs cl-lib tooltip eldoc electric uniquify ediff-hook vc-hooks lisp-float-type mwheel term/x-win x-win term/common-win x-dnd tool-bar dnd fontset image regexp-opt fringe tabulated-list replace newcomment text-mode elisp-mode lisp-mode prog-mode register page tab-bar menu-bar rfn-eshadow isearch timer select scroll-bar mouse jit-lock font-lock syntax facemenu font-core term/tty-colors frame minibuffer cl-generic cham georgian utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european ethiopic indian cyrillic chinese composite charscript charprop case-table epa-hook jka-cmpr-hook help simple abbrev obarray cl-preloaded nadvice loaddefs button faces cus-face macroexp files text-properties overlay sha1 md5 base64 format env code-pages mule custom widget hashtable-print-readable backquote threads dbusbind inotify dynamic-setting system-font-setting font-render-setting move-toolbar gtk x-toolkit x multi-tty make-network-process emacs) Memory information: ((conses 16 553627 84742) (symbols 48 27664 5) (strings 32 109868 12210) (string-bytes 1 4407199) (vectors 16 47901) (vector-slots 8 1347908 158898) (floats 8 232 330) (intervals 56 48562 536) (buffers 1000 503)) --000000000000789374059ba3a117 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I'm observing creeping memory increase (at one point, emacs= was using over 3.8GB before I restarted it), possibly related to running c= ompilations with large amounts of output. Seems related to Bug#26952 (which= my Bug#38629 seemed to be a duplicate of), and which was fixed in emacs 26= .3. It seems to have reappeared in emacs 28.0.50, but with a difference -- = I'm not seeing the high CPU usage that I previously observed with the h= igh memory use (perhaps this is because global-auto-revert has been improve= d in 28.0.50).

What information should I collect to confirm this prob= lem and to help someone debug it?

In GNU Emacs 28.0.50 (build 1, x86= _64-pc-linux-gnu, GTK+ Version 3.22.30)
=C2=A0of 2020-01-07 built on wis= taria5b
Repository revision: 724af7671590cd91df37f64df6be73f6dca0144dRepository branch: master
Windowing system distributor 'The X.Org F= oundation', version 11.0.11906000
System Description: Ubuntu 18.04.3= LTS

Recent messages:
Reverting buffer =E2=80=98pykythe_utils.pl=E2=80=99.
You can run the comman= d =E2=80=98compile=E2=80=99 with C-x C-g g
Reverting buffer =E2=80=98TAG= S=E2=80=99.
Reverting buffer =E2=80=98FILES.js=E2=80=99. [2 times]
Re= verting buffer =E2=80=98t10.kythe.json-decoded=E2=80=99. [2 times]
Compi= lation finished
You can run the command =E2=80=98garbage-collect=E2=80= =99 with M-x ga RET
x is undefined [3 times]
Making completion list..= .
Quit
Quit
Configured using:
=C2=A0'configure --prefix=3D/= home/peter/emacs-2019-12-17'

Configured features:
XPM JPEG TI= FF GIF PNG RSVG SOUND DBUS GSETTINGS GLIB NOTIFY INOTIFY
GNUTLS LIBXML2 = FREETYPE HARFBUZZ M17N_FLT LIBOTF XFT ZLIB
TOOLKIT_SCROLL_BARS GTK3 X11 = XDBE XIM MODULES THREADS PDUMPER GMP

Important settings:
=C2=A0 v= alue of $LC_MONETARY: en_CA.UTF-8
=C2=A0 value of $LC_NUMERIC: en_CA.UTF= -8
=C2=A0 value of $LC_TIME: en_CA.UTF-8
=C2=A0 value of $LANG: en_US= .UTF-8
=C2=A0 value of $XMODIFIERS: @im=3Dibus
=C2=A0 locale-coding-s= ystem: utf-8-unix

Major mode: Compilation

Minor modes in effe= ct:
=C2=A0 shell-dirtrack-mode: t
=C2=A0 global-auto-revert-mode: t=C2=A0 show-paren-mode: t
=C2=A0 display-time-mode: t
=C2=A0 savehi= st-mode: t
=C2=A0 desktop-save-mode: t
=C2=A0 tooltip-mode: t
=C2= =A0 global-eldoc-mode: t
=C2=A0 electric-indent-mode: t
=C2=A0 mouse-= wheel-mode: t
=C2=A0 menu-bar-mode: t
=C2=A0 file-name-shadow-mode: t=
=C2=A0 global-font-lock-mode: t
=C2=A0 font-lock-mode: t
=C2=A0 a= uto-composition-mode: t
=C2=A0 auto-encryption-mode: t
=C2=A0 auto-co= mpression-mode: t
=C2=A0 buffer-read-only: t
=C2=A0 column-number-mod= e: t
=C2=A0 line-number-mode: t
=C2=A0 transient-mark-mode: t

= Load-path shadows:
~/emacs/prolog hides /home/peter/emacs-2019-12-17/sha= re/emacs/28.0.50/lisp/progmodes/prolog

Features:
(shadow mail-ext= r emacsbug message rmc rfc822 mml mml-sec epa derived
epg epg-config mm-= decode mm-bodies mm-encode mail-parse rfc2231
mailabbrev gmm-utils mailh= eader sendmail sort pulse vc vc-dispatcher
misearch multi-isearch tabify= man pcmpl-unix pcmpl-gnu mule-util server
asm-mode conf-mode tar-mode a= rc-mode archive-mode add-log rst
haskell-mode haskell-cabal haskell-util= s haskell-font-lock
haskell-indentation haskell-string haskell-sort-impo= rts haskell-lexeme
rx haskell-align-imports haskell-compat haskell-compl= ete-module
haskell-ghc-support flymake-proc flymake warnings dabbrev
= haskell-customize doc-view jka-compr image-mode exif go-mode find-file
f= fap etags fileloop generator xref project mhtml-mode css-mode sgml-mode
= eww mm-url gnus nnheader gnus-util rmail rmail-loaddefs rfc2047 rfc2045
= ietf-drums mail-utils wid-edit mm-util mail-prsvr url-queue url
url-prox= y url-privacy url-expand url-methods url-history mailcap shr
text-proper= ty-search url-cookie url-domsuf url-util puny svg xml dom
sh-script smie= executable markdown-mode color thingatpt noutline outline
dired dired-l= oaddefs js cc-mode cc-fonts cc-guess cc-menus cc-cmds
cc-styles cc-align= cc-engine cc-vars cc-defs make-mode smerge-mode diff
prolog align imenu= vc-git diff-mode easy-mmode python tramp-sh tramp
tramp-loaddefs trampv= er tramp-integration files-x tramp-compat shell
pcomplete parse-time iso= 8601 time-date ls-lisp format-spec finder-inf
cl-extra help-mode autorev= ert filenotify grep compile comint ansi-color
ring cus-start cus-load pa= ren time savehist desktop frameset info
package easymenu browse-url url-= handlers url-parse auth-source cl-seq
eieio eieio-core cl-macs eieio-loa= ddefs password-cache json subr-x map
url-vars seq byte-opt gv bytecomp b= yte-compile cconv cl-loaddefs cl-lib
tooltip eldoc electric uniquify edi= ff-hook vc-hooks lisp-float-type
mwheel term/x-win x-win term/common-win= x-dnd tool-bar dnd fontset image
regexp-opt fringe tabulated-list repla= ce newcomment text-mode elisp-mode
lisp-mode prog-mode register page tab= -bar menu-bar rfn-eshadow isearch
timer select scroll-bar mouse jit-lock= font-lock syntax facemenu
font-core term/tty-colors frame minibuffer cl= -generic cham georgian
utf-8-lang misc-lang vietnamese tibetan thai tai-= viet lao korean
japanese eucjp-ms cp51932 hebrew greek romanian slovak c= zech european
ethiopic indian cyrillic chinese composite charscript char= prop
case-table epa-hook jka-cmpr-hook help simple abbrev obarray
cl-= preloaded nadvice loaddefs button faces cus-face macroexp files
text-pro= perties overlay sha1 md5 base64 format env code-pages mule
custom widget= hashtable-print-readable backquote threads dbusbind
inotify dynamic-set= ting system-font-setting font-render-setting
move-toolbar gtk x-toolkit = x multi-tty make-network-process emacs)

Memory information:
((con= ses 16 553627 84742)
=C2=A0(symbols 48 27664 5)
=C2=A0(strings 32 109= 868 12210)
=C2=A0(string-bytes 1 4407199)
=C2=A0(vectors 16 47901)=C2=A0(vector-slots 8 1347908 158898)
=C2=A0(floats 8 232 330)
=C2= =A0(intervals 56 48562 536)
=C2=A0(buffers 1000 503))
--000000000000789374059ba3a117--