From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED.blaine.gmane.org!not-for-mail From: Peter Ludemann Newsgroups: gmane.emacs.bugs Subject: bug#39045: Fwd: Possible regression - "repeated buffer insertion consumes excessive memory" Date: Wed, 8 Jan 2020 16:08:25 -0800 Message-ID: References: Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="000000000000fe0bac059ba9d0bc" Injection-Info: blaine.gmane.org; posting-host="blaine.gmane.org:195.159.176.226"; logging-data="228151"; mail-complaints-to="usenet@blaine.gmane.org" To: 39045@debbugs.gnu.org Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Thu Jan 09 01:11:05 2020 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by blaine.gmane.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.89) (envelope-from ) id 1ipLPK-000Z2y-PG for geb-bug-gnu-emacs@m.gmane-mx.org; Thu, 09 Jan 2020 01:10:39 +0100 Original-Received: from localhost ([::1]:50658 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ipLPI-0000ds-St for geb-bug-gnu-emacs@m.gmane-mx.org; Wed, 08 Jan 2020 19:10:36 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:59308) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ipLOm-0000Q8-U6 for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 19:10:10 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ipLOk-0005bu-EK for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 19:10:04 -0500 Original-Received: from debbugs.gnu.org ([209.51.188.43]:45521) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1ipLOk-0005bK-A6 for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 19:10:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1ipLOk-0006NE-3C for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 19:10:02 -0500 X-Loop: help-debbugs@gnu.org Resent-From: Peter Ludemann Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Thu, 09 Jan 2020 00:10:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: report 39045 X-GNU-PR-Package: emacs X-Debbugs-Original-To: bug-gnu-emacs@gnu.org Original-Received: via spool by submit@debbugs.gnu.org id=B.157852856024440 (code B ref -1); Thu, 09 Jan 2020 00:10:01 +0000 Original-Received: (at submit) by debbugs.gnu.org; 9 Jan 2020 00:09:20 +0000 Original-Received: from localhost ([127.0.0.1]:51494 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ipLO3-0006M8-KE for submit@debbugs.gnu.org; Wed, 08 Jan 2020 19:09:20 -0500 Original-Received: from lists.gnu.org ([209.51.188.17]:33238) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ipLO1-0006Ly-Bz for submit@debbugs.gnu.org; Wed, 08 Jan 2020 19:09:18 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:56518) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ipLNr-000816-Nu for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 19:09:17 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ipLNp-0004ch-Al for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 19:09:07 -0500 Original-Received: from mail-lj1-x232.google.com ([2a00:1450:4864:20::232]:39911) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1ipLNo-0004Xu-VQ for bug-gnu-emacs@gnu.org; Wed, 08 Jan 2020 19:09:05 -0500 Original-Received: by mail-lj1-x232.google.com with SMTP id l2so5221706lja.6 for ; Wed, 08 Jan 2020 16:09:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=i97g19V4n5FkvGoUMajmpf6nOoyXFK6v45fHalzKO8c=; b=UGNAl+BUZ8VSN9KvoVwIZMwpW+Zz79RQSH8yvIG1SXfWnefJfs7UAmkdVMYyWN6Aen v3USZmSpjq+IDBAoBj1aJwgaaKAPPP/+GxUXNEm3NQ7N+EOansgqpnVWFzXVUkE+DpTB n0uLQsXTOc7MIplpV/HNN8iXlgIF9j/0z5p6hBv6Rwe6gfB8/kf5WuwOQxIQTVaaCAIl KSPSD5Bh8DJpCoJvNmsM+LhqI4QUZObpGfrKwgtheuHZs29J/inA745UZ2vgNz9jxgfJ DDCro+oJXcULYUuCAgtkswxWfmh4q1uNowH7SOVk2EtbDAyO/KJsvWDpXjvv3gGe4jmP 62Sw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=i97g19V4n5FkvGoUMajmpf6nOoyXFK6v45fHalzKO8c=; b=PKDDQmPWUUQGVSDDYHspt6gfWw2dSjne8kEgibB1UvtfMgY35ybMYYd1pIFZadNjGD ABUl53y+uczvizlf58YUNdwP3wljcofyTrSeVXl8b05iPfXoGD1QWmWubwPGDwDx62EF 4wXYVvCJdpc6hAz6jgY8kVd8uD6RrJL8IN9RG42cYJkBKKzw6K6ibjBoHH3dSuR26CSf VwI/vg3umIhkTxn9NdiVJEh83GDsI4WPVfUO7aHFEnDKnbJwHWQbKYRu3hwGzpo0OuVT 6ZR22xKuRAzWrd84ZdderaQOkJR0eqdLGwCK6vVTtt3OWWQWvcb2R81/XN4aMR8ImMJT Pdbw== X-Gm-Message-State: APjAAAWmh8dx+lKxc3Dg6rAq5lkYPTNxQw+3wQ0b1NbmPIm/CXkHGwcV kR0wTOUjzrXe54ShX6t16Zsx9cWs/50uNPV4EExS9y1L X-Google-Smtp-Source: APXvYqy4/z8sgqyulddS0Iefw7dddKwCYGW6M/helwWJhZYPbf+FoakvyPSROzB0T+y8ovEUpwyh+mmkQmLpZKQfKo4= X-Received: by 2002:a2e:88d6:: with SMTP id a22mr4264659ljk.163.1578528541634; Wed, 08 Jan 2020 16:09:01 -0800 (PST) In-Reply-To: X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 209.51.188.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.org gmane.emacs.bugs:174388 Archived-At: --000000000000fe0bac059ba9d0bc Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable I'm observing creeping memory increase (at one point, emacs was using over 3.8GB before I restarted it), possibly related to running compilations with large amounts of output. Seems related to Bug#26952 (which my Bug#38629 seemed to be a duplicate of), and which was fixed in emacs 26.3. It seems to have reappeared in emacs 28.0.50, but with a difference -- I'm not seeing the high CPU usage that I previously observed with the high memory use (perhaps this is because global-auto-revert has been improved in 28.0.50). What information should I collect to confirm this problem and to help someone debug it? In GNU Emacs 28.0.50 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.22.30) of 2020-01-07 built on wistaria5b Repository revision: 724af7671590cd91df37f64df6be73f6dca0144d Repository branch: master Windowing system distributor 'The X.Org Foundation', version 11.0.11906000 System Description: Ubuntu 18.04.3 LTS Recent messages: Reverting buffer =E2=80=98pykythe_utils.pl=E2=80=99. You can run the command =E2=80=98compile=E2=80=99 with C-x C-g g Reverting buffer =E2=80=98TAGS=E2=80=99. Reverting buffer =E2=80=98FILES.js=E2=80=99. [2 times] Reverting buffer =E2=80=98t10.kythe.json-decoded=E2=80=99. [2 times] Compilation finished You can run the command =E2=80=98garbage-collect=E2=80=99 with M-x ga RET x is undefined [3 times] Making completion list... Quit Quit Configured using: 'configure --prefix=3D/home/peter/emacs-2019-12-17' Configured features: XPM JPEG TIFF GIF PNG RSVG SOUND DBUS GSETTINGS GLIB NOTIFY INOTIFY GNUTLS LIBXML2 FREETYPE HARFBUZZ M17N_FLT LIBOTF XFT ZLIB TOOLKIT_SCROLL_BARS GTK3 X11 XDBE XIM MODULES THREADS PDUMPER GMP Important settings: value of $LC_MONETARY: en_CA.UTF-8 value of $LC_NUMERIC: en_CA.UTF-8 value of $LC_TIME: en_CA.UTF-8 value of $LANG: en_US.UTF-8 value of $XMODIFIERS: @im=3Dibus locale-coding-system: utf-8-unix Major mode: Compilation Minor modes in effect: shell-dirtrack-mode: t global-auto-revert-mode: t show-paren-mode: t display-time-mode: t savehist-mode: t desktop-save-mode: t tooltip-mode: t global-eldoc-mode: t electric-indent-mode: t mouse-wheel-mode: t menu-bar-mode: t file-name-shadow-mode: t global-font-lock-mode: t font-lock-mode: t auto-composition-mode: t auto-encryption-mode: t auto-compression-mode: t buffer-read-only: t column-number-mode: t line-number-mode: t transient-mark-mode: t Load-path shadows: ~/emacs/prolog hides /home/peter/emacs-2019-12-17/share/emacs/28.0.50/lisp/progmodes/prolog Features: (shadow mail-extr emacsbug message rmc rfc822 mml mml-sec epa derived epg epg-config mm-decode mm-bodies mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader sendmail sort pulse vc vc-dispatcher misearch multi-isearch tabify man pcmpl-unix pcmpl-gnu mule-util server asm-mode conf-mode tar-mode arc-mode archive-mode add-log rst haskell-mode haskell-cabal haskell-utils haskell-font-lock haskell-indentation haskell-string haskell-sort-imports haskell-lexeme rx haskell-align-imports haskell-compat haskell-complete-module haskell-ghc-support flymake-proc flymake warnings dabbrev haskell-customize doc-view jka-compr image-mode exif go-mode find-file ffap etags fileloop generator xref project mhtml-mode css-mode sgml-mode eww mm-url gnus nnheader gnus-util rmail rmail-loaddefs rfc2047 rfc2045 ietf-drums mail-utils wid-edit mm-util mail-prsvr url-queue url url-proxy url-privacy url-expand url-methods url-history mailcap shr text-property-search url-cookie url-domsuf url-util puny svg xml dom sh-script smie executable markdown-mode color thingatpt noutline outline dired dired-loaddefs js cc-mode cc-fonts cc-guess cc-menus cc-cmds cc-styles cc-align cc-engine cc-vars cc-defs make-mode smerge-mode diff prolog align imenu vc-git diff-mode easy-mmode python tramp-sh tramp tramp-loaddefs trampver tramp-integration files-x tramp-compat shell pcomplete parse-time iso8601 time-date ls-lisp format-spec finder-inf cl-extra help-mode autorevert filenotify grep compile comint ansi-color ring cus-start cus-load paren time savehist desktop frameset info package easymenu browse-url url-handlers url-parse auth-source cl-seq eieio eieio-core cl-macs eieio-loaddefs password-cache json subr-x map url-vars seq byte-opt gv bytecomp byte-compile cconv cl-loaddefs cl-lib tooltip eldoc electric uniquify ediff-hook vc-hooks lisp-float-type mwheel term/x-win x-win term/common-win x-dnd tool-bar dnd fontset image regexp-opt fringe tabulated-list replace newcomment text-mode elisp-mode lisp-mode prog-mode register page tab-bar menu-bar rfn-eshadow isearch timer select scroll-bar mouse jit-lock font-lock syntax facemenu font-core term/tty-colors frame minibuffer cl-generic cham georgian utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european ethiopic indian cyrillic chinese composite charscript charprop case-table epa-hook jka-cmpr-hook help simple abbrev obarray cl-preloaded nadvice loaddefs button faces cus-face macroexp files text-properties overlay sha1 md5 base64 format env code-pages mule custom widget hashtable-print-readable backquote threads dbusbind inotify dynamic-setting system-font-setting font-render-setting move-toolbar gtk x-toolkit x multi-tty make-network-process emacs) Memory information: ((conses 16 553627 84742) (symbols 48 27664 5) (strings 32 109868 12210) (string-bytes 1 4407199) (vectors 16 47901) (vector-slots 8 1347908 158898) (floats 8 232 330) (intervals 56 48562 536) (buffers 1000 503)) --000000000000fe0bac059ba9d0bc Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
I'm observing creeping memory increase (at one point, emacs= was using over 3.8GB before I restarted it), possibly related to running c= ompilations with large amounts of output. Seems related to Bug#26952 (which= my Bug#38629 seemed to be a duplicate of), and which was fixed in emacs 26= .3. It seems to have reappeared in emacs 28.0.50, but with a difference -- = I'm not seeing the high CPU usage that I previously observed with the h= igh memory use (perhaps this is because global-auto-revert has been improve= d in 28.0.50).

Wha= t information should I collect to confirm this problem and to help someone = debug it?

In GNU Emacs 28.0.50 (build 1, x8= 6_64-pc-linux-gnu, GTK+ Version 3.22.30)
=C2=A0of 2020-01-07 built on wi= staria5b
Repository revision: 724af7671590cd91df37f64df6be73f6dca0144dRepository branch: master
Windowing system distributor 'The X.Org = Foundation', version 11.0.11906000
System Description: Ubuntu 18.04.= 3 LTS

Recent messages:
Reverting buffer =E2=80=98pykythe_utils.pl=E2=80=99.
You= can run the command =E2=80=98compile=E2=80=99 with C-x C-g g
Reverting = buffer =E2=80=98TAGS=E2=80=99.
Reverting buffer =E2=80=98FILES.js=E2=80= =99. [2 times]
Reverting buffer =E2=80=98t10.kythe.json-decoded=E2=80=99= . [2 times]
Compilation finished
You can run the command =E2=80=98gar= bage-collect=E2=80=99 with M-x ga RET
x is undefined [3 times]
Making= completion list...
Quit
Quit
Configured using:
=C2=A0'conf= igure --prefix=3D/home/peter/emacs-2019-12-17'

Configured featur= es:
XPM JPEG TIFF GIF PNG RSVG SOUND DBUS GSETTINGS GLIB NOTIFY INOTIFY<= br>GNUTLS LIBXML2 FREETYPE HARFBUZZ M17N_FLT LIBOTF XFT ZLIB
TOOLKIT_SCR= OLL_BARS GTK3 X11 XDBE XIM MODULES THREADS PDUMPER GMP

Important set= tings:
=C2=A0 value of $LC_MONETARY: en_CA.UTF-8
=C2=A0 value of $LC_= NUMERIC: en_CA.UTF-8
=C2=A0 value of $LC_TIME: en_CA.UTF-8
=C2=A0 val= ue of $LANG: en_US.UTF-8
=C2=A0 value of $XMODIFIERS: @im=3Dibus
=C2= =A0 locale-coding-system: utf-8-unix

Major mode: Compilation

= Minor modes in effect:
=C2=A0 shell-dirtrack-mode: t
=C2=A0 global-au= to-revert-mode: t
=C2=A0 show-paren-mode: t
=C2=A0 display-time-mode:= t
=C2=A0 savehist-mode: t
=C2=A0 desktop-save-mode: t
=C2=A0 tool= tip-mode: t
=C2=A0 global-eldoc-mode: t
=C2=A0 electric-indent-mode: = t
=C2=A0 mouse-wheel-mode: t
=C2=A0 menu-bar-mode: t
=C2=A0 file-n= ame-shadow-mode: t
=C2=A0 global-font-lock-mode: t
=C2=A0 font-lock-m= ode: t
=C2=A0 auto-composition-mode: t
=C2=A0 auto-encryption-mode: t=
=C2=A0 auto-compression-mode: t
=C2=A0 buffer-read-only: t
=C2=A0= column-number-mode: t
=C2=A0 line-number-mode: t
=C2=A0 transient-ma= rk-mode: t

Load-path shadows:
~/emacs/prolog hides /home/peter/em= acs-2019-12-17/share/emacs/28.0.50/lisp/progmodes/prolog

Features:(shadow mail-extr emacsbug message rmc rfc822 mml mml-sec epa derived
= epg epg-config mm-decode mm-bodies mm-encode mail-parse rfc2231
mailabbr= ev gmm-utils mailheader sendmail sort pulse vc vc-dispatcher
misearch mu= lti-isearch tabify man pcmpl-unix pcmpl-gnu mule-util server
asm-mode co= nf-mode tar-mode arc-mode archive-mode add-log rst
haskell-mode haskell-= cabal haskell-utils haskell-font-lock
haskell-indentation haskell-string= haskell-sort-imports haskell-lexeme
rx haskell-align-imports haskell-co= mpat haskell-complete-module
haskell-ghc-support flymake-proc flymake wa= rnings dabbrev
haskell-customize doc-view jka-compr image-mode exif go-m= ode find-file
ffap etags fileloop generator xref project mhtml-mode css-= mode sgml-mode
eww mm-url gnus nnheader gnus-util rmail rmail-loaddefs r= fc2047 rfc2045
ietf-drums mail-utils wid-edit mm-util mail-prsvr url-que= ue url
url-proxy url-privacy url-expand url-methods url-history mailcap = shr
text-property-search url-cookie url-domsuf url-util puny svg xml dom=
sh-script smie executable markdown-mode color thingatpt noutline outlin= e
dired dired-loaddefs js cc-mode cc-fonts cc-guess cc-menus cc-cmds
= cc-styles cc-align cc-engine cc-vars cc-defs make-mode smerge-mode diff
= prolog align imenu vc-git diff-mode easy-mmode python tramp-sh tramp
tra= mp-loaddefs trampver tramp-integration files-x tramp-compat shell
pcompl= ete parse-time iso8601 time-date ls-lisp format-spec finder-inf
cl-extra= help-mode autorevert filenotify grep compile comint ansi-color
ring cus= -start cus-load paren time savehist desktop frameset info
package easyme= nu browse-url url-handlers url-parse auth-source cl-seq
eieio eieio-core= cl-macs eieio-loaddefs password-cache json subr-x map
url-vars seq byte= -opt gv bytecomp byte-compile cconv cl-loaddefs cl-lib
tooltip eldoc ele= ctric uniquify ediff-hook vc-hooks lisp-float-type
mwheel term/x-win x-w= in term/common-win x-dnd tool-bar dnd fontset image
regexp-opt fringe ta= bulated-list replace newcomment text-mode elisp-mode
lisp-mode prog-mode= register page tab-bar menu-bar rfn-eshadow isearch
timer select scroll-= bar mouse jit-lock font-lock syntax facemenu
font-core term/tty-colors f= rame minibuffer cl-generic cham georgian
utf-8-lang misc-lang vietnamese= tibetan thai tai-viet lao korean
japanese eucjp-ms cp51932 hebrew greek= romanian slovak czech european
ethiopic indian cyrillic chinese composi= te charscript charprop
case-table epa-hook jka-cmpr-hook help simple abb= rev obarray
cl-preloaded nadvice loaddefs button faces cus-face macroexp= files
text-properties overlay sha1 md5 base64 format env code-pages mul= e
custom widget hashtable-print-readable backquote threads dbusbind
i= notify dynamic-setting system-font-setting font-render-setting
move-tool= bar gtk x-toolkit x multi-tty make-network-process emacs)

Memory inf= ormation:
((conses 16 553627 84742)
=C2=A0(symbols 48 27664 5)
=C2= =A0(strings 32 109868 12210)
=C2=A0(string-bytes 1 4407199)
=C2=A0(ve= ctors 16 47901)
=C2=A0(vector-slots 8 1347908 158898)
=C2=A0(floats 8= 232 330)
=C2=A0(intervals 56 48562 536)
=C2=A0(buffers 1000 503))
--000000000000fe0bac059ba9d0bc--