unofficial mirror of emacs-devel@gnu.org 
 help / color / mirror / code / Atom feed
* Debugging emacs memory management
@ 2015-02-11  6:01 Dima Kogan
  2015-02-11 15:05 ` Stefan Monnier
                   ` (2 more replies)
  0 siblings, 3 replies; 37+ messages in thread
From: Dima Kogan @ 2015-02-11  6:01 UTC (permalink / raw)
  To: emacs-devel

Hi.

I'm running emacs snapshots from the latest git, usually as a
long-running daemon. For a few months now I've had to restart my emacs
session every week or so because it eats all my RAM, and cycling emacs
is the only way to get the RAM back. So two main questions:

1. How does one debug this? There's a memory profiler (launched with
(profiler-start) ), but it only instruments allocations, which is
useless for hunting leaks. Past that, there's some mailing list wisdom
such as this:

 https://lists.gnu.org/archive/html/emacs-devel/2008-12/msg00782.html

It turned up some variables that it claimed were about 20MB long, not x
GB, but admittedly it's not obvious to me that 

 (length (prin1-to-string (symbol-value sym)))

is an accurate measure of the memory footprint of a variable, especially
if it represents something like a hash table.

That's about it, though. Are there better techniques available now? Are
there obvious ways to improve the profiler? Should I look at it?



2. This is specifically about my problem, so maybe this is better as a
bug report; putting it here anyway.

As a test, I tried to split out my ERC and mu4e use to a different
session and that made no difference, so it's not those. As a random
guess, I have a sequence that appears to leak, but I'm not 100% sure how
this is supposed to work. As I ran through this sequence, I looked at
resident memory with this:

 while (true) { sleep 1; ps -o rss `pidof emacs-snapshot` | grep --line-buffered -v RSS }

init.el only has this line:

 (global-set-key (kbd "C-S-w") 'delete-region)

Sequence:

1.  seq 1000000 > /tmp/dat                  [ create large file on disk ]
2.  emacs-snapshot                          [ 32MB RSS ]

3.  open /tmp/dat                           [ 40MB ]
4.  (delete-region (point-min) (point-max)) [ 40MB ]
5.  (undo)                                  [ 47MB ]
6.  (kill-buffer)                           [ 40MB ]
7.  (garbage-collect)                       [ 40MB ]

3a. open /tmp/dat                           [ 46MB ]
4a. (delete-region (point-min) (point-max)) [ 60MB ]
5a. (undo)                                  [ 60MB ]
6a. (kill-buffer)                           [ 60MB ]
7a. (garbage-collect)                       [ 60MB ]

3b. open /tmp/dat                           [ 60MB ]
4b. (delete-region (point-min) (point-max)) [ 60MB ]
5b. (undo)                                  [ 60MB ]
6b. (kill-buffer)                           [ 60MB ]
7b. (garbage-collect)                       [ 60MB ]

So here it looks like 28MB vanished. Is this a leak? I'm using
(delete-region) specifically because it doesn't move anything to the
kill ring. The undo information shouldn't persist either because the
buffer is being killed.

Without knowing the internals, it looks like a leak, but I can't be
sure. If I move around the /tmp/dat buffer, and (delete-region) various
other chunks, I can eat up even more memory. The exact usage values
aren't consistent every time, but it always looks like it leaks. Also,
'emacs -Q' shows the same behavior, just not as badly. Advice?

dima



^ permalink raw reply	[flat|nested] 37+ messages in thread

end of thread, other threads:[~2015-10-08 21:51 UTC | newest]

Thread overview: 37+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2015-02-11  6:01 Debugging emacs memory management Dima Kogan
2015-02-11 15:05 ` Stefan Monnier
2015-02-15 20:28   ` Dima Kogan
2015-02-15 20:47     ` Eli Zaretskii
2015-02-16  1:39       ` Stefan Monnier
2015-02-17  7:59         ` Dima Kogan
2015-02-17 15:59           ` Eli Zaretskii
2015-02-18  0:07           ` Stefan Monnier
2015-02-11 19:07 ` Florian Weimer
2015-09-15 19:27 ` Dima Kogan
2015-09-16 16:28   ` Paul Eggert
2015-09-20 22:01     ` Dima Kogan
2015-09-21  6:46       ` Eli Zaretskii
2015-09-21  8:54         ` Dima Kogan
2015-09-21 10:00           ` Eli Zaretskii
2015-09-21 10:21             ` Eli Zaretskii
2015-09-22 21:33               ` Dima Kogan
2015-09-23  6:35                 ` Eli Zaretskii
2015-09-23  6:37                   ` Dima Kogan
2015-09-23  7:16                     ` Eli Zaretskii
2015-10-05  7:21               ` Dima Kogan
2015-10-05  7:55                 ` Eli Zaretskii
2015-10-05  8:24                   ` Dima Kogan
2015-10-05  8:33                     ` Eli Zaretskii
2015-10-05  8:43                     ` Eli Zaretskii
2015-10-05  9:24                       ` Dima Kogan
2015-10-05  9:49                         ` Dima Kogan
2015-10-05  9:58                           ` Andreas Schwab
2015-10-05 10:02                             ` Dima Kogan
2015-10-05 10:47                               ` Eli Zaretskii
2015-10-05 18:19                                 ` Dima Kogan
2015-10-05 18:24                                   ` Eli Zaretskii
2015-10-05 23:21                                   ` Dima Kogan
2015-10-06  2:41                                     ` Eli Zaretskii
2015-10-08 21:51                                       ` Dima Kogan
2015-09-16 16:34   ` Davis Herring
2015-09-16 22:03   ` Markus Triska

Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/emacs.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).