From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Carlos O'Donell Newsgroups: gmane.emacs.bugs Subject: bug#43389: 28.0.50; Emacs memory leaks using hard disk all time Date: Wed, 25 Nov 2020 15:51:16 -0500 Organization: Red Hat Message-ID: <399d4681-940a-c782-b91e-750e62840cb6@redhat.com> References: <83y2j0qb2v.fsf@gnu.org> <831rgppg3w.fsf@gnu.org> <83zh3czbvz.fsf@gnu.org> <83blfovzxz.fsf@gnu.org> <87o8jnu5f2.fsf@mail.trevorbentley.com> <83o8jmu49z.fsf@gnu.org> <522e3cc0-c563-3308-7264-1b09cd5e264b@redhat.com> <87o8jltglg.fsf@mail.trevorbentley.com> <43b8f55b-d201-76e0-2d19-d97dec8798aa@redhat.com> <87im9ttfeg.fsf@mail.trevorbentley.com> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="25360"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 Cc: fweimer@redhat.com, 43389@debbugs.gnu.org, dj@redhat.com, michael_heerdegen@web.de To: Trevor Bentley , Jean Louis Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Wed Nov 25 21:52:09 2020 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1ki1lp-0006Tu-63 for geb-bug-gnu-emacs@m.gmane-mx.org; Wed, 25 Nov 2020 21:52:09 +0100 Original-Received: from localhost ([::1]:47578 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1ki1ln-00052Y-MR for geb-bug-gnu-emacs@m.gmane-mx.org; Wed, 25 Nov 2020 15:52:07 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:50904) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1ki1li-00052P-5t for bug-gnu-emacs@gnu.org; Wed, 25 Nov 2020 15:52:02 -0500 Original-Received: from debbugs.gnu.org ([209.51.188.43]:53952) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1ki1lh-0001ii-UQ for bug-gnu-emacs@gnu.org; Wed, 25 Nov 2020 15:52:01 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1ki1lh-0000ag-S6 for bug-gnu-emacs@gnu.org; Wed, 25 Nov 2020 15:52:01 -0500 X-Loop: help-debbugs@gnu.org Resent-From: Carlos O'Donell Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 25 Nov 2020 20:52:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 43389 X-GNU-PR-Package: emacs Original-Received: via spool by 43389-submit@debbugs.gnu.org id=B43389.16063374842228 (code B ref 43389); Wed, 25 Nov 2020 20:52:01 +0000 Original-Received: (at 43389) by debbugs.gnu.org; 25 Nov 2020 20:51:24 +0000 Original-Received: from localhost ([127.0.0.1]:37265 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ki1l6-0000Zs-JM for submit@debbugs.gnu.org; Wed, 25 Nov 2020 15:51:24 -0500 Original-Received: from us-smtp-delivery-124.mimecast.com ([216.205.24.124]:52388) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ki1l5-0000Zl-Aa for 43389@debbugs.gnu.org; Wed, 25 Nov 2020 15:51:24 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1606337482; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=4QwnxLlSfIwFH/l0+zsGIgeRlr33GEAyRbItBNYRkWo=; b=ixH1VfQrlqa9VUTwlyzKyj6zYR6Uu8XsbzJuETFEWuaUG4zTq6uy7ovSYaqmQF65R2hN/K +ZXvMvf552R33Sj278EgcEK7xVC+KqSWfo3d2SgTv2T4n+gW7pM8HX34KLekFA5VNpyuac cCwEMwf21hThn1RTPXVKWUfJsJgvueQ= Original-Received: from mail-qv1-f71.google.com (mail-qv1-f71.google.com [209.85.219.71]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-155-GMtKIcxdO-ObMNO5H6p2oQ-1; Wed, 25 Nov 2020 15:51:19 -0500 X-MC-Unique: GMtKIcxdO-ObMNO5H6p2oQ-1 Original-Received: by mail-qv1-f71.google.com with SMTP id t14so3259786qvc.13 for <43389@debbugs.gnu.org>; Wed, 25 Nov 2020 12:51:19 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:organization :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=4QwnxLlSfIwFH/l0+zsGIgeRlr33GEAyRbItBNYRkWo=; b=uEKbgZruxR7iFTmOMcWTIHlTql7mKhpxgz3AC/nMMhqZihBgnrBcOCbNP1vIg1I7N4 8nCgNOw/RuuKwMy2Dp8pVHyFhk1GvEZlU2IZUHLrIKcL5/ytSOAt9vVS+uOjHlroQKwP TpZpEju9jiB5XpVMS50WZF6xzQ3Er1p2PpB4suI/alU6uvQAclhXTpFXXTWKEee4tOyP en3l2i3bZfpse6ZfmDt3KwkITwWb/+c+eLiLg+21JaDFmUJ/FMjc3GvrvB41VbJbK8YT z2GDQgrjsJPNqgs6Fl6uPemNDxWyKdKGAbAZ3U08/97iDfcXLFcMGWthZmsR2+VkzMTv uWcw== X-Gm-Message-State: AOAM532NWJ3xSY/OqbH0b62DnQ1GaR2FTqxhHA0sbblX6Bo4kJvzlRS6 8GRYFymzXA19g8ORdx0R3dkjgWlCtbOvNkHSZRSWdy6ZNTv10NvoapNJtoxx6Ce2fOgzBYdp1/N CWaGrUdpV+HJH1jM= X-Received: by 2002:aed:2662:: with SMTP id z89mr803960qtc.70.1606337478785; Wed, 25 Nov 2020 12:51:18 -0800 (PST) X-Google-Smtp-Source: ABdhPJzNy5YezZPu7g6R0+rhDNQ095uNuo54OTel8zWQCgrrUaZMqg8KnzCKdBdusTXtfHmFbyNCEg== X-Received: by 2002:aed:2662:: with SMTP id z89mr803935qtc.70.1606337478586; Wed, 25 Nov 2020 12:51:18 -0800 (PST) Original-Received: from [192.168.1.16] (198-84-214-74.cpe.teksavvy.com. [198.84.214.74]) by smtp.gmail.com with ESMTPSA id j19sm409010qkk.119.2020.11.25.12.51.17 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 25 Nov 2020 12:51:17 -0800 (PST) In-Reply-To: <87im9ttfeg.fsf@mail.trevorbentley.com> Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=carlos@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Language: en-US X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.io gmane.emacs.bugs:194243 Archived-At: On 11/25/20 2:17 PM, Trevor Bentley wrote: > Carlos O'Donell writes: > >> On 11/25/20 1:51 PM, Trevor Bentley wrote: >>> I also still hit it while running under Valgrind; the whole emacs session was slow as hell, but still managed to blow out its heap in a few days.  Of course, libmtrace could be different, but at least it doesn't seem to be a heisenbug. >> >> Do you have a valgrind report to share? > > Yes, they were earlier in this bug report, perhaps before you joined.  It was the 'massif' heap tracing tool from the valgrind suite, not the regular valgrind leak detector. > > Here are the links again: > >  The raw massif output: >  http://trevorbentley.com/massif.out.3364630 >  The *full* tree output: >  http://trevorbentley.com/ms_print.3364630.txt >  The tree output showing only entries above 10% usage: >  http://trevorbentley.com/ms_print.thresh10.3364630.txt This data is pretty clear: 1.40GiB - lisp_align_malloc (alloc.c:1195) 1.40GiB - lmalloc (alloc.c:1359) 0.65GiB - lrealloc (alloc.c:1374) 0.24GiB - AcquireAlignedMemory (/usr/lib/libMagickCore-7.Q16HDRI.so.7.0.0) -------- 3.60Gib - In use as of the snapshot. That's a fairly high fraction of the ~4.2GiB that is eventually in use. With lisp_align_malloc, lmalloc, and lrealloc shooting up exponentially at the end of the run look like they are making lists and processing numbers and other objects. This is a direct expression of something increasing demand for memory. -- Cheers, Carlos.