From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Carlos O'Donell Newsgroups: gmane.emacs.bugs Subject: bug#43389: 28.0.50; Emacs memory leaks Date: Wed, 18 Nov 2020 00:43:55 -0500 Organization: Red Hat Message-ID: <4c760dd6-edb7-c6b1-f5de-f1bcae5ce63d@redhat.com> References: <83ft57raog.fsf@gnu.org> <871rgrk9g5.fsf@oldenburg2.str.redhat.com> <83d00br9xk.fsf@gnu.org> <87tutnitta.fsf@oldenburg2.str.redhat.com> <83a6vfr8p0.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="31976"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:78.0) Gecko/20100101 Thunderbird/78.4.0 Cc: 43389@debbugs.gnu.org, dj@redhat.com To: Eli Zaretskii , Florian Weimer Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Wed Nov 18 06:45:11 2020 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1kfGHH-0008CR-6O for geb-bug-gnu-emacs@m.gmane-mx.org; Wed, 18 Nov 2020 06:45:11 +0100 Original-Received: from localhost ([::1]:43468 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kfGHG-0001H0-95 for geb-bug-gnu-emacs@m.gmane-mx.org; Wed, 18 Nov 2020 00:45:10 -0500 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:45382) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kfGH8-0001Fb-EL for bug-gnu-emacs@gnu.org; Wed, 18 Nov 2020 00:45:02 -0500 Original-Received: from debbugs.gnu.org ([209.51.188.43]:50483) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kfGH8-0001z8-4M for bug-gnu-emacs@gnu.org; Wed, 18 Nov 2020 00:45:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1kfGH8-0000Jr-2Y for bug-gnu-emacs@gnu.org; Wed, 18 Nov 2020 00:45:02 -0500 X-Loop: help-debbugs@gnu.org Resent-From: Carlos O'Donell Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 18 Nov 2020 05:45:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 43389 X-GNU-PR-Package: emacs Original-Received: via spool by 43389-submit@debbugs.gnu.org id=B43389.16056782471143 (code B ref 43389); Wed, 18 Nov 2020 05:45:02 +0000 Original-Received: (at 43389) by debbugs.gnu.org; 18 Nov 2020 05:44:07 +0000 Original-Received: from localhost ([127.0.0.1]:33796 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kfGGF-0000IM-3M for submit@debbugs.gnu.org; Wed, 18 Nov 2020 00:44:07 -0500 Original-Received: from us-smtp-delivery-124.mimecast.com ([63.128.21.124]:38025) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kfGGB-0000ID-NQ for 43389@debbugs.gnu.org; Wed, 18 Nov 2020 00:44:05 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=redhat.com; s=mimecast20190719; t=1605678243; h=from:from:reply-to:subject:subject:date:date:message-id:message-id: to:to:cc:cc:mime-version:mime-version:content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references; bh=eJ9SKLrzsGvZOwdZheJxpsGq7+m2UNNMzlERIRYtzVA=; b=iIqKwt2WthSwjkirON65w1x2MORy13y88Fe9b3bdCcVMoTfpwX8y3VKKIdT4W8EUdzulh/ bEakUNliiXs2lKILhpymMaUwdYb+foa5izg5fdKi5pnKcPQovQ03gycryekOtUvchVhu89 a3Gv+IA7ZQay7W//hUc3TQ1Eyny3H0M= Original-Received: from mail-il1-f200.google.com (mail-il1-f200.google.com [209.85.166.200]) (Using TLS) by relay.mimecast.com with ESMTP id us-mta-218-iuutKUPcNrC10Z6xFrAUUQ-1; Wed, 18 Nov 2020 00:43:59 -0500 X-MC-Unique: iuutKUPcNrC10Z6xFrAUUQ-1 Original-Received: by mail-il1-f200.google.com with SMTP id o5so717448ilh.15 for <43389@debbugs.gnu.org>; Tue, 17 Nov 2020 21:43:58 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:organization :message-id:date:user-agent:mime-version:in-reply-to :content-language:content-transfer-encoding; bh=eJ9SKLrzsGvZOwdZheJxpsGq7+m2UNNMzlERIRYtzVA=; b=PO50eQ5m5OSKvVoHex0nxlRco+m9NCBlbCdoMTQE+lC9W3GF2d+17theJ3hmEAhtPM 6L7pG5H38TZGFrgR0qt+hJCAfiSaFro7YALHI1q/0kcuonFPfE0E1YUd+jI2JORX1ALw e9YdnayNkVAK7dZYbQDdltWRZc4wFjuH57YTLX9gsCVF+EmtjKMwz5TcyyQjcZOkQebD nT40TuDW8vPhYIRe5Z4R0bsMAIyouK57BS2yEH+GN67uqMS2lCyVyRr5UP0sWFNPJ6Wc BfXcFZbeO+E/isuCBKyNxuO0TIDolC+BcFhD0lC1ODTys1/fiC+FyE30baA7F0Xbj7IE 2hZA== X-Gm-Message-State: AOAM530u4rANmpZ+kTZgblb1w3Pr+dUoiwW0rnlSUkcXPS1cXM7+uGbb QHuP4TJlKrbRSZmgmqvmCn3gJyEU0lW2KYo6aJsP8azLYN6eoMqmcGiU5NsCxBHvci+CXmQOT+Z 0fNXv72uAb97RTPyLGdjQ5K5NRa85pX7fwy8uO3IV6wXuYNeB+Z71C41iUMZb9Hss X-Received: by 2002:a92:4850:: with SMTP id v77mr15834026ila.229.1605678237954; Tue, 17 Nov 2020 21:43:57 -0800 (PST) X-Google-Smtp-Source: ABdhPJxkEZzKt6+E1bOeTY5rBjEdLcuugwLoAJwiryDkgq1T8zhLSRrtP/v2xmToP8mgFY69LSLUGQ== X-Received: by 2002:a92:4850:: with SMTP id v77mr15834017ila.229.1605678237744; Tue, 17 Nov 2020 21:43:57 -0800 (PST) Original-Received: from [192.168.1.16] (198-84-214-74.cpe.teksavvy.com. [198.84.214.74]) by smtp.gmail.com with ESMTPSA id c66sm15518501ilg.46.2020.11.17.21.43.56 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Tue, 17 Nov 2020 21:43:57 -0800 (PST) In-Reply-To: <83a6vfr8p0.fsf@gnu.org> Authentication-Results: relay.mimecast.com; auth=pass smtp.auth=CUSA124A263 smtp.mailfrom=carlos@redhat.com X-Mimecast-Spam-Score: 0 X-Mimecast-Originator: redhat.com Content-Language: en-US X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.io gmane.emacs.bugs:193595 Archived-At: On 11/17/20 4:10 PM, Eli Zaretskii wrote: >> From: Florian Weimer >> Cc: dj@redhat.com, carlos@redhat.com, 43389@debbugs.gnu.org >> Date: Tue, 17 Nov 2020 21:58:57 +0100 >> >> (let ((size 0)) >> (dolist (buffer (buffer-list) size) >> (setq size (+ size (buffer-size buffer))))) >> ⇒ 98249826 >> >> So it's not a small number, but still far away from those 800 MiB. > > Yes. I have a very similar value: 94642916 (in 376 buffers; you have > more than 1000). This is in a session that runs for 17 days and whose > VM size is 615 MB: a "normal" size for a long-living session, nowhere > near 2GB, let alone 11GB someone reported. If you get us a data trace I will run it through the simulator and produce a report that includes graphs explaining the results of the trace and we'll see if a smoking gun shows up. The biggest smoking gun is a spike in RSS size without a matching Ideal RSS (integral of API calls). This would indicate an algorithmic issue. Usually though we can have ratcheting effects due to mixed object liftimes and those are harder to detect and we don't have tooling for that to look for such issues. We'd need to track chunk lifetimes. -- Cheers, Carlos.