From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED!not-for-mail From: Linas Vepstas Newsgroups: gmane.lisp.guile.bugs Subject: bug#25386: This can be closed Date: Wed, 11 Jan 2017 00:14:14 -0600 Message-ID: References: Reply-To: linasvepstas@gmail.com NNTP-Posting-Host: blaine.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=UTF-8 X-Trace: blaine.gmane.org 1484115320 18864 195.159.176.226 (11 Jan 2017 06:15:20 GMT) X-Complaints-To: usenet@blaine.gmane.org NNTP-Posting-Date: Wed, 11 Jan 2017 06:15:20 +0000 (UTC) To: 25386@debbugs.gnu.org Original-X-From: bug-guile-bounces+guile-bugs=m.gmane.org@gnu.org Wed Jan 11 07:15:16 2017 Return-path: Envelope-to: guile-bugs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by blaine.gmane.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cRCBg-0003lm-2N for guile-bugs@m.gmane.org; Wed, 11 Jan 2017 07:15:08 +0100 Original-Received: from localhost ([::1]:51642 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1cRCBj-0002RD-Oe for guile-bugs@m.gmane.org; Wed, 11 Jan 2017 01:15:11 -0500 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:48341) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1cRCBe-0002Pr-7E for bug-guile@gnu.org; Wed, 11 Jan 2017 01:15:07 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1cRCBb-00050a-1E for bug-guile@gnu.org; Wed, 11 Jan 2017 01:15:06 -0500 Original-Received: from debbugs.gnu.org ([208.118.235.43]:33908) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1cRCBa-00050W-SV for bug-guile@gnu.org; Wed, 11 Jan 2017 01:15:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1cRCBa-0004Vb-Jz for bug-guile@gnu.org; Wed, 11 Jan 2017 01:15:02 -0500 X-Loop: help-debbugs@gnu.org In-Reply-To: Resent-From: Linas Vepstas Original-Sender: "Debbugs-submit" Resent-CC: bug-guile@gnu.org Resent-Date: Wed, 11 Jan 2017 06:15:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 25386 X-GNU-PR-Package: guile X-GNU-PR-Keywords: Original-Received: via spool by 25386-submit@debbugs.gnu.org id=B25386.148411528217287 (code B ref 25386); Wed, 11 Jan 2017 06:15:02 +0000 Original-Received: (at 25386) by debbugs.gnu.org; 11 Jan 2017 06:14:42 +0000 Original-Received: from localhost ([127.0.0.1]:49307 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cRCBG-0004Ul-0W for submit@debbugs.gnu.org; Wed, 11 Jan 2017 01:14:42 -0500 Original-Received: from mail-qk0-f181.google.com ([209.85.220.181]:34618) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1cRCBE-0004US-8E for 25386@debbugs.gnu.org; Wed, 11 Jan 2017 01:14:41 -0500 Original-Received: by mail-qk0-f181.google.com with SMTP id a20so199666018qkc.1 for <25386@debbugs.gnu.org>; Tue, 10 Jan 2017 22:14:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:reply-to:from:date:message-id:subject:to; bh=3jXWNenFqlGKcG1/GodoCeMLQ8YBLRrLGGmmZM103M8=; b=OgMb6wWYVt1EuqJHjSPWX+x8N/LH+lzDMC3YFsjE5naGv6s0my7AYS8tUM8Y025l9L 80S0rbF5ZtWOOORXuIbCLJp5eviWZt0NTUGwS7K3m5qtajw1WyjabyECkMui5bSxykSJ 4aqhzUvaHySPiv3A3iT2AMIwIhfCX+K6YJSXgfKfATWbgGPb9Q86xfI+tezhsIVhlXQj LG0Bm34CQVMjzecY7gr+ESzXpUFI6u3rhhNdWs9BWoXlH1mzBpfa0z7PNRxgIZ4SDimw WbaBczFyKpMmJLXO5eyaRAGwzMnuJvaU19y0LdXXGdwDwVTefgGn+Rk2yBAaiJmY3GvM +jRQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:reply-to:from:date:message-id :subject:to; bh=3jXWNenFqlGKcG1/GodoCeMLQ8YBLRrLGGmmZM103M8=; b=NZTNr4AUdUW6EO+hV9DvXDr0i1RnDWOw9gIkTewtFTe0A7mlUDmScH4KHjj3jBbAN2 7NsKXWYeTaMaqqcJgUi2D/3BhPObPDYWaQ0c2N19Yyqraoyx3Nhd0KLMlKDed1N3l1Hq efhcRppzoBj46S1wWiaOfljh5vu/ghUqxA2FQgW17r3n2Vl2ecyK85o2VRgTiLyFhXIY ntHMGQH3KIxRGStPKumENhS36wflc0vVVDEga1XxR6zDQO073VXhi8I7H4Ezoitun4Fz c44YQoeg6OQ6WOoMNyATq0DVvx1x6nhIsyta7sedVn8MDRL4BqmYkrWYG+nIl3RZmY1k 2Emg== X-Gm-Message-State: AIkVDXIYvN3tCNL6LWKD0S5sIM2nG7Tj1y44rgeRDJWYFXIlj49vzOIZILWkqQ438KA0gr6DKo6VBlea0MDpMQ== X-Received: by 10.55.215.202 with SMTP id t71mr7613885qkt.114.1484115274751; Tue, 10 Jan 2017 22:14:34 -0800 (PST) Original-Received: by 10.12.128.78 with HTTP; Tue, 10 Jan 2017 22:14:14 -0800 (PST) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 208.118.235.43 X-BeenThere: bug-guile@gnu.org List-Id: "Bug reports for GUILE, GNU's Ubiquitous Extension Language" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guile-bounces+guile-bugs=m.gmane.org@gnu.org Original-Sender: "bug-guile" Xref: news.gmane.org gmane.lisp.guile.bugs:8516 Archived-At: This can be closed as 'fixed'; I tested on today's git guile (GNU Guile) 2.1.5.19-7e9395 and the worst of it seems to be over. mem usage growth on the original test case: (heap-size . 7921664) (gc-times . 40) (heap-size . 14344192) (gc-times . 953) (heap-size . 14344192) (gc-times . 5219) ; after 4 minutes CPU (heap-size . 26419200) (gc-times . 64975) ; after 77 minutes CPU (heap-size . 26419200) (gc-times . 133346) ; after 154 mins CPU (heap-size . 26419200) (gc-times . 170083) ; after 192 mins CPU (heap-size . 26419200) (gc-times . 249102) ; after 283 mins cpu (heap-size . 26419200) (gc-times . 420031) ; after 468 min cpu (heap-size . 26419200) (gc-times . 557039) ; after 804 mins CPU i.e. 26MBytes - larger than it needs to be, but acceptable. The last entry was, in full, ((gc-time-taken . 355210357) (heap-size . 26419200) (heap-free-size . 20336640) (heap-total-allocated . 2522568563312) (heap-allocated-since-gc . 57648) (protected-objects . 0) (gc-times . 557619)) i.e. of the 26MB, only 6MB is in use, the rest is free. The 6MB is close to what it starts with. 2522 GB were chewed through in the process, so this is OK, I guess. A variant test case, create 510 threads before calling join: (change 10 to 510 in above test) (heap-size . 10604544) (gc-times . 32) (heap-size . 19505152) (gc-times . 484) (heap-size . 35926016) (gc-times . 1761) (heap-size . 48238592) (gc-times . 4217) ; after 8 minutes cpu time (heap-size . 48238592) (gc-times . 47902) ; after 76 mins CPU (heap-size . 48238592) (gc-times . 73063) ; after 114 mins CPU (heap-size . 65540096) (gc-times . 128094) ; after 209 mins cpu (heap-size . 65540096) (gc-times . 248321) ; after 399 mins (heap-size . 65540096) (gc-times . 344197) ; after 546 min i.e. 65MBytes .. acceptable, I guess. The last one was: ((gc-time-taken . 218714374) (heap-size . 65540096) (heap-free-size . 54419456) (heap-total-allocated . 2057186203744) (heap-allocated-since-gc . 4553872) (protected-objects . 0) (gc-times . 344799)) so of the 65MB, only 11MB is in-use. My production server is doing this: (heap-size . 652918784) (gc-times . 233) ; about 8 mins CPU (heap-size . 737722368) (gc-times . 339) ; 12 mins CPU (heap-size . 1332973568) (gc-times . 1797) ; 120 mins CPU (heap-size . 1441443840) (gc-times . 2221) ; 151 min CPU (heap-size . 1521213440) (gc-times . 2441) ; 168 min cpu (heap-size . 1595101184) (gc-times . 3061) ; 218 min cpu (heap-size . 1726119936) (gc-times . 3292) ; 237 min (heap-size . 1960865792) (gc-times . 6698) ; 510 minn (heap-size . 1960865792) (gc-times . 10383) ; 805 min (heap-size . 2931556352) (gc-times . 14211) ; 1199 min about 3GB -- Last one is, in full: (gc-stats) ((gc-time-taken . 19818394581722) (heap-size . 2931556352) (heap-free-size . 1767579648) (heap-total-allocated . 731393991040) (heap-allocated-since-gc . 4063680) (protected-objects . 318) (gc-times . 14211)) so of the 3GB, 1.8GB is free, and 1.2GB in use which is surprisingly high for my app, but I can live with that. Thanks! --linas