From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED!not-for-mail From: Ricardo Wurmus Newsgroups: gmane.lisp.guile.bugs Subject: bug#19180: Weak tables harmful to GC? Date: Thu, 26 Oct 2017 10:35:06 +0200 Message-ID: <87k1zimhmt.fsf__25660.0784873173$1509013474$gmane$org@elephly.net> References: <87wp9gwz8m.fsf@gnu.org> <87fug4o8z2.fsf@pobox.com> <87wp54z3p5.fsf@gnu.org> <87zi9th1i6.fsf_-_@gnu.org> <87y3o454pr.fsf@gnu.org> <87r2tvncs5.fsf@dustycloud.org> <87wp3mwwef.fsf@gnu.org> <87mv4gd0ik.fsf@elephly.net> <87a80eie63.fsf@gnu.org> NNTP-Posting-Host: blaine.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit X-Trace: blaine.gmane.org 1509013474 3094 195.159.176.226 (26 Oct 2017 10:24:34 GMT) X-Complaints-To: usenet@blaine.gmane.org NNTP-Posting-Date: Thu, 26 Oct 2017 10:24:34 +0000 (UTC) User-Agent: mu4e 0.9.18; emacs 25.3.1 Cc: Andy Wingo , 19180@debbugs.gnu.org, guile-devel@gnu.org To: Ludovic =?UTF-8?Q?Court=C3=A8s?= Original-X-From: bug-guile-bounces+guile-bugs=m.gmane.org@gnu.org Thu Oct 26 12:24:30 2017 Return-path: Envelope-to: guile-bugs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by blaine.gmane.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e7fKb-0006rY-Aw for guile-bugs@m.gmane.org; Thu, 26 Oct 2017 12:24:09 +0200 Original-Received: from localhost ([::1]:51966 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1e7fKi-0002sW-CX for guile-bugs@m.gmane.org; Thu, 26 Oct 2017 06:24:16 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:51729) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1e7fKZ-0002pc-7Y for bug-guile@gnu.org; Thu, 26 Oct 2017 06:24:09 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1e7fKU-0000Xh-Md for bug-guile@gnu.org; Thu, 26 Oct 2017 06:24:05 -0400 Original-Received: from debbugs.gnu.org ([208.118.235.43]:53561) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1e7fKU-0000Xa-Id for bug-guile@gnu.org; Thu, 26 Oct 2017 06:24:02 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1e7fKU-0000ty-Bk for bug-guile@gnu.org; Thu, 26 Oct 2017 06:24:02 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Ricardo Wurmus Original-Sender: "Debbugs-submit" Resent-CC: bug-guile@gnu.org Resent-Date: Thu, 26 Oct 2017 10:24:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 19180 X-GNU-PR-Package: guile X-GNU-PR-Keywords: Original-Received: via spool by 19180-submit@debbugs.gnu.org id=B19180.15090134313447 (code B ref 19180); Thu, 26 Oct 2017 10:24:02 +0000 Original-Received: (at 19180) by debbugs.gnu.org; 26 Oct 2017 10:23:51 +0000 Original-Received: from localhost ([127.0.0.1]:34009 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e7fKJ-0000tX-AZ for submit@debbugs.gnu.org; Thu, 26 Oct 2017 06:23:51 -0400 Original-Received: from sender-of-o51.zoho.com ([135.84.80.216]:21097) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1e7fKH-0000tO-79 for 19180@debbugs.gnu.org; Thu, 26 Oct 2017 06:23:50 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1509006909; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding; l=9798; bh=FQ8QJCVSfttO4bRkNMwFaU9t0E/n90AC0Q+DidsY880=; b=Lwuuabn5VpLGhyQzzIbkT2vRuc4ciRdrA7JMYQh/0K3/2JE6ydcfj8AL7q69JKaM Y/+c7v3O0bMxi6IsTVtDZRIrSYuDVvR/bWnIKt36zznykJ48avBE6uS2mc0PZxvdBvP mqeXuQ+jsIMevNJhm2qhOkq+Ertxa6QQQi/fdm30= Original-Received: from localhost (port-92-200-82-198.dynamic.qsc.de [92.200.82.198]) by mx.zohomail.com with SMTPS id 1509006909386335.636868016482; Thu, 26 Oct 2017 01:35:09 -0700 (PDT) In-reply-to: <87a80eie63.fsf@gnu.org> X-URL: https://elephly.net X-PGP-Key: https://elephly.net/rekado.pubkey X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC X-ZohoMailClient: External X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 208.118.235.43 X-BeenThere: bug-guile@gnu.org List-Id: "Bug reports for GUILE, GNU's Ubiquitous Extension Language" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guile-bounces+guile-bugs=m.gmane.org@gnu.org Original-Sender: "bug-guile" Xref: news.gmane.org gmane.lisp.guile.bugs:8862 Archived-At: Hi Ludo, I tried building Guile with the following Guix package definition: --8<---------------cut here---------------start------------->8--- (define-public guile-2.2-awesome (package (inherit guile-2.2) (name "guile-awesome") (source (origin (inherit (package-source guile-2.2)) (patches (list "/home/rwurmus/0001-Remove-weak-tables-and-revert-to-weak-hash-tables.patch" "/home/rwurmus/0002-Keep-weak-hash-table-item-count-consistent.patch")))) (arguments (substitute-keyword-arguments (package-arguments guile-2.2) ((#:phases phases) `(modify-phases ,phases (add-before 'pre-configure 'bootstrap (lambda _ (zero? (system* "autoreconf" "-vif")))))))) (native-inputs `(("autoconf" ,autoconf) ("automake" ,automake) ("libtool" ,libtool) ("flex" ,flex) ("texinfo" ,texinfo) ("gettext" ,gettext-minimal) ,@(package-native-inputs guile-2.2))))) --8<---------------cut here---------------end--------------->8--- Unfortunately, I cannot bootstrap Guile on this 1.5 TB RAM server: --8<---------------cut here---------------start------------->8--- … BOOTSTRAP GUILEC system/vm/program.go BOOTSTRAP GUILEC system/vm/vm.go BOOTSTRAP GUILEC system/foreign.go GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS /gnu/store/kpxi8h3669afr9r1bgvaf9ij3y4wdyyn-bash-minimal-4.4.12/bin/bash: line 6: 30796 Aborted GUILE_AUTO_COMPILE=0 ../meta/build-env guild compile --target="x86_64-unknown-linux-gnu" -O1 -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/module" -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/guile-readline" -o "language/scheme/compile-tree-il.go" "../module/language/scheme/compile-tree-il.scm" make[2]: *** [Makefile:1928: language/scheme/compile-tree-il.go] Error 134 make[2]: *** Waiting for unfinished jobs.... ^GGC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS /gnu/store/kpxi8h3669afr9r1bgvaf9ij3y4wdyyn-bash-minimal-4.4.12/bin/bash: line 6: 30386 Aborted GUILE_AUTO_COMPILE=0 ../meta/build-env guild compile --target="x86_64-unknown-linux-gnu" -O1 -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/module" -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/guile-readline" -o "language/tree-il/fix-letrec.go" "../module/language/tree-il/fix-letrec.scm" make[2]: *** [Makefile:1928: language/tree-il/fix-letrec.go] Error 134 GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS /gnu/store/kpxi8h3669afr9r1bgvaf9ij3y4wdyyn-bash-minimal-4.4.12/bin/bash: line 6: 30839 Aborted GUILE_AUTO_COMPILE=0 ../meta/build-env guild compile --target="x86_64-unknown-linux-gnu" -O1 -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/module" -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/guile-readline" -o "language/value/spec.go" "../module/language/value/spec.scm" make[2]: *** [Makefile:1928: language/value/spec.go] Error 134 /gnu/store/kpxi8h3669afr9r1bgvaf9ij3y4wdyyn-bash-minimal-4.4.12/bin/bash: line 6: 30917 Aborted GUILE_AUTO_COMPILE=0 ../meta/build-env guild compile --target="x86_64-unknown-linux-gnu" -O1 -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/module" -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/guile-readline" -o "system/base/syntax.go" "../module/system/base/syntax.scm" make[2]: *** [Makefile:1928: system/base/syntax.go] Error 134 GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance /gnu/store/kpxi8h3669afr9r1bgvaf9ij3y4wdyyn-bash-minimal-4.4.12/bin/bash: line 6: 30344 Aborted GUILE_AUTO_COMPILE=0 ../meta/build-env guild compile --target="x86_64-unknown-linux-gnu" -O1 -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/module" -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/guile-readline" -o "ice-9/psyntax-pp.go" "../module/ice-9/psyntax-pp.scm" make[2]: *** [Makefile:1928: ice-9/psyntax-pp.go] Error 134 /gnu/store/kpxi8h3669afr9r1bgvaf9ij3y4wdyyn-bash-minimal-4.4.12/bin/bash: line 6: 30354 Aborted GUILE_AUTO_COMPILE=0 ../meta/build-env guild compile --target="x86_64-unknown-linux-gnu" -O1 -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/module" -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/guile-readline" -o "srfi/srfi-1.go" "../module/srfi/srfi-1.scm" make[2]: *** [Makefile:1928: srfi/srfi-1.go] Error 134 Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance /gnu/store/kpxi8h3669afr9r1bgvaf9ij3y4wdyyn-bash-minimal-4.4.12/bin/bash: line 6: 30548 Aborted GUILE_AUTO_COMPILE=0 ../meta/build-env guild compile --target="x86_64-unknown-linux-gnu" -O1 -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/module" -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/guile-readline" -o "language/cps/peel-loops.go" "../module/language/cps/peel-loops.scm" make[2]: *** [Makefile:1928: language/cps/peel-loops.go] Error 134 GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS /gnu/store/kpxi8h3669afr9r1bgvaf9ij3y4wdyyn-bash-minimal-4.4.12/bin/bash: line 6: 31410 Aborted GUILE_AUTO_COMPILE=0 ../meta/build-env guild compile --target="x86_64-unknown-linux-gnu" -O1 -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/module" -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/guile-readline" -o "system/vm/dwarf.go" "../module/system/vm/dwarf.scm" make[2]: *** [Makefile:1928: system/vm/dwarf.go] Error 134 Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance /gnu/store/kpxi8h3669afr9r1bgvaf9ij3y4wdyyn-bash-minimal-4.4.12/bin/bash: line 6: 31415 Aborted GUILE_AUTO_COMPILE=0 ../meta/build-env guild compile --target="x86_64-unknown-linux-gnu" -O1 -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/module" -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/guile-readline" -o "system/vm/elf.go" "../module/system/vm/elf.scm" make[2]: *** [Makefile:1928: system/vm/elf.go] Error 134 Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS /gnu/store/kpxi8h3669afr9r1bgvaf9ij3y4wdyyn-bash-minimal-4.4.12/bin/bash: line 6: 31028 Aborted GUILE_AUTO_COMPILE=0 ../meta/build-env guild compile --target="x86_64-unknown-linux-gnu" -O1 -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/module" -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/guile-readline" -o "ice-9/boot-9.go" "../module/ice-9/boot-9.scm" make[2]: *** [Makefile:1928: ice-9/boot-9.go] Error 134 GC Warning: Repeated allocation of very large block (appr. size 230096896): May lead to memory leak and poor performance Too many heap sections: Increase MAXHINCR or MAX_HEAP_SECTS /gnu/store/kpxi8h3669afr9r1bgvaf9ij3y4wdyyn-bash-minimal-4.4.12/bin/bash: line 6: 30348 Aborted GUILE_AUTO_COMPILE=0 ../meta/build-env guild compile --target="x86_64-unknown-linux-gnu" -O1 -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/module" -L "/tmp/guix-build-guile-awesome-2.2.2.drv-0/guile-2.2.2/guile-readline" -o "language/cps/intset.go" "../module/language/cps/intset.scm" make[2]: *** [Makefile:1928: language/cps/intset.go] Error 134 … --8<---------------cut here---------------end--------------->8--- I will try this on a workstation with fewer cores and less memory later. -- Ricardo GPG: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC https://elephly.net