From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED!not-for-mail From: phillip.lord@russet.org.uk (Phillip Lord) Newsgroups: gmane.emacs.devel Subject: Re: msys2 building issue Date: Tue, 10 Apr 2018 13:00:20 +0100 Message-ID: <87d0z7s23v.fsf@russet.org.uk> References: <87a7utgqql.fsf@russet.org.uk> <83zi2rcbqz.fsf@gnu.org> NNTP-Posting-Host: blaine.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: blaine.gmane.org 1523361579 2477 195.159.176.226 (10 Apr 2018 11:59:39 GMT) X-Complaints-To: usenet@blaine.gmane.org NNTP-Posting-Date: Tue, 10 Apr 2018 11:59:39 +0000 (UTC) User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.0.91 (gnu/linux) Cc: emacs-devel@gnu.org To: Eli Zaretskii Original-X-From: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Tue Apr 10 13:59:34 2018 Return-path: Envelope-to: ged-emacs-devel@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by blaine.gmane.org with esmtp (Exim 4.84_2) (envelope-from ) id 1f5rvy-0000Wa-8m for ged-emacs-devel@m.gmane.org; Tue, 10 Apr 2018 13:59:34 +0200 Original-Received: from localhost ([::1]:39532 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1f5ry4-0006vN-37 for ged-emacs-devel@m.gmane.org; Tue, 10 Apr 2018 08:01:44 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:49050) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1f5rx5-0006sG-NB for emacs-devel@gnu.org; Tue, 10 Apr 2018 08:00:46 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1f5rx3-0007QH-Oi for emacs-devel@gnu.org; Tue, 10 Apr 2018 08:00:43 -0400 Original-Received: from cloud103.planethippo.com ([78.129.138.110]:37871) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1f5rwz-0007Jo-1v; Tue, 10 Apr 2018 08:00:37 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=russet.org.uk; s=default; h=Content-Type:MIME-Version:Message-ID:Date: References:In-Reply-To:Subject:Cc:To:From:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=eOHM5KNqegb2oLR4GpWd5sOhTx59d52yn0UipmeCXDc=; b=qDJkTe97UStUSeIw4faYmQLBt e/iGpKU7ysnIB3dPnmVpzfeJuetR2iJO4TgTic2hl6Q0opLTaRPyLoB4rJv9iWMJ0WDltykLqjiOj Ht063KdgHbYeuSwrt6p5HClwTmq/XmXa7LVqQHnmCpMxE6TeeREN/qy0zbU2hox/rbr08Pc8BE1uX 5/X49GnPB4QSXi6rDyxtOda0UnmjG+g92E6SxeNmhqYSw6Bpc7J8IYhEZIsKXl54VXkxskU5Y+CSP hQPtXbgcpzqlbgoE05J25MvTd3+INcoQgVMZ9oRvqPKbNmVlVbkQO8UGpE8KhuRhUzkw6ZRuQjH40 PTCBlDGyA==; Original-Received: from cpc142652-benw12-2-0-cust953.16-2.cable.virginm.net ([82.21.43.186]:57692 helo=russet.org.uk) by cloud103.planethippo.com with esmtpsa (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.89_1) (envelope-from ) id 1f5rwx-001S0S-RS; Tue, 10 Apr 2018 12:00:35 +0000 In-Reply-To: <83zi2rcbqz.fsf@gnu.org> (Eli Zaretskii's message of "Thu, 29 Mar 2018 15:22:28 +0300") X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - cloud103.planethippo.com X-AntiAbuse: Original Domain - gnu.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - russet.org.uk X-Get-Message-Sender-Via: cloud103.planethippo.com: authenticated_id: phillip.lord@russet.org.uk X-Authenticated-Sender: cloud103.planethippo.com: phillip.lord@russet.org.uk X-Source: X-Source-Args: X-Source-Dir: X-detected-operating-system: by eggs.gnu.org: GNU/Linux 3.x [fuzzy] X-Received-From: 78.129.138.110 X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1.21 Precedence: list List-Id: "Emacs development discussions." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: emacs-devel-bounces+ged-emacs-devel=m.gmane.org@gnu.org Original-Sender: "Emacs-devel" Xref: news.gmane.org gmane.emacs.devel:224499 Archived-At: Eli Zaretskii writes: >> From: phillip.lord@russet.org.uk (Phillip Lord) >> Date: Tue, 27 Mar 2018 22:20:34 +0100 >> >> x86_64 >> no-deps zip 17min >> Deps-zip 3min >> installer 25min >> >> i686 >> no deps zip 31min >> deps zip 47min >> installer 61min >> >> So, the installer is really slow to build (probably because of the >> compression I guess). But the second i686 step is really slow, >> especially the building the zips and installer. > > Does this happen only when building both the 64-bit and the 32-bit > zips? What if you build only the 32-bit one -- do you get the same > slow times? > > My next suspect is the way MSYS2 lets you build 32-bit binaries. I > know nothing about that, all I see is that you set 2 environment > variables, but could that cause Bash or Make or some other component > to run out of memory due to a bug or a memory leak? I've tested this out since. And I am having a hard time making head nor tail of it. Building on it's own, the i686 will build fast enough. Building x86_64 sometimes give very inconsistent behaviour between the two builds (with the second slower). I could, of course, build the x86 and i686 separately, but I want to launch the build once and let it finish. I've had occasions when the build time goes up to many hours. >> I don't think this is the Emacs build per se; it looks to me like a >> memory leak; the build process just gets slower and slower. In fact, >> I've had to reduce the parallalism of make or the whole process crashes >> with a resource allocation error. > > Which program reports the error? > >> But Process Manager reports that the VM has memory left. > > What does Task Manager say about memory consumption of the various > programs involved in the build, like Bash, Make, and Python? Do you > see their memory growing to values that are unreasonably large? > > The slow-down could be caused by memory consumption, so it's possible > the actual problem is with memory, not with slow builds. Actually, no Task Manager reports that CPU is 100%, memory is between 50 and 70%. I'm coming to the conclusion that it's an oddity of the VM infrastructure. I think it's going to be hard to test out further, because the slow build makes experiments a bit of a PITA. Never mind, even if it is slow it always seems to build now that I am using only dual threaded build. I guess that is ultimately all I care about. Phil