From mboxrd@z Thu Jan 1 00:00:00 1970 From: Mark H Weaver Subject: Re: [PATCH 4/4] gnu: matplotlib: Add gtk3 backends. Date: Wed, 24 Dec 2014 10:34:24 -0500 Message-ID: <87a92d3vun.fsf@netris.org> References: <878ui8edzl.fsf@gnu.org> <87vblahv6n.fsf@gnu.org> <878uhzkynx.fsf@gnu.org> <87fvc6jked.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:44098) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Y3nxR-0001I7-9a for guix-devel@gnu.org; Wed, 24 Dec 2014 10:34:42 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Y3nxO-0005Dd-3J for guix-devel@gnu.org; Wed, 24 Dec 2014 10:34:41 -0500 In-Reply-To: <87fvc6jked.fsf@gnu.org> ("Ludovic \=\?utf-8\?Q\?Court\=C3\=A8s\=22'\?\= \=\?utf-8\?Q\?s\?\= message of "Tue, 23 Dec 2014 19:22:50 +0100") List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org To: Ludovic =?utf-8?Q?Court=C3=A8s?= Cc: Guix-devel ludo@gnu.org (Ludovic Court=C3=A8s) writes: > Federico Beffa skribis: > >> The build does finish as I've tested it on my machine before >> committing the package. However, for some reason, guix needs very long >> to generate the derivation. On my machine (quad-core Xeon E5520) >> python2-matplotlib takes ca. 31 mins to start building. >> Python2-scipy, which includes python2-matplotlib, takes ca. 80 mins.! > > Eric Bavier skribis: > >> I wonder if this could this be a result of package-with-python2's >> behavior of recursively creating new package objects for each input in a >> package. As Ludovic suggested, this could easily create very large DAGs >> that then need to be processed. >> >> This behavior of package-with-python2 was giving me a nightmare when >> trying to code some improvements to `guix refresh -l`, since there would >> easily become tens or hundreds of logically identical python package >> objects floating through the package dependency DAG. > > Ouch, thanks for putting me on the right track. Basically > =E2=80=98package-with-explicit-python=E2=80=99 was recursing way too much= , leading to > hundreds of unique package objects, and thus defeating memoization of > =E2=80=98package-derivation=E2=80=99. > > Commit 78a2745 fixes that. =E2=80=98guix build python2-matplotlib -n > --no-substitutes=E2=80=99 takes ~5 seconds on my laptop (which is still t= oo much > IMO, but that=E2=80=99s another story.) I=E2=80=99ve thus reinstated num= py, scipy, etc. This seems to have fixed Hydra as well. Previously, it was timing out (after 3 hours) while trying to evaluate jobsets. Hydra is now building the xorg-updates branch. Thanks! Mark