From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ricardo Wurmus Subject: Re: How/When will guix pull stop to compile the 616 files? Date: Wed, 09 Aug 2017 10:08:29 +0200 Message-ID: <87d185noxu.fsf@elephly.net> References: <8760dy8pm8.fsf@gmail.com> <87fud1olks.fsf@elephly.net> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 8bit Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:38448) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dfM2j-0000dS-Eo for help-guix@gnu.org; Wed, 09 Aug 2017 04:08:42 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dfM2e-00042b-FV for help-guix@gnu.org; Wed, 09 Aug 2017 04:08:41 -0400 Received: from sender-of-o51.zoho.com ([135.84.80.216]:21049) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1dfM2e-00042E-6w for help-guix@gnu.org; Wed, 09 Aug 2017 04:08:36 -0400 In-reply-to: List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: help-guix-bounces+gcggh-help-guix=m.gmane.org@gnu.org Sender: "Help-Guix" To: Jack Hill Cc: help-guix@gnu.org Jack Hill writes: > On Tue, 8 Aug 2017, Ricardo Wurmus wrote: > >> >> Paul Dufresne writes: >> >>> It takes 45 mins. on my relatively old dual core to guix-pull >> >> Yeah, this isn’t great. Since 0.13.0 compilation is slower and requires >> a whole lot more memory. That’s a known problem. >> >> There are some ideas to reduce the amount of compilation that has to >> happen locally, but it isn’t quite as simple as a first look may >> suggest. > > Could building be avoided entirely with substitutes? Are substitutes not > appropriate for some reason, or is it just that substitutes are not > produced on Hydra for every guix commit? Before a substitute can be requested, Guix will have to compute a derivation locally. In the case of Guix itself this is rather expensive. Once we have the derivation we can ask substitute servers if they have a binary substitute for performing the work the derivation describes. So, local *computation* cannot be avoided, but local building should be avoidable for most packages — here the problem is that hydra isn’t fast enough yet. I’ve been preparing an alternative build farm at the institute where I work, which will hopefully soon be powerful enough to build packages more quickly than our current Hydra does. -- Ricardo GPG: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC https://elephly.net