all messages for Guix-related lists mirrored at yhetil.org
 help / color / mirror / code / Atom feed
From: ludo@gnu.org (Ludovic Courtès)
To: YOANN P <yoann_mac_donald@hotmail.com>
Cc: "guix-devel@gnu.org" <guix-devel@gnu.org>
Subject: Re: Questions regarding offloading ( unprivileged setup , parallel builds )
Date: Mon, 05 Feb 2018 11:55:07 +0100	[thread overview]
Message-ID: <87eflzhfjo.fsf@gnu.org> (raw)
In-Reply-To: <DB6P18901MB00229B170ABE9B6583EFA2A3DBF80@DB6P18901MB0022.EURP189.PROD.OUTLOOK.COM> (YOANN P.'s message of "Sat, 3 Feb 2018 19:51:14 +0000")

Hello,

YOANN P <yoann_mac_donald@hotmail.com> skribis:

> I didn't find any documentation describing a way to use an alternative file for the offload settings instead of the default /etc/guix/machines.scm.
>
>
> Did i missed something ?

No, this is correct.

> Is there other files that are put under /etc ?

/etc/guix also contains things related to substitutes.

> It could be problematic for users who use custom store/state path in unprivileged environnements but want to use the offload isn't it ?

Indeed, though if you’re customizing things anyway, you could run:

  ./configure --prefix=/my/prefix --sysconfdir=/my/etc

> Another question regarding the offload, how are used the machines describe inside  /etc/guix/machines.scm ?
>
> If the installation of a package require to build multiple packages, does the builds are all done on the first machine choose for the build or distribute over all machines describe on /etc/guix/machines.scm ?

When there are several matching machines, ‘guix offload’ currently picks
one at random; if that machine is already under high load, it goes on
and picks another one.  See:

  https://git.savannah.gnu.org/cgit/guix.git/tree/guix/scripts/offload.scm#n442

> The description of "parallel-builds" parameter and the fact than missing dependencies already present on the host who request the offload seem to be transferred through ssh let me think that only one machine at time is used for the offload even if all the machines present inside machines.scm share the same store.

Several machines can be used at the same time, no worries.  :-)

> Not sure about this too, there is no ssh transfert if the dependencies (same packages / store path ) are already on the offload store isn't it ?

Right, only missing items are transferred.

> Implementing something similar to the project "guix-relocate" from Pjotr inside the core project to be able to use native Guix packages with custom path when we install them would be a real huge improvement to prevent the use of proot/namespace/offloading :)

I think offloading serves a completely different purpose: it’s a way to
distribute builds to several machines.

But yeah, we discussed relocation at FOSDEM again and it’s a useful
thing in its own right, even though there are limitations.  :-)

Ludo’.

  reply	other threads:[~2018-02-05 10:55 UTC|newest]

Thread overview: 5+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2018-02-03 19:51 Questions regarding offloading ( unprivileged setup , parallel builds ) YOANN P
2018-02-05 10:55 ` Ludovic Courtès [this message]
2018-02-05 16:13   ` YOANN P
2018-02-05 17:39     ` Pjotr Prins
2018-02-09 13:33     ` Ludovic Courtès

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=87eflzhfjo.fsf@gnu.org \
    --to=ludo@gnu.org \
    --cc=guix-devel@gnu.org \
    --cc=yoann_mac_donald@hotmail.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
Code repositories for project(s) associated with this external index

	https://git.savannah.gnu.org/cgit/guix.git

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.