Hi,

Thanks you for yours answers :-)

> Indeed, though if you=92re customizing things anyway, you could r= un:

> ./configure --prefix=3D/my/prefix --sysconfdir=3D/my/= etc

Thanks, I missed that part sorry

> Several machines can be used at the same time, no worries. = :-)

It is really nice if each dependencies could be build among diff= erent machines at the same time :-)

Anothers questions regarding the way the offload work:

- does the machines.scm is read at the start of the daemon or read eac= h time the hook is called ? (just to be sure because the sources let me thi= nk it is read each time and is what i want)

- if a machine disappear during a build, does that build is retry on a= nother machine ? is there a retry parameter ?

- Is there any project to had a parametrable post/pre offload-hook ? (= Could be used to start preemptive cloud instances before a build = and fill the "machines.scm" and shutdown instances at the end)

- No problem to use multiple daemon with the same store ? (I'm not sur= e of it because I never seen this kind of implementation on web, could be v= ery useful if it not yet possible)

We could imagine a S3 storage for the store / state directories and wh= en we need compute resources to build packages, only start preemptible inst= ances who mount the same store through S3QL.

This way we only pay the storage for state / store directories

Best regards,

Yoann

--_000_DB6P18901MB00221A60916A2DCFBA85D80EDBFE0DB6P18901MB0022_-- From mboxrd@z Thu Jan 1 00:00:00 1970 From: Pjotr Prins Subject: Re: Questions regarding offloading ( unprivileged setup , parallel builds ) Date: Mon, 5 Feb 2018 18:39:53 +0100 Message-ID: <20180205173953.GA12638@thebird.nl> References: <87eflzhfjo.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=us-ascii Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:43457) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1eiknk-0006tr-7k for guix-devel@gnu.org; Mon, 05 Feb 2018 12:43:33 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1eikng-00089L-JT for guix-devel@gnu.org; Mon, 05 Feb 2018 12:43:32 -0500 Received: from mail.thebird.nl ([95.154.246.10]:45802) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1eikng-00087W-BQ for guix-devel@gnu.org; Mon, 05 Feb 2018 12:43:28 -0500 Content-Disposition: inline In-Reply-To: List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: "Guix-devel" To: YOANN P Cc: "guix-devel@gnu.org" On Mon, Feb 05, 2018 at 04:13:31PM +0000, YOANN P wrote: > We could imagine a S3 storage for the store / state directories and > when we need compute resources to build packages, only start > preemptible instances who mount the same store through S3QL. > This way we only pay the storage for state / store directories > Best regards, > Yoann Are you on HPC? - we have a HPC working group, please join. One thing we discussed is content addressable binaries - that way we can fetch them from anywhere, even without signing! Pj. -- From mboxrd@z Thu Jan 1 00:00:00 1970 From: ludo@gnu.org (Ludovic =?utf-8?Q?Court=C3=A8s?=) Subject: Re: Questions regarding offloading ( unprivileged setup , parallel builds ) Date: Fri, 09 Feb 2018 14:33:18 +0100 Message-ID: <87r2pu1e5d.fsf@gnu.org> References: <87eflzhfjo.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:43496) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1ek8nt-0006zE-En for guix-devel@gnu.org; Fri, 09 Feb 2018 08:33:29 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1ek8np-0007aR-4x for guix-devel@gnu.org; Fri, 09 Feb 2018 08:33:24 -0500 Received: from hera.aquilenet.fr ([2a0c:e300::1]:55368) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1ek8no-0007Y2-Tf for guix-devel@gnu.org; Fri, 09 Feb 2018 08:33:21 -0500 In-Reply-To: (YOANN P.'s message of "Mon, 5 Feb 2018 16:13:31 +0000") List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane.org@gnu.org Sender: "Guix-devel" To: YOANN P Cc: "guix-devel@gnu.org" Hi, YOANN P skribis: > Anothers questions regarding the way the offload work: > > - does the machines.scm is read at the start of the daemon or read > each time the hook is called ? (just to be sure because the sources > let me think it is read each time and is what i want) It=E2=80=99s reach each time the hook is called. You can add a =E2=80=98di= splay=E2=80=99 call in there if you want to see. > - if a machine disappear during a build, does that build is retry on > another machine ? is there a retry parameter ? No. In that case, I think the daemon returns a transient error in this case, and the build can be restarted eventually, but we don=E2=80=99t do th= at automatically currently. > - Is there any project to had a parametrable post/pre offload-hook ? > (Could be used to start preemptive cloud instances before a build and > fill the "machines.scm" and shutdown instances at the end) Currently no, though I guess you could do some of that in machines.scm. More specifically you could have a =E2=80=9Cmachine server=E2=80=9D that do= es all the heavy lifting, and have machines.scm simply make an RPC to that server along the lines of =E2=80=9Cgimme a bunch of machines plz.=E2=80=9D > - No problem to use multiple daemon with the same store ? (I'm not > sure of it because I never seen this kind of implementation on web, > could be very useful if it not yet possible) It kinda works but it=E2=80=99s not recommended. HTH, Ludo=E2=80=99.