Binary downloads

Binary downloads

[Pjotr Prins]

Hi,

I installed Guix successfully from the git repo. When I want to
install something everything gets build from scratch, say

  guix package -i hello

How do I get binary downloads to work? Or is my base system already
different from what is on the farm?

Pj.

looking for the latest release of GNU hello...

The following package will be installed:
   hello-2.9    out     /nix/store/jgvkvznlsvwax0hc29f5br508ivphks1-hello-2.9

The following derivations will be built:
   /nix/store/f1dlq9z2pia4sd0yvjz27czbfdw21ki5-profile.drv
   /nix/store/w4idg62vraipjpcrfwsz7ygiv3yaq50j-libsigsegv-2.10.drv
   /nix/store/38kviyysrxkl742r832jvz4qc4h6hra5-expat-2.1.0.drv
   /nix/store/f1d7r9x9fx112190i34i5h3fc2nnd17g-gettext-0.18.3.1.drv
   /nix/store/i9pp243f77jbapycgr14c69v5gjb62bm-attr-2.4.46.drv
   /nix/store/b9fmyar4lq6lgm1a7b2v6x5jzck4n0d1-m4-1.4.17.drv
   /nix/store/b8hywvmn90gzy1i8ljxkn3k5lhixmdql-perl-5.16.1.drv
   /nix/store/rcivqm0lqc8y9rhyz0qkgpa1sxs3isfg-gmp-5.1.3.drv
   /nix/store/rv3npfhgmv4czcagq5yxh9vsin1kiz8m-acl-2.2.51.drv
   /nix/store/1cgp0gca2sxfar9gs5g9cc5v87gf6swn-diffutils-3.3.drv
   /nix/store/1xvmhn9pdkzpl626gm98927x2xasrw51-coreutils-8.21.drv
   (...)

Re: Binary downloads

[Pjotr Prins]

Ah, that makes sense... It is using /nix/store now.

> If you are using the git version, Ludo has made some changes to the
> hydra server which serves the binary package downloads.  Due to these
> you have to configure guix with `--with-store-dir=/gnu/store` to be able
> to get the binaries.

Re: Binary downloads

[Sree Harsha Totakura]

On 03/07/2014 02:47 PM, Pjotr Prins wrote:
> How do I get binary downloads to work? Or is my base system already
> different from what is on the farm?

Which version have you installed?  If it is the 0.5 one, then I guess
you should be able to get them.

If you are using the git version, Ludo has made some changes to the
hydra server which serves the binary package downloads.  Due to these
you have to configure guix with `--with-store-dir=/gnu/store` to be able
to get the binaries.

Sree

Re: Binary downloads

[Pjotr Prins]

Hmmm. Running the git repo with store set to /gnu/nix does not make a
difference. Guix still wants to build everything. I also kind of miss a step
by step description.

guix package --install=hello --dry-run
accepted connection from pid 14415, uid 502
The following package would be installed:     
   hello-2.9    out     /gnu/store/5kgsss1jjlck8pmzvk29agayzdwhk5ch-hello-2.9

The following derivations would be built:
   /gnu/store/1b29qisj2j9843qa58h0nsgrrn2id8cq-profile.drv
   /gnu/store/hvczfn93s94agdjy1qsjkz7mni2s7l16-m4-1.4.17.drv
   /gnu/store/5kihr38nk51lk34r9hkmj7llv1qza91h-expat-2.1.0.drv
   /gnu/store/9gg6r6lshbss31p93znf7rfrnyy6f4i9-gettext-0.18.3.1.drv
   /gnu/store/n0z9f429ib7s4aq6237kdax0jjdxvywj-attr-2.4.46.drv
   /gnu/store/ialb42c5gi90ldyp92d5xsf0bbk6vwbh-acl-2.2.51.drv
   /gnu/store/jdpr06jvd4qxrvr3f2rscjvlj42qs59f-perl-5.16.1.drv
   /gnu/store/qswjnl69lcnhmq5rp8qjnwag2ab5sva8-gmp-5.1.3.drv
   /gnu/store/29mh4zdpcijh79fp355d3lrznjabdcz5-module-import-compiled.drv
   /gnu/store/c1mg1n9fl8kziv2sq301l25s96vl9ql0-module-import.drv
   /gnu/store/47pw4x3c6rraq1qi75yskrz5rhm4j12p-libsigsegv-2.10.drv


On Fri, Mar 07, 2014 at 02:47:59PM +0100, Pjotr Prins wrote:
> Hi,
> 
> I installed Guix successfully from the git repo. When I want to
> install something everything gets build from scratch, say
> 
>   guix package -i hello
> 
> How do I get binary downloads to work? Or is my base system already
> different from what is on the farm?
> 
> Pj.
> 
> looking for the latest release of GNU hello...
> 
> The following package will be installed:
>    hello-2.9    out     /nix/store/jgvkvznlsvwax0hc29f5br508ivphks1-hello-2.9
> 
> The following derivations will be built:
>    /nix/store/f1dlq9z2pia4sd0yvjz27czbfdw21ki5-profile.drv
>    /nix/store/w4idg62vraipjpcrfwsz7ygiv3yaq50j-libsigsegv-2.10.drv
>    /nix/store/38kviyysrxkl742r832jvz4qc4h6hra5-expat-2.1.0.drv
>    /nix/store/f1d7r9x9fx112190i34i5h3fc2nnd17g-gettext-0.18.3.1.drv
>    /nix/store/i9pp243f77jbapycgr14c69v5gjb62bm-attr-2.4.46.drv
>    /nix/store/b9fmyar4lq6lgm1a7b2v6x5jzck4n0d1-m4-1.4.17.drv
>    /nix/store/b8hywvmn90gzy1i8ljxkn3k5lhixmdql-perl-5.16.1.drv
>    /nix/store/rcivqm0lqc8y9rhyz0qkgpa1sxs3isfg-gmp-5.1.3.drv
>    /nix/store/rv3npfhgmv4czcagq5yxh9vsin1kiz8m-acl-2.2.51.drv
>    /nix/store/1cgp0gca2sxfar9gs5g9cc5v87gf6swn-diffutils-3.3.drv
>    /nix/store/1xvmhn9pdkzpl626gm98927x2xasrw51-coreutils-8.21.drv
>    (...)
> 
> 

Re: Binary downloads

[Andreas Enge]

On Fri, Mar 07, 2014 at 02:47:59PM +0100, Pjotr Prins wrote:
> How do I get binary downloads to work? Or is my base system already
> different from what is on the farm?

I think the machine serving them (hydra.gnu.org) is offline right now.
It should be back some time in the future...

Andreas

Re: Binary downloads

[Pjotr Prins]

Never a bed of roses... 

OK then. I'll build on a server instead. Is there a howto on creating your
own 'remote' package cache? And does Guix hashing ignore kernel
versions? The server has

  Linux version 2.6.32-431.3.1.el6.x86_64
  (mockbuild@c6b10.bsys.dev.centos.org) (gcc version 4.4.7 20120313
  (Red Hat 4.4.7-4) (GCC) ) #1 SMP Fri Jan 3 21:39:27 UTC 2014

my laptop has

  Linux version 3.2.0-4-amd64 (debian-kernel@lists.debian.org) (gcc
  version 4.6.3 (Debian 4.6.3-14) ) #1 SMP Debian 3.2.46-1

Be great if I could share binaries.

Pj.

On Fri, Mar 07, 2014 at 04:21:32PM +0100, Andreas Enge wrote:
> On Fri, Mar 07, 2014 at 02:47:59PM +0100, Pjotr Prins wrote:
> > How do I get binary downloads to work? Or is my base system already
> > different from what is on the farm?
> 
> I think the machine serving them (hydra.gnu.org) is offline right now.
> It should be back some time in the future...
> 
> Andreas
> 

Re: Binary downloads

[Pjotr Prins]

In fact, if I set verbosity I get 

guix package --install=hello --dry-run --verbosity=9
accepted connection from pid 15646, uid 502
acquiring global GC lock `/usr/local/var/nix/gc.lock'
acquiring read lock on `/usr/local/var/nix/temproots/15648'
acquiring write lock on `/usr/local/var/nix/temproots/15648'
downgrading to read lock on `/usr/local/var/nix/temproots/15648'
acquiring write lock on `/usr/local/var/nix/temproots/15648'
downgrading to read lock on `/usr/local/var/nix/temproots/15648'

without --dry-run I get

   |   building of `/gnu/store/hcv3nm0dbpwgsaia77vnr6a2nab3vx6z-gcc-4.8.2.tar.bz2.drv': init
|   |   substitution of `/gnu/store/hcv3nm0dbpwgsaia77vnr6a2nab3vx6z-gcc-4.8.2.tar.bz2.drv': created
|   |   substitution of `/gnu/store/hcv3nm0dbpwgsaia77vnr6a2nab3vx6z-gcc-4.8.2.tar.bz2.drv': woken up

Where does it say that the cache server is not responding? I would not
mind seeing that explicitely.

Pj.

On Fri, Mar 07, 2014 at 05:21:54PM +0100, Pjotr Prins wrote:
> Never a bed of roses... 
> 
> OK then. I'll build on a server instead. Is there a howto on creating your
> own 'remote' package cache? And does Guix hashing ignore kernel
> versions? The server has
> 
>   Linux version 2.6.32-431.3.1.el6.x86_64
>   (mockbuild@c6b10.bsys.dev.centos.org) (gcc version 4.4.7 20120313
>   (Red Hat 4.4.7-4) (GCC) ) #1 SMP Fri Jan 3 21:39:27 UTC 2014
> 
> my laptop has
> 
>   Linux version 3.2.0-4-amd64 (debian-kernel@lists.debian.org) (gcc
>   version 4.6.3 (Debian 4.6.3-14) ) #1 SMP Debian 3.2.46-1
> 
> Be great if I could share binaries.
> 
> Pj.
> 
> On Fri, Mar 07, 2014 at 04:21:32PM +0100, Andreas Enge wrote:
> > On Fri, Mar 07, 2014 at 02:47:59PM +0100, Pjotr Prins wrote:
> > > How do I get binary downloads to work? Or is my base system already
> > > different from what is on the farm?
> > 
> > I think the machine serving them (hydra.gnu.org) is offline right now.
> > It should be back some time in the future...
> > 
> > Andreas
> > 
> 

Re: Binary downloads

[Andreas Enge]

On Fri, Mar 07, 2014 at 05:21:54PM +0100, Pjotr Prins wrote:
> OK then. I'll build on a server instead. Is there a howto on creating your
> own 'remote' package cache? And does Guix hashing ignore kernel
> versions? The server has

There is no need to install a separate server. If you wish to install a
package on your laptop, "guix package -i package-name" will download the
sources of all prerequisites and compile them for your (assuming that you
installed guix and its daemon as explained in the manual).

Andreas

Re: Binary downloads

[Pjotr Prins]

On Fri, Mar 07, 2014 at 05:43:29PM +0100, Andreas Enge wrote:
> On Fri, Mar 07, 2014 at 05:21:54PM +0100, Pjotr Prins wrote:
> > OK then. I'll build on a server instead. Is there a howto on creating your
> > own 'remote' package cache? And does Guix hashing ignore kernel
> > versions? The server has
> 
> There is no need to install a separate server. If you wish to install a
> package on your laptop, "guix package -i package-name" will download the
> sources of all prerequisites and compile them for your (assuming that you
> installed guix and its daemon as explained in the manual).

Sorry, I was not clear. I do not want to build on my laptop (the noise
drives me nuts :). So I want to build on a remote server and install
on my laptop, or on compute nodes, or whatever. With Nix it is
possible. Does Guix allow caching of packages, so I can share. Of
course it does, question is how :). Do I revert to Nix?

Pj.

Re: Binary downloads

[Sree Harsha Totakura]

On 03/07/2014 05:46 PM, Pjotr Prins wrote:
> Sorry, I was not clear. I do not want to build on my laptop (the noise
> drives me nuts :). So I want to build on a remote server and install
> on my laptop, or on compute nodes, or whatever. With Nix it is
> possible. Does Guix allow caching of packages, so I can share. Of
> course it does, question is how :). Do I revert to Nix?

FWIK, you have to run the same hydra from Nix on the server.  Then
you'll have to change the hydra.gnu.org server to your server in the
Guix code somewhere.

Sree

Re: Binary downloads

[Ludovic Courtès]

Pjotr Prins <pjotr.public12@thebird.nl> skribis:

> On Fri, Mar 07, 2014 at 05:43:29PM +0100, Andreas Enge wrote:
>> On Fri, Mar 07, 2014 at 05:21:54PM +0100, Pjotr Prins wrote:
>> > OK then. I'll build on a server instead. Is there a howto on creating your
>> > own 'remote' package cache? And does Guix hashing ignore kernel
>> > versions? The server has
>> 
>> There is no need to install a separate server. If you wish to install a
>> package on your laptop, "guix package -i package-name" will download the
>> sources of all prerequisites and compile them for your (assuming that you
>> installed guix and its daemon as explained in the manual).
>
> Sorry, I was not clear. I do not want to build on my laptop (the noise
> drives me nuts :). So I want to build on a remote server and install
> on my laptop, or on compute nodes, or whatever. With Nix it is
> possible. Does Guix allow caching of packages, so I can share.

Guix can use “substitutes” (binaries) from Hydra, just like Nix does.

Alternately (but I’m not sure that’s what you’re asking for), it has
support to offload builds to remote machines over SSH (info "(guix)
Daemon Offload Setup").

There’s currently nothing like ‘nix-push’, though.

Does it answer your question?

Thanks,
Ludo’.

Re: Binary downloads

[Pjotr Prins]

On Fri, Mar 07, 2014 at 06:48:54PM +0100, Ludovic Courtès wrote:
> Guix can use ???substitutes??? (binaries) from Hydra, just like Nix does.
> 
> Alternately (but I???m not sure that???s what you???re asking for), it has
> support to offload builds to remote machines over SSH (info "(guix)
> Daemon Offload Setup").
> 
> There???s currently nothing like ???nix-push???, though.
> 
> Does it answer your question?

Yup, thanks!

Pj.