Guix on aarch64

Guix on aarch64

[Benjamin Slade]

I'm trying to install the Guix (standalone) package manager on top of
Void Linux (musl libc) on a raspberrypi3 using the aarch64 architecture,
but when (from the processed described here:
https://www.gnu.org/software/guix/manual/en/guix.html#Installation ), I
get to the bit:

`# ~root/.guix-profile/bin/guix-daemon --build-users-group=guixbuild`

It just seems to hang. When I look at the process, it doesn't seem to be
using cpu resources anything. I tried leaving it for a couple of hours,
but it never seems to do anything.

Any suggestions?

thanks,
   —Ben
-- 
Benjamin Slade - https://babbagefiles.xyz
  `(pgp_fp: ,(21BA 2AE1 28F6 DF36 110A 0E9C A320 BBE8 2B52 EE19))
    '(sent by mu4e on Emacs running under GNU/Linux . https://gnu.org )
       `(Choose Linux ,(Choose Freedom) . https://linux.com )

Re: Guix on aarch64

[Clément Lassieur]

Hi Benjamin,

Benjamin Slade <beoram@gmail.com> writes:

> I'm trying to install the Guix (standalone) package manager on top of
> Void Linux (musl libc) on a raspberrypi3 using the aarch64 architecture,
> but when (from the processed described here:
> https://www.gnu.org/software/guix/manual/en/guix.html#Installation ), I
> get to the bit:
>
> `# ~root/.guix-profile/bin/guix-daemon --build-users-group=guixbuild`
>
> It just seems to hang. When I look at the process, it doesn't seem to be
> using cpu resources anything. I tried leaving it for a couple of hours,
> but it never seems to do anything.

It is its normal behaviour, because it's a long-running process; it
should be always running and the Guix command talks to it.  People
usually use an init manager to start it automatically (systemd, the
Shepherd...).  You can also add '&' at the end of the command so that it
goes in the background.

Clément

Re: Guix on aarch64

[Benjamin Slade]

Thanks, Clément. For some reason the `--build-users-group=guixbuild`
make me think it was supposed to build something. In retrospect, it's
obvious that it's just a groupname.

So far it seems to be working. I'll have to see if I can get runit to
start the guixdaemon automatically.

 > > `# ~root/.guix-profile/bin/guix-daemon --build-users-group=guixbuild`
 > >
 > > It just seems to hang. When I look at the process, it doesn't seem to be
 > > using cpu resources anything. I tried leaving it for a couple of hours,
 > > but it never seems to do anything.

 > It is its normal behaviour, because it's a long-running process; it
 > should be always running and the Guix command talks to it.  People
 > usually use an init manager to start it automatically (systemd, the
 > Shepherd...).  You can also add '&' at the end of the command so that it
 > goes in the background.

 > Clément

thanks again,
  —Ben

-- 
Benjamin Slade - https://babbagefiles.xyz
  `(pgp_fp: ,(21BA 2AE1 28F6 DF36 110A 0E9C A320 BBE8 2B52 EE19))
    '(sent by mu4e on Emacs running under GNU/Linux . https://gnu.org )
       `(Choose Linux ,(Choose Freedom) . https://linux.com )

Re: Guix on aarch64

[Benjamin Slade]

Though, unfortunately, when I try `guix package -i hello` (or any other
package), I get the following error:

````
............
/gnu/store/qzdabl7b02cp4xsfkz4znxpy482gsgh8-bootstrap-binaries-0/bin/tar: /gnu/store/4ka60wq7j51ywy7pmpwy7fqqnzk12ay6-binutils-2.30.tar.xz: Wrote only 4096 of 10240 bytes
/gnu/store/qzdabl7b02cp4xsfkz4znxpy482gsgh8-bootstrap-binaries-0/bin/tar: Child died with signal 9
/gnu/store/qzdabl7b02cp4xsfkz4znxpy482gsgh8-bootstrap-binaries-0/bin/tar: Error is not recoverable: exiting now
source is under 'binutils-2.30'
applying '/gnu/store/r7imyzhcnqbyzrbxygg60iwqp1jmwgrq-binutils-loongson-workaround.patch'...
Backtrace:
In ice-9/boot-9.scm:
 160: 9 [catch #t #<catch-closure 9d13c0> ...]
In unknown file:
   ?: 8 [apply-smob/1 #<catch-closure 9d13c0>]
In ice-9/boot-9.scm:
  66: 7 [call-with-prompt prompt0 ...]
In ice-9/eval.scm:
 432: 6 [eval # #]
In ice-9/boot-9.scm:
2412: 5 [save-module-excursion #<procedure a40780 at ice-9/boot-9.scm:4084:3 ()>]
4089: 4 [#<procedure a40780 at ice-9/boot-9.scm:4084:3 ()>]
1734: 3 [%start-stack load-stack #<procedure a52560 at ice-9/boot-9.scm:4080:10 ()>]
1739: 2 [#<procedure a54d20 ()>]
In unknown file:
   ?: 1 [primitive-load "/gnu/store/976r9wpcnsi9lhsg2yr8hdzkqnilyq9n-binutils-2.30.tar.xz-builder"]
In ./guix/build/utils.scm:
 616: 0 [invoke "/gnu/store/qzdabl7b02cp4xsfkz4znxpy482gsgh8-bootstrap-binaries-0/bin/tar" ...]

./guix/build/utils.scm:616:6: In procedure invoke:
./guix/build/utils.scm:616:6: Throw to key `srfi-34' with args `(#<condition &invoke-error [program: "/gnu/store/qzdabl7b02cp4xsfkz4znxpy482gsgh8-bootstrap-binaries-0/bin/tar" arguments: ("cvf" "/gnu/store/4ka60wq7j51ywy7pmpwy7fqqnzk12ay6-binutils-2.30.tar.xz" "--use-compress-program=/gnu/store/qzdabl7b02cp4xsfkz4znxpy482gsgh8-bootstrap-binaries-0/bin/xz --threads=0" "--mtime=@0" "--owner=root:0" "--group=root:0" "--sort=name" "binutils-2.30") exit-status: 2 term-signal: #f stop-signal: #f] d7ff00>)'.
builder for `/gnu/store/8bkfchbibkfflp72vvdf39hdbv362vm7-binutils-2.30.tar.xz.drv' failed with exit code 1
cannot build derivation `/gnu/store/6mbhl1b7kdmysilwsxk59vkws2ca9ajh-binutils-2.30.drv': 1 dependencies couldn't be built
cannot build derivation `/gnu/store/20q3yb3yri1g7nqng06j9kwc07ypxh1g-binutils-cross-boot0-2.30.drv': 1 dependencies couldn't be built
cannot build derivation `/gnu/store/sghh265k30fn0cj24rxc9p6xvn6yv3qs-perl-5.26.1.drv': 1 dependencies couldn't be built
guix package: error: build failed: build of `/gnu/store/sghh265k30fn0cj24rxc9p6xvn6yv3qs-perl-5.26.1.drv' failed
````

 —Ben

-- 
Benjamin Slade - https://babbagefiles.xyz
  `(pgp_fp: ,(21BA 2AE1 28F6 DF36 110A 0E9C A320 BBE8 2B52 EE19))
    '(sent by mu4e on Emacs running under GNU/Linux . https://gnu.org )
       `(Choose Linux ,(Choose Freedom) . https://linux.com )

Re: Guix on aarch64

[Mark H Weaver]

Hi Benjamin,

Benjamin Slade <beoram@gmail.com> writes:

> Though, unfortunately, when I try `guix package -i hello` (or any other
> package), I get the following error:
>
> ````
> ............
> /gnu/store/qzdabl7b02cp4xsfkz4znxpy482gsgh8-bootstrap-binaries-0/bin/tar: /gnu/store/4ka60wq7j51ywy7pmpwy7fqqnzk12ay6-binutils-2.30.tar.xz: Wrote only 4096 of 10240 bytes
> /gnu/store/qzdabl7b02cp4xsfkz4znxpy482gsgh8-bootstrap-binaries-0/bin/tar: Child died with signal 9
> /gnu/store/qzdabl7b02cp4xsfkz4znxpy482gsgh8-bootstrap-binaries-0/bin/tar: Error is not recoverable: exiting now
[...]
> ./guix/build/utils.scm:616:6: In procedure invoke:
> ./guix/build/utils.scm:616:6: Throw to key `srfi-34' with args `(#<condition &invoke-error [program: "/gnu/store/qzdabl7b02cp4xsfkz4znxpy482gsgh8-bootstrap-binaries-0/bin/tar" arguments: ("cvf" "/gnu/store/4ka60wq7j51ywy7pmpwy7fqqnzk12ay6-binutils-2.30.tar.xz" "--use-compress-program=/gnu/store/qzdabl7b02cp4xsfkz4znxpy482gsgh8-bootstrap-binaries-0/bin/xz --threads=0" "--mtime=@0" "--owner=root:0" "--group=root:0" "--sort=name" "binutils-2.30") exit-status: 2 term-signal: #f stop-signal: #f] d7ff00>)'.
> builder for `/gnu/store/8bkfchbibkfflp72vvdf39hdbv362vm7-binutils-2.30.tar.xz.drv' failed with exit code 1

I looked in the GNU tar source code to see what could produce that
message during archive creation.  The message would seem to indicate
that an error occurred during a kernel-level 'write' call to the archive
file.  The code is written to retry in case of short writes or EINTR.

What kind of filesystems are running on /tmp and /gnu?  How much free
space is on those filesystems?

       Mark

Re: Guix on aarch64

[Benjamin Slade]

On 2018-08-20T11:51:20-0600, Mark H Weaver <mhw@netris.org> wrote:
 > I looked in the GNU tar source code to see what could produce that
 > message during archive creation.  The message would seem to indicate
 > that an error occurred during a kernel-level 'write' call to the archive
 > file.  The code is written to retry in case of short writes or EINTR.

 > What kind of filesystems are running on /tmp and /gnu?  How much free
 > space is on those filesystems?

/tmp is a tmpfs filesystem on ext4, and /gnu is on ext4. there was over
20Gb of free space.

I seemed to need to:

1) create a very large /tmp
2) create an even 2nd larger swapfile
3) increase swappiness to 100 (to make sure it actually used the
swapfile(s) before deciding it was out of memory)

Because one of the things it wanted to do (for tar?) was create a ">8Gb
sparse file", and this would fail with an "out of memory error" with the
a second 8Gb swapfile on top of my original 3Gb swapfile.

(Unfortunately, even after I fixed that, it chugged away for over
24hours, when I just wanted to install `emacs` and `certbot`. In the end
I just ended up using Nix to install these. :( ) 


--
Benjamin Slade - https://babbagefiles.xyz
  `(pgp_fp: ,(21BA 2AE1 28F6 DF36 110A 0E9C A320 BBE8 2B52 EE19))
    '(sent by mu4e on Emacs running under GNU/Linux . https://gnu.org )
       `(Choose Linux ,(Choose Freedom) . https://linux.com )

Re: Guix on aarch64

[Leo Famulari]

[-- Attachment #1: Type: text/plain, Size: 869 bytes --]

On Mon, Aug 20, 2018 at 09:52:24PM -0600, Benjamin Slade wrote:
> Because one of the things it wanted to do (for tar?) was create a ">8Gb
> sparse file", and this would fail with an "out of memory error" with the
> a second 8Gb swapfile on top of my original 3Gb swapfile.
> 
> (Unfortunately, even after I fixed that, it chugged away for over
> 24hours, when I just wanted to install `emacs` and `certbot`. In the end
> I just ended up using Nix to install these. :( ) 

Having to build tar from the bootstrap binaries suggests you didn't get
any pre-built "substitutes", but instead were building every package up
to emacs and certbot from source.

Aarch64 substitutes *should* be available from
<https://berlin.guixsd.org>.

https://www.gnu.org/software/guix/manual/en/html_node/Binary-Installation.html#index-substitutes_002c-authorization-thereof

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: Guix on aarch64

[Benjamin Slade]

On 2018-08-20T22:38:20-0600, Leo Famulari <leo@famulari.name> wrote:

 > Having to build tar from the bootstrap binaries suggests you didn't
 > get any pre-built "substitutes", but instead were building every
 > package up to emacs and certbot from source.  Aarch64 substitutes
 > *should* be available from <https://berlin.guixsd.org>.
 > https://www.gnu.org/software/guix/manual/en/html_node/Binary-Installation.html#index-substitutes_002c-authorization-thereof

I have followed that page in the manual (and just repeated now just in
case) to make sure both hydra.gnu.org.pub (though I think it should be
authorised by default) and hydra.gnu.org.pub are authorised, and it's
still building everything from source as far as I can tell when I try to
do `guix pull`.

 —Ben

--
Benjamin Slade - https://babbagefiles.xyz
  `(pgp_fp: ,(21BA 2AE1 28F6 DF36 110A 0E9C A320 BBE8 2B52 EE19))
    '(sent by mu4e on Emacs running under GNU/Linux . https://gnu.org )
       `(Choose Linux ,(Choose Freedom) . https://linux.com )

Re: Guix on aarch64

[Mark H Weaver]

Benjamin Slade <slade@jnanam.net> writes:

> On 2018-08-20T22:38:20-0600, Leo Famulari <leo@famulari.name> wrote:
>
>  > Having to build tar from the bootstrap binaries suggests you didn't
>  > get any pre-built "substitutes", but instead were building every
>  > package up to emacs and certbot from source.  Aarch64 substitutes
>  > *should* be available from <https://berlin.guixsd.org>.
>  > https://www.gnu.org/software/guix/manual/en/html_node/Binary-Installation.html#index-substitutes_002c-authorization-thereof
>
> I have followed that page in the manual (and just repeated now just in
> case) to make sure both hydra.gnu.org.pub (though I think it should be
> authorised by default) and hydra.gnu.org.pub are authorised,

Did you mean to write "berlin.guixsd.org.pub" above?  That's the key you
would need to authorise to find substitutes for aarch64.

       Mark

Re: Guix on aarch64

[Benjamin Slade]

On 2018-08-21T11:44:44-0600, Mark H Weaver <mhw@netris.org> wrote:

 > Benjamin Slade <slade@jnanam.net> writes:
 > > I have followed that page in the manual (and just repeated now just
 > > in case) to make sure both hydra.gnu.org.pub (though I think it
 > > should be authorised by default) and hydra.gnu.org.pub are
 > > authorised,

 > Did you mean to write "berlin.guixsd.org.pub" above?  That's the key
 > you would need to authorise to find substitutes for aarch64.

Mark, yes, indeed that was what I had meant to write.


--
Benjamin Slade - https://babbagefiles.xyz
  `(pgp_fp: ,(21BA 2AE1 28F6 DF36 110A 0E9C A320 BBE8 2B52 EE19))
    '(sent by mu4e on Emacs running under GNU/Linux . https://gnu.org )
       `(Choose Linux ,(Choose Freedom) . https://linux.com )