Building arm64 guix system image

Building arm64 guix system image

[Max Brieiev]

I want to run Guix on Apple M1 as a Qemu virtual machine.

On the Mac machine I run arm64 dedian image. I installed there guix as a
package manager. Now I am trying to create a guix system image to use
with Qemu, but it fails.

Here is what I do:

    max@debian:~$ guix system image --system=aarch64-linux -t qcow2 ~/code/guix/gnu/system/examples/bare-bones.tmpl 
    guix system: warning: Consider running 'guix pull' followed by
    'guix system reconfigure' to get up-to-date packages and security updates.
    
    substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
    substitute: updating substitutes from 'https://bordeaux.guix.gnu.org'... 100.0%
    The following derivations will be built:
      /gnu/store/dhknasynfsx9ffsv2m188mmhfvz4l1cl-grub-2.06.drv
      /gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv
      /gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv
      /gnu/store/dclmdk80rbqqpix98vh6srhdbgscyiwb-qemu-7.2.0.tar.xz.drv
      /gnu/store/g9crxhl9j2pw35kwgx9bdcjg3jrvi77v-linux-libre-6.1.9.drv
      /gnu/store/blyj3j5v3p2lh6pj7mw81xjg58d1k4zb-shepherd-0.9.3.drv
      /gnu/store/r517qlsjsl877kpjfl9ixay9mzh0n923-grub-efi32-2.06.drv
      /gnu/store/pyv1w00f9c0q291qhi6y0911sqlvfcrv-grub-efi-2.06.drv
      /gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv
      /gnu/store/brzpisxg4dkvad07pd95riwn7c8559j6-genimage-15-1.ec44ae0.drv
    
    1.0 MB will be downloaded
     alsa-utils-1.2.4  987KiB             4.5MiB/s 00:00 [##################] 100.0%
    building /gnu/store/g9crxhl9j2pw35kwgx9bdcjg3jrvi77v-linux-libre-6.1.9.drv...
    building /gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv...
    | 'build' phasebuilder for `/gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv' failed with exit code 1
    build of /gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv failed
    View build log at '/var/log/guix/drvs/2v/bjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv.gz'.
    cannot build derivation `/gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv': 1 dependencies couldn't be built
    guix system: error: build of `/gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv' failed


The relevant part of the build log shows the following errors:

    Building OpenBIOS for ppc
    Building...
    error:
    /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:128:2: error: unknown type name ‘__u32’
      128 |  __u32 size; /* size in bytes of the extra space */
          |  ^~~~~
    /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:129:2: error: unknown type name ‘__u32’
      129 |  __u32 __reserved[3];
          |  ^~~~~
    /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:136:2: error: unknown type name ‘__u16’
      136 |  __u16 vl;
          |  ^~~~~
    /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:137:2: error: unknown type name ‘__u16’
      137 |  __u16 __reserved[3];
          |  ^~~~~
    make[1]: *** [rules.mak:83: host/kernel/bootstrap.o] Error 1
    make[1]: *** Waiting for unfinished jobs....
    make[1]: Leaving directory '/tmp/guix-build-openbios-qemu-ppc-1.1.drv-0/source/obj-ppc'
    make: *** [Makefile:19: build] Error 1
    error: in phase 'build': uncaught exception:
    %exception #<&invoke-error program: "make" arguments: ("-j" "4") exit-status: 2 term-signal: #f stop-signal: #f> 
    phase `build' failed after 0.2 seconds
    command "make" "-j" "4" failed with status 2

I don't know where to look to fix this error. Please, help me.

Also, I thought I could find somewhere arm64 guix build, but apparently
there is none?

I found only a raw image for Pinebook Pro:
https://ci.guix.gnu.org/eval/196495

But for some reason it says it is x86_64 system, and this confuses me.

Thank you in advance.

Re: Building arm64 guix system image

[Akira Kyle]

On Fri, Feb 17, 2023 at 10:29 AM, Max Brieiev 
<max.brieiev@gmail.com> wrote:

> I want to run Guix on Apple M1 as a Qemu virtual machine.

I think I may be one of the few (only?) guix users that has a 
setup like this. IIRC getting grub setup with qemu was the one 
trickier parts of this. Feel free to ping me directly if you're 
having trouble.

> On the Mac machine I run arm64 dedian image. I installed there 
> guix as a
> package manager. Now I am trying to create a guix system image 
> to use
> with Qemu, but it fails.

This is also how I got my guix system on qemu setup. For the 
record, I initially tried fedora but iirc, selinux was causing 
some difficulties.

> ...
> I don't know where to look to fix this error. Please, help me.

This is the relevant issue 
https://issues.guix.gnu.org/60719. Unfortunately until this is 
fixed, guix system won't build since grub-efi depends on 
qemu-minimial which in turn (recently) depends on 
openbios-qemu-ppc. Fortunately this can be worked around, and I 
posted how I'm working around this for now on that issue. Maybe 
this will also work for you.

> Also, I thought I could find somewhere arm64 guix build, but 
> apparently
> there is none?

It's been awhile since I've looked into the current status of 
building guix system installer images for aarch64 but this is the 
issue I have in my notes that was blocking this last time I looked 
into it: https://issues.guix.gnu.org/41120

Re: Building arm64 guix system image

[Max Brieiev]

Hi,

Akira Kyle <akira@akirakyle.com> writes:

> I think I may be one of the few (only?) guix users that has a setup
> like this. IIRC getting grub setup with qemu was the one trickier
> parts of this. Feel free to ping me directly if you're having trouble.

Thanks.

> This is also how I got my guix system on qemu setup. For the record, I
> initially tried fedora but iirc, selinux was causing some
> difficulties.

Was it by any chance a syslinux? It causes build failures for me right
now. How did you work around it?

> This is the relevant issue
> https://issues.guix.gnu.org/60719. Unfortunately until this is fixed,
> guix system won't build since grub-efi depends on qemu-minimial which
> in turn (recently) depends on openbios-qemu-ppc.

I used time-machine to go back to the parent of "Unbundle OpenBIOS"
commit. open-bios-qemu-ppc issue is gone, but now it fails to build
syslinux:

    guix time-machine --commit=53a1fce25a -- system image --system=aarch64-linux -t qcow2 ~/code/guix/gnu/system/examples/bare-bones.tmpl
    ...
    building /gnu/store/gf432a4p1a3ll314g8sina9d4mis37ca-syslinux-6.04-pre-1.bb41e93.drv...
    - 'build' phasebuilder for `/gnu/store/gf432a4p1a3ll314g8sina9d4mis37ca-syslinux-6.04-pre-1.bb41e93.drv' failed with exit code 1
    build of /gnu/store/gf432a4p1a3ll314g8sina9d4mis37ca-syslinux-6.04-pre-1.bb41e93.drv failed
    View build log at '/var/log/guix/drvs/gf/432a4p1a3ll314g8sina9d4mis37ca-syslinux-6.04-pre-1.bb41e93.drv.gz'.
    cannot build derivation `/gnu/store/0smy079q2zsmnq0lvxw7c0amy9va3vv7-ipxe-qemu-1.21.1.drv': 1 dependencies couldn't be built
    building /gnu/store/i7ir5yv7ifw1rh8x20141dx4c8h7wcgd-u-boot-2022.10.tar.xz.drv...
    cannot build derivation `/gnu/store/rz143y972xmgv2gzw830b3ckm93z15l3-qemu-minimal-7.2.0.drv': 1 dependencies couldn't be built
    guix system: error: build of `/gnu/store/rz143y972xmgv2gzw830b3ckm93z15l3-qemu-minimal-7.2.0.drv' failed

How can I proceed from here?

Thank you.

Re: Building arm64 guix system image

[Roman Scherer]

[-- Attachment #1: Type: text/plain, Size: 2273 bytes --]


Hi Max,

I'm running Guix system on an Apple M1 and also run into these
issues. At the moment I'm using the following commit to build my system:

7833acab0da02335941974608510c02e2d1d8069

Roman

Max Brieiev <max.brieiev@gmail.com> writes:

> Hi,
>
> Akira Kyle <akira@akirakyle.com> writes:
>
>> I think I may be one of the few (only?) guix users that has a setup
>> like this. IIRC getting grub setup with qemu was the one trickier
>> parts of this. Feel free to ping me directly if you're having trouble.
>
> Thanks.
>
>> This is also how I got my guix system on qemu setup. For the record, I
>> initially tried fedora but iirc, selinux was causing some
>> difficulties.
>
> Was it by any chance a syslinux? It causes build failures for me right
> now. How did you work around it?
>
>> This is the relevant issue
>> https://issues.guix.gnu.org/60719. Unfortunately until this is fixed,
>> guix system won't build since grub-efi depends on qemu-minimial which
>> in turn (recently) depends on openbios-qemu-ppc.
>
> I used time-machine to go back to the parent of "Unbundle OpenBIOS"
> commit. open-bios-qemu-ppc issue is gone, but now it fails to build
> syslinux:
>
>     guix time-machine --commit=53a1fce25a -- system image --system=aarch64-linux -t qcow2 ~/code/guix/gnu/system/examples/bare-bones.tmpl
>     ...
>     building /gnu/store/gf432a4p1a3ll314g8sina9d4mis37ca-syslinux-6.04-pre-1.bb41e93.drv...
>     - 'build' phasebuilder for `/gnu/store/gf432a4p1a3ll314g8sina9d4mis37ca-syslinux-6.04-pre-1.bb41e93.drv' failed with exit code 1
>     build of /gnu/store/gf432a4p1a3ll314g8sina9d4mis37ca-syslinux-6.04-pre-1.bb41e93.drv failed
>     View build log at '/var/log/guix/drvs/gf/432a4p1a3ll314g8sina9d4mis37ca-syslinux-6.04-pre-1.bb41e93.drv.gz'.
>     cannot build derivation `/gnu/store/0smy079q2zsmnq0lvxw7c0amy9va3vv7-ipxe-qemu-1.21.1.drv': 1 dependencies couldn't be built
>     building /gnu/store/i7ir5yv7ifw1rh8x20141dx4c8h7wcgd-u-boot-2022.10.tar.xz.drv...
>     cannot build derivation `/gnu/store/rz143y972xmgv2gzw830b3ckm93z15l3-qemu-minimal-7.2.0.drv': 1 dependencies couldn't be built
>     guix system: error: build of `/gnu/store/rz143y972xmgv2gzw830b3ckm93z15l3-qemu-minimal-7.2.0.drv' failed
>
> How can I proceed from here?
>
> Thank you.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 528 bytes --]

Error booting aarch64 installation image (was: Building arm64 guix system image)

[Max Brieiev]

Hi Roman,

Roman Scherer <roman.scherer@burningswell.com> writes:

> I'm running Guix system on an Apple M1 and also run into these
> issues. At the moment I'm using the following commit to build my system:
>
> 7833acab0da02335941974608510c02e2d1d8069

Thank you, I managed to build installation image from this commit like
this:

    guix time-machine --commit=7833acab0da02335941974608510c02e2d1d8069 -- system image --system=aarch64-linux -t iso9660 ~/code/guix/gnu/system/install.scm 
    ...
    /gnu/store/rqf53a5xx3dknk689ag620n5617pqpj3-image.iso

But now I have another problem, this image throws an error after
selecting the "GNU Guix installation 1.4.0" entry in Grub:

    error: invalid magic number.
    error: you need to load the kernel first.

I googled a bit about this error and most answers suggest that the image
is corrupted in one way or another.

How can I debug this error?

Re: Error booting aarch64 installation image (was: Building arm64 guix system image)

[Roman Scherer]

[-- Attachment #1: Type: text/plain, Size: 1529 bytes --]


Hi Max,

I think you need to use --image-type=efi-raw for this to work.

To boot from an USB stick, also make sure to use an USB A to C adapter
and put the stick into the USB port on the left side of your computer.

I actually installed my Guix system from another distro. I roughly
followed this guide here:

https://guix.gnu.org/blog/2019/guix-on-an-arm-board/

I'm not sure if I can link to it here, so I will just mention that I
have a Guix channel that contains some of the Asahi Linux packages,
which you might want at some point.

Roman

Max Brieiev <max.brieiev@gmail.com> writes:

> Hi Roman,
>
> Roman Scherer <roman.scherer@burningswell.com> writes:
>
>> I'm running Guix system on an Apple M1 and also run into these
>> issues. At the moment I'm using the following commit to build my system:
>>
>> 7833acab0da02335941974608510c02e2d1d8069
>
> Thank you, I managed to build installation image from this commit like
> this:
>
>     guix time-machine --commit=7833acab0da02335941974608510c02e2d1d8069 -- system image --system=aarch64-linux -t iso9660 ~/code/guix/gnu/system/install.scm
>     ...
>     /gnu/store/rqf53a5xx3dknk689ag620n5617pqpj3-image.iso
>
> But now I have another problem, this image throws an error after
> selecting the "GNU Guix installation 1.4.0" entry in Grub:
>
>     error: invalid magic number.
>     error: you need to load the kernel first.
>
> I googled a bit about this error and most answers suggest that the image
> is corrupted in one way or another.
>
> How can I debug this error?

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 528 bytes --]

Re: Error booting aarch64 installation image

[Max Brieiev]

Hi Roman,

Roman Scherer <roman.scherer@burningswell.com> writes:

> I think you need to use --image-type=efi-raw for this to work.

Unfortunately, this doesn't build and produces yet another errors.

> I actually installed my Guix system from another distro. I roughly
> followed this guide here:
>
> https://guix.gnu.org/blog/2019/guix-on-an-arm-board/

Thank you! I spent all day yesterday playing with this idea.

And it actually works. For me the steps were like this:

1. Launch Debian ARM image.
2. Install Guix on it as package manager
3. Attach an empty qcow image as a storage device (/dev/vdb for me)
4. Partition and format /dev/vdb
5. Mount root and boot efi partitions.
6. Edit file-system entries in lightweight-desktop.scm and save it as
/mnt/etc/config.scm
7. Run:
    guix system init /mnt/etc/config.scm /mnt
8. Reboot

And this works!

Now I've just discovered in guix-cookbook that there is a special
linux-libre-arm64-generic kernel for ARM boards and that u-boot is
usually used to boot them.

But in my case it works with grub and a default kernel.

Are there any advantages of switching to linux-libre-arm64-generic
kernel?

Re: Error booting aarch64 installation image

[Efraim Flashner]

[-- Attachment #1: Type: text/plain, Size: 1760 bytes --]

On Tue, Feb 21, 2023 at 10:06:41AM +0200, Max Brieiev wrote:
> Hi Roman,
> 
> Roman Scherer <roman.scherer@burningswell.com> writes:
> 
> > I think you need to use --image-type=efi-raw for this to work.
> 
> Unfortunately, this doesn't build and produces yet another errors.
> 
> > I actually installed my Guix system from another distro. I roughly
> > followed this guide here:
> >
> > https://guix.gnu.org/blog/2019/guix-on-an-arm-board/
> 
> Thank you! I spent all day yesterday playing with this idea.
> 
> And it actually works. For me the steps were like this:
> 
> 1. Launch Debian ARM image.
> 2. Install Guix on it as package manager
> 3. Attach an empty qcow image as a storage device (/dev/vdb for me)
> 4. Partition and format /dev/vdb
> 5. Mount root and boot efi partitions.
> 6. Edit file-system entries in lightweight-desktop.scm and save it as
> /mnt/etc/config.scm
> 7. Run:
>     guix system init /mnt/etc/config.scm /mnt
> 8. Reboot
> 
> And this works!
> 
> Now I've just discovered in guix-cookbook that there is a special
> linux-libre-arm64-generic kernel for ARM boards and that u-boot is
> usually used to boot them.
> 
> But in my case it works with grub and a default kernel.
> 
> Are there any advantages of switching to linux-libre-arm64-generic
> kernel?
> 

I believe it mostly comes down to kernel configs. The regular
linux-libre arm64 kernel uses the Guix kernel config. The
linux-libre-arm64-generic build uses the upstream defaults instead of a
configuration file.

-- 
Efraim Flashner   <efraim@flashner.co.il>   אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: Building arm64 guix system image

[Efraim Flashner]

[-- Attachment #1: Type: text/plain, Size: 4749 bytes --]

On Fri, Feb 17, 2023 at 10:29:35AM +0200, Max Brieiev wrote:
> I want to run Guix on Apple M1 as a Qemu virtual machine.
> 
> On the Mac machine I run arm64 dedian image. I installed there guix as a
> package manager. Now I am trying to create a guix system image to use
> with Qemu, but it fails.
> 
> Here is what I do:
> 
>     max@debian:~$ guix system image --system=aarch64-linux -t qcow2 ~/code/guix/gnu/system/examples/bare-bones.tmpl 
>     guix system: warning: Consider running 'guix pull' followed by
>     'guix system reconfigure' to get up-to-date packages and security updates.
>     
>     substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
>     substitute: updating substitutes from 'https://bordeaux.guix.gnu.org'... 100.0%
>     The following derivations will be built:
>       /gnu/store/dhknasynfsx9ffsv2m188mmhfvz4l1cl-grub-2.06.drv
>       /gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv
>       /gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv
>       /gnu/store/dclmdk80rbqqpix98vh6srhdbgscyiwb-qemu-7.2.0.tar.xz.drv
>       /gnu/store/g9crxhl9j2pw35kwgx9bdcjg3jrvi77v-linux-libre-6.1.9.drv
>       /gnu/store/blyj3j5v3p2lh6pj7mw81xjg58d1k4zb-shepherd-0.9.3.drv
>       /gnu/store/r517qlsjsl877kpjfl9ixay9mzh0n923-grub-efi32-2.06.drv
>       /gnu/store/pyv1w00f9c0q291qhi6y0911sqlvfcrv-grub-efi-2.06.drv
>       /gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv
>       /gnu/store/brzpisxg4dkvad07pd95riwn7c8559j6-genimage-15-1.ec44ae0.drv
>     
>     1.0 MB will be downloaded
>      alsa-utils-1.2.4  987KiB             4.5MiB/s 00:00 [##################] 100.0%
>     building /gnu/store/g9crxhl9j2pw35kwgx9bdcjg3jrvi77v-linux-libre-6.1.9.drv...
>     building /gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv...
>     | 'build' phasebuilder for `/gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv' failed with exit code 1
>     build of /gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv failed
>     View build log at '/var/log/guix/drvs/2v/bjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv.gz'.
>     cannot build derivation `/gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv': 1 dependencies couldn't be built
>     guix system: error: build of `/gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv' failed
> 
> 
> The relevant part of the build log shows the following errors:
> 
>     Building OpenBIOS for ppc
>     Building...
>     error:
>     /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:128:2: error: unknown type name ‘__u32’
>       128 |  __u32 size; /* size in bytes of the extra space */
>           |  ^~~~~
>     /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:129:2: error: unknown type name ‘__u32’
>       129 |  __u32 __reserved[3];
>           |  ^~~~~
>     /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:136:2: error: unknown type name ‘__u16’
>       136 |  __u16 vl;
>           |  ^~~~~
>     /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:137:2: error: unknown type name ‘__u16’
>       137 |  __u16 __reserved[3];
>           |  ^~~~~
>     make[1]: *** [rules.mak:83: host/kernel/bootstrap.o] Error 1
>     make[1]: *** Waiting for unfinished jobs....
>     make[1]: Leaving directory '/tmp/guix-build-openbios-qemu-ppc-1.1.drv-0/source/obj-ppc'
>     make: *** [Makefile:19: build] Error 1
>     error: in phase 'build': uncaught exception:
>     %exception #<&invoke-error program: "make" arguments: ("-j" "4") exit-status: 2 term-signal: #f stop-signal: #f> 
>     phase `build' failed after 0.2 seconds
>     command "make" "-j" "4" failed with status 2
> 
> I don't know where to look to fix this error. Please, help me.
> 
> Also, I thought I could find somewhere arm64 guix build, but apparently
> there is none?
> 
> I found only a raw image for Pinebook Pro:
> https://ci.guix.gnu.org/eval/196495
> 
> But for some reason it says it is x86_64 system, and this confuses me.
> 
> Thank you in advance.

I have two patches on the core-updates branch that should allow building
openbios-qemu-ppc from aarch64. I'll try cherry-picking them to master
and see if that allows building qemu-minimal.

-- 
Efraim Flashner   <efraim@flashner.co.il>   אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: Building arm64 guix system image

[Roman Scherer]

[-- Attachment #1: Type: text/plain, Size: 5182 bytes --]


Hi Efraim,

that would be great. I'm looking forward to try them out.

Since we are already talking about arm64 here, do you have experience
with transparent huge pages on aarch64?

I would love to get some feedback on this one:

https://lists.gnu.org/archive/html/guix-patches/2023-02/msg00698.html

Do you know if any of the aarch64 build machines configured with a page
size > 4K? If so, I think that patch could help building more packages
on that architecture.

Thanks, Roman.

Efraim Flashner <efraim@flashner.co.il> writes:

> [[PGP Signed Part:Undecided]]
> On Fri, Feb 17, 2023 at 10:29:35AM +0200, Max Brieiev wrote:
>> I want to run Guix on Apple M1 as a Qemu virtual machine.
>>
>> On the Mac machine I run arm64 dedian image. I installed there guix as a
>> package manager. Now I am trying to create a guix system image to use
>> with Qemu, but it fails.
>>
>> Here is what I do:
>>
>>     max@debian:~$ guix system image --system=aarch64-linux -t qcow2 ~/code/guix/gnu/system/examples/bare-bones.tmpl
>>     guix system: warning: Consider running 'guix pull' followed by
>>     'guix system reconfigure' to get up-to-date packages and security updates.
>>
>>     substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
>>     substitute: updating substitutes from 'https://bordeaux.guix.gnu.org'... 100.0%
>>     The following derivations will be built:
>>       /gnu/store/dhknasynfsx9ffsv2m188mmhfvz4l1cl-grub-2.06.drv
>>       /gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv
>>       /gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv
>>       /gnu/store/dclmdk80rbqqpix98vh6srhdbgscyiwb-qemu-7.2.0.tar.xz.drv
>>       /gnu/store/g9crxhl9j2pw35kwgx9bdcjg3jrvi77v-linux-libre-6.1.9.drv
>>       /gnu/store/blyj3j5v3p2lh6pj7mw81xjg58d1k4zb-shepherd-0.9.3.drv
>>       /gnu/store/r517qlsjsl877kpjfl9ixay9mzh0n923-grub-efi32-2.06.drv
>>       /gnu/store/pyv1w00f9c0q291qhi6y0911sqlvfcrv-grub-efi-2.06.drv
>>       /gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv
>>       /gnu/store/brzpisxg4dkvad07pd95riwn7c8559j6-genimage-15-1.ec44ae0.drv
>>
>>     1.0 MB will be downloaded
>>      alsa-utils-1.2.4  987KiB             4.5MiB/s 00:00 [##################] 100.0%
>>     building /gnu/store/g9crxhl9j2pw35kwgx9bdcjg3jrvi77v-linux-libre-6.1.9.drv...
>>     building /gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv...
>>     | 'build' phasebuilder for `/gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv' failed with exit code 1
>>     build of /gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv failed
>>     View build log at '/var/log/guix/drvs/2v/bjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv.gz'.
>>     cannot build derivation `/gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv': 1 dependencies couldn't be built
>>     guix system: error: build of `/gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv' failed
>>
>>
>> The relevant part of the build log shows the following errors:
>>
>>     Building OpenBIOS for ppc
>>     Building...
>>     error:
>>     /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:128:2: error: unknown type name ‘__u32’
>>       128 |  __u32 size; /* size in bytes of the extra space */
>>           |  ^~~~~
>>     /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:129:2: error: unknown type name ‘__u32’
>>       129 |  __u32 __reserved[3];
>>           |  ^~~~~
>>     /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:136:2: error: unknown type name ‘__u16’
>>       136 |  __u16 vl;
>>           |  ^~~~~
>>     /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:137:2: error: unknown type name ‘__u16’
>>       137 |  __u16 __reserved[3];
>>           |  ^~~~~
>>     make[1]: *** [rules.mak:83: host/kernel/bootstrap.o] Error 1
>>     make[1]: *** Waiting for unfinished jobs....
>>     make[1]: Leaving directory '/tmp/guix-build-openbios-qemu-ppc-1.1.drv-0/source/obj-ppc'
>>     make: *** [Makefile:19: build] Error 1
>>     error: in phase 'build': uncaught exception:
>>     %exception #<&invoke-error program: "make" arguments: ("-j" "4") exit-status: 2 term-signal: #f stop-signal: #f>
>>     phase `build' failed after 0.2 seconds
>>     command "make" "-j" "4" failed with status 2
>>
>> I don't know where to look to fix this error. Please, help me.
>>
>> Also, I thought I could find somewhere arm64 guix build, but apparently
>> there is none?
>>
>> I found only a raw image for Pinebook Pro:
>> https://ci.guix.gnu.org/eval/196495
>>
>> But for some reason it says it is x86_64 system, and this confuses me.
>>
>> Thank you in advance.
>
> I have two patches on the core-updates branch that should allow building
> openbios-qemu-ppc from aarch64. I'll try cherry-picking them to master
> and see if that allows building qemu-minimal.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 528 bytes --]

Re: Building arm64 guix system image

[Efraim Flashner]

[-- Attachment #1: Type: text/plain, Size: 1849 bytes --]

On Mon, Feb 20, 2023 at 11:31:04AM +0100, Roman Scherer wrote:
> 
> Efraim Flashner <efraim@flashner.co.il> writes:
> >
> > I have two patches on the core-updates branch that should allow building
> > openbios-qemu-ppc from aarch64. I'll try cherry-picking them to master
> > and see if that allows building qemu-minimal.
> 
> Hi Efraim,
> 
> that would be great. I'm looking forward to try them out.

I ran out of space while building qemu so I'm waiting on the build farm¹
to see if qemu worked. Since qemu-minimal worked I pushed it upstream
and current master should have that building now. I haven't tested
building an image yet though.

¹ https://ci.guix.gnu.org/eval/211772

> Since we are already talking about arm64 here, do you have experience
> with transparent huge pages on aarch64?
> 
> I would love to get some feedback on this one:
> 
> https://lists.gnu.org/archive/html/guix-patches/2023-02/msg00698.html
> 
> Do you know if any of the aarch64 build machines configured with a page
> size > 4K? If so, I think that patch could help building more packages
> on that architecture.
> 
> Thanks, Roman.

I'm pretty sure they all use a 4K page size. From
gnu/packages/aux-files/linux-libre/6.1-arm64.conf:
CONFIG_ARM64_4K_PAGES=y
# CONFIG_ARM64_16K_PAGES is not set
# CONFIG_ARM64_64K_PAGES is not set

It looks like they're set for 4K pages. I'm not sure if it can be set
for more than one size at once. As for the transparent huge pages, I'm
pretty sure back in 2017 when I disabled it in jemalloc it was fairly
broken on aarch64 but I don't see a reason to not enable it now.

-- 
Efraim Flashner   <efraim@flashner.co.il>   אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: Building arm64 guix system image

[Andrew Patterson]

On Mon, 2023-02-20 at 16:17+02, Efraim Flashner 
<efraim@flashner.co.il> wrote:

> I ran out of space while building qemu so I'm waiting on the 
> build farm¹
> to see if qemu worked. Since qemu-minimal worked I pushed it 
> upstream
> and current master should have that building now. I haven't 
> tested
> building an image yet though.
>
> ¹ https://ci.guix.gnu.org/eval/211772

Thank you for fixing this!  I'll close my bug report.

It looks like the fix was just updating to a more recent commit; 
should I close the issue I posted on github, then?

Thanks,
-- 
Andrew Patterson

Re: Building arm64 guix system image

[Efraim Flashner]

[-- Attachment #1: Type: text/plain, Size: 1030 bytes --]

On Tue, Feb 21, 2023 at 12:02:53AM -0500, Andrew Patterson wrote:
> 
> On Mon, 2023-02-20 at 16:17+02, Efraim Flashner <efraim@flashner.co.il>
> wrote:
> 
> > I ran out of space while building qemu so I'm waiting on the build farm¹
> > to see if qemu worked. Since qemu-minimal worked I pushed it upstream
> > and current master should have that building now. I haven't tested
> > building an image yet though.
> > 
> > ¹ https://ci.guix.gnu.org/eval/211772
> 
> Thank you for fixing this!  I'll close my bug report.

Happy to help :)

> It looks like the fix was just updating to a more recent commit; should I
> close the issue I posted on github, then?

We don't use github for issue tracking so I'm not sure which repo you're
talking about... so it'd probably be a good idea to close it :D

-- 
Efraim Flashner   <efraim@flashner.co.il>   אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: Building arm64 guix system image

[Roman Scherer]

[-- Attachment #1: Type: text/plain, Size: 2218 bytes --]


Hi Efraim,

can you help me getting the support for transparent huge page on aarch64
for jemalloc into Guix?

https://lists.gnu.org/archive/html/guix-patches/2023-02/msg00698.html

I'm using those patches locally and have tested it so far by:

- Compiling the whole Rust toolchain

- Using this Rust toolchain to compile Icecat and a Rust Linux kernel
  module for thr GPU

I haven't noticed any issues so far.

Thanks, Roman.

Efraim Flashner <efraim@flashner.co.il> writes:

> [[PGP Signed Part:Undecided]]
> On Mon, Feb 20, 2023 at 11:31:04AM +0100, Roman Scherer wrote:
>>
>> Efraim Flashner <efraim@flashner.co.il> writes:
>> >
>> > I have two patches on the core-updates branch that should allow building
>> > openbios-qemu-ppc from aarch64. I'll try cherry-picking them to master
>> > and see if that allows building qemu-minimal.
>>
>> Hi Efraim,
>>
>> that would be great. I'm looking forward to try them out.
>
> I ran out of space while building qemu so I'm waiting on the build farm¹
> to see if qemu worked. Since qemu-minimal worked I pushed it upstream
> and current master should have that building now. I haven't tested
> building an image yet though.
>
> ¹ https://ci.guix.gnu.org/eval/211772
>
>> Since we are already talking about arm64 here, do you have experience
>> with transparent huge pages on aarch64?
>>
>> I would love to get some feedback on this one:
>>
>> https://lists.gnu.org/archive/html/guix-patches/2023-02/msg00698.html
>>
>> Do you know if any of the aarch64 build machines configured with a page
>> size > 4K? If so, I think that patch could help building more packages
>> on that architecture.
>>
>> Thanks, Roman.
>
> I'm pretty sure they all use a 4K page size. From
> gnu/packages/aux-files/linux-libre/6.1-arm64.conf:
> CONFIG_ARM64_4K_PAGES=y
> # CONFIG_ARM64_16K_PAGES is not set
> # CONFIG_ARM64_64K_PAGES is not set
>
> It looks like they're set for 4K pages. I'm not sure if it can be set
> for more than one size at once. As for the transparent huge pages, I'm
> pretty sure back in 2017 when I disabled it in jemalloc it was fairly
> broken on aarch64 but I don't see a reason to not enable it now.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 528 bytes --]

Re: Building arm64 guix system image

[Roman Scherer]

[-- Attachment #1: Type: text/plain, Size: 4894 bytes --]


Hi Efraim,

I just pulled master with the patches you applied, and now I'm able to
build my Guix system again with the latest and greatest. :)

Thanks for your work on this! Greatly appreciated.

Roman

Efraim Flashner <efraim@flashner.co.il> writes:

> [[PGP Signed Part:Undecided]]
> On Fri, Feb 17, 2023 at 10:29:35AM +0200, Max Brieiev wrote:
>> I want to run Guix on Apple M1 as a Qemu virtual machine.
>>
>> On the Mac machine I run arm64 dedian image. I installed there guix as a
>> package manager. Now I am trying to create a guix system image to use
>> with Qemu, but it fails.
>>
>> Here is what I do:
>>
>>     max@debian:~$ guix system image --system=aarch64-linux -t qcow2 ~/code/guix/gnu/system/examples/bare-bones.tmpl
>>     guix system: warning: Consider running 'guix pull' followed by
>>     'guix system reconfigure' to get up-to-date packages and security updates.
>>
>>     substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
>>     substitute: updating substitutes from 'https://bordeaux.guix.gnu.org'... 100.0%
>>     The following derivations will be built:
>>       /gnu/store/dhknasynfsx9ffsv2m188mmhfvz4l1cl-grub-2.06.drv
>>       /gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv
>>       /gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv
>>       /gnu/store/dclmdk80rbqqpix98vh6srhdbgscyiwb-qemu-7.2.0.tar.xz.drv
>>       /gnu/store/g9crxhl9j2pw35kwgx9bdcjg3jrvi77v-linux-libre-6.1.9.drv
>>       /gnu/store/blyj3j5v3p2lh6pj7mw81xjg58d1k4zb-shepherd-0.9.3.drv
>>       /gnu/store/r517qlsjsl877kpjfl9ixay9mzh0n923-grub-efi32-2.06.drv
>>       /gnu/store/pyv1w00f9c0q291qhi6y0911sqlvfcrv-grub-efi-2.06.drv
>>       /gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv
>>       /gnu/store/brzpisxg4dkvad07pd95riwn7c8559j6-genimage-15-1.ec44ae0.drv
>>
>>     1.0 MB will be downloaded
>>      alsa-utils-1.2.4  987KiB             4.5MiB/s 00:00 [##################] 100.0%
>>     building /gnu/store/g9crxhl9j2pw35kwgx9bdcjg3jrvi77v-linux-libre-6.1.9.drv...
>>     building /gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv...
>>     | 'build' phasebuilder for `/gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv' failed with exit code 1
>>     build of /gnu/store/2vbjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv failed
>>     View build log at '/var/log/guix/drvs/2v/bjnb0f6dzcnvvyaaqjzww0146fpwmj-openbios-qemu-ppc-1.1.drv.gz'.
>>     cannot build derivation `/gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv': 1 dependencies couldn't be built
>>     guix system: error: build of `/gnu/store/875pz541zymv6vhl0hkfll151jv8sd2p-qemu-minimal-7.2.0.drv' failed
>>
>>
>> The relevant part of the build log shows the following errors:
>>
>>     Building OpenBIOS for ppc
>>     Building...
>>     error:
>>     /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:128:2: error: unknown type name ‘__u32’
>>       128 |  __u32 size; /* size in bytes of the extra space */
>>           |  ^~~~~
>>     /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:129:2: error: unknown type name ‘__u32’
>>       129 |  __u32 __reserved[3];
>>           |  ^~~~~
>>     /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:136:2: error: unknown type name ‘__u16’
>>       136 |  __u16 vl;
>>           |  ^~~~~
>>     /gnu/store/gm5mbaxkqhzafwy0wnimrg53j884glxn-linux-libre-headers-5.10.35/include/asm/sigcontext.h:137:2: error: unknown type name ‘__u16’
>>       137 |  __u16 __reserved[3];
>>           |  ^~~~~
>>     make[1]: *** [rules.mak:83: host/kernel/bootstrap.o] Error 1
>>     make[1]: *** Waiting for unfinished jobs....
>>     make[1]: Leaving directory '/tmp/guix-build-openbios-qemu-ppc-1.1.drv-0/source/obj-ppc'
>>     make: *** [Makefile:19: build] Error 1
>>     error: in phase 'build': uncaught exception:
>>     %exception #<&invoke-error program: "make" arguments: ("-j" "4") exit-status: 2 term-signal: #f stop-signal: #f>
>>     phase `build' failed after 0.2 seconds
>>     command "make" "-j" "4" failed with status 2
>>
>> I don't know where to look to fix this error. Please, help me.
>>
>> Also, I thought I could find somewhere arm64 guix build, but apparently
>> there is none?
>>
>> I found only a raw image for Pinebook Pro:
>> https://ci.guix.gnu.org/eval/196495
>>
>> But for some reason it says it is x86_64 system, and this confuses me.
>>
>> Thank you in advance.
>
> I have two patches on the core-updates branch that should allow building
> openbios-qemu-ppc from aarch64. I'll try cherry-picking them to master
> and see if that allows building qemu-minimal.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 528 bytes --]