PowerPC & GNU/Hurd cross-compilation

PowerPC & GNU/Hurd cross-compilation

[Ludovic Courtès]

[-- Attachment #1: Type: text/plain, Size: 4096 bytes --]

Hello Guix!

A picture (?) is worth a thousand words:

--8<---------------cut here---------------start------------->8---
$ file $(./pre-inst-env guix build -q --target=i586-pc-gnu guile )/bin/guile
The following files will be downloaded:
   /gnu/store/8jxpzizhb780cqqn9qk27hfgyv9v224x-guile-2.0.13-debug
   /gnu/store/zl3m30z9rvj15jnfgn43wd6qikahf9l1-guile-2.0.13
   /gnu/store/0p00kg842bpjfj7vvix73iqvz977wnng-readline-7.0
   /gnu/store/1l8jnzmpzivmph26md6wvrbkdi0xlbd9-libgc-7.6.0
   /gnu/store/4icii2kkn8zwgi6qz6varyflp1ms11i7-gcc-cross-i586-pc-gnu-5.4.0
   /gnu/store/5nwkzw2ipzbdmyx0c8jg3zv74p233yg8-glibc-cross-i586-pc-gnu-2.23
   /gnu/store/7j4ni6bliwr5y4f8x6caqcfpw6cayi9x-libunistring-0.9.7
   /gnu/store/9g4lx00ifmgwp47l6n4h0sx72fk1r7jf-libltdl-2.4.6
   /gnu/store/9jfv1vgnag4nc7pfhzyc2j97q9l567x2-gmp-6.1.2
   /gnu/store/v3zi67s9yyfb1cym28chczk5zf9gmczn-libffi-3.2.1
   /gnu/store/xxmdzy6v625fqdafcgp4lxvdipnjqd45-gcc-cross-sans-libc-i586-pc-gnu-5.4.0
   /gnu/store/flwn3xam69q593iinvb9sjl9lzyad2k1-libatomic-ops-7.4.4
   /gnu/store/kh3f6x5d0r3xmqzl79y99drdsn1lsmaz-ncurses-6.0
   /gnu/store/ln735a8nzl427izyb4lfgwr4rfd929wr-pkg-config-i586-pc-gnu-0.29
   /gnu/store/mpz7j090145v0zij8h28v9zvqr2kafw5-bash-4.4.5
/gnu/store/8jxpzizhb780cqqn9qk27hfgyv9v224x-guile-2.0.13-debug:     directory
/gnu/store/zl3m30z9rvj15jnfgn43wd6qikahf9l1-guile-2.0.13/bin/guile: ELF 32-bit LSB executable, Intel 80386, version 1 (SYSV), dynamically linked, interpreter /lib/ld.so, for GNU/Hurd 0.0.0, not stripped
$ file $(./pre-inst-env guix build -q --target=powerpc-linux-gnu guile )/bin/guile
The following files will be downloaded:
   /gnu/store/4cmc36jhjj2qq7z5pd0n9fw48dfq1cr7-guile-2.0.13-debug
   /gnu/store/h153jzzqiz10xc3yh4r2w7lkrm5pbx88-guile-2.0.13
   /gnu/store/253hrca11y3cjh2f83dcjaxiv9a2j5m3-gmp-6.1.2
   /gnu/store/29iq9axvllgdrf6y6zfqz111icmy3pdj-libgc-7.6.0
   /gnu/store/911r5chr83yi6xivavndgb6mcvn71qv1-libunistring-0.9.7
   /gnu/store/hkhffl6c6iap2igbbcap2vqbcgh7xkjv-gcc-cross-sans-libc-powerpc-linux-gnu-5.4.0
   /gnu/store/k2j02w9q58h6i07y1fixvcdq8jply68i-gcc-cross-powerpc-linux-gnu-5.4.0
   /gnu/store/naqawviclvwzixvcjc17c3sss7zj9k1w-readline-7.0
   /gnu/store/qivxbbn03scn5wn932ky8mm5xap5zn93-glibc-cross-powerpc-linux-gnu-2.24
   /gnu/store/rqb8p9f13mfha1xkkjwf7wfjvzv34xlk-libltdl-2.4.6
   /gnu/store/z1qain73n3475p6sdb2ignwyalckvgnx-libffi-3.2.1
   /gnu/store/4dazcdvnbgvhdvi5aj17ci07mz1xwzvq-bash-4.4.5
   /gnu/store/6fzzsp453p3n5axcnl0rddjf1yw9309m-ncurses-6.0
   /gnu/store/r7dbj8y4nf024phn8sd2v4206y71mk8q-pkg-config-powerpc-linux-gnu-0.29
   /gnu/store/rbhdn0wkbgb69w17f1fhridw81msam8v-libatomic-ops-7.4.4
/gnu/store/4cmc36jhjj2qq7z5pd0n9fw48dfq1cr7-guile-2.0.13-debug:     directory
/gnu/store/h153jzzqiz10xc3yh4r2w7lkrm5pbx88-guile-2.0.13/bin/guile: ELF 32-bit MSB executable, PowerPC or cisco 4500, version 1 (SYSV), dynamically linked, interpreter /gnu/store/qivxbbn03scn5wn932ky8mm5xap5zn93-glibc-cross-powerpc-linux-gnu-2.24/lib/ld.so.1, for GNU/Linux 3.2.0, not stripped
$ git describe
v0.12.0-458-g168c40004
--8<---------------cut here---------------end--------------->8---

Coreutils 8.26 fails upon ‘make install’ when cross-compiling, but I
think Manolis has already investigated that so we should be able to fix
it soon:

  https://hydra.gnu.org/build/1817891/nixlog/1/raw

There’s also a small problem with sed:

  https://hydra.gnu.org/build/1817854/nixlog/1/raw

Besides, on GNU/Hurd, the loader file name is incorrect:

--8<---------------cut here---------------start------------->8---
$ readelf -a /gnu/store/zl3m30z9rvj15jnfgn43wd6qikahf9l1-guile-2.0.13/bin/guile |grep -A1 INTERP
  INTERP         0x000134 0x08048134 0x08048134 0x0000b 0x0000b R   0x1
      [Requesting program interpreter: /lib/ld.so]
--8<---------------cut here---------------end--------------->8---

(Should be /gnu/store/…-glibc-2.24/lib/ld.so.)

Looking at gcc/config/i386/gnu.h, I think the problem is fixed with the
patch below, I’ll give it a try and commit if it works.

Enjoy!

Ludo’.


[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #2: Type: text/x-patch, Size: 902 bytes --]

--- a/gnu/packages/gcc.scm
+++ b/gnu/packages/gcc.scm
@@ -213,9 +213,10 @@ where the OS part is overloaded to denote a specific ABI---into GCC
                 ;; Fix the dynamic linker's file name.
                 (substitute* (find-files "gcc/config"
                                          "^(linux|gnu|sysv4)(64|-elf|-eabi)?\\.h$")
-                  (("#define GLIBC_DYNAMIC_LINKER([^ ]*).*$" _ suffix)
-                   (format #f "#define GLIBC_DYNAMIC_LINKER~a \"~a\"~%"
-                           suffix
+                  (("#define (GLIBC|GNU_USER)_DYNAMIC_LINKER([^ ]*).*$"
+                    _ gnu-user suffix)
+                   (format #f "#define ~a_DYNAMIC_LINKER~a \"~a\"~%"
+                           gnu-user suffix
                            (string-append libc ,(glibc-dynamic-linker)))))
 
                 ;; Tell where to find libstdc++, libc, and `?crt*.o', except

Re: PowerPC & GNU/Hurd cross-compilation

[Ludovic Courtès]

ludo@gnu.org (Ludovic Courtès) skribis:

> $ file $(./pre-inst-env guix build -q --target=powerpc-linux-gnu guile )/bin/guile
> The following files will be downloaded:
>    /gnu/store/4cmc36jhjj2qq7z5pd0n9fw48dfq1cr7-guile-2.0.13-debug
>    /gnu/store/h153jzzqiz10xc3yh4r2w7lkrm5pbx88-guile-2.0.13
>    /gnu/store/253hrca11y3cjh2f83dcjaxiv9a2j5m3-gmp-6.1.2
>    /gnu/store/29iq9axvllgdrf6y6zfqz111icmy3pdj-libgc-7.6.0
>    /gnu/store/911r5chr83yi6xivavndgb6mcvn71qv1-libunistring-0.9.7
>    /gnu/store/hkhffl6c6iap2igbbcap2vqbcgh7xkjv-gcc-cross-sans-libc-powerpc-linux-gnu-5.4.0
>    /gnu/store/k2j02w9q58h6i07y1fixvcdq8jply68i-gcc-cross-powerpc-linux-gnu-5.4.0
>    /gnu/store/naqawviclvwzixvcjc17c3sss7zj9k1w-readline-7.0
>    /gnu/store/qivxbbn03scn5wn932ky8mm5xap5zn93-glibc-cross-powerpc-linux-gnu-2.24
>    /gnu/store/rqb8p9f13mfha1xkkjwf7wfjvzv34xlk-libltdl-2.4.6
>    /gnu/store/z1qain73n3475p6sdb2ignwyalckvgnx-libffi-3.2.1
>    /gnu/store/4dazcdvnbgvhdvi5aj17ci07mz1xwzvq-bash-4.4.5
>    /gnu/store/6fzzsp453p3n5axcnl0rddjf1yw9309m-ncurses-6.0
>    /gnu/store/r7dbj8y4nf024phn8sd2v4206y71mk8q-pkg-config-powerpc-linux-gnu-0.29
>    /gnu/store/rbhdn0wkbgb69w17f1fhridw81msam8v-libatomic-ops-7.4.4

With QEMU:

--8<---------------cut here---------------start------------->8---
$ qemu-ppc /gnu/store/4dazcdvnbgvhdvi5aj17ci07mz1xwzvq-bash-4.4.5/bin/bash --version
GNU bash, version 4.4.5(1)-release (powerpc-unknown-linux-gnu)
Copyright (C) 2016 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>

This is free software; you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
$ qemu-ppc /gnu/store/h153jzzqiz10xc3yh4r2w7lkrm5pbx88-guile-2.0.13/bin/guile -q --version
qemu: uncaught target signal 11 (Segmentation fault) - core dumped
--8<---------------cut here---------------end--------------->8---

Carlos, could you check whether the cross-compiled Guile works on a real
PowerPC machine?  I suspect ‘qemu-ppc’ doesn’t emulate everything libgc
relies on.

Ludo’.

Re: PowerPC & GNU/Hurd cross-compilation

[Leo Famulari]

[-- Attachment #1: Type: text/plain, Size: 486 bytes --]

On Sat, Jan 21, 2017 at 10:24:46PM +0100, Ludovic Courtès wrote:
> Hello Guix!
> 
> A picture (?) is worth a thousand words:
> 
> --8<---------------cut here---------------start------------->8---
> $ file $(./pre-inst-env guix build -q --target=i586-pc-gnu guile )/bin/guile
> The following files will be downloaded:

[...]

> $ file $(./pre-inst-env guix build -q --target=powerpc-linux-gnu guile )/bin/guile
> The following files will be downloaded:

[...]

Awesome!

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: PowerPC & GNU/Hurd cross-compilation

[Ludovic Courtès]

ludo@gnu.org (Ludovic Courtès) skribis:

> There’s also a small problem with sed:
>
>   https://hydra.gnu.org/build/1817854/nixlog/1/raw

Fixed in c8b44fc10717a106b305d66e95ea27d1a3be45f5.

> Besides, on GNU/Hurd, the loader file name is incorrect:
>
> $ readelf -a /gnu/store/zl3m30z9rvj15jnfgn43wd6qikahf9l1-guile-2.0.13/bin/guile |grep -A1 INTERP
>   INTERP         0x000134 0x08048134 0x08048134 0x0000b 0x0000b R   0x1
>       [Requesting program interpreter: /lib/ld.so]
>
> (Should be /gnu/store/…-glibc-2.24/lib/ld.so.)

Fixed in 33ae7d43854d8e36f29892015d4ee172c7f518f6.

Ludo’.

Re: PowerPC & GNU/Hurd cross-compilation

[Kei Kebreau]

[-- Attachment #1: Type: text/plain, Size: 625 bytes --]

Leo Famulari <leo@famulari.name> writes:

> On Sat, Jan 21, 2017 at 10:24:46PM +0100, Ludovic Courtès wrote:
>> Hello Guix!
>> 
>> A picture (?) is worth a thousand words:
>> 
>> --8<---------------cut here---------------start------------->8---
>> $ file $(./pre-inst-env guix build -q --target=i586-pc-gnu guile )/bin/guile
>> The following files will be downloaded:
>
> [...]
>
>> $ file $(./pre-inst-env guix build -q --target=powerpc-linux-gnu
>> guile )/bin/guile
>> The following files will be downloaded:
>
> [...]
>
> Awesome!

I agree. It's encouraging to see steady progress on these fronts.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

Re: PowerPC & GNU/Hurd cross-compilation

[Carlos Sánchez de La Lama]

Hi Ludo, all,

>> $ file $(./pre-inst-env guix build -q --target=powerpc-linux-gnu guile )/bin/guile
>> The following files will be downloaded:
>>    /gnu/store/4cmc36jhjj2qq7z5pd0n9fw48dfq1cr7-guile-2.0.13-debug
>>    /gnu/store/h153jzzqiz10xc3yh4r2w7lkrm5pbx88-guile-2.0.13
>>    /gnu/store/253hrca11y3cjh2f83dcjaxiv9a2j5m3-gmp-6.1.2
>>    /gnu/store/29iq9axvllgdrf6y6zfqz111icmy3pdj-libgc-7.6.0
>>    /gnu/store/911r5chr83yi6xivavndgb6mcvn71qv1-libunistring-0.9.7
>>    /gnu/store/hkhffl6c6iap2igbbcap2vqbcgh7xkjv-gcc-cross-sans-libc-powerpc-linux-gnu-5.4.0
>>    /gnu/store/k2j02w9q58h6i07y1fixvcdq8jply68i-gcc-cross-powerpc-linux-gnu-5.4.0
>>    /gnu/store/naqawviclvwzixvcjc17c3sss7zj9k1w-readline-7.0
>>    /gnu/store/qivxbbn03scn5wn932ky8mm5xap5zn93-glibc-cross-powerpc-linux-gnu-2.24
>>    /gnu/store/rqb8p9f13mfha1xkkjwf7wfjvzv34xlk-libltdl-2.4.6
>>    /gnu/store/z1qain73n3475p6sdb2ignwyalckvgnx-libffi-3.2.1
>>    /gnu/store/4dazcdvnbgvhdvi5aj17ci07mz1xwzvq-bash-4.4.5
>>    /gnu/store/6fzzsp453p3n5axcnl0rddjf1yw9309m-ncurses-6.0
>>    /gnu/store/r7dbj8y4nf024phn8sd2v4206y71mk8q-pkg-config-powerpc-linux-gnu-0.29
>>    /gnu/store/rbhdn0wkbgb69w17f1fhridw81msam8v-libatomic-ops-7.4.4
>
> With QEMU:
>
> --8<---------------cut here---------------start------------->8---
> $ qemu-ppc /gnu/store/4dazcdvnbgvhdvi5aj17ci07mz1xwzvq-bash-4.4.5/bin/bash --version
> GNU bash, version 4.4.5(1)-release (powerpc-unknown-linux-gnu)
> Copyright (C) 2016 Free Software Foundation, Inc.
> License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
>
> This is free software; you are free to change and redistribute it.
> There is NO WARRANTY, to the extent permitted by law.
> $ qemu-ppc /gnu/store/h153jzzqiz10xc3yh4r2w7lkrm5pbx88-guile-2.0.13/bin/guile -q --version
> qemu: uncaught target signal 11 (Segmentation fault) - core dumped
> --8<---------------cut here---------------end--------------->8---
>
> Carlos, could you check whether the cross-compiled Guile works on a real
> PowerPC machine?  I suspect ‘qemu-ppc’ doesn’t emulate everything libgc
> relies on.

I checked out commit 58ea4d to try to obtain most sustitutes from hydra,
but seems my products differ:

$ ./pre-inst-env guix build -q --target=powerpc-linux-gnu guile
/gnu/store/75vvlackg42i2aisc8zxgvqnkfz3nnx0-guile-2.0.13-debug
/gnu/store/g4q5kgrl8qigzaqlhhg2jjnmzhj75pk7-guile-2.0.13

While, for hydra, products for evaluation 109452 (which uses commit
58ea4d) are:
powerpc-linux-gnu.guile-2.0.13.x86_64-linux:
        /gnu/store/viv5cw795vy7gblgv68k16q4ri37s7aj-guile-2.0.13-debug
        /gnu/store/1zy8jfwbb2g956ihg5d9bk2ac41xhcsc-guile-2.0.13
powerpc-linux-gnu.guile-2.0.13.i686-linux: Fails.

Note I am on i686.
        
In any case, the cross-compiled Guile generated on my machine works on
the real PowerPC:

./pre-inst-env guix gc --references /gnu/store/g4q5kgrl8qigzaqlhhg2jjnmzhj75pk7-guile-2.0.13 | xargs tar cf ~/guile.tar

I scp to ppc machine, untar, and guile works:

--8<---------------cut here---------------start------------->8---
ppc$ /gnu/store/g4q5kgrl8qigzaqlhhg2jjnmzhj75pk7-guile-2.0.13/bin/guile --version
guile (GNU Guile) 2.0.13
Copyright (C) 2016 Free Software Foundation, Inc.

License LGPLv3+: GNU LGPL 3 or later
<http://gnu.org/licenses/lgpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
--8<---------------cut here---------------end--------------->8---

BR

Carlos

Re: PowerPC & GNU/Hurd cross-compilation

[Ludovic Courtès]

Hey Carlos,

csanchezdll@gmail.com (Carlos Sánchez de La Lama) skribis:

>>> $ file $(./pre-inst-env guix build -q --target=powerpc-linux-gnu guile )/bin/guile
>>> The following files will be downloaded:
>>>    /gnu/store/4cmc36jhjj2qq7z5pd0n9fw48dfq1cr7-guile-2.0.13-debug
>>>    /gnu/store/h153jzzqiz10xc3yh4r2w7lkrm5pbx88-guile-2.0.13
>>>    /gnu/store/253hrca11y3cjh2f83dcjaxiv9a2j5m3-gmp-6.1.2
>>>    /gnu/store/29iq9axvllgdrf6y6zfqz111icmy3pdj-libgc-7.6.0
>>>    /gnu/store/911r5chr83yi6xivavndgb6mcvn71qv1-libunistring-0.9.7
>>>    /gnu/store/hkhffl6c6iap2igbbcap2vqbcgh7xkjv-gcc-cross-sans-libc-powerpc-linux-gnu-5.4.0
>>>    /gnu/store/k2j02w9q58h6i07y1fixvcdq8jply68i-gcc-cross-powerpc-linux-gnu-5.4.0
>>>    /gnu/store/naqawviclvwzixvcjc17c3sss7zj9k1w-readline-7.0
>>>    /gnu/store/qivxbbn03scn5wn932ky8mm5xap5zn93-glibc-cross-powerpc-linux-gnu-2.24
>>>    /gnu/store/rqb8p9f13mfha1xkkjwf7wfjvzv34xlk-libltdl-2.4.6
>>>    /gnu/store/z1qain73n3475p6sdb2ignwyalckvgnx-libffi-3.2.1
>>>    /gnu/store/4dazcdvnbgvhdvi5aj17ci07mz1xwzvq-bash-4.4.5
>>>    /gnu/store/6fzzsp453p3n5axcnl0rddjf1yw9309m-ncurses-6.0
>>>    /gnu/store/r7dbj8y4nf024phn8sd2v4206y71mk8q-pkg-config-powerpc-linux-gnu-0.29
>>>    /gnu/store/rbhdn0wkbgb69w17f1fhridw81msam8v-libatomic-ops-7.4.4
>>
>> With QEMU:
>>
>> --8<---------------cut here---------------start------------->8---
>> $ qemu-ppc /gnu/store/4dazcdvnbgvhdvi5aj17ci07mz1xwzvq-bash-4.4.5/bin/bash --version
>> GNU bash, version 4.4.5(1)-release (powerpc-unknown-linux-gnu)
>> Copyright (C) 2016 Free Software Foundation, Inc.
>> License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
>>
>> This is free software; you are free to change and redistribute it.
>> There is NO WARRANTY, to the extent permitted by law.
>> $ qemu-ppc /gnu/store/h153jzzqiz10xc3yh4r2w7lkrm5pbx88-guile-2.0.13/bin/guile -q --version
>> qemu: uncaught target signal 11 (Segmentation fault) - core dumped
>> --8<---------------cut here---------------end--------------->8---
>>
>> Carlos, could you check whether the cross-compiled Guile works on a real
>> PowerPC machine?  I suspect ‘qemu-ppc’ doesn’t emulate everything libgc
>> relies on.
>
> I checked out commit 58ea4d to try to obtain most sustitutes from hydra,
> but seems my products differ:
>
> $ ./pre-inst-env guix build -q --target=powerpc-linux-gnu guile
> /gnu/store/75vvlackg42i2aisc8zxgvqnkfz3nnx0-guile-2.0.13-debug
> /gnu/store/g4q5kgrl8qigzaqlhhg2jjnmzhj75pk7-guile-2.0.13
>
> While, for hydra, products for evaluation 109452 (which uses commit
> 58ea4d) are:
> powerpc-linux-gnu.guile-2.0.13.x86_64-linux:
>         /gnu/store/viv5cw795vy7gblgv68k16q4ri37s7aj-guile-2.0.13-debug
>         /gnu/store/1zy8jfwbb2g956ihg5d9bk2ac41xhcsc-guile-2.0.13
> powerpc-linux-gnu.guile-2.0.13.i686-linux: Fails.
>
> Note I am on i686.

The “.x86_64-linux” in the Hydra job name above means that it’s
cross-built from x86_64; that’s why the store file name is different
from the one you have on i686.

The failure on i686 is a timeout while running libgc’s test suite (the
native i686 build):

  https://hydra.gnu.org/build/1820051

--8<---------------cut here---------------start------------->8---
make  check-TESTS
make[2]: Entering directory '/tmp/guix-build-libgc-7.6.0.drv-0/gc-7.6.0'
make[3]: Entering directory '/tmp/guix-build-libgc-7.6.0.drv-0/gc-7.6.0'
PASS: leaktest
PASS: cordtest
PASS: smashtest
PASS: hugetest
PASS: middletest
PASS: threadleaktest
PASS: threadkey_test
PASS: subthreadcreate_test
PASS: initsecondarythread_test
PASS: staticrootstest
PASS: realloc_test
PASS: test_cpp
PASS: disclaim_test
PASS: disclaim_bench
building of `/gnu/store/yk15c9c5vjny19pw30zkygf2vzy6zp7h-libgc-7.6.0.drv' timed out after 3600 seconds of silence
--8<---------------cut here---------------end--------------->8---

I’ve just tried:

  ./pre-inst-env guix build -e '(@@ (gnu packages commencement) guile-final)' \
      -s i686-linux -K

on my x86_64 box and it passes without a problem.

Probably that was a transient failure, though we’ll need to pay
attention.

> In any case, the cross-compiled Guile generated on my machine works on
> the real PowerPC:
>
> ./pre-inst-env guix gc --references /gnu/store/g4q5kgrl8qigzaqlhhg2jjnmzhj75pk7-guile-2.0.13 | xargs tar cf ~/guile.tar
>
> I scp to ppc machine, untar, and guile works:
>
> ppc$ /gnu/store/g4q5kgrl8qigzaqlhhg2jjnmzhj75pk7-guile-2.0.13/bin/guile --version
> guile (GNU Guile) 2.0.13
> Copyright (C) 2016 Free Software Foundation, Inc.

Awesome, thanks for checking!

Ludo’.