bug#42569: 'No such file or directory builder' error while building with qemu-binfmt and --system=aarch64-linux

bug#42569: 'No such file or directory builder' error while building with qemu-binfmt and --system=aarch64-linux

[Maxim Cournoyer]

Hello!

I just encountered the following error while trying to build on master
(commit 2bd84c50ff7a8dafe83b6aa89cd0f01d5282c621) with:

--8<---------------cut here---------------start------------->8---
./pre-inst-env guix build --system=aarch64-linux lib2geom

The following derivation will be built:
   /gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv
building /gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv...
while setting up the build environment: executing `/gnu/store/x3gq648qnfnla7nppyfjvj62s2i8y7rl-guile-3.0.2/bin/guile': No such file or directory
builder for `/gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv' failed with exit code 1
build of /gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv failed
View build log at '/var/log/guix/drvs/vs/11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv.bz2'.
guix build: error: build of
   `/gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv' failed
--8<---------------cut here---------------end--------------->8---

The build log doesn't contain any more than the above no such file or
directory error. Retrying the same commands leads to the same error
message.

The build machine is an offload Guix System machine running the
qemu-binfmt service.

The output directory,
/gnu/store/3c0ihmfpazx3hkwyq3k0w8cdfi5ijdg4-lib2geom-1.0-1.42e119d
doesn't exist yet, but I guess that's normal.

A previous error (with the same message) when attempting to build
plotutils led me to find out that the
/gnu/store/2hibdxsj9f0zx3zilwh8phk1knk6y2fl-plotutils-2.6.tar.xz-builder
file referred to in its
/gnu/store/qcilzch61vsm9y4c3k4vbrl89g0fn8a3-plotutils-2.6.tar.xz.drv
derivation did not exist, but retrying the build succeeded.

Marius suggested restarting the guix-daemon, but it didn't resolve the
issue after running it both locally and on the remote offload machine.

A workaround was to 'guix copy /gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv' then
run 'guix build
/gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv'
on that remote machine.

Maxim

bug#42569: 'No such file or directory builder' error while building with qemu-binfmt and --system=aarch64-linux

[Maxim Cournoyer]

Hello again,

Maxim Cournoyer <maxim.cournoyer@gmail.com> writes:

[...]

> Marius suggested restarting the guix-daemon, but it didn't resolve the
> issue after running it both locally and on the remote offload machine.

Restarting the 'qemu-binfmt' service *locally* (not on the remote
offload machine) did work around the issue though.

Maxim

bug#42569: 'No such file or directory builder' error while building with qemu-binfmt and --system=aarch64-linux

[Maxim Cournoyer]

Maxim Cournoyer <maxim.cournoyer@gmail.com> writes:

> Hello!
>
> I just encountered the following error while trying to build on master
> (commit 2bd84c50ff7a8dafe83b6aa89cd0f01d5282c621) with:
>
> ./pre-inst-env guix build --system=aarch64-linux lib2geom
>

[...]

> The build machine is an offload Guix System machine running the
> qemu-binfmt service.

Apologies, no it wasn't!  None of the entries in /etc/guix/machines.scm
for my offload machine had 'aarch64-linux' defined for the system field.
I mistakenly thought the builds were being offloded but now I'm sure
they were occurring locally.

> The output directory,
> /gnu/store/3c0ihmfpazx3hkwyq3k0w8cdfi5ijdg4-lib2geom-1.0-1.42e119d
> doesn't exist yet, but I guess that's normal.
>
> A previous error (with the same message) when attempting to build
> plotutils led me to find out that the
> /gnu/store/2hibdxsj9f0zx3zilwh8phk1knk6y2fl-plotutils-2.6.tar.xz-builder
> file referred to in its
> /gnu/store/qcilzch61vsm9y4c3k4vbrl89g0fn8a3-plotutils-2.6.tar.xz.drv
> derivation did not exist, but retrying the build succeeded.

I mistakenly thought that build was occurring on my remote offload, but
there's no way it was.  So please ignore the my reports of nonexistent
files.

bug#42569: 'No such file or directory builder' error while building with qemu-binfmt and --system=aarch64-linux

[Mathieu Othacehe]

Hello Maxim,

> The following derivation will be built:
>    /gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv
> building /gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv...
> while setting up the build environment: executing `/gnu/store/x3gq648qnfnla7nppyfjvj62s2i8y7rl-guile-3.0.2/bin/guile': No such file or directory
> builder for `/gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv' failed with exit code 1
> build of /gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv failed
> View build log at '/var/log/guix/drvs/vs/11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv.bz2'.
> guix build: error: build of
>    `/gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv' failed

This reminds me an issue I had running qemu-binfmt based builds on a
foreign distribution. From what I understand you are offloading builds
to a Guix System machine, but is the machine displaying the above
message also running Guix System?

If that's not the case, there are some tricks to make it run, that I'm
supposed to document, see:
https://lists.gnu.org/archive/html/guix-devel/2019-11/msg00423.html.

Thanks,

Mathieu

bug#42569: 'No such file or directory builder' error while building with qemu-binfmt and --system=aarch64-linux

[Maxim Cournoyer]

Hello Mathieu!

Mathieu Othacehe <othacehe@gnu.org> writes:

> Hello Maxim,
>
>> The following derivation will be built:
>>    /gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv
>> building /gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv...
>> while setting up the build environment: executing
>> `/gnu/store/x3gq648qnfnla7nppyfjvj62s2i8y7rl-guile-3.0.2/bin/guile':
>> No such file or directory
>> builder for `/gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv' failed with exit code 1
>> build of /gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv failed
>> View build log at '/var/log/guix/drvs/vs/11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv.bz2'.
>> guix build: error: build of
>>    `/gnu/store/vs11h35gq7fi90bm0h4ygi7ak4ihkck8-lib2geom-1.0-1.42e119d.drv' failed

> This reminds me an issue I had running qemu-binfmt based builds on a
> foreign distribution. From what I understand you are offloading builds
> to a Guix System machine, but is the machine displaying the above
> message also running Guix System?

I thought I was offloading, but as I wrote in a follow-up message, there
was no offloading involved and the problem was strictly local
(restarting the local qemu-binfmt service fixed it).

> If that's not the case, there are some tricks to make it run, that I'm
> supposed to document, see:
> https://lists.gnu.org/archive/html/guix-devel/2019-11/msg00423.html.

Interesting :-). I pondered about such feasibility in the past, good to
know that it *can* work (with some fiddling :-). I think it'd be neat to
have this documented.

Thank you!

Maxim