unofficial mirror of guix-devel@gnu.org 
 help / color / mirror / code / Atom feed
* Numpy failures
@ 2015-02-07 16:41 Andreas Enge
  2015-02-09  8:30 ` Federico Beffa
  0 siblings, 1 reply; 6+ messages in thread
From: Andreas Enge @ 2015-02-07 16:41 UTC (permalink / raw)
  To: bug-guix, guix-devel

python-numpy-bootstrap currently fails its tests on hydra, which entails a
bunch of other failures. On my own x86_64 machines, the build succeeds,
however.

Andreas

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: Numpy failures
@ 2015-02-09  8:30 ` Federico Beffa
  2015-02-09 23:07   ` bug#19805: " Ludovic Courtès
  0 siblings, 1 reply; 6+ messages in thread
From: Federico Beffa @ 2015-02-09  8:30 UTC (permalink / raw)
  To: Andreas Enge; +Cc: Guix-devel, bug-guix

Andreas Enge <andreas@enge.fr> writes:

> python-numpy-bootstrap currently fails its tests on hydra, which entails a
> bunch of other failures. On my own x86_64 machines, the build succeeds,
> however.

We believe the reason being the fact that hydra doesn't handle the flag
'#:substitutable?' properly. As a result we have the following
situation:

1. hydra builds a version of ATLAS optimized for its CPU locally.

2. 'python-numpy-bootstrap' and co., on some architectures, probably get
an incompatible version of ATLAS and therefore fail to pass some tests.

You can check in the build log of 'python-numpy-bootstrap' that ATLAS,
despite the flas, is substituted (no local build on the slave).

At some point we should fix the support for '#:substitutable?' on hydra
(or the upcoming 'guix publish').

Regards,
Fede

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: bug#19805: Numpy failures
  2015-02-09  8:30 ` Federico Beffa
@ 2015-02-09 23:07   ` Ludovic Courtès
  2015-02-10 13:20     ` Federico Beffa
  2015-02-10 13:52     ` Mark H Weaver
  0 siblings, 2 replies; 6+ messages in thread
From: Ludovic Courtès @ 2015-02-09 23:07 UTC (permalink / raw)
  To: Federico Beffa; +Cc: guix-devel, 19805

Federico Beffa <beffa@ieee.org> skribis:

> Andreas Enge <andreas@enge.fr> writes:
>
>> python-numpy-bootstrap currently fails its tests on hydra, which entails a
>> bunch of other failures. On my own x86_64 machines, the build succeeds,
>> however.
>
> We believe the reason being the fact that hydra doesn't handle the flag
> '#:substitutable?' properly. As a result we have the following
> situation:
>
> 1. hydra builds a version of ATLAS optimized for its CPU locally.
>
> 2. 'python-numpy-bootstrap' and co., on some architectures, probably get
> an incompatible version of ATLAS and therefore fail to pass some tests.
>
> You can check in the build log of 'python-numpy-bootstrap' that ATLAS,
> despite the flas, is substituted (no local build on the slave).

Oh.  Actually, slaves do not use substitutes at all, but they receive
missing store items from hydra.gnu.org when builds are offloaded.  So I
suppose they receive something built on hydra.gnu.org, which may be
incompatible.

> At some point we should fix the support for '#:substitutable?' on hydra

That probably means that #:substitutable? should be propagated–i.e.,
that anything depending on ATLAS should not be substituted.

Thanks for investigating!

Ludo’.

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: bug#19805: Numpy failures
  2015-02-09 23:07   ` bug#19805: " Ludovic Courtès
@ 2015-02-10 13:20     ` Federico Beffa
  2015-02-10 13:52     ` Mark H Weaver
  1 sibling, 0 replies; 6+ messages in thread
From: Federico Beffa @ 2015-02-10 13:20 UTC (permalink / raw)
  To: Ludovic Courtès; +Cc: Guix-devel, 19805

On Tue, Feb 10, 2015 at 12:07 AM, Ludovic Courtès <ludo@gnu.org> wrote:
>> At some point we should fix the support for '#:substitutable?' on hydra
>
> That probably means that #:substitutable? should be propagated–i.e.,
> that anything depending on ATLAS should not be substituted.

I guess so. Is there a way to specify this in a package or does it
require changes to the guix code?

Regards,
Fede

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: bug#19805: Numpy failures
  2015-02-09 23:07   ` bug#19805: " Ludovic Courtès
  2015-02-10 13:20     ` Federico Beffa
@ 2015-02-10 13:52     ` Mark H Weaver
  2015-02-10 14:41       ` Ludovic Courtès
  1 sibling, 1 reply; 6+ messages in thread
From: Mark H Weaver @ 2015-02-10 13:52 UTC (permalink / raw)
  To: Ludovic Courtès; +Cc: guix-devel, 19805, Federico Beffa

ludo@gnu.org (Ludovic Courtès) writes:

> Federico Beffa <beffa@ieee.org> skribis:
>
>> At some point we should fix the support for '#:substitutable?' on hydra
>
> That probably means that #:substitutable? should be propagated–i.e.,
> that anything depending on ATLAS should not be substituted.

As I just wrote in the "texlive failure" thread, setting
#:substitutable? #f might make sense for texlive.  However, in that case
we certainly would not want to propagate that setting.

So, instead of propagating it, how about simply arranging to not send
such packages to the build slaves, instead forcing them to build it
locally on their own?

I suppose this would cause the texlive build log to be prepended to some
other build log, which is not so good, but that could also be dealt with
in various ways, e.g. by changing the "send dependency to slave" logic
for non-substitutable packages to build the package on that particular
slave.

What do you think?

      Mark

^ permalink raw reply	[flat|nested] 6+ messages in thread

* Re: bug#19805: Numpy failures
  2015-02-10 13:52     ` Mark H Weaver
@ 2015-02-10 14:41       ` Ludovic Courtès
  0 siblings, 0 replies; 6+ messages in thread
From: Ludovic Courtès @ 2015-02-10 14:41 UTC (permalink / raw)
  To: Mark H Weaver; +Cc: guix-devel, 19805, Federico Beffa

Mark H Weaver <mhw@netris.org> skribis:

> ludo@gnu.org (Ludovic Courtès) writes:
>
>> Federico Beffa <beffa@ieee.org> skribis:
>>
>>> At some point we should fix the support for '#:substitutable?' on hydra
>>
>> That probably means that #:substitutable? should be propagated–i.e.,
>> that anything depending on ATLAS should not be substituted.
>
> As I just wrote in the "texlive failure" thread, setting
> #:substitutable? #f might make sense for texlive.  However, in that case
> we certainly would not want to propagate that setting.
>
> So, instead of propagating it, how about simply arranging to not send
> such packages to the build slaves, instead forcing them to build it
> locally on their own?

I think there are two properties of interest: “substitutability”, and
“offloadability”.

What do we want for ATLAS, for NumPy, and for TeX Live?

However, note that we can’t currently distinguish between these two
properties: <http://bugs.gnu.org/18747>.

Thanks,
Ludo’.

^ permalink raw reply	[flat|nested] 6+ messages in thread

end of thread, other threads:[~2015-02-10 14:41 UTC | newest]

Thread overview: 6+ messages (download: mbox.gz follow: Atom feed
-- links below jump to the message on this page --
2015-02-07 16:41 Numpy failures Andreas Enge
2015-02-09  8:30 ` Federico Beffa
2015-02-09 23:07   ` bug#19805: " Ludovic Courtès
2015-02-10 13:20     ` Federico Beffa
2015-02-10 13:52     ` Mark H Weaver
2015-02-10 14:41       ` Ludovic Courtès

Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/guix.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).