Rust = bust?

Rust = bust?

[swedebugia]

Hi

I'm eager to begin building grin which relies on rust 1.34+ but I get 
this from a guix checkout compiled yesterday:

The following derivations would be built:
    /gnu/store/9d9r8c70yz329gl01ywgvf4gql9ir31f-grin-1.1.0.drv
    /gnu/store/hgpjq9f5z6rpmidsij7nrp20ad38vg98-rust-1.35.0.drv
    /gnu/store/1lmw4151bbz6b0scd2gvxsgh0ad25vwb-rust-1.34.1.drv
    /gnu/store/cssgpdzm63zd8vdxr9pkhmplr5c0wglr-rust-1.33.0.drv
    /gnu/store/ivkmn1gisdz3xys6gdmncr1vfpwp1a0v-rust-1.32.0.drv
    /gnu/store/11b81ijyi1wnp41wgyqjwgxvg28hk4hg-rust-1.31.1.drv
    /gnu/store/1yis5vsvqpf0gaynnfqpnin45yp3cw4l-rust-1.30.1.drv

This has not changed for days/a week.

When investigation on the CI I find that rust above 1.30 have not build 
on master for x86-64 since april.

http://ci.guix.gnu.org/search?query=rust-1.30
->
http://ci.guix.gnu.org/build/1303680/details "dependency failed"

What does that mean?

What is going on?

Also could somebody tell me how to shut off the tests if I choose to 
build them myself?
-- 
Cheers Swedebugia

Re: Rust = bust?

[John Soo]

Hi Swedebugia,

Hmm maybe the simplest workaround for a temporary hack would be to add #:tests #f to the arguments of the affected rust package definitions while you work on grin.  It will be great when rust substitutes are reliably available...

- John

> On Jun 30, 2019, at 12:12 PM, swedebugia <swedebugia@riseup.net> wrote:
> 
> Hi
> 
> I'm eager to begin building grin which relies on rust 1.34+ but I get this from a guix checkout compiled yesterday:
> 
> The following derivations would be built:
>   /gnu/store/9d9r8c70yz329gl01ywgvf4gql9ir31f-grin-1.1.0.drv
>   /gnu/store/hgpjq9f5z6rpmidsij7nrp20ad38vg98-rust-1.35.0.drv
>   /gnu/store/1lmw4151bbz6b0scd2gvxsgh0ad25vwb-rust-1.34.1.drv
>   /gnu/store/cssgpdzm63zd8vdxr9pkhmplr5c0wglr-rust-1.33.0.drv
>   /gnu/store/ivkmn1gisdz3xys6gdmncr1vfpwp1a0v-rust-1.32.0.drv
>   /gnu/store/11b81ijyi1wnp41wgyqjwgxvg28hk4hg-rust-1.31.1.drv
>   /gnu/store/1yis5vsvqpf0gaynnfqpnin45yp3cw4l-rust-1.30.1.drv
> 
> This has not changed for days/a week.
> 
> When investigation on the CI I find that rust above 1.30 have not build on master for x86-64 since april.
> 
> http://ci.guix.gnu.org/search?query=rust-1.30
> ->
> http://ci.guix.gnu.org/build/1303680/details "dependency failed"
> 
> What does that mean?
> 
> What is going on?
> 
> Also could somebody tell me how to shut off the tests if I choose to build them myself?
> -- 
> Cheers Swedebugia
> 

Re: Rust = bust?

[swedebugia]

On 2019-06-30 21:12, swedebugia wrote:
> Hi
> 
> I'm eager to begin building grin which relies on rust 1.34+ but I get 
> this from a guix checkout compiled yesterday:
> 
> The following derivations would be built:
>     /gnu/store/9d9r8c70yz329gl01ywgvf4gql9ir31f-grin-1.1.0.drv
>     /gnu/store/hgpjq9f5z6rpmidsij7nrp20ad38vg98-rust-1.35.0.drv
>     /gnu/store/1lmw4151bbz6b0scd2gvxsgh0ad25vwb-rust-1.34.1.drv
>     /gnu/store/cssgpdzm63zd8vdxr9pkhmplr5c0wglr-rust-1.33.0.drv
>     /gnu/store/ivkmn1gisdz3xys6gdmncr1vfpwp1a0v-rust-1.32.0.drv
>     /gnu/store/11b81ijyi1wnp41wgyqjwgxvg28hk4hg-rust-1.31.1.drv
>     /gnu/store/1yis5vsvqpf0gaynnfqpnin45yp3cw4l-rust-1.30.1.drv
> 
> This has not changed for days/a week.
> 
> When investigation on the CI I find that rust above 1.30 have not build 
> on master for x86-64 since april.
> 
> http://ci.guix.gnu.org/search?query=rust-1.30
> ->
> http://ci.guix.gnu.org/build/1303680/details "dependency failed"
> 
> What does that mean?
> 
> What is going on?
> 
> Also could somebody tell me how to shut off the tests if I choose to 
> build them myself?

Investigating further I found this:
http://ci.guix.gnu.org/build/1303679/details

Build marked failed 11 may but the log says:
"Rust is ready to roll." and "@ build-succeeded 
/gnu/store/2za0a3v7p8dbmnf64cb5agjs09cmns15-rust-1.24.1.drv -"

ERROR in our CI?

This "failed" build of course causes the rest of the toolchain to fail 
with "dependency failed" but that seems to be incorrect.

(rust-0.23 http://ci.guix.gnu.org/search?query=rust-1.23 succeded 11 may 
and was correctly marked as such :) )

Anyone capable of helping out?

-- 
Cheers Swedebugia

Re: Rust = bust?

[Ivan Petkov]

Hi swedebugia,

Rust 1.30 was recently broken I believe when gdb was upgraded. I’ve pushed out a fix,
so rust 1.30 and anything else should build successfully. Unfortunately there are no substitutes
for this currently (the CI keeps showing jobs in progress and failing after a day, maybe the
build nodes are all busy building the staging updates?)

—Ivan

Re: Rust = bust?

[Tobias Geerinckx-Rice]

[-- Attachment #1: Type: text/plain, Size: 1717 bytes --]

Swedebugia,

swedebugia wrote:
> http://ci.guix.gnu.org/search?query=rust-1.30
> ->
> http://ci.guix.gnu.org/build/1303680/details "dependency failed"
>
> What does that mean?
>
> What is going on?

That a package (well, derivation) upon which rust@1.30.1 depends 
failed to build.

I'm almost certain that Cuirass doesn't currently track dependency 
information the way it eventually should, which would mean there's 
no way to find out *which* dependency failed.  The only way to 
find out would be build rust@1.30.1 yourself and see what fails 
before you get to it.  If you do get to it, you managed to build 
something that ci.guix didn't and you should feel proud.

I logged into my substitute server to find out more, but:

  athena.tobias.gr ~ λ guix describe
  Generation 109  Jun 30 2019 21:11:58    (current)
    guix a3d1a34
      repository URL: https://git.savannah.gnu.org/git/guix.git
      branch: master
      commit: a3d1a3487a34820d2a0b3d5e6206e4df1c77c15c
  athena.tobias.gr ~ λ guix build rust@1.30.1
  […]
  /gnu/store/p20fkgdlqqw4dlfqg8jximqg6qpcz7a1-rust-1.30.1

Looks like I already built the entire rust chain successfully. (?)

You're welcome to give my substitute server at https://guix.<my 
domain name> a try (more info at that URL).  I'd be interested in 
both success and failure.  :-)

> Also could somebody tell me how to shut off the tests if I 
> choose to
> build them myself?

Edit the package definition to add ‘#:tests? #f’ to the arguments 
field.  This will change the derivation and all that depend on it 
(so you won't get substitutes for anything that depends on your 
untested rust fork).

Kind regards,

T G-R

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 227 bytes --]

Re: Rust = bust?

[swedebugia]

Hi

On 2019-06-30 21:27, Ivan Petkov wrote:
> Hi swedebugia,
> 
> Rust 1.30 was recently broken I believe when gdb was upgraded. I’ve pushed out a fix,

Nice.

> so rust 1.30 and anything else should build successfully. Unfortunately there are no substitutes
> for this currently (the CI keeps showing jobs in progress and failing after a day, maybe the
> build nodes are all busy building the staging updates?)

As I detailed above the problem now seems to be below 1.30 as I detailed 
in my email. Rust-1.24 seems to be the bottleneck (since 11 may) if I 
understood it correctly.

-- 
Cheers Swedebugia

Re: Rust = bust?

[swedebugia]

On 2019-06-30 21:32, Tobias Geerinckx-Rice wrote:
> Swedebugia,
> 
> swedebugia wrote:
>> http://ci.guix.gnu.org/search?query=rust-1.30
>> ->
>> http://ci.guix.gnu.org/build/1303680/details "dependency failed"
>>
>> What does that mean?
>>
>> What is going on?
> 
> That a package (well, derivation) upon which rust@1.30.1 depends failed 
> to build.
> 
> I'm almost certain that Cuirass doesn't currently track dependency 
> information the way it eventually should, which would mean there's no 
> way to find out *which* dependency failed.  The only way to find out 
> would be build rust@1.30.1 yourself and see what fails before you get to 
> it.  If you do get to it, you managed to build something that ci.guix 
> didn't and you should feel proud.
> 
> I logged into my substitute server to find out more, but:
> 
>   athena.tobias.gr ~ λ guix describe
>   Generation 109  Jun 30 2019 21:11:58    (current)
>     guix a3d1a34
>       repository URL: https://git.savannah.gnu.org/git/guix.git
>       branch: master
>       commit: a3d1a3487a34820d2a0b3d5e6206e4df1c77c15c
>   athena.tobias.gr ~ λ guix build rust@1.30.1
>   […]
>   /gnu/store/p20fkgdlqqw4dlfqg8jximqg6qpcz7a1-rust-1.30.1
> 
> Looks like I already built the entire rust chain successfully. (?)
> 
> You're welcome to give my substitute server at https://guix.<my domain 
> name> a try (more info at that URL).  I'd be interested in both success 
> and failure.  :-)

Nice, what a gift!

> 
>> Also could somebody tell me how to shut off the tests if I choose to
>> build them myself?
> 
> Edit the package definition to add ‘#:tests? #f’ to the arguments 
> field.  This will change the derivation and all that depend on it (so 
> you won't get substitutes for anything that depends on your untested 
> rust fork).

Yeah, thats the downside.

-- 
Cheers Swedebugia

Re: Rust = bust?

[swedebugia]

On 2019-06-30 21:35, swedebugia wrote:

>> I logged into my substitute server to find out more, but:
>>
>>   athena.tobias.gr ~ λ guix describe
>>   Generation 109  Jun 30 2019 21:11:58    (current)
>>     guix a3d1a34
>>       repository URL: https://git.savannah.gnu.org/git/guix.git
>>       branch: master
>>       commit: a3d1a3487a34820d2a0b3d5e6206e4df1c77c15c
>>   athena.tobias.gr ~ λ guix build rust@1.30.1
>>   […]
>>   /gnu/store/p20fkgdlqqw4dlfqg8jximqg6qpcz7a1-rust-1.30.1
>>
>> Looks like I already built the entire rust chain successfully. (?)
>>
>> You're welcome to give my substitute server at https://guix.<my domain 
>> name> a try (more info at that URL).  I'd be interested in both 
>> success and failure.  :-)
> 
> Nice, what a gift!

Authorized your key and ran:
$ ./pre-inst-env guix build -K grin -c 1 -n 
--substitute-urls="https://ci.guix.gnu.org https://guix.tobias.gr"

substitute: updating substitutes from 'https://guix.tobias.gr'... 100.0%
The following derivations would be built:
    /gnu/store/9d9r8c70yz329gl01ywgvf4gql9ir31f-grin-1.1.0.drv
    /gnu/store/hgpjq9f5z6rpmidsij7nrp20ad38vg98-rust-1.35.0.drv
    /gnu/store/1lmw4151bbz6b0scd2gvxsgh0ad25vwb-rust-1.34.1.drv
    /gnu/store/cssgpdzm63zd8vdxr9pkhmplr5c0wglr-rust-1.33.0.drv
    /gnu/store/ivkmn1gisdz3xys6gdmncr1vfpwp1a0v-rust-1.32.0.drv
    /gnu/store/11b81ijyi1wnp41wgyqjwgxvg28hk4hg-rust-1.31.1.drv
    /gnu/store/1yis5vsvqpf0gaynnfqpnin45yp3cw4l-rust-1.30.1.drv
147.4 MB would be downloaded:
    /gnu/store/0bqbl8jpirdi4g84hylcxj6i500mr93b-rustc-1.32.0-src.tar.xz
    /gnu/store/k8i6bf0c5dzm34dnfx7qq7wq5hgccfnz-rustc-1.31.1-src.tar.xz
    /gnu/store/3hfni09gy7d7n0gnc12s7zfa0lr7c0ff-rustc-1.33.0-src.tar.xz
    /gnu/store/zamc7lhcsjn0hkfs93796xgpbmkccfam-rustc-1.34.1-src.tar.xz

Hm. Then I did a git pull && make and got

The following derivation would be built:
    /gnu/store/f19xi2dy52ajyylikzvm1ks2mhkdj0j4-grin-1.1.0.drv
The following files would be downloaded:
    /gnu/store/s89kb99c07wvyxjcq3rc6aap8rkcfwqx-rust-1.35.0-cargo
    /gnu/store/2dc71v5jlbd6rpz7qx04iyzwl7kcqrjm-rust-1.35.0

Hooray! Thanks a lot.

-- 
Cheers Swedebugia

Re: Rust = bust?

[John Soo]

Fortunately, I think rust tests are the longest build phase for rust. So I think even a rebuild of all dependents won’t take more than a few hours without tests.

Hope rust is taken care of soon!

- John

> On Jun 30, 2019, at 12:35 PM, swedebugia <swedebugia@riseup.net> wrote:
> 
>> On 2019-06-30 21:32, Tobias Geerinckx-Rice wrote:
>> Swedebugia,
>> swedebugia wrote:
>>> http://ci.guix.gnu.org/search?query=rust-1.30
>>> ->
>>> http://ci.guix.gnu.org/build/1303680/details "dependency failed"
>>> 
>>> What does that mean?
>>> 
>>> What is going on?
>> That a package (well, derivation) upon which rust@1.30.1 depends failed to build.
>> I'm almost certain that Cuirass doesn't currently track dependency information the way it eventually should, which would mean there's no way to find out *which* dependency failed.  The only way to find out would be build rust@1.30.1 yourself and see what fails before you get to it.  If you do get to it, you managed to build something that ci.guix didn't and you should feel proud.
>> I logged into my substitute server to find out more, but:
>>  athena.tobias.gr ~ λ guix describe
>>  Generation 109  Jun 30 2019 21:11:58    (current)
>>    guix a3d1a34
>>      repository URL: https://git.savannah.gnu.org/git/guix.git
>>      branch: master
>>      commit: a3d1a3487a34820d2a0b3d5e6206e4df1c77c15c
>>  athena.tobias.gr ~ λ guix build rust@1.30.1
>>  […]
>>  /gnu/store/p20fkgdlqqw4dlfqg8jximqg6qpcz7a1-rust-1.30.1
>> Looks like I already built the entire rust chain successfully. (?)
>> You're welcome to give my substitute server at https://guix.<my domain name> a try (more info at that URL).  I'd be interested in both success and failure.  :-)
> 
> Nice, what a gift!
> 
>>> Also could somebody tell me how to shut off the tests if I choose to
>>> build them myself?
>> Edit the package definition to add ‘#:tests? #f’ to the arguments field.  This will change the derivation and all that depend on it (so you won't get substitutes for anything that depends on your untested rust fork).
> 
> Yeah, thats the downside.
> 
> -- 
> Cheers Swedebugia
> 

Re: Rust = bust?

[Tobias Geerinckx-Rice]

[-- Attachment #1: Type: text/plain, Size: 264 bytes --]

Swedebugia,

swedebugia wrote:
> The following files would be downloaded:

\o/

> Hooray! Thanks a lot.

You're very welcome.

Let's hope ci.guix (I must say, ‘Hydra’ rolled off the tongue a 
lot easier) catches up soon.

Kind regards,

T G-R

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 227 bytes --]