Unable to Install Rust 1.20.0 and Beyond

Unable to Install Rust 1.20.0 and Beyond

[Brian Woodcox]

Hi all,

I’m not able to install rust.  Initially, I was having problems with 1.19.0 because of memory issues.  I fixed that by increasing the memory and now 1.19.0 is installed.

Now that I have lots of memory 16GB, and lots of hard disk space, I cannot get 1.20.0 to install.

I am installing it via:

guix package -i rust

It appears to be hung.

guixbui+ 10572  0.0  0.2 127308 38260 ?        Ssl  01:03   0:17 guile --no-auto-compile -L /gnu/store/27qw1zxljzylvm9b3jbi343gh6cngazq-module-import /gnu/store/iw20znxa586mkrv0156paq7z1ya9vcbq-rust-1.20.0-guile-builder

The cpu just sits at 0.0 for this process.  Normally it should be close to 100.

My var/log/guix/drvs/av/xcyxs39bdzs28kya500s4kpv0xvb9p-rust-1.20.0.drv.bz2 file has the following at the end:

test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1260) ... ignored                                                 test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1273) ... ok                                                      test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1306) ... ok                                                      test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1321) ... ok                                                      test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1338) ... ok                                                      test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1358) ... ok                                                      test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1409) ... ok                                                      test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1440) ... ok                                                      test /tmp/guix-build-rust-1.20.0.drv-0/rustc-

I have tried to install multiple times.

Any ideas?

Re: Unable to Install Rust 1.20.0 and Beyond

[Chris Marusich]

[-- Attachment #1: Type: text/plain, Size: 425 bytes --]

Brian Woodcox <bw@InSkyData.com> writes:

> I have tried to install multiple times.
>
> Any ideas?

How long did you wait before deciding that the process was hung?
Anecdotally, I think it took my laptop about 48 hours to install rust.
It needs to build a lot of rust compilers, and their tests (among other
things, maybe?) are slow:

https://www.gnu.org/software/guix/blog/2018/bootstrapping-rust/

-- 
Chris

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

Re: Unable to Install Rust 1.20.0 and Beyond

[Brian Woodcox]

[-- Attachment #1: Type: text/plain, Size: 755 bytes --]



> On Dec 20, 2018, at 3:10 AM, Chris Marusich <cmmarusich@gmail.com> wrote:
> 
> Brian Woodcox <bw@InSkyData.com> writes:
> 
>> I have tried to install multiple times.
>> 
>> Any ideas?
> 
> How long did you wait before deciding that the process was hung?
> Anecdotally, I think it took my laptop about 48 hours to install rust.
> It needs to build a lot of rust compilers, and their tests (among other
> things, maybe?) are slow:

I’m pretty sure it’s hung.  See attached screenshot.  Nothing has changed in this screen shot for more than a day.

You know if the progress cursor would at least move once, I would be happy.  But nothing.

> 
> https://www.gnu.org/software/guix/blog/2018/bootstrapping-rust/
> 
> -- 
> Chris

[-- Attachment #2.1: Type: text/html, Size: 1821 bytes --]

[-- Attachment #2.2: Screen Shot 2018-12-20 at 8.29.51 AM.png --]
[-- Type: image/png, Size: 102369 bytes --]

Re: Unable to Install Rust 1.20.0 and Beyond

[Mark H Weaver]

Hi Brian,

Brian Woodcox <bw@InSkyData.com> writes:

> I’m not able to install rust.  Initially, I was having problems with
> 1.19.0 because of memory issues.  I fixed that by increasing the
> memory and now 1.19.0 is installed.
>
> Now that I have lots of memory 16GB, and lots of hard disk space, I cannot get 1.20.0 to install.
>
> I am installing it via:
>
> guix package -i rust
>
> It appears to be hung.
>
> guixbui+ 10572 0.0 0.2 127308 38260 ?  Ssl 01:03 0:17 guile
> --no-auto-compile -L
> /gnu/store/27qw1zxljzylvm9b3jbi343gh6cngazq-module-import
> /gnu/store/iw20znxa586mkrv0156paq7z1ya9vcbq-rust-1.20.0-guile-builder
>
> The cpu just sits at 0.0 for this process.  Normally it should be close to 100.

FWIW, I've built rust-1.20.0 locally on my x86_64 GuixSD system several
times without running into this issue.  My system has only 4 GB of RAM
and 8 GB of swap.  On this system, I build everything locally.

Hydra.gnu.org, our older build farm, has not run into this issue while
building rust-1.20.0.  Binary substitutes for rust-1.20.0 are currently
available from hydra.gnu.org, so you should simply be able to download
them.

Are you attempting to perform these builds within a VM?  If so, are you
using QEMU, VirtualBox, or something else?

I'm reminded of another unusual build failure that you encountered in
'guile' when you were first experimenting with Guix, when hydra.gnu.org
was temporarily offline.  The failure was one that I'd not seen reported
before or since.  As I recall, in that case you were attempting the
build within VirtualBox.

With this in mind, I wonder if the virtualization is imperfect in some
way that the rust-1.20.0 test suite is sensitive to.

> My var/log/guix/drvs/av/xcyxs39bdzs28kya500s4kpv0xvb9p-rust-1.20.0.drv.bz2 file has the following at the end:
>
> test
> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
> - Standard_library_traits_used_for_error_handling (line 1260)
> ... ignored test
> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
> - Standard_library_traits_used_for_error_handling (line 1273) ... ok
> test
> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
> - Standard_library_traits_used_for_error_handling (line 1306) ... ok
> test
> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
> - Standard_library_traits_used_for_error_handling (line 1321) ... ok
> test
> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
> - Standard_library_traits_used_for_error_handling (line 1338) ... ok
> test
> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
> - Standard_library_traits_used_for_error_handling (line 1358) ... ok
> test
> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
> - Standard_library_traits_used_for_error_handling (line 1409) ... ok
> test
> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
> - Standard_library_traits_used_for_error_handling (line 1440) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-

FYI, here's the most recent build of rust-1.20.0 on x86_64 on
hydra.gnu.org:

  https://hydra.gnu.org/build/3218738

From there, you can retrieve the build log.  Here's an excerpt of the
rust-1.20.0 build log from my own local system, including the point
where your build gets stuck:

--8<---------------cut here---------------start------------->8---
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1321) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1338) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1358) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1409) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1440) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1466) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1500) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1514) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 132) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 148) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 173) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 197) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 232) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 266) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 283) ... ok
test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 300) ... ok
--8<---------------cut here---------------end--------------->8---

       Mark

Re: Unable to Install Rust 1.20.0 and Beyond

[Brian Woodcox]

Hi Mark,

I am marking this as *** RESOLVED ***.

Thanks for responding.  It got me thinking in a different direction.  I decided to delve into this problem by running the guix build command.

Turn out the failure was occurring during cargo tests.

Specifically:

...
  Running build/x86_64-unknown-linux-gnu/stage2-tools/x86_64-unknown-gnu/release/deps/jobserver-dd0c6bf78d70e32b

running 3 tests
test jobserver_and_j ... ok
test jobserver_exists ... test jobserver_exists has been running for over 60 seconds

At this point the system hangs forever.

After much internet searching without much for results, I decided on a hunch to increase the number of processors on my virtual machine from 1 to 2.

Tests now succeed!!  rustc is now installed.

Brian.

> On Dec 20, 2018, at 11:24 AM, Mark H Weaver <mhw@netris.org> wrote:
> 
> Hi Brian,
> 
> Brian Woodcox <bw@InSkyData.com> writes:
> 
>> I’m not able to install rust.  Initially, I was having problems with
>> 1.19.0 because of memory issues.  I fixed that by increasing the
>> memory and now 1.19.0 is installed.
>> 
>> Now that I have lots of memory 16GB, and lots of hard disk space, I cannot get 1.20.0 to install.
>> 
>> I am installing it via:
>> 
>> guix package -i rust
>> 
>> It appears to be hung.
>> 
>> guixbui+ 10572 0.0 0.2 127308 38260 ?  Ssl 01:03 0:17 guile
>> --no-auto-compile -L
>> /gnu/store/27qw1zxljzylvm9b3jbi343gh6cngazq-module-import
>> /gnu/store/iw20znxa586mkrv0156paq7z1ya9vcbq-rust-1.20.0-guile-builder
>> 
>> The cpu just sits at 0.0 for this process.  Normally it should be close to 100.
> 
> FWIW, I've built rust-1.20.0 locally on my x86_64 GuixSD system several
> times without running into this issue.  My system has only 4 GB of RAM
> and 8 GB of swap.  On this system, I build everything locally.
> 
> Hydra.gnu.org, our older build farm, has not run into this issue while
> building rust-1.20.0.  Binary substitutes for rust-1.20.0 are currently
> available from hydra.gnu.org, so you should simply be able to download
> them.
> 
I am able to install the binaries for these.

> Are you attempting to perform these builds within a VM?  If so, are you
> using QEMU, VirtualBox, or something else?

Yes, with VirtualBox.
> 
> I'm reminded of another unusual build failure that you encountered in
> 'guile' when you were first experimenting with Guix, when hydra.gnu.org
> was temporarily offline.  The failure was one that I'd not seen reported
> before or since.  As I recall, in that case you were attempting the
> build within VirtualBox.
> 
> With this in mind, I wonder if the virtualization is imperfect in some
> way that the rust-1.20.0 test suite is sensitive to.
> 
Yup, it’s imperfect with less than 2 processors in the virtual machine.

>> My var/log/guix/drvs/av/xcyxs39bdzs28kya500s4kpv0xvb9p-rust-1.20.0.drv.bz2 file has the following at the end:
>> 
>> test
>> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
>> - Standard_library_traits_used_for_error_handling (line 1260)
>> ... ignored test
>> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
>> - Standard_library_traits_used_for_error_handling (line 1273) ... ok
>> test
>> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
>> - Standard_library_traits_used_for_error_handling (line 1306) ... ok
>> test
>> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
>> - Standard_library_traits_used_for_error_handling (line 1321) ... ok
>> test
>> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
>> - Standard_library_traits_used_for_error_handling (line 1338) ... ok
>> test
>> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
>> - Standard_library_traits_used_for_error_handling (line 1358) ... ok
>> test
>> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
>> - Standard_library_traits_used_for_error_handling (line 1409) ... ok
>> test
>> /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md
>> - Standard_library_traits_used_for_error_handling (line 1440) ... ok
>> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-
> 
> FYI, here's the most recent build of rust-1.20.0 on x86_64 on
> hydra.gnu.org:
> 
>  https://hydra.gnu.org/build/3218738
> 
> From there, you can retrieve the build log.  Here's an excerpt of the
> rust-1.20.0 build log from my own local system, including the point
> where your build gets stuck:
> 
> --8<---------------cut here---------------start------------->8---
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1321) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1338) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1358) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1409) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1440) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1466) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1500) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - Standard_library_traits_used_for_error_handling (line 1514) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 132) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 148) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 173) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 197) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 232) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 266) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 283) ... ok
> test /tmp/guix-build-rust-1.20.0.drv-0/rustc-1.20.0-src/src/doc/book/first-edition/src/error-handling.md - The_Basics (line 300) ... ok
> --8<---------------cut here---------------end--------------->8---
> 
Thanks for pointing me to this.

>       Mark