python-minimal compilation is breaking

python-minimal compilation is breaking

[znavko]

[-- Attachment #1: Type: text/plain, Size: 809 bytes --]

Hello, Guix Help!
This is not working on Lenovo G50-30 everytime (already 3 times)

# guix system reconfigure /etc/config.scm --substitute-urls=https://berlin.guixsd.org <https://berlin.guixsd.org>
building /gnu/store/6c4g38n9fhvnlk2vasn34mdd6nvpgx8m-python-minimal-3.6.5.drv...
-Killed

While it is working:

$ free -m
              total        used        free      shared  buff/cache   available
Mem:           1882         777         322          72         782        1031
Swap:          2168         143        2024


I think it lacks resources: cpu 2.1GHz, RAM 2 Gb. When it crashes PC stops on 15-20 seconds, mouse does not move, and then process is killed.
What to try?


[-- Attachment #2: Type: text/html, Size: 1503 bytes --]

Re: python-minimal compilation is breaking

[Gábor Boskovits]

Hello Znavko,

<znavko@tutanota.com> ezt írta (időpont: 2018. nov. 1., Cs, 5:18):
>
> Hello, Guix Help!
> This is not working on Lenovo G50-30 everytime (already 3 times)
>
> # guix system reconfigure /etc/config.scm --substitute-urls=https://berlin.guixsd.org
> building /gnu/store/6c4g38n9fhvnlk2vasn34mdd6nvpgx8m-python-minimal-3.6.5.drv...
> -Killed
>
> While it is working:
>
> $ free -m
>               total        used        free      shared  buff/cache   available
> Mem:           1882         777         322          72         782        1031
> Swap:          2168         143        2024
>
>
> I think it lacks resources: cpu 2.1GHz, RAM 2 Gb. When it crashes PC stops on 15-20 seconds, mouse does not move, and then process is killed.
> What to try?
>

I can see two ways forward:
either wait for the substitutes any try again
or throw more resources at it: You can try to add additional swap. It
might be very slow, but I guess if the resource limit is the issue,
you can get on with it.

Does that make sense?

Best regards,
g_bor

bug#33248: python-minimal compilation is breaking

[znavko]

[-- Attachment #1: Type: text/plain, Size: 946 bytes --]

I am watching this bug on Lenovo G50-30 (CPU 2.1 GHz, 2Gb Ram):

# guix pull  --substitute-urls=https://berlin.guixsd.org <https://berlin.guixsd.org>
Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.org/git/guix.git' <https://git.savannah.gnu.org/git/guix.git'>...
Building from this channel:
  guix      https://git.savannah.gnu.org/git/guix.git <https://git.savannah.gnu.org/git/guix.git>    3995e85
Computing Guix derivation for 'x86_64-linux'... \
nothing to be done

# guix package  --substitute-urls=https://berlin.guixsd.org <https://berlin.guixsd.org> -u
substitute: updating substitutes from 'https://berlin.guixsd.org <https://berlin.guixsd.org>'... 100.0%
substitute: updating substitutes from 'https://berlin.guixsd.org <https://berlin.guixsd.org>'... 100.0%
building /gnu/store/6c4g38n9fhvnlk2vasn34mdd6nvpgx8m-python-minimal-3.6.5.drv...
/Killed
#

Python-minimal cannot compile.

[-- Attachment #2: Type: text/html, Size: 1514 bytes --]

bug#33248: python-minimal compilation is breaking

[Gábor Boskovits]

[-- Attachment #1: Type: text/plain, Size: 945 bytes --]

<znavko@tutanota.com> ezt írta (időpont: 2018. nov. 3., Szo 7:13):

> I am watching this bug on Lenovo G50-30 (CPU 2.1 GHz, 2Gb Ram):
>
> # guix pull  --substitute-urls=https://berlin.guixsd.org
> Updating channel 'guix' from Git repository at '
> https://git.savannah.gnu.org/git/guix.git'...
> Building from this channel:
>   guix      https://git.savannah.gnu.org/git/guix.git    3995e85
> Computing Guix derivation for 'x86_64-linux'... \
> nothing to be done
>
> # guix package  --substitute-urls=https://berlin.guixsd.org -u
> substitute: updating substitutes from 'https://berlin.guixsd.org'...
> 100.0%
> substitute: updating substitutes from 'https://berlin.guixsd.org'...
> 100.0%
> building
> /gnu/store/6c4g38n9fhvnlk2vasn34mdd6nvpgx8m-python-minimal-3.6.5.drv...
> /Killed
> #
>
> Python-minimal cannot compile.
>

Most probably you are hitting a resource limit, I guess ram. Do you have
any swap?

>

[-- Attachment #2: Type: text/html, Size: 2090 bytes --]

bug#33248: python-minimal compilation is breaking

[znavko]

[-- Attachment #1: Type: text/plain, Size: 2171 bytes --]

I have 2GB Swap space
$  swapon --summary
Filename                Type        Size    Used    Priority
/dev/sda2                                  partition    2220500    182784    -2

Will adding swap be enough? How much and how to add?

# fdisk -l /dev/sda
Disk /dev/sda: 111.8 GiB, 120034123776 bytes, 234441648 sectors
Units: sectors of 1 * 512 = 512 bytes
Sector size (logical/physical): 512 bytes / 512 bytes
I/O size (minimum/optimal): 512 bytes / 512 bytes
Disklabel type: dos
Disk identifier: 0x4cc7fbcb

Device     Boot     Start       End   Sectors   Size Id Type
/dev/sda1            2048 230000000 229997953 109.7G 83 Linux
/dev/sda2       230000640 234441647   4441008   2.1G 82 Linux swap / Solaris



3. Nov 2018 11:49 by boskovits@gmail.com <mailto:boskovits@gmail.com>:


>
>
>  <> znavko@tutanota.com <mailto:znavko@tutanota.com>> > ezt írta (időpont: 2018. nov. 3., Szo 7:13):
>
>>           >> I am watching this bug on Lenovo G50-30 (CPU 2.1 GHz, 2Gb Ram):
>>
>> # guix pull  --substitute-urls=>> https://berlin.guixsd.org <https://berlin.guixsd.org>
>> Updating channel 'guix' from Git repository at '>> https://git.savannah.gnu.org/git/guix.git' <https://git.savannah.gnu.org/git/guix.git'>>> ...
>> Building from this channel:
>>   guix      >> https://git.savannah.gnu.org/git/guix.git <https://git.savannah.gnu.org/git/guix.git>>>     3995e85
>> Computing Guix derivation for 'x86_64-linux'... \
>> nothing to be done
>>
>> # guix package  --substitute-urls=>> https://berlin.guixsd.org <https://berlin.guixsd.org>>>  -u
>> substitute: updating substitutes from '>> https://berlin.guixsd.org <https://berlin.guixsd.org>>> '... 100.0%
>> substitute: updating substitutes from '>> https://berlin.guixsd.org <https://berlin.guixsd.org>>> '... 100.0%
>> building /gnu/store/6c4g38n9fhvnlk2vasn34mdd6nvpgx8m-python-minimal-3.6.5.drv...
>> /Killed
>> #
>>
>> Python-minimal cannot compile.
>>
>
> Most probably you are hitting a resource limit, I guess ram. Do you have any swap?
>>   

[-- Attachment #2: Type: text/html, Size: 3814 bytes --]

bug#33248: python-minimal compilation is breaking

[Julien Lepiller]

It seems there is a bug in one test on recent kernels that exhaust memory. Python-minimal is available on berlin though, I wonder why it's not downloaded. Did you authorize berlin?

Le 3 novembre 2018 09:49:04 GMT+01:00, "Gábor Boskovits" <boskovits@gmail.com> a écrit :
><znavko@tutanota.com> ezt írta (időpont: 2018. nov. 3., Szo 7:13):
>
>> I am watching this bug on Lenovo G50-30 (CPU 2.1 GHz, 2Gb Ram):
>>
>> # guix pull  --substitute-urls=https://berlin.guixsd.org
>> Updating channel 'guix' from Git repository at '
>> https://git.savannah.gnu.org/git/guix.git'...
>> Building from this channel:
>>   guix      https://git.savannah.gnu.org/git/guix.git    3995e85
>> Computing Guix derivation for 'x86_64-linux'... \
>> nothing to be done
>>
>> # guix package  --substitute-urls=https://berlin.guixsd.org -u
>> substitute: updating substitutes from 'https://berlin.guixsd.org'...
>> 100.0%
>> substitute: updating substitutes from 'https://berlin.guixsd.org'...
>> 100.0%
>> building
>>
>/gnu/store/6c4g38n9fhvnlk2vasn34mdd6nvpgx8m-python-minimal-3.6.5.drv...
>> /Killed
>> #
>>
>> Python-minimal cannot compile.
>>
>
>Most probably you are hitting a resource limit, I guess ram. Do you
>have
>any swap?
>
>>

bug#33248: python-minimal compilation is breaking

[Christopher Baines]

[-- Attachment #1: Type: text/plain, Size: 1290 bytes --]


Gábor Boskovits <boskovits@gmail.com> writes:

> <znavko@tutanota.com> ezt írta (időpont: 2018. nov. 3., Szo 7:13):
>
>> I am watching this bug on Lenovo G50-30 (CPU 2.1 GHz, 2Gb Ram):
>>
>> # guix pull  --substitute-urls=https://berlin.guixsd.org
>> Updating channel 'guix' from Git repository at '
>> https://git.savannah.gnu.org/git/guix.git'...
>> Building from this channel:
>>   guix      https://git.savannah.gnu.org/git/guix.git    3995e85
>> Computing Guix derivation for 'x86_64-linux'... \
>> nothing to be done
>>
>> # guix package  --substitute-urls=https://berlin.guixsd.org -u
>> substitute: updating substitutes from 'https://berlin.guixsd.org'...
>> 100.0%
>> substitute: updating substitutes from 'https://berlin.guixsd.org'...
>> 100.0%
>> building
>> /gnu/store/6c4g38n9fhvnlk2vasn34mdd6nvpgx8m-python-minimal-3.6.5.drv...
>> /Killed
>> #
>>
>> Python-minimal cannot compile.
>>
>
> Most probably you are hitting a resource limit, I guess ram. Do you have
> any swap?

I think I've hit the same problem, I tried with 32GB of RAM, along with
60GB of swap, and it still didn't work.

There is a bug here describing it as a memory link [1], which is a
better theory I think.

1: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=33213

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 962 bytes --]

bug#33248: python-minimal compilation is breaking

[znavko]

[-- Attachment #1: Type: text/plain, Size: 2234 bytes --]

Sorry, I do not authorize in berlin, cause I have read only one line here http://mirror.hydra.gnu.org <http://mirror.hydra.gnu.org/> and just changed url in --substitute-urls option to berlin. 

How to prevent test_socket running?  Can we use own scm ?
Does guix put cache files somewhere and I can modify them? 
Need more graphical info about guix functions. This might be helpful for me to find solutions while server maintenance, guix daemons' week-end.


3. Nov 2018 12:09 by mail@cbaines.net <mailto:mail@cbaines.net>:


>
> Gábor Boskovits <> boskovits@gmail.com <mailto:boskovits@gmail.com>> > writes:
>
>> <>> znavko@tutanota.com <mailto:znavko@tutanota.com>>> > ezt írta (időpont: 2018. nov. 3., Szo 7:13):
>>
>>> I am watching this bug on Lenovo G50-30 (CPU 2.1 GHz, 2Gb Ram):
>>>
>>> # guix pull  --substitute-urls=>>> https://berlin.guixsd.org <https://berlin.guixsd.org>
>>> Updating channel 'guix' from Git repository at '
>>> https://git.savannah.gnu.org/git/guix.git' <https://git.savannah.gnu.org/git/guix.git'>>>> ...
>>> Building from this channel:
>>>   guix      >>> https://git.savannah.gnu.org/git/guix.git <https://git.savannah.gnu.org/git/guix.git>>>>     3995e85
>>> Computing Guix derivation for 'x86_64-linux'... \
>>> nothing to be done
>>>
>>> # guix package  --substitute-urls=>>> https://berlin.guixsd.org <https://berlin.guixsd.org>>>>  -u
>>> substitute: updating substitutes from '>>> https://berlin.guixsd.org <https://berlin.guixsd.org>>>> '...
>>> 100.0%
>>> substitute: updating substitutes from '>>> https://berlin.guixsd.org <https://berlin.guixsd.org>>>> '...
>>> 100.0%
>>> building
>>> /gnu/store/6c4g38n9fhvnlk2vasn34mdd6nvpgx8m-python-minimal-3.6.5.drv...
>>> /Killed
>>> #
>>>
>>> Python-minimal cannot compile.
>>>
>>
>> Most probably you are hitting a resource limit, I guess ram. Do you have
>> any swap?
>
> I think I've hit the same problem, I tried with 32GB of RAM, along with
> 60GB of swap, and it still didn't work.
>
> There is a bug here describing it as a memory link [1], which is a
> better theory I think.
>
> 1: > https://debbugs.gnu.org/cgi/bugreport.cgi?bug=33213 <https://debbugs.gnu.org/cgi/bugreport.cgi?bug=33213>

[-- Attachment #2: Type: text/html, Size: 3156 bytes --]

bug#33248: python-minimal compilation is breaking

[Ludovic Courtès]

Hello,

<znavko@tutanota.com> skribis:

> Sorry, I do not authorize in berlin, cause I have read only one line here http://mirror.hydra.gnu.org <http://mirror.hydra.gnu.org/> and just changed url in --substitute-urls option to berlin. 

Please see
<https://www.gnu.org/software/guix/manual/en/html_node/Substitute-Server-Authorization.html>
on how to authorize substitutes from berlin.guixsd.org.

HTH,
Ludo’.

bug#33248: python-minimal compilation is breaking

[George Clemmer]

Hello,

Christopher Baines <mail@cbaines.net> writes:

>> Most probably you are hitting a resource limit, I guess ram. Do you have
>> any swap?
>
> I think I've hit the same problem, I tried with 32GB of RAM, along with
> 60GB of swap, and it still didn't work.
>
> There is a bug here describing it as a memory link [1], which is a
> better theory I think.
>
> 1: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=33213

Agreed. I had the same problem building ...

/gnu/store/phy1nbsmlml06lkjixjw2dfb4k6wi5al-python-3.6.5.drv...

... where I normally don't and I could see the build leaking [1]

- George

[1] http://lists.gnu.org/archive/html/bug-guix/2018-11/msg00001.html

Re: python-minimal compilation is breaking

[Eric Bavier]

[-- Attachment #1: Type: text/plain, Size: 1096 bytes --]

On Thu, 1 Nov 2018 05:18:00 +0100 (CET)
<znavko@tutanota.com> wrote:

> Hello, Guix Help!
> This is not working on Lenovo G50-30 everytime (already 3 times)
> 
> # guix system reconfigure /etc/config.scm --substitute-urls=https://berlin.guixsd.org <https://berlin.guixsd.org>
> building /gnu/store/6c4g38n9fhvnlk2vasn34mdd6nvpgx8m-python-minimal-3.6.5.drv...
> -Killed
> 
> While it is working:
> 
> $ free -m
>               total        used        free      shared  buff/cache   available
> Mem:           1882         777         322          72         782        1031
> Swap:          2168         143        2024
> 
> 
> I think it lacks resources: cpu 2.1GHz, RAM 2 Gb. When it crashes PC stops on 15-20 seconds, mouse does not move, and then process is killed.
> What to try?
> 

I submitted this patch that I created while struggling with the same
package: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=33284

Perhaps it might help you too?

`~Eric

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: python-minimal compilation is breaking

[Mathieu Othacehe]

[-- Attachment #1: Type: text/plain, Size: 1542 bytes --]

Hi,

I ran into the same problem on a very powerful machine. In my case the
congestion test was the problem. It finished by eating all of my 128Gb of
RAM.

This problem is known and fixed upstream by disabling the test. I submitted
a patch to disable it on our 3.6.5 version, but it will have to go to
core-updates if merged.

https://debbugs.gnu.org/cgi/bugreport.cgi?bug=33186#26

Thanks,

Mathieu

Le mar. 6 nov. 2018 11:30, Eric Bavier <ericbavier@centurylink.net> a
écrit :

> On Thu, 1 Nov 2018 05:18:00 +0100 (CET)
> <znavko@tutanota.com> wrote:
>
> > Hello, Guix Help!
> > This is not working on Lenovo G50-30 everytime (already 3 times)
> >
> > # guix system reconfigure /etc/config.scm --substitute-urls=
> https://berlin.guixsd.org <https://berlin.guixsd.org>
> > building
> /gnu/store/6c4g38n9fhvnlk2vasn34mdd6nvpgx8m-python-minimal-3.6.5.drv...
> > -Killed
> >
> > While it is working:
> >
> > $ free -m
> >               total        used        free      shared  buff/cache
> available
> > Mem:           1882         777         322          72
> 782        1031
> > Swap:          2168         143        2024
> >
> >
> > I think it lacks resources: cpu 2.1GHz, RAM 2 Gb. When it crashes PC
> stops on 15-20 seconds, mouse does not move, and then process is killed.
> > What to try?
> >
>
> I submitted this patch that I created while struggling with the same
> package: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=33284
>
> Perhaps it might help you too?
>
> `~Eric
>

[-- Attachment #2: Type: text/html, Size: 2815 bytes --]

bug#33248: python-minimal compilation is breaking

[Maxim Cournoyer]

Hi,

Christopher Baines <mail@cbaines.net> writes:

> Gábor Boskovits <boskovits@gmail.com> writes:
>
>> <znavko@tutanota.com> ezt írta (időpont: 2018. nov. 3., Szo 7:13):
>>
>>> I am watching this bug on Lenovo G50-30 (CPU 2.1 GHz, 2Gb Ram):
>>>
>>> # guix pull  --substitute-urls=https://berlin.guixsd.org
>>> Updating channel 'guix' from Git repository at '
>>> https://git.savannah.gnu.org/git/guix.git'...
>>> Building from this channel:
>>>   guix      https://git.savannah.gnu.org/git/guix.git    3995e85
>>> Computing Guix derivation for 'x86_64-linux'... \
>>> nothing to be done
>>>
>>> # guix package  --substitute-urls=https://berlin.guixsd.org -u
>>> substitute: updating substitutes from 'https://berlin.guixsd.org'...
>>> 100.0%
>>> substitute: updating substitutes from 'https://berlin.guixsd.org'...
>>> 100.0%
>>> building
>>> /gnu/store/6c4g38n9fhvnlk2vasn34mdd6nvpgx8m-python-minimal-3.6.5.drv...
>>> /Killed
>>> #
>>>
>>> Python-minimal cannot compile.
>>>
>>
>> Most probably you are hitting a resource limit, I guess ram. Do you have
>> any swap?
>
> I think I've hit the same problem, I tried with 32GB of RAM, along with
> 60GB of swap, and it still didn't work.
>
> There is a bug here describing it as a memory link [1], which is a
> better theory I think.
>
> 1: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=33213

Yes, it probably was related to this bug.  This test has been disabled
for some time already.

Closing.

Thanks for the report!

Maxim