bug#63666: sporadic “guix substitute: error: connect*: Connection timed out”

bug#63666: sporadic “guix substitute: error: connect*: Connection timed out”

[Simon Tournier]

Hi,

On different machines (laptop, desktop, workstation) using different
networks, running different revisions of Guix, I often see this sort of
message (here bash-static and aspell-dict-fr are examples, I see that
for various others):

--8<---------------cut here---------------start------------->8---
 bash-static-5.1.16  701KiB                                                409KiB/s 00:00 ▕█▋                ▏   9.1%guix substitute: warning: while fetching https://ci.guix.gnu.org/nar/lzip/s3lfskbxkq65f4zf0iair8yz3s7nskml-aspell-dict-fr-0.50-3: server is somewhat slow
guix substitute: warning: try `--no-substitutes' if the problem persists
guix substitute: error: connect*: Connection timed out
--8<---------------cut here---------------end--------------->8---

And I have not noticed if it’s always about the same compression (lzip).

The most recent failure uses 3f59fd6 (pulled on May 23) with:

        $ /root/.config/guix/current/bin/guix-daemon --version
        guix-daemon (GNU Guix) 1.3.0-31.3170843

Well, if that’s because guix-daemon is too old, maybe we could provide a
more meaningful message.

Sometimes, I even get:

--8<---------------cut here---------------start------------->8---
substitute: updating substitutes from 'https://ci.guix.gnu.org'...   0.0%guix substitute: warning: ci.guix.gnu.org: connection failed: Connection timed out
--8<---------------cut here---------------end--------------->8---


Cheers,
simon

bug#63666: sporadic “guix substitute: error: connect*: Connection timed out”

[Simon Tournier]

Hi,

On Tue, 23 May 2023 at 17:14, Simon Tournier <zimon.toutoune@gmail.com> wrote:

> The most recent failure uses 3f59fd6 (pulled on May 23) with:
>
>         $ /root/.config/guix/current/bin/guix-daemon --version
>         guix-daemon (GNU Guix) 1.3.0-31.3170843

Just in case, using recent guix-daemon as 3f59fd6, I see:

--8<---------------cut here---------------start------------->8---
 gumbo-parser-0.10.1  149KiB                                                                                                                                                                       555KiB/s 00:00 ▕██████████████████▏ 100.0%
 cups-minimal-2.4.2  4.9MiB                                                                                                                                                                        533KiB/s 00:03 ▕█████▎            ▏  29.2%guix substitute: warning: while fetching https://ci.guix.gnu.org/nar/lzip/mcdi162f45smrgvjmm3vldx2i1xhz0x5-iso-codes-4.5.0: server is somewhat slow
guix substitute: warning: try `--no-substitutes' if the problem persists
retrying download of '/gnu/store/mcdi162f45smrgvjmm3vldx2i1xhz0x5-iso-codes-4.5.0' with other substitute URLs...
--8<---------------cut here---------------end--------------->8---

And I do not know which other substitute URLs are since I pass the
option ’--substitute-urls=https://ci.guix.gnu.org’; both to guix-daemon
and to “guix shell”.

Last, I start to see the progress bar, then something happens and I only
see this:

--8<---------------cut here---------------start------------->8---
substitution of /gnu/store/6r4brvchlkbbqx2n2iz2p6i2ki78zfp2-kexec-tools-2.0.23 complete

substitution of /gnu/store/rfx142plc19c12mcfk86a8ff0c7bpch0-lame-3.100 complete

substitution of /gnu/store/65rbvsb9fyx74ff1sjnar1bp8qif7k07-libaacs-0.11.0 complete
--8<---------------cut here---------------end--------------->8---

No more progress bars.


Cheers,
simon

bug#63666: sporadic “guix substitute: error: connect*: Connection timed out”

[Ludovic Courtès]

Hi,

Simon Tournier <zimon.toutoune@gmail.com> skribis:

> On Tue, 23 May 2023 at 17:14, Simon Tournier <zimon.toutoune@gmail.com> wrote:
>
>> The most recent failure uses 3f59fd6 (pulled on May 23) with:
>>
>>         $ /root/.config/guix/current/bin/guix-daemon --version
>>         guix-daemon (GNU Guix) 1.3.0-31.3170843
>
> Just in case, using recent guix-daemon as 3f59fd6, I see:
>
>  gumbo-parser-0.10.1  149KiB                                                                                                                                                                       555KiB/s 00:00 ▕██████████████████▏ 100.0%
>  cups-minimal-2.4.2  4.9MiB                                                                                                                                                                        533KiB/s 00:03 ▕█████▎            ▏  29.2%guix substitute: warning: while fetching https://ci.guix.gnu.org/nar/lzip/mcdi162f45smrgvjmm3vldx2i1xhz0x5-iso-codes-4.5.0: server is somewhat slow
> guix substitute: warning: try `--no-substitutes' if the problem persists
> retrying download of '/gnu/store/mcdi162f45smrgvjmm3vldx2i1xhz0x5-iso-codes-4.5.0' with other substitute URLs...

Good, that’s the expected behavior.  (Of course that may still fail if
there are no other valid substitute URLs.)

> And I do not know which other substitute URLs are since I pass the
> option ’--substitute-urls=https://ci.guix.gnu.org’; both to guix-daemon
> and to “guix shell”.
>
> Last, I start to see the progress bar, then something happens and I only
> see this:
>
> substitution of /gnu/store/6r4brvchlkbbqx2n2iz2p6i2ki78zfp2-kexec-tools-2.0.23 complete
>
> substitution of /gnu/store/rfx142plc19c12mcfk86a8ff0c7bpch0-lame-3.100 complete
>
> substitution of /gnu/store/65rbvsb9fyx74ff1sjnar1bp8qif7k07-libaacs-0.11.0 complete
>
> No more progress bars.

That’s because you have max-jobs > 1: progress bars aren’t displayed
when several jobs are running in parallel.

Thanks for testing!

Ludo’.

bug#63666: sporadic “guix substitute: error: connect*: Connection timed out”

[Simon Tournier]

Hi,

On mer., 24 mai 2023 at 17:01, Ludovic Courtès <ludo@gnu.org> wrote:

>>  gumbo-parser-0.10.1  149KiB                                                                                                                                                                       555KiB/s 00:00 ▕██████████████████▏ 100.0%
>>  cups-minimal-2.4.2  4.9MiB                                                                                                                                                                        533KiB/s 00:03 ▕█████▎            ▏  29.2%guix substitute: warning: while fetching https://ci.guix.gnu.org/nar/lzip/mcdi162f45smrgvjmm3vldx2i1xhz0x5-iso-codes-4.5.0: server is somewhat slow
>> guix substitute: warning: try `--no-substitutes' if the problem persists
>> retrying download of '/gnu/store/mcdi162f45smrgvjmm3vldx2i1xhz0x5-iso-codes-4.5.0' with other substitute URLs...
>
> Good, that’s the expected behavior.  (Of course that may still fail if
> there are no other valid substitute URLs.)

Well, I do not have other substitutes and sometimes it displays this
message but it does not fail.  Does it retry?


>> And I do not know which other substitute URLs are since I pass the
>> option ’--substitute-urls=https://ci.guix.gnu.org’; both to guix-daemon
>> and to “guix shell”.
>>
>> Last, I start to see the progress bar, then something happens and I only
>> see this:
>>
>> substitution of /gnu/store/6r4brvchlkbbqx2n2iz2p6i2ki78zfp2-kexec-tools-2.0.23 complete
>>
>> substitution of /gnu/store/rfx142plc19c12mcfk86a8ff0c7bpch0-lame-3.100 complete
>>
>> substitution of /gnu/store/65rbvsb9fyx74ff1sjnar1bp8qif7k07-libaacs-0.11.0 complete
>>
>> No more progress bars.
>
> That’s because you have max-jobs > 1: progress bars aren’t displayed
> when several jobs are running in parallel.

Well, I only see this “substitution of …” message when before the
progress bar is broken by a warning.  Then I do not see again any
progress bar.


Cheers,
simon

bug#63666: sporadic “guix substitute: error: connect*: Connection timed out”

[Ludovic Courtès]

Simon Tournier <zimon.toutoune@gmail.com> skribis:

> On mer., 24 mai 2023 at 17:01, Ludovic Courtès <ludo@gnu.org> wrote:
>
>>>  gumbo-parser-0.10.1  149KiB                                                                                                                                                                       555KiB/s 00:00 ▕██████████████████▏ 100.0%
>>>  cups-minimal-2.4.2  4.9MiB                                                                                                                                                                        533KiB/s 00:03 ▕█████▎            ▏  29.2%guix substitute: warning: while fetching https://ci.guix.gnu.org/nar/lzip/mcdi162f45smrgvjmm3vldx2i1xhz0x5-iso-codes-4.5.0: server is somewhat slow
>>> guix substitute: warning: try `--no-substitutes' if the problem persists
>>> retrying download of '/gnu/store/mcdi162f45smrgvjmm3vldx2i1xhz0x5-iso-codes-4.5.0' with other substitute URLs...
>>
>> Good, that’s the expected behavior.  (Of course that may still fail if
>> there are no other valid substitute URLs.)
>
> Well, I do not have other substitutes and sometimes it displays this
> message but it does not fail.  Does it retry?

The warning is just that: a warning.  It’s telling you that the thing is
slow.

In the case above, on top of being slow, something went wrong, which is
why it tried again with another URL.

>>> No more progress bars.
>>
>> That’s because you have max-jobs > 1: progress bars aren’t displayed
>> when several jobs are running in parallel.
>
> Well, I only see this “substitution of …” message when before the
> progress bar is broken by a warning.  Then I do not see again any
> progress bar.

Hmm interesting.  I wouldn’t think the progress bar can be “broken” by
the warning, but maybe there’s something fishy going on that leads (guix
status) to think one of the substitution jobs never finished, which is
why it falls back to no-progress-bar behavior.

Thanks,
Ludo’.