bug#56005: exception while downloading substitutes

bug#56005: exception while downloading substitutes

[Thiago Jung Bauermann via Bug reports for GNU Guix]

Hello,

I just ran “guix pull && guix package -u” and after downloading many
substitutes, guix package aborted with the following error:

--8<---------------cut here---------------start------------->8---
    ⋮
substitute: atualizando substitutos de "https://ci.guix.gnu.org"...   0.0%Backtrace:
substitute:           14 (primitive-load "/gnu/store/yxh9kr0150494jf8phrf1x28mhw…")
substitute: In guix/ui.scm:
substitute:    2230:7 13 (run-guix . _)
substitute:   2193:10 12 (run-guix-command _ . _)
substitute: In ice-9/boot-9.scm:
substitute:   1752:10 11 (with-exception-handler _ _ #:unwind? _ # _)
substitute:   1752:10 10 (with-exception-handler _ _ #:unwind? _ # _)
substitute: In guix/scripts/substitute.scm:
substitute:    757:18  9 (_)
substitute:    348:26  8 (process-query #<output: file 4> _ #:cache-urls _ #:acl _)
substitute: In guix/substitutes.scm:
substitute:    365:27  7 (lookup-narinfos/diverse _ _ #<procedure 7f22cf4534a0 …> …)
substitute:    322:31  6 (lookup-narinfos "https://ci.guix.gnu.org" _ # _ # _)
substitute:    245:26  5 (fetch-narinfos _ _ #:open-connection _ # _)
substitute: In ice-9/boot-9.scm:
substitute:   1685:16  4 (raise-exception _ #:continuable? _)
substitute:   1685:16  3 (raise-exception _ #:continuable? _)
substitute:   1780:13  2 (_ #<&compound-exception components: (#<&error> #<&orig…>)
substitute:   1685:16  1 (raise-exception _ #:continuable? _)
substitute:   1685:16  0 (raise-exception _ #:continuable? _)
substitute:
substitute: ice-9/boot-9.scm:1685:16: In procedure raise-exception:
substitute: In procedure write_wait_fd: unimplemented
guix package: erro: `/gnu/store/yxh9kr0150494jf8phrf1x28mhwnnv7f-guix-command substitute' died unexpectedly
popigai: (1) guix describe
Geração 144     15 jun 2022 22:55:58    (atual)
  guix 128697d
    URL do repositório: https://git.savannah.gnu.org/git/guix.git
    ramo: master
    commit: 128697d43c21eb229ff5413f1c4cf79ae1a9dcd4
--8<---------------cut here---------------end--------------->8---

I immediately ran “guix package -u” again, and this time the command
completed successfully.

I had a quick look at ‘fetch-narinfos’ but I couldn't figure out what
could be calling into this unimplemented function ‘write_wait_fd’…

-- 
Thanks
Thiago

bug#56005: "write_wait_fd: unimplemented" during downloading substitutes

[Maxime Devos]

[-- Attachment #1: Type: text/plain, Size: 682 bytes --]

retitle 56006 "write_wait_fd: unimplemented" during downloading substitutes
thanks

Thiago Jung Bauermann via Bug reports for GNU Guix schreef op wo 15-06-
2022 om 23:40 [-0300]:
> I had a quick look at ‘fetch-narinfos’ but I couldn't figure out what
> could be calling into this unimplemented function ‘write_wait_fd’…

Untested hypothesis: maybe writing to the TLS-wrapped port constructed
in (guix build download) blocked, so Guile's port code ran
'write_wait_fd', which was not set for the TLS port (in the GnuTLS
library)?  Alternatively: maybe 'make-custom-binary-input/output-port'
in (guix build download) was used incorrectly?

Greetings,
Maxime.

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

bug#56005: In procedure write_wait_fd: unimplemented

[Attila Lendvai]

i'm also seeing this every once in a while.

some speculation: my router has QoS set up that limits the upstream, so that i avoid triggering my ISP's rate limiter, because it sends ping into the ballpark of seconds.

maybe because of this config i'm seeing this more regularly than others?

- attila

bug#56005: during substitution: write_wait_fd: unimplemented

[Maxime Devos]

[-- Attachment #1: Type: text/plain, Size: 588 bytes --]

> substitute:    348:26  8 (process-query #<output: file 4> _ #:cache
urls _ #:acl _)
> substitute: In guix/substitutes.scm:
> substitute:    365:27  7 (lookup-narinfos/diverse _ _ #<procedure
7f22cf4534a0 …> …)
> substitute:    322:31  6 (lookup-narinfos "https://ci.guix.gnu.org" _
# _ # _)
> substitute:    245:26  5 (fetch-narinfos _ _ #:open-connection _ # _)

For extra debugging information, you could try adding "COLUMNS=999999" to
the environment variables with which the guix daemon is started (where
exactly, depends on the init system).

Greetings,
Maxime.

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

bug#56005: during substitution: write_wait_fd: unimplemented

[Maxime Devos]

[-- Attachment #1: Type: text/plain, Size: 1166 bytes --]

Maxime Devos schreef op do 30-06-2022 om 13:51 [+0200]:
> > substitute:    348:26  8 (process-query #<output: file 4> _ #:cache
> urls _ #:acl _)
> > substitute: In guix/substitutes.scm:
> > substitute:    365:27  7 (lookup-narinfos/diverse _ _ #<procedure
> 7f22cf4534a0 …> …)
> > substitute:    322:31  6 (lookup-narinfos "https://ci.guix.gnu.org"
> > _
> # _ # _)
> > substitute:    245:26  5 (fetch-narinfos _ _ #:open-connection _ #

This is at  the following ...

substitute:    348:26  8 (process-query #<output: file 4> _ #:cache-
urls _ #:acl _)
substitute: In guix/substitutes.scm:
substitute:    365:27  7 (lookup-narinfos/diverse _ _ #<procedure
7f22cf4534a0 …> …)
substitute:    322:31  6 (lookup-narinfos "https://ci.guix.gnu.org" _ #
_ # _)
substitute:    245:26  5 (fetch-narinfos _ _ #:open-connection _ # _)

line.  Looks like the error wasn't actually handled.  The reason that
the backtrace was truncated, is that 'catch' was used instead of
'with-exception-handler' + #:unwind? #true.  So to investigate the
error, it might be good to adjust 'call-with-connection-error-handling'
first.

Greetings,
Maxime.

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

bug#56005: during substitution: write_wait_fd: unimplemented

[Maxime Devos]

[-- Attachment #1: Type: text/plain, Size: 208 bytes --]

Maxime Devos schreef op do 30-06-2022 om 13:55 [+0200]:
> 
> the backtrace was truncated, is that 'catch' was used instead of
> 'with-exception-handler' + #:unwind? #true

Correction: #:unwind? #false.

[-- Attachment #2: This is a digitally signed message part --]
[-- Type: application/pgp-signature, Size: 260 bytes --]

bug#56005: during substitution: write_wait_fd: unimplemented

[Thiago Jung Bauermann via Bug reports for GNU Guix]

Hello,

This bug was closed, but I couldn't find what was the resolution of the
problem. Could someone please clarify, for my own education and also so
that it gets documented in the bug report?

-- 
Thanks
Thiago

bug#56005: during substitution: write_wait_fd: unimplemented

[Maxime Devos]

[-- Attachment #1.1.1: Type: text/plain, Size: 608 bytes --]

reopen 56005
thanks

(not sure if this works because I haven't set up plain-text instead of 
HTML yet ...)


On 16-07-2022 05:34, Thiago Jung Bauermann wrote:

> Hello,
>
> This bug was closed, but I couldn't find what was the resolution of the
> problem. Could someone please clarify, for my own education and also so
> that it gets documented in the bug report?

No reason was given at all for closing (normally it says "solved in 
commit ..." or "cannot reproduce" or such ...) , so I'd assume that the 
wrong bug number was targetted? Tentatively reopening ...

Greetings,
Maxime.


[-- Attachment #1.1.2: OpenPGP public key --]
[-- Type: application/pgp-keys, Size: 929 bytes --]

[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 236 bytes --]

bug#56005:

[Nathan Dehnel]

Can we please do a workaround for this until it is fixed? I can't
leave my machines while they're updating and have to keep babying
them, which is a massive waste of my time.

Specific suggestion, this flag:
--fallback         fall back to building when the substituter fails
This "unimplemented" error is a substituter failure, so if it fails it
should fall back to building the package, no? Instead the entire
command fails and the upgrade is aborted.