guix package builds, subsitutes and --no-build

guix package builds, subsitutes and --no-build

[Giovanni Biscuolo]

[-- Attachment #1: Type: text/plain, Size: 3969 bytes --]

Hello,

I tried several times to install ungoogled-chromium with "guix package
-i ungoogled-chromium", and guix always starts building it

checking the weather of that package gives me this result:

--8<---------------cut here---------------start------------->8---
giovanni@anemone: guix weather --manifest=.ungoogled-chromium.manifest
computing 1 package derivations for x86_64-linux...
looking for 1 store items on https://ci.guix.info...
https://ci.guix.info
  100.0% substitutes available (1 out of 1)
  99.3 MiB of nars (compressed)
  288.3 MiB on disk (uncompressed)
  0.004 seconds per request (0.0 seconds in total)
  274.9 requests per second
Backtrace:
          13 (primitive-load "/home/giovanni/.config/guix/current/bi…")
In guix/ui.scm:
  1654:12 12 (run-guix-command _ . _)
In ice-9/boot-9.scm:
    829:9 11 (catch _ _ #<procedure 7fb8c13409b8 at guix/ui.scm:624…> …)
    829:9 10 (catch _ _ #<procedure 7fb8c13409d0 at guix/ui.scm:750…> …)
In guix/scripts/weather.scm:
    496:8  9 (_)
In srfi/srfi-1.scm:
    640:9  8 (for-each #<procedure 324a480 at guix/scripts/weather.…> …)
In guix/scripts/weather.scm:
   497:20  7 (_ "https://ci.guix.info")
In ice-9/boot-9.scm:
    829:9  6 (catch srfi-34 #<procedure 23f25c0 at guix/scripts/wea…> …)
In guix/scripts/weather.scm:
   211:23  5 (_)
In guix/ci.scm:
    96:15  4 (queued-builds _ _)
    82:15  3 (json-fetch _)
In guix/http-client.scm:
    88:25  2 (http-fetch _ #:port _ #:text? _ #:buffered? _ # _ # _ # …)
In guix/build/download.scm:
    413:4  1 (open-connection-for-uri _ #:timeout _ # _)
    313:6  0 (tls-wrap #<closed: file 2ff4310> _ # _)

guix/build/download.scm:313:6: In procedure tls-wrap:
X.509 certificate of 'ci.guix.info' could not be verified:
  signer-not-found
  invalid
--8<---------------cut here---------------end--------------->8---

with this manifest file:

--8<---------------cut here---------------start------------->8---
(specifications->manifest
 '("ungoogled-chromium"))
--8<---------------cut here---------------end--------------->8---

so 100% substitutes are available, but I get an error on X.509
ci.guix.info certificate verification: is this the reason for guix
starts building instead of downloading the substitute?

also, at 27% of the build process it fails with this message:

--8<---------------cut here---------------start------------->8---
building /gnu/store/4mvzzx2jmr4r4p2kx0hcvwr9s9lvx0gd-ungoogled-chromium-72.0.3626.109.drv...
 27% [##################################################                                                                                                                                         ]note: build failure may have been caused by lack of free disk space
builder for `/gnu/store/4mvzzx2jmr4r4p2kx0hcvwr9s9lvx0gd-ungoogled-chromium-72.0.3626.109.drv' failed with exit code 1
build of /gnu/store/4mvzzx2jmr4r4p2kx0hcvwr9s9lvx0gd-ungoogled-chromium-72.0.3626.109.drv failed
View build log at '/var/log/guix/drvs/4m/vzzx2jmr4r4p2kx0hcvwr9s9lvx0gd-ungoogled-chromium-72.0.3626.109.drv.bz2'.
guix package: error: build of `/gnu/store/4mvzzx2jmr4r4p2kx0hcvwr9s9lvx0gd-ungoogled-chromium-72.0.3626.109.drv' failed
--8<---------------cut here---------------end--------------->8---

and checking the build logs it's clear my problem is lack of space in /tmp

I created a dedicated folder in $HOME and tried using that as TMPDIR
with this command:

--8<---------------cut here---------------start------------->8---
env TMPDIR=/home/giovanni/.ungoogled-chromium-build guix package -i ungoogled-chromium
--8<---------------cut here---------------end--------------->8---

but no file gets unpacked there

please how can I set a different TMPDIR for the build process?

I'd prefer to avoid building, but it would be a nice exercise to
learn... :-)

thanks!
Giovanni

-- 
Giovanni Biscuolo

Xelera IT Infrastructures

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

Re: guix package builds, subsitutes and --no-build

[Leo Famulari]

[-- Attachment #1: Type: text/plain, Size: 1212 bytes --]

On Wed, Feb 20, 2019 at 05:39:29PM +0100, Giovanni Biscuolo wrote:
> Hello,
> 
> I tried several times to install ungoogled-chromium with "guix package
> -i ungoogled-chromium", and guix always starts building it

Okay, I'm not sure why but here are some suggestions:

Did you authorize substitutes for ci.guix.info?

https://www.gnu.org/software/guix/manual/en/html_node/Substitutes.html

> guix/build/download.scm:313:6: In procedure tls-wrap:
> X.509 certificate of 'ci.guix.info' could not be verified:
>   signer-not-found
>   invalid
> --8<---------------cut here---------------end--------------->8---

Also, did you set up X.509 certificates for use by Guix?

https://www.gnu.org/software/guix/manual/en/html_node/Application-Setup.html

> and checking the build logs it's clear my problem is lack of space in /tmp

Yes, I don't know off the top of my head how much space it needs but
since the source alone is several gigabytes I recommend 15 GB.

> please how can I set a different TMPDIR for the build process?

You need to set this variable in the context of the guix-daemon:

https://www.gnu.org/software/guix/manual/en/html_node/Invoking-guix_002ddaemon.html

HTH!

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Giovanni Biscuolo]

[-- Attachment #1: Type: text/plain, Size: 3588 bytes --]

Leo,

thanks for helping!

I'm also involving guix-devel since probably this issue must escalate
:-)

I think my specific problem is caused by the "Gateway Timeout" error
from ci.guix.info, see below for details

Leo Famulari <leo@famulari.name> writes:

[...]

> Did you authorize substitutes for ci.guix.info?
>
> https://www.gnu.org/software/guix/manual/en/html_node/Substitutes.html

not explicitly but my (user) guix accepts it by default, I was able to
install other packages with no problem, also tried again some minutes
ago and succeeded installing gnumeric

this also means that my problem installing ungoogled-chromium substitute
does not depend from my X.509 problem shown below (subsitutes are
installed via https://ci.guix.info and I'm able to install them)

still, if I try to install ungoogled-chromium on my machine, it starts
building:

--8<---------------cut here---------------start------------->8---
$ guix package -i ungoogled-chromium
substitute: updating substitutes from 'https://ci.guix.info'... 100.0%
building /gnu/store/4mvzzx2jmr4r4p2kx0hcvwr9s9lvx0gd-ungoogled-chromium-72.0.3626.109.drv...
| 'unpack' phase
--8<---------------cut here---------------end--------------->8---

now, guix weather tell me this:

--8<---------------cut here---------------start------------->8---
$ guix weather --manifest=.ungoogled-chromium.manifest
computing 1 package derivations for x86_64-linux...
looking for 1 store items on https://ci.guix.info...
https://ci.guix.info
  100.0% substitutes available (1 out of 1)
  99,3 MiB of nars (compressed)
  288,3 MiB on disk (uncompressed)
  0,004 seconds per request (0,0 seconds in total)
  262,4 requests per second
  'https://ci.guix.info/api/queue?nr=1000' returned 504 ("Gateway Time-out")
--8<---------------cut here---------------end--------------->8---

actually all https://ci.guix.info/ returns 504 "Gateway Time-out":
AFAIU this mean I'm not able to install that package (possibly others)
for some problem in the CDN

>> guix/build/download.scm:313:6: In procedure tls-wrap:
>> X.509 certificate of 'ci.guix.info' could not be verified:
>>   signer-not-found
>>   invalid
>> --8<---------------cut here---------------end--------------->8---
>
> Also, did you set up X.509 certificates for use by Guix?
>
> https://www.gnu.org/software/guix/manual/en/html_node/Application-Setup.html

ouch no :-S (I'm on foreign distro)

I've installed nss-certs (and configured my env) and now "guix weather"
does not report the above error

>> and checking the build logs it's clear my problem is lack of space in /tmp
>
> Yes, I don't know off the top of my head how much space it needs but
> since the source alone is several gigabytes I recommend 15 GB.

wow: I don't have so much space in /tmp so I have to find an alternative
:-) (i.e. grow my volume, LVM unfortunately [1])

>> please how can I set a different TMPDIR for the build process?
>
> You need to set this variable in the context of the guix-daemon:
>
> https://www.gnu.org/software/guix/manual/en/html_node/Invoking-guix_002ddaemon.html

the builder! guix-daemon is The Builder!

thanks Leo: I read that once in the manual but missed it yesterday when
I needed it :-S

in my case (I'm on Debian with systemd) I have to add an "Environment="
parameter in /etc/systemd/system/guix-daemon.service, reload the systemd
file and restart the service

kudos
Giovanni


[1] because LVM is still not fully supported by Guix

-- 
Giovanni Biscuolo

Xelera IT Infrastructures

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Ricardo Wurmus]

Hi Giovanni,

> I think my specific problem is caused by the "Gateway Timeout" error
> from ci.guix.info, see below for details

I cannot reproduce this.

-- 
Ricardo

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Mathieu Lirzin]

Hello,

Ricardo Wurmus <rekado@elephly.net> writes:

> Hi Giovanni,
>
>> I think my specific problem is caused by the "Gateway Timeout" error
>> from ci.guix.info, see below for details
>
> I cannot reproduce this.

I can reproduce here (on GuixSD) and like Giovanni I am unable to use
the substitutes for ‘ungoogled-chromium’.

--8<---------------cut here---------------start------------->8---
$ guix weather --manifest=foo.scm 
calcul de 1 dérivations de paquets pour x86_64-linux…
recherche de 1 éléments du dépôt sur https://ci.guix.info...
https://ci.guix.info
  100.0% substituts disponibles (1 sur 1)
  99,3 Mo de fichiers nar (compressés)
  288,3 Mo sur le disque (décompressé)
  0,003 secondes par requête (0,0 secondesen tout)
  358,9 requêtes par seconde
  « https://ci.guix.info/api/queue?nr=1000 » a renvoyé 504 ("Gateway Time-out")
$ guix package -i ungoogled-chromium
construction de /gnu/store/w54r150nj8ksyznj6b8q92fgr1n0l20h-ungoogled-chromium-72.0.3626.109.tar.xz.drv...
\  C-c C-c
--8<---------------cut here---------------end--------------->8---

-- 
Mathieu Lirzin
GPG: F2A3 8D7E EB2B 6640 5761  070D 0ADE E100 9460 4D37

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Giovanni Biscuolo]

[-- Attachment #1: Type: text/plain, Size: 2076 bytes --]

Hi Ricardo and Mathieu,

Mathieu Lirzin <mthl@gnu.org> writes:

> Ricardo Wurmus <rekado@elephly.net> writes:
>
>> Hi Giovanni,
>>
>>> I think my specific problem is caused by the "Gateway Timeout" error
>>> from ci.guix.info, see below for details
>>
>> I cannot reproduce this.

do you mean you are able to reach https://ci.guix.info/ without
problems?

> I can reproduce here (on GuixSD) and like Giovanni I am unable to use
> the substitutes for ‘ungoogled-chromium’.

here some detail about the connection from my network (Italy):

--8<---------------cut here---------------start------------->8---
giovanni@anemone: curl -I https://ci.guix.info/
HTTP/2 405 
server: nginx
date: Thu, 21 Feb 2019 16:51:48 GMT
x-cache: Error from cloudfront
via: 1.1 a6fa155499d42d80898e356700528797.cloudfront.net (CloudFront)
x-amz-cf-id: gx4DPKlmNJNqdVcpOWJTXgAXFpPleiZdxBz4HyYRuP-xzkZAKt7j4Q==
--8<---------------cut here---------------end--------------->8---

and from the network of one remote hosts in OVH (France):

--8<---------------cut here---------------start------------->8---
$ curl -I https://ci.guix.info/
HTTP/2 405 
server: nginx
date: Thu, 21 Feb 2019 16:53:33 GMT
x-cache: Error from cloudfront
via: 1.1 6cb5674c966cf185ca044933e4011460.cloudfront.net (CloudFront)
x-amz-cf-id: JXxc1CoqYXERBwRSu-TtvpzdgzbfJ5rBCFcJNrP779n4EG8l33VNFA==
--8<---------------cut here---------------end--------------->8---

and in Hetzner (Germany)

--8<---------------cut here---------------start------------->8---
$  curl -I https://ci.guix.info/
HTTP/2 405 
server: nginx
date: Thu, 21 Feb 2019 16:58:59 GMT
x-cache: Error from cloudfront
via: 1.1 6135f6c459dcfb7b39ddb7d01def7207.cloudfront.net (CloudFront)
x-amz-cf-id: OKRLI-rbcxr59M5HfO6eRiFHkGsFVcV8hbXiMEsmR1qZ70Pc5yrbVg==
--8<---------------cut here---------------end--------------->8---

it seems a problem affecting several geographical regions

if I can do some more testing please tell me!

Thanks!
Giovanni

-- 
Giovanni Biscuolo

Xelera IT Infrastructures

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Ricardo Wurmus]

Hi Giovanni,

>>>> I think my specific problem is caused by the "Gateway Timeout" error
>>>> from ci.guix.info, see below for details
>>>
>>> I cannot reproduce this.
>
> do you mean you are able to reach https://ci.guix.info/ without
> problems?

Yes.  I can still access it without problems with a browser.  I can also
access https://berlin.guixsd.org just fine.

Curl gives me the same kind of error, though:

--8<---------------cut here---------------start------------->8---
$ curl -I https://ci.guix.info/
HTTP/2 405 
server: nginx
date: Thu, 21 Feb 2019 18:26:49 GMT
x-cache: Error from cloudfront
via: 1.1 e83e50311ef72f016908ba58ad2e6bd8.cloudfront.net (CloudFront)
x-amz-cf-id: EeV0rybaav9_GfKT4ufwCu5orDNAlV6v11fUV_OEzze_UsjnlP2VvQ==
--8<---------------cut here---------------end--------------->8---

I don’t know what this means.

-- 
Ricardo

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Chris Marusich]

[-- Attachment #1: Type: text/plain, Size: 2870 bytes --]

Giovanni Biscuolo <g@xelera.eu> writes:

> $ guix weather --manifest=.ungoogled-chromium.manifest
> computing 1 package derivations for x86_64-linux...
> looking for 1 store items on https://ci.guix.info...
> https://ci.guix.info
>   100.0% substitutes available (1 out of 1)
>   99,3 MiB of nars (compressed)
>   288,3 MiB on disk (uncompressed)
>   0,004 seconds per request (0,0 seconds in total)
>   262,4 requests per second
>   'https://ci.guix.info/api/queue?nr=1000' returned 504 ("Gateway Time-out")
>
> actually all https://ci.guix.info/ returns 504 "Gateway Time-out":
> AFAIU this mean I'm not able to install that package (possibly others)
> for some problem in the CDN

Summary: A Cuirass API is failing, but substitutes are available.  The
CDN is not the problem.  I'll explain more below.

The 504 error comes from berlin, not the CDN.  If you access
berlin.guixsd.org directly when the 504 occurs, I think you'll see a 504
from there, too.  The CDN is merely forwarding you the 504 it got from
berlin.  I've observed this behavior multiple times in the past.  The
next time this happens, try viewing the offending location via berlin
directly in your browser:

https://berlin.guixsd.org/api/queue?nr=1000

I think you'll find that berlin, not the CDN, returns the 504 error.  To
understand why berlin.guixsd.org returns a 504, we would need someone to
investigate more on the server side.  I don't know if anyone understands
why this happens; I don't have access to investigate berlin, myself.

In any case, the 504 for the /api/queue path doesn't imply that
substitutes are unavailable.  Indeed, your "guix weather" output states
that the 1 substitute you were looking for was in fact available.  How
can this be?  Well, both Cuirass and "guix publish" are served through a
front-end NGINX web server, which confuses matters a little.  The name
berlin.guixsd.org resolves to that NGINX web server.  That NGINX web
server forwards requests to their appropriate destination ("guix
publish" or Cuirass) depending on the path.  Substitutes are served from
"guix publish" via one set of paths (e.g., /nar/gzip/<store-item>), and
Cuirass resources are served from Cuirass via a different set of paths
(e.g., "/api/queue").  It's possible for a Cuirass path to fail even
though the "guix publish" paths are working just fine.  This is because
"guix publish" and Cuirass are not the same thing, even though they are
served via the same domain name.

What I'm trying to say is that the 504 doesn't mean substitutes are
unavailable.  However, it does suggest a problem with Cuirass or its
dependencies.  When you run commands that fetch substitutes, like "guix
build" and "guix install," you will probably find that the substitution
is not failing.  If that isn't the case, please let us know.

-- 
Chris

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Chris Marusich]

[-- Attachment #1: Type: text/plain, Size: 266 bytes --]

Hi Giovanni

I responded to your questions here:

https://lists.gnu.org/archive/html/help-guix/2019-02/msg00216.html

I replied there because I didn't see your new email thread here until
just now.  I just wanted to make sure you saw my reply.

-- 
Chris

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Alex Vong]

[-- Attachment #1: Type: text/plain, Size: 1088 bytes --]

Hello everyone,

Mathieu Lirzin <mthl@gnu.org> writes:

> Hello,
>
> Ricardo Wurmus <rekado@elephly.net> writes:
>
>> Hi Giovanni,
>>
>>> I think my specific problem is caused by the "Gateway Timeout" error
>>> from ci.guix.info, see below for details
>>
>> I cannot reproduce this.
>
> I can reproduce here (on GuixSD) and like Giovanni I am unable to use
> the substitutes for ‘ungoogled-chromium’.
>
I think the problem is not specific to 'ungoogled-chromium', because I
can reproduce it on the manifest containing all the packages I am using:


scheme@(emacs-guix)> (guix-command "weather" "--manifest=/home/alexvong1995/manifest/manifest")
computing 675 package derivations for x86_64-linux...
looking for 810 store items on https://ci.guix.info...
https://ci.guix.info
  92.5% substitutes available (749 out of 810)
  1,901.5 MiB of nars (compressed)
  7,294.0 MiB on disk (uncompressed)
  0.001 seconds per request (0.7 seconds in total)
  1,118.6 requests per second
  'https://ci.guix.info/api/queue?nr=1000' returned 504 ("Gateway Time-out")

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 227 bytes --]

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Giovanni Biscuolo]

[-- Attachment #1: Type: text/plain, Size: 3017 bytes --]

Hi Chris,

thanks for looking into this issue!

Chris Marusich <cmmarusich@gmail.com> writes:

> Giovanni Biscuolo <g@xelera.eu> writes:

[...]

>> actually all https://ci.guix.info/ returns 504 "Gateway Time-out":
>> AFAIU this mean I'm not able to install that package (possibly others)
>> for some problem in the CDN
>
> Summary: A Cuirass API is failing, but substitutes are available.  The
> CDN is not the problem.  I'll explain more below.

OK I got it, actually I didn't check https://berlin.guixsd.org/ whan I
got that error

the "504 Gateway Time-out" is coming from https://berlin.guixsd.org/,
**but** _sometimes_ the error goes away

I mean: if I try to reach https://berlin.guixsd.org/ or
https://ci.guix.info/ and periodically reload the page, sometimes I get
504 error and sometimes not

in particular, it _seems_ to me that the gateway time-out is triggered
by a visit to https://ci.guix.info/api/queue?nr=1000

I mean: if I reach https://berlin.guixsd.org/ or https://ci.guix.info/
and I get a proper response (not 504) I can subsequently reload the page
and clean the cache and always get a proper response; after I try to
visit https://ci.guix.info/api/queue?nr=1000 in my browser and then try
to visit https://ci.guix.info/ or https://berlin.guixsd.org/ I
systematically get a 504

> The 504 error comes from berlin, not the CDN.  If you access
> berlin.guixsd.org directly when the 504 occurs, I think you'll see a 504
> from there, too.

OK, sorry for the confusion I made: it's not CDN related

nevertheless it seems to me we have a problem with our infrastructure

[...]

> What I'm trying to say is that the 504 doesn't mean substitutes are
> unavailable.

OK, so my problem getting ungoogled-chromium installed is not related to
the 504 gateway timeout from the web API

unfortunately I'm still having problems installing it since my client
does not download the substitute but starts building the derivation:

--8<---------------cut here---------------start------------->8---
$ guix package -i ungoogled-chromium
substitute: updating substitutes from 'https://ci.guix.info'... 100.0%
building /gnu/store/4mvzzx2jmr4r4p2kx0hcvwr9s9lvx0gd-ungoogled-chromium-72.0.3626.109.drv...
\ 'set-paths' phase^C
--8<---------------cut here---------------end--------------->8---

despite

--8<---------------cut here---------------start------------->8---
computing 1 package derivations for x86_64-linux...
looking for 1 store items on https://ci.guix.info...
https://ci.guix.info
  100.0% substitutes available (1 out of 1)
  99,3 MiB of nars (compressed)
  288,3 MiB on disk (uncompressed)
  0,059 seconds per request (0,1 seconds in total)
  16,9 requests per second
  'https://ci.guix.info/api/queue?nr=1000' returned 504 ("Gateway Time-out")
--8<---------------cut here---------------end--------------->8---

...and I still can't understand why

Thanks!
Giovanni

-- 
Giovanni Biscuolo

Xelera IT Infrastructures

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Ricardo Wurmus]

Giovanni Biscuolo <g@xelera.eu> writes:

> unfortunately I'm still having problems installing it since my client
> does not download the substitute but starts building the derivation:
>
> --8<---------------cut here---------------start------------->8---
> $ guix package -i ungoogled-chromium
> substitute: updating substitutes from 'https://ci.guix.info'... 100.0%
> building /gnu/store/4mvzzx2jmr4r4p2kx0hcvwr9s9lvx0gd-ungoogled-chromium-72.0.3626.109.drv...
> \ 'set-paths' phase^C
> --8<---------------cut here---------------end--------------->8---

There is no such derivation on the server at berlin.guixsd.org.

-- 
Ricardo

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Ricardo Wurmus]

Ricardo Wurmus <rekado@elephly.net> writes:

> Giovanni Biscuolo <g@xelera.eu> writes:
>
>> unfortunately I'm still having problems installing it since my client
>> does not download the substitute but starts building the derivation:
>>
>> --8<---------------cut here---------------start------------->8---
>> $ guix package -i ungoogled-chromium
>> substitute: updating substitutes from 'https://ci.guix.info'... 100.0%
>> building /gnu/store/4mvzzx2jmr4r4p2kx0hcvwr9s9lvx0gd-ungoogled-chromium-72.0.3626.109.drv...
>> \ 'set-paths' phase^C
>> --8<---------------cut here---------------end--------------->8---
>
> There is no such derivation on the server at berlin.guixsd.org.

We do have these though:

/gnu/store/394p90k2kz47pi7nn5cvwzw4hcqrp1xf-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/61kj5jlhq8c1pc32vs2f6ibg45m08y3q-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/7ci5jh1vh9af75xbv330gq647fdpr7pb-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/ayc7plhz9j3y3vxxdss8028h9iw70mza-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/chdj91fkq2yad890zwy9dfd8jc8r30r7-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/gf0bavw8q5mrqh5p87mdf2pdjciq431n-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/gp0s9xi2kijjzfzmy5yqiy9q4pnw285d-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/h67xpfjlw8w9dx880d6b6f79qq9rzd50-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/ipjyrrd3l69bpk3mk6h75gcnm6x87qls-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/j3xvknmcgkmp5m51awi1np4jfqv7148z-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/j7c1apddih4zp8dirf92c362ivixbmc8-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/k3g0nsclzi5l0fil1jvp3i21vz9pirqw-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/l5x9f0rqkbw2agmrkk1lzks0m549hypq-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/m08kbvnclxxgpjkxp2azdgw7cv720fyz-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/nk4jbfd1dd1xbin9jib0yy9nc10am2vz-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/p3wmgfw20npsfcpfjbhaf5nb2x8a27n4-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/qksjfj7s222ybl7gxa6vnhzg2l3d5wiy-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/x2hlczmryal6fd5hbr5n12j4r0xvq6gj-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/yvs8xvhh07q4bgq16zgq16qpxpdzmyfz-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/yw5f9ja6cmfzljwhz0kbk3rq0hs9nbac-ungoogled-chromium-72.0.3626.109.drv
/gnu/store/z0m2mfwsnlc65sbf5pcx04j2mwk4ssb0-ungoogled-chromium-72.0.3626.109.drv

-- 
Ricardo

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Giovanni Biscuolo]

[-- Attachment #1: Type: text/plain, Size: 4523 bytes --]

Ricardo,

thanks for your patience with users like me still not able to find
substitutes availability info :-S

Ricardo Wurmus <rekado@elephly.net> writes:

> Ricardo Wurmus <rekado@elephly.net> writes:
>
>> Giovanni Biscuolo <g@xelera.eu> writes:
>>
>>> unfortunately I'm still having problems installing it since my client
>>> does not download the substitute but starts building the derivation:
>>>
>>> --8<---------------cut here---------------start------------->8---
>>> $ guix package -i ungoogled-chromium
>>> substitute: updating substitutes from 'https://ci.guix.info'... 100.0%
>>> building /gnu/store/4mvzzx2jmr4r4p2kx0hcvwr9s9lvx0gd-ungoogled-chromium-72.0.3626.109.drv...
>>> \ 'set-paths' phase^C
>>> --8<---------------cut here---------------end--------------->8---
>>
>> There is no such derivation on the server at berlin.guixsd.org.

ouch, sorry! I thought "guix weather" [1] is telling me the contrary
(sorry if I repeat myself):

--8<---------------cut here---------------start------------->8---
$ guix weather --manifest=.ungoogled-chromium.manifest
computing 1 package derivations for x86_64-linux...
looking for 1 store items on https://ci.guix.info...
https://ci.guix.info
  100.0% substitutes available (1 out of 1)
  99,3 MiB of nars (compressed)
  288,3 MiB on disk (uncompressed)
  0,004 seconds per request (0,0 seconds in total)
  271,0 requests per second
  'https://ci.guix.info/api/queue?nr=1000' returned 504 ("Gateway Time-out")
--8<---------------cut here---------------end--------------->8---

this is .ungoogled-chromium.manifest:

--8<---------------cut here---------------start------------->8---
(specifications->manifest
 '("ungoogled-chromium"))
--8<---------------cut here---------------end--------------->8---

from the manual I thought this was enough, I mean there is an avaiable
substitute for my current commit of guix

--8<---------------cut here---------------start------------->8---
$ guix describe
Generation 3	Feb 19 2019 19:35:54	(current)
  guix a4fc802
    repository URL: https://git.savannah.gnu.org/git/guix.git
    branch: master
    commit: a4fc80254a53b46b33f138d1009ddd044b8cb6be
--8<---------------cut here---------------end--------------->8---

how can I check if a substitute is available for my specific commit?

> We do have these though:
>
> /gnu/store/394p90k2kz47pi7nn5cvwzw4hcqrp1xf-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/61kj5jlhq8c1pc32vs2f6ibg45m08y3q-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/7ci5jh1vh9af75xbv330gq647fdpr7pb-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/ayc7plhz9j3y3vxxdss8028h9iw70mza-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/chdj91fkq2yad890zwy9dfd8jc8r30r7-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/gf0bavw8q5mrqh5p87mdf2pdjciq431n-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/gp0s9xi2kijjzfzmy5yqiy9q4pnw285d-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/h67xpfjlw8w9dx880d6b6f79qq9rzd50-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/ipjyrrd3l69bpk3mk6h75gcnm6x87qls-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/j3xvknmcgkmp5m51awi1np4jfqv7148z-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/j7c1apddih4zp8dirf92c362ivixbmc8-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/k3g0nsclzi5l0fil1jvp3i21vz9pirqw-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/l5x9f0rqkbw2agmrkk1lzks0m549hypq-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/m08kbvnclxxgpjkxp2azdgw7cv720fyz-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/nk4jbfd1dd1xbin9jib0yy9nc10am2vz-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/p3wmgfw20npsfcpfjbhaf5nb2x8a27n4-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/qksjfj7s222ybl7gxa6vnhzg2l3d5wiy-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/x2hlczmryal6fd5hbr5n12j4r0xvq6gj-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/yvs8xvhh07q4bgq16zgq16qpxpdzmyfz-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/yw5f9ja6cmfzljwhz0kbk3rq0hs9nbac-ungoogled-chromium-72.0.3626.109.drv
> /gnu/store/z0m2mfwsnlc65sbf5pcx04j2mwk4ssb0-ungoogled-chromium-72.0.3626.109.drv

OK there are plenty of it

I still have to learn how to find a guix commit giving me one of those
specific derivations... or just check if one specific commit provides
one of those

Thanks!
Giovanni


[1] https://www.gnu.org/software/guix/manual/en/html_node/Invoking-guix-weather.html#index-availability-of-substitutes

-- 
Giovanni Biscuolo

Xelera IT Infrastructures

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Ricardo Wurmus]

Giovanni Biscuolo <g@xelera.eu> writes:

> Ricardo,
>
> thanks for your patience with users like me still not able to find
> substitutes availability info :-S
>
> Ricardo Wurmus <rekado@elephly.net> writes:
>
>> Ricardo Wurmus <rekado@elephly.net> writes:
>>
>>> Giovanni Biscuolo <g@xelera.eu> writes:
>>>
>>>> unfortunately I'm still having problems installing it since my client
>>>> does not download the substitute but starts building the derivation:
>>>>
>>>> --8<---------------cut here---------------start------------->8---
>>>> $ guix package -i ungoogled-chromium
>>>> substitute: updating substitutes from 'https://ci.guix.info'... 100.0%
>>>> building /gnu/store/4mvzzx2jmr4r4p2kx0hcvwr9s9lvx0gd-ungoogled-chromium-72.0.3626.109.drv...
>>>> \ 'set-paths' phase^C
>>>> --8<---------------cut here---------------end--------------->8---
>>>
>>> There is no such derivation on the server at berlin.guixsd.org.
>
> ouch, sorry! […]

No need to apologize.  I was curious as to what’s going on here, so I
checked right on berlin.guixsd.org to see if the file exists at all.

I don’t know why the derivation you get isn’t yet available on berlin.
It’s possible that there hasn’t been an evaluation corresponding to your
commit.

> I still have to learn how to find a guix commit giving me one of those
> specific derivations... or just check if one specific commit provides
> one of those

You generally can’t do that.  You can’t compute the commit from only a
derivation file name.

--
Ricardo

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Mathieu Lirzin]

Hello,

Ricardo Wurmus <rekado@elephly.net> writes:

> Giovanni Biscuolo <g@xelera.eu> writes:
>
>> I still have to learn how to find a guix commit giving me one of those
>> specific derivations... or just check if one specific commit provides
>> one of those
>
> You generally can’t do that.  You can’t compute the commit from only a
> derivation file name.

I guess that ‘guix weather’ checks the presence of substitutes for a
current derivation of a package definition, so if in the same
environment ‘guix weather’ tells that a substitute is available and
‘guix package’ doesn't fetch it, it sounds fishy no?

Thanks.

-- 
Mathieu Lirzin
GPG: F2A3 8D7E EB2B 6640 5761  070D 0ADE E100 9460 4D37

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Ricardo Wurmus]

Mathieu Lirzin <mthl@gnu.org> writes:

> Hello,
>
> Ricardo Wurmus <rekado@elephly.net> writes:
>
>> Giovanni Biscuolo <g@xelera.eu> writes:
>>
>>> I still have to learn how to find a guix commit giving me one of those
>>> specific derivations... or just check if one specific commit provides
>>> one of those
>>
>> You generally can’t do that.  You can’t compute the commit from only a
>> derivation file name.
>
> I guess that ‘guix weather’ checks the presence of substitutes for a
> current derivation of a package definition, so if in the same
> environment ‘guix weather’ tells that a substitute is available and
> ‘guix package’ doesn't fetch it, it sounds fishy no?

Yes.  I cannot see the derivation in question, though, so I don’t
understand why “guix weather” would claim that a substitute exists.

I haven’t begun investigating this yet.  I’m probably overlooking
something obvious.

-- 
Ricardo

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[swedebugia]

[-- Attachment #1.1: Type: text/plain, Size: 353 bytes --]

On 2019-02-21 16:14, Giovanni Biscuolo wrote:
snip

> 
> in my case (I'm on Debian with systemd) I have to add an "Environment="
> parameter in /etc/systemd/system/guix-daemon.service, reload the systemd
> file and restart the service

If this is not explained in the manual could you send a patch to include
this?

-- 
Cheers Swedebugia


[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 228 bytes --]

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Giovanni Biscuolo]

[-- Attachment #1: Type: text/plain, Size: 534 bytes --]

swedebugia <swedebugia@riseup.net> writes:

> On 2019-02-21 16:14, Giovanni Biscuolo wrote:
> snip
>
>> 
>> in my case (I'm on Debian with systemd) I have to add an "Environment="
>> parameter in /etc/systemd/system/guix-daemon.service, reload the systemd
>> file and restart the service
>
> If this is not explained in the manual could you send a patch to include
> this?

yes! not tomorrow, on Wednesday I should be able to send it...

stay tuned :-D
Giovanni

-- 
Giovanni Biscuolo

Xelera IT Infrastructures

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Ricardo Wurmus]

swedebugia <swedebugia@riseup.net> writes:

> On 2019-02-21 16:14, Giovanni Biscuolo wrote:
> snip
>
>> 
>> in my case (I'm on Debian with systemd) I have to add an "Environment="
>> parameter in /etc/systemd/system/guix-daemon.service, reload the systemd
>> file and restart the service
>
> If this is not explained in the manual could you send a patch to include
> this?

The service file already includes an “Environment” line.

-- 
Ricardo

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Leo Famulari]

[-- Attachment #1: Type: text/plain, Size: 655 bytes --]

On Mon, Feb 25, 2019 at 09:31:48PM +0100, Ricardo Wurmus wrote:
> swedebugia <swedebugia@riseup.net> writes:
> > If this is not explained in the manual could you send a patch to include
> > this?
> 
> The service file already includes an “Environment” line.

Also, this 'Environment=' parameter is a feature of systemd services [0]
and applicable to any use of systemd. I don't think the Guix manual
needs to include specific examples of how to set environment variables
in third-party service managers.

[0] See the manual page systemd.service(5) or view it online:
https://www.freedesktop.org/software/systemd/man/systemd.service.html

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Giovanni Biscuolo]

[-- Attachment #1: Type: text/plain, Size: 720 bytes --]

Hello,

Leo Famulari <leo@famulari.name> writes:

> On Mon, Feb 25, 2019 at 09:31:48PM +0100, Ricardo Wurmus wrote:
>> swedebugia <swedebugia@riseup.net> writes:
>> > If this is not explained in the manual could you send a patch to include
>> > this?
>> 
>> The service file already includes an “Environment” line.
>
> Also, this 'Environment=' parameter is a feature of systemd services [0]
> and applicable to any use of systemd. I don't think the Guix manual
> needs to include specific examples of how to set environment variables
> in third-party service managers.

I agree, non need to patch Guix manual in this case

Thanks!
Giovanni

-- 
Giovanni Biscuolo

Xelera IT Infrastructures

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

Re: ci.guix.info 504 gateway timeout (was Re: guix package builds, subsitutes and --no-build)

[Mark H Weaver]

Giovanni Biscuolo <g@xelera.eu> writes:

> OK, so my problem getting ungoogled-chromium installed is not related to
> the 504 gateway timeout from the web API
>
> unfortunately I'm still having problems installing it since my client
> does not download the substitute but starts building the derivation:
>
> $ guix package -i ungoogled-chromium
> substitute: updating substitutes from 'https://ci.guix.info'... 100.0%
> building /gnu/store/4mvzzx2jmr4r4p2kx0hcvwr9s9lvx0gd-ungoogled-chromium-72.0.3626.109.drv...
> \ 'set-paths' phase^C

I don't know about berlin, but hydra.gnu.org has *never* successfully
built ungoogled-chromium.  So far, it has made 3 attempts on
x86_64-linux and 5 attempts on i686-linux:

  https://hydra.gnu.org/build/3387889 (x86_64-linux)
  https://hydra.gnu.org/build/3381436 (x86_64-linux)
  https://hydra.gnu.org/build/3380876 (x86_64-linux)
  https://hydra.gnu.org/build/3386821 (i686-linux)
  https://hydra.gnu.org/build/3385227 (i686-linux)
  https://hydra.gnu.org/build/3381453 (i686-linux)
  https://hydra.gnu.org/build/3380895 (i686-linux)
  https://hydra.gnu.org/build/3379818 (i686-linux)

If the same is true on berlin.guixsd.org, that would explain the lack of
binary substitutes.

        Mark