unofficial mirror of bug-guix@gnu.org 
 help / color / mirror / Atom feed
* bug#44574: guix weather not checking all substitute urls
@ 2020-11-11 11:30 Efraim Flashner
  2020-11-16 17:12 ` zimoun
  0 siblings, 1 reply; 7+ messages in thread
From: Efraim Flashner @ 2020-11-11 11:30 UTC (permalink / raw)
  To: 44574

[-- Attachment #1: Type: text/plain, Size: 5915 bytes --]

I would have assumed that it would check for all of the substitute urls
I listed and not just the first one. Most of the packages listed below
I've test built on my pine64 so they shouldn't appear in the list
anymore.

(ins)efraim@E5400 ~/workspace/guix-1.2.0$ time ./pre-inst-env guix weather -c 100 --system=aarch64-linux --substitute-urls="https://ci.guix.gnu.org http://pine64:3000"
computing 14,359 package derivations for aarch64-linux...
looking for 14,945 store items on https://ci.guix.gnu.org...
updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
https://ci.guix.gnu.org
  52.4% substitutes available (7,838 out of 14,945)
  at least 25,425.6 MiB of nars (compressed)
  46,859.9 MiB on disk (uncompressed)
  0.002 seconds per request (30.7 seconds in total)
  487.1 requests per second

  0.0% (3 out of 7,107) of the missing items are queued
  at least 1,000 queued builds
      aarch64-linux: 123 (12.3%)
      i686-linux: 401 (40.1%)
      x86_64-linux: 404 (40.4%)
      armhf-linux: 72 (7.2%)
  build rate: 124.61 builds per hour
      x86_64-linux: 50.96 builds per hour
      i686-linux: 35.14 builds per hour
      armhf-linux: 17.95 builds per hour
      aarch64-linux: 20.57 builds per hour
updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
1857 packages are missing from 'https://ci.guix.gnu.org' for 'aarch64-linux', among which:
  1625  rust@1.24.1     /gnu/store/iaw29nqdhsvpg1zi4xh2i7q9v813kjyw-rust-1.24.1-cargo /gnu/store/kgn4q5nfdmh4hx32b1zd907ri0a26x26-rust-1.24.1-doc /gnu/store/fm
k8vnwc1x8a91w5ybdrfbfrfiq91d3y-rust-1.24.1
   766  ghc@7.10.2      /gnu/store/zcvd3yqka7s1gn323y202rqxirmldawi-ghc-7.10.2-doc /gnu/store/vhhjk5z31rgxw82bv3dmrhz2fyhvh3yl-ghc-7.10.2
   749  r-yaml@2.2.1    /gnu/store/d06vsnv4rbkz389g7wrh0xbr3mb37rbk-r-yaml-2.2.1
   747  r-highr@0.8     /gnu/store/gjwsyw35p4c6cd7gqrnl4xjpgys6pic7-r-highr-0.8
   562  jamvm@1.5.1     /gnu/store/mwgkpyjgrw4cnvkhglz2605i7c1rpfva-jamvm-1.5.1
   509  sbcl-lift@1.7.1-1.7d49a66       /gnu/store/javclx2bycs1ig5rc0z5zw86ljwc5x5m-sbcl-lift-1.7.1-1.7d49a66
   488  r-rlang@0.4.8   /gnu/store/l50wdpz16295diabmp2pkkvz2q0f52p3-r-rlang-0.4.8
   487  sbcl-net.didierverna.asdf-flv@2.1       /gnu/store/mk4lpkafkbpsncf7qf7i310ix9h14xal-sbcl-net.didierverna.asdf-flv-2.1
   451  r-bh@1.72.0-3   /gnu/store/0n560alajilbryj94z46wabfkq6hjjm9-r-bh-1.72.0-3
   436  sbcl-trivial-gray-streams@0.0.0-1.ebd59b1       /gnu/store/s4cghmgb9pf79zw9z81lnp9ff5rx6p0g-sbcl-trivial-gray-streams-0.0.0-1.ebd59b1
   245  r-munsell@0.5.0 /gnu/store/2gwfqxkpjvk4yjycs26n17dxkxd2w5m0-r-munsell-0.5.0
   236  r-r-cache@0.14.0        /gnu/store/2g3c41lnvir5rr5ppn3svf2acqzs2290-r-r-cache-0.14.0
   236  sbcl-cffi-libffi@0.21.0 /gnu/store/znfcdhp684zvjcipi5dvydn5886xzsa4-sbcl-cffi-libffi-0.21.0
   175  libpipeline@1.5.3       /gnu/store/6qi0yj1i61py5mhg02vll8b6gbjilngl-libpipeline-1.5.3
   173  r-curl@4.3      /gnu/store/gv0jw7rsmjq6a6xzzil1xlml2yd59mm8-r-curl-4.3
   169  python2-cffi@1.14.0     /gnu/store/d24l9z1an90d9h2dk5zhliwp5rirh6ic-python2-cffi-1.14.0
   160  python2-iso8601@0.1.12  /gnu/store/ncbiv7lrikp7hqj6nykd4hsrjillg5rg-python2-iso8601-0.1.12
   156  python2-pytest-cov@2.8.1        /gnu/store/xdxx4w89lqcdi9yzxrjzd2fwbq58a7dk-python2-pytest-cov-2.8.1
   156  sbcl-closer-mop@1.0.0-2.19c9d33 /gnu/store/c4mch43a7w4ivhrcz0wkfb2936dyr8p3-sbcl-closer-mop-1.0.0-2.19c9d33
   154  kservice@5.70.0 /gnu/store/2lhmsz7k8hgqhgahcj6bfcgmknnfbk5w-kservice-5.70.0
   151  r-survival@3.2-7        /gnu/store/5yfkcacmm4lpygvfb8xk291p9f10c244-r-survival-3.2-7
   148  sbcl-trivial-garbage@0.21       /gnu/store/zz75ir2q0k7gd6wprr42vxg7vsjcrb0i-sbcl-trivial-garbage-0.21
   138  cl-trivial-features@0.8-1.870d03d       /gnu/store/6apvh159ld0b1rwsbzav1ls90bgiq5ad-cl-trivial-features-0.8-1.870d03d
   132  python2-markupsafe@1.1.1        /gnu/store/hc6aami5qjwrmdfsj0m6rky5qsz0518n-python2-markupsafe-1.1.1
   128  zeromq@4.3.3    /gnu/store/kpwiaj4ng31p71p15rdww6fnggc54l8w-zeromq-4.3.3
   113  webkitgtk@2.30.2        /gnu/store/2hv5x29z673nzn4m11h21xxzgb0k47hv-webkitgtk-2.30.2-doc /gnu/store/whxb77cnsbhwd0dn0dcam8hjpz0z5ffy-webkitgtk-2.30.2
   110  numactl@2.0.14  /gnu/store/dlc90qk7152iqf702hkp5y1axb8fr1dj-numactl-2.0.14
   106  emacs-shut-up@0.3.2     /gnu/store/g6vjsdslm4m3bp6wbz0j9rwnmp3vr1x8-emacs-shut-up-0.3.2
   105  emacs-f@0.20.0  /gnu/store/ars7lf4vswnw731pklng4dprwmw41km0-emacs-f-0.20.0

real    2m43.059s
user    2m10.339s
sys     0m3.571s

When I reversed the order of the substitute servers:
(ins)efraim@E5400 ~/workspace/guix-1.2.0$ time ./pre-inst-env guix weather -c 100 --system=aarch64-linux --substitute-urls="http://pine64:3000 https://ci.guix.gnu.org"
computing 14,359 package derivations for aarch64-linux...
looking for 14,945 store items on http://pine64:3000...
updating substitutes from 'http://pine64:3000'... 100.0%
http://pine64:3000
  7.7% substitutes available (1,148 out of 14,945)
  unknown substitute sizes
  5,199.5 MiB on disk (uncompressed)
  0.011 seconds per request (171.8 seconds in total)
  86.0 requests per second
  (continuous integration information unavailable)
updating substitutes from 'http://pine64:3000'... 100.0%
4885 packages are missing from 'http://pine64:3000' for 'aarch64-linux', among which:
  10801 python-minimal@3.8.2    /gnu/store/r7ncfbpi0q153qybcbhpzqf5rf6wg4pg-python-minimal-3.8.2
  10651 xtrans@1.4.0    /gnu/store/an00f8f7cq2hdh5pak9f50ngx4xy0bgq-xtrans-1.4.0
  8954  autoconf-wrapper@2.69   /gnu/store/3m5kvv8a5196gk1x3n0qdn5f07g9v4gb-autoconf-wrapper-2.69
  8470  datefudge@1.23  /gnu/store/rwk9qqb61iyn2bqy4w39j4v9llrqc6xk-datefudge-1.23
  <..snip..>

-- 
Efraim Flashner   <efraim@flashner.co.il>   אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

^ permalink raw reply	[flat|nested] 7+ messages in thread

* bug#44574: guix weather not checking all substitute urls
  2020-11-11 11:30 bug#44574: guix weather not checking all substitute urls Efraim Flashner
@ 2020-11-16 17:12 ` zimoun
  2020-11-16 19:30   ` Efraim Flashner
  0 siblings, 1 reply; 7+ messages in thread
From: zimoun @ 2020-11-16 17:12 UTC (permalink / raw)
  To: Efraim Flashner, 44574

Hi Efraim,

On Wed, 11 Nov 2020 at 13:30, Efraim Flashner <efraim@flashner.co.il> wrote:
> I would have assumed that it would check for all of the substitute urls
> I listed and not just the first one. Most of the packages listed below
> I've test built on my pine64 so they shouldn't appear in the list
> anymore.

I think #44688 [1] fixes it.  Please let me know.

1: <http://issues.guix.gnu.org/issue/44688>


Examples:

--8<---------------cut here---------------start------------->8---
$ ./pre-inst-env guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org"
computing 15,391 package derivations for x86_64-linux...
looking for 16,707 store items on https://bayfront.guix.gnu.org...
updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0%
https://bayfront.guix.gnu.org
  55.6% substitutes available (9,289 out of 16,707)
  at least 51,869.2 MiB of nars (compressed)
  82,986.2 MiB on disk (uncompressed)
  0.001 seconds per request (24.6 seconds in total)
  679.0 requests per second

  0.3% (20 out of 7,418) of the missing items are queued
  32 queued builds
      x86_64-linux: 32 (100.0%)
  build rate: 13.83 builds per hour
      x86_64-linux: 13.83 builds per hour
looking for 16,707 store items on https://ci.guix.gnu.org...
updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
https://ci.guix.gnu.org
  88.9% substitutes available (14,860 out of 16,707)
  at least 78,929.4 MiB of nars (compressed)
  130,797.2 MiB on disk (uncompressed)
  0.002 seconds per request (26.9 seconds in total)
  620.2 requests per second

  0.5% (10 out of 1,847) of the missing items are queued
  at least 1,000 queued builds
      x86_64-linux: 493 (49.3%)
      aarch64-linux: 140 (14.0%)
      i686-linux: 346 (34.6%)
      armhf-linux: 21 (2.1%)
  build rate: 38.98 builds per hour
      x86_64-linux: 13.29 builds per hour
      i686-linux: 12.32 builds per hour
      aarch64-linux: 6.78 builds per hour
      armhf-linux: 6.59 builds per hour
--8<---------------cut here---------------end--------------->8---
      
or

--8<---------------cut here---------------start------------->8---
$ ./pre-inst-env guix weather --substitute-urls="https://guix.tobias.gr https://ci.guix.gnu.org" -c 100
computing 15,391 package derivations for x86_64-linux...
looking for 16,707 store items on https://guix.tobias.gr...
updating substitutes from 'https://guix.tobias.gr'... 100.0%
https://guix.tobias.gr
  35.0% substitutes available (5,855 out of 16,707)
  unknown substitute sizes
  52,230.7 MiB on disk (uncompressed)
  0.017 seconds per request (291.8 seconds in total)
  57.3 requests per second
  (continuous integration information unavailable)
updating substitutes from 'https://guix.tobias.gr'... 100.0%
6777 packages are missing from 'https://guix.tobias.gr' for 'x86_64-linux', among which:
  16564	bootar@1a	/gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 
  16561	bootstrap-mes-rewired@0.19	/gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 
  16495	ld-wrapper-boot3@0	/gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 
  9743	bison@3.5.3	/gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 
  1831	xkbcomp-intermediate@1.4.3	/gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3 
   788	bootar@1a	/gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 
   785	bootstrap-mes-rewired@0.19	/gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 
   719	ld-wrapper-boot3@0	/gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 
   595	bootar@1a	/gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 
   592	bootstrap-mes-rewired@0.19	/gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 
   526	ld-wrapper-boot3@0	/gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 
   339	bison@3.5.3	/gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 
   305	go@1.4-bootstrap-20171003	/gnu/store/asw6676iy7i0a8azpra2870w5hkq7bvv-go-1.4-bootstrap-20171003-doc /gnu/store/j20pik1y8psi78v7zb5ksqybn198inx7-go-1.4-bootstrap-20171003 /gnu/store/csfqsyyysbg9afnck405wmkhrlrblmza-go-1.4-bootstrap-20171003-tests 
   211	xkbcomp-intermediate@1.4.3	/gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3 
   121	bison@3.5.3	/gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 
   113	r-codetools@0.2-16	/gnu/store/k217j4c4ra2hfdldva075dmvq89ww1dn-r-codetools-0.2-16 
looking for 16,707 store items on https://ci.guix.gnu.org...
https://ci.guix.gnu.org
  88.9% substitutes available (14,860 out of 16,707)
  at least 78,929.4 MiB of nars (compressed)
  130,797.2 MiB on disk (uncompressed)
  0.001 seconds per request (10.1 seconds in total)
  1,650.0 requests per second

  0.5% (10 out of 1,847) of the missing items are queued
  at least 1,000 queued builds
      x86_64-linux: 493 (49.3%)
      aarch64-linux: 140 (14.0%)
      i686-linux: 346 (34.6%)
      armhf-linux: 21 (2.1%)
  build rate: 38.70 builds per hour
      x86_64-linux: 13.20 builds per hour
      i686-linux: 12.23 builds per hour
      aarch64-linux: 6.73 builds per hour
      armhf-linux: 6.54 builds per hour
updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
1251 packages are missing from 'https://ci.guix.gnu.org' for 'x86_64-linux', among which:
   112	java-snappy@1.1.7.5	/gnu/store/mq1xagq5sn9mfhpfg7j2cn1dn4vsds72-java-snappy-1.1.7.5 
--8<---------------cut here---------------end--------------->8---



compared to the current behaviour:

--8<---------------cut here---------------start------------->8---
$ guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org"
computing 15,287 package derivations for x86_64-linux...
looking for 16,584 store items on https://bayfront.guix.gnu.org...
updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0%
https://bayfront.guix.gnu.org
  54.4% substitutes available (9,026 out of 16,584)
  at least 49,365.8 MiB of nars (compressed)
  81,792.9 MiB on disk (uncompressed)
  0.003 seconds per request (41.6 seconds in total)
  398.0 requests per second

  0.1% (10 out of 7,558) of the missing items are queued
  32 queued builds
      x86_64-linux: 32 (100.0%)
  build rate: 13.84 builds per hour
      x86_64-linux: 13.84 builds per hour
--8<---------------cut here---------------end--------------->8---

(Note that Bayfront is working hard. ;-))

All the best,
simon




^ permalink raw reply	[flat|nested] 7+ messages in thread

* bug#44574: guix weather not checking all substitute urls
  2020-11-16 17:12 ` zimoun
@ 2020-11-16 19:30   ` Efraim Flashner
  2020-11-16 20:41     ` zimoun
  0 siblings, 1 reply; 7+ messages in thread
From: Efraim Flashner @ 2020-11-16 19:30 UTC (permalink / raw)
  To: zimoun; +Cc: 44574

[-- Attachment #1: Type: text/plain, Size: 7328 bytes --]

On Mon, Nov 16, 2020 at 06:12:54PM +0100, zimoun wrote:
> Hi Efraim,
> 
> On Wed, 11 Nov 2020 at 13:30, Efraim Flashner <efraim@flashner.co.il> wrote:
> > I would have assumed that it would check for all of the substitute urls
> > I listed and not just the first one. Most of the packages listed below
> > I've test built on my pine64 so they shouldn't appear in the list
> > anymore.
> 
> I think #44688 [1] fixes it.  Please let me know.
> 
> 1: <http://issues.guix.gnu.org/issue/44688>

I had hoped for a unified list of the missing packages between the two
or more build machines but the separate output is also useful. With a
unified list it's possible to see which packages are missing overall and
need fixing/building.

> 
> Examples:
> 
> --8<---------------cut here---------------start------------->8---
> $ ./pre-inst-env guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org"
> computing 15,391 package derivations for x86_64-linux...
> looking for 16,707 store items on https://bayfront.guix.gnu.org...
> updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0%
> https://bayfront.guix.gnu.org
>   55.6% substitutes available (9,289 out of 16,707)
>   at least 51,869.2 MiB of nars (compressed)
>   82,986.2 MiB on disk (uncompressed)
>   0.001 seconds per request (24.6 seconds in total)
>   679.0 requests per second
> 
>   0.3% (20 out of 7,418) of the missing items are queued
>   32 queued builds
>       x86_64-linux: 32 (100.0%)
>   build rate: 13.83 builds per hour
>       x86_64-linux: 13.83 builds per hour
> looking for 16,707 store items on https://ci.guix.gnu.org...
> updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
> https://ci.guix.gnu.org
>   88.9% substitutes available (14,860 out of 16,707)
>   at least 78,929.4 MiB of nars (compressed)
>   130,797.2 MiB on disk (uncompressed)
>   0.002 seconds per request (26.9 seconds in total)
>   620.2 requests per second
> 
>   0.5% (10 out of 1,847) of the missing items are queued
>   at least 1,000 queued builds
>       x86_64-linux: 493 (49.3%)
>       aarch64-linux: 140 (14.0%)
>       i686-linux: 346 (34.6%)
>       armhf-linux: 21 (2.1%)
>   build rate: 38.98 builds per hour
>       x86_64-linux: 13.29 builds per hour
>       i686-linux: 12.32 builds per hour
>       aarch64-linux: 6.78 builds per hour
>       armhf-linux: 6.59 builds per hour
> --8<---------------cut here---------------end--------------->8---
>       
> or
> 
> --8<---------------cut here---------------start------------->8---
> $ ./pre-inst-env guix weather --substitute-urls="https://guix.tobias.gr https://ci.guix.gnu.org" -c 100
> computing 15,391 package derivations for x86_64-linux...
> looking for 16,707 store items on https://guix.tobias.gr...
> updating substitutes from 'https://guix.tobias.gr'... 100.0%
> https://guix.tobias.gr
>   35.0% substitutes available (5,855 out of 16,707)
>   unknown substitute sizes
>   52,230.7 MiB on disk (uncompressed)
>   0.017 seconds per request (291.8 seconds in total)
>   57.3 requests per second
>   (continuous integration information unavailable)
> updating substitutes from 'https://guix.tobias.gr'... 100.0%
> 6777 packages are missing from 'https://guix.tobias.gr' for 'x86_64-linux', among which:
>   16564	bootar@1a	/gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 
>   16561	bootstrap-mes-rewired@0.19	/gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 
>   16495	ld-wrapper-boot3@0	/gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 
>   9743	bison@3.5.3	/gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 
>   1831	xkbcomp-intermediate@1.4.3	/gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3 
>    788	bootar@1a	/gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 
>    785	bootstrap-mes-rewired@0.19	/gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 
>    719	ld-wrapper-boot3@0	/gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 
>    595	bootar@1a	/gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 
>    592	bootstrap-mes-rewired@0.19	/gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 
>    526	ld-wrapper-boot3@0	/gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 
>    339	bison@3.5.3	/gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 
>    305	go@1.4-bootstrap-20171003	/gnu/store/asw6676iy7i0a8azpra2870w5hkq7bvv-go-1.4-bootstrap-20171003-doc /gnu/store/j20pik1y8psi78v7zb5ksqybn198inx7-go-1.4-bootstrap-20171003 /gnu/store/csfqsyyysbg9afnck405wmkhrlrblmza-go-1.4-bootstrap-20171003-tests 
>    211	xkbcomp-intermediate@1.4.3	/gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3 
>    121	bison@3.5.3	/gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 
>    113	r-codetools@0.2-16	/gnu/store/k217j4c4ra2hfdldva075dmvq89ww1dn-r-codetools-0.2-16 
> looking for 16,707 store items on https://ci.guix.gnu.org...
> https://ci.guix.gnu.org
>   88.9% substitutes available (14,860 out of 16,707)
>   at least 78,929.4 MiB of nars (compressed)
>   130,797.2 MiB on disk (uncompressed)
>   0.001 seconds per request (10.1 seconds in total)
>   1,650.0 requests per second
> 
>   0.5% (10 out of 1,847) of the missing items are queued
>   at least 1,000 queued builds
>       x86_64-linux: 493 (49.3%)
>       aarch64-linux: 140 (14.0%)
>       i686-linux: 346 (34.6%)
>       armhf-linux: 21 (2.1%)
>   build rate: 38.70 builds per hour
>       x86_64-linux: 13.20 builds per hour
>       i686-linux: 12.23 builds per hour
>       aarch64-linux: 6.73 builds per hour
>       armhf-linux: 6.54 builds per hour
> updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
> 1251 packages are missing from 'https://ci.guix.gnu.org' for 'x86_64-linux', among which:
>    112	java-snappy@1.1.7.5	/gnu/store/mq1xagq5sn9mfhpfg7j2cn1dn4vsds72-java-snappy-1.1.7.5 
> --8<---------------cut here---------------end--------------->8---
> 
> 
> 
> compared to the current behaviour:
> 
> --8<---------------cut here---------------start------------->8---
> $ guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org"
> computing 15,287 package derivations for x86_64-linux...
> looking for 16,584 store items on https://bayfront.guix.gnu.org...
> updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0%
> https://bayfront.guix.gnu.org
>   54.4% substitutes available (9,026 out of 16,584)
>   at least 49,365.8 MiB of nars (compressed)
>   81,792.9 MiB on disk (uncompressed)
>   0.003 seconds per request (41.6 seconds in total)
>   398.0 requests per second
> 
>   0.1% (10 out of 7,558) of the missing items are queued
>   32 queued builds
>       x86_64-linux: 32 (100.0%)
>   build rate: 13.84 builds per hour
>       x86_64-linux: 13.84 builds per hour
> --8<---------------cut here---------------end--------------->8---
> 
> (Note that Bayfront is working hard. ;-))
> 
> All the best,
> simon

-- 
Efraim Flashner   <efraim@flashner.co.il>   אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

^ permalink raw reply	[flat|nested] 7+ messages in thread

* bug#44574: guix weather not checking all substitute urls
  2020-11-16 19:30   ` Efraim Flashner
@ 2020-11-16 20:41     ` zimoun
  2020-11-16 20:49       ` Efraim Flashner
  0 siblings, 1 reply; 7+ messages in thread
From: zimoun @ 2020-11-16 20:41 UTC (permalink / raw)
  To: Efraim Flashner; +Cc: 44574

Hi Efraim,

On Mon, 16 Nov 2020 at 21:30, Efraim Flashner <efraim@flashner.co.il> wrote:

>> > I would have assumed that it would check for all of the substitute urls
>> > I listed and not just the first one. Most of the packages listed below
>> > I've test built on my pine64 so they shouldn't appear in the list
>> > anymore.
>> 
>> I think #44688 [1] fixes it.  Please let me know.
>> 
>> 1: <http://issues.guix.gnu.org/issue/44688>
>
> I had hoped for a unified list of the missing packages between the two
> or more build machines but the separate output is also useful. With a
> unified list it's possible to see which packages are missing overall and
> need fixing/building.

Ah, this a feature request. ;-)  I agree it could be really helpful.

Cheers,
simon




^ permalink raw reply	[flat|nested] 7+ messages in thread

* bug#44574: guix weather not checking all substitute urls
  2020-11-16 20:41     ` zimoun
@ 2020-11-16 20:49       ` Efraim Flashner
  2020-11-17 16:01         ` zimoun
  0 siblings, 1 reply; 7+ messages in thread
From: Efraim Flashner @ 2020-11-16 20:49 UTC (permalink / raw)
  To: zimoun; +Cc: 44574

[-- Attachment #1: Type: text/plain, Size: 1153 bytes --]

On Mon, Nov 16, 2020 at 09:41:53PM +0100, zimoun wrote:
> Hi Efraim,
> 
> On Mon, 16 Nov 2020 at 21:30, Efraim Flashner <efraim@flashner.co.il> wrote:
> 
> >> > I would have assumed that it would check for all of the substitute urls
> >> > I listed and not just the first one. Most of the packages listed below
> >> > I've test built on my pine64 so they shouldn't appear in the list
> >> > anymore.
> >> 
> >> I think #44688 [1] fixes it.  Please let me know.
> >> 
> >> 1: <http://issues.guix.gnu.org/issue/44688>
> >
> > I had hoped for a unified list of the missing packages between the two
> > or more build machines but the separate output is also useful. With a
> > unified list it's possible to see which packages are missing overall and
> > need fixing/building.
> 
> Ah, this a feature request. ;-)  I agree it could be really helpful.
> 

Lets merge 44688 anyway, it does address something that's lacking.

-- 
Efraim Flashner   <efraim@flashner.co.il>   אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

^ permalink raw reply	[flat|nested] 7+ messages in thread

* bug#44574: guix weather not checking all substitute urls
  2020-11-16 20:49       ` Efraim Flashner
@ 2020-11-17 16:01         ` zimoun
  2020-11-17 20:45           ` Ludovic Courtès
  0 siblings, 1 reply; 7+ messages in thread
From: zimoun @ 2020-11-17 16:01 UTC (permalink / raw)
  To: Efraim Flashner, Ludovic Courtès; +Cc: 44574

Hi,

On Mon, 16 Nov 2020 at 22:49, Efraim Flashner <efraim@flashner.co.il> wrote:

>> >> > I would have assumed that it would check for all of the substitute urls
>> >> > I listed and not just the first one. Most of the packages listed below
>> >> > I've test built on my pine64 so they shouldn't appear in the list
>> >> > anymore.
>> >> 
>> >> I think #44688 [1] fixes it.  Please let me know.
>> >> 
>> >> 1: <http://issues.guix.gnu.org/issue/44688>

> Lets merge 44688 anyway, it does address something that's lacking.

Ludo, does #44688 go to version-1.2.0 or master?  It is simple patch
that fixes:

  guix weather \
       --substitute-urls=“https://bayfront.guix.gnu.org https://ci.guix.gnu.org”

where the current behaviour process only one server.


Cheers,
simon





^ permalink raw reply	[flat|nested] 7+ messages in thread

* bug#44574: guix weather not checking all substitute urls
  2020-11-17 16:01         ` zimoun
@ 2020-11-17 20:45           ` Ludovic Courtès
  0 siblings, 0 replies; 7+ messages in thread
From: Ludovic Courtès @ 2020-11-17 20:45 UTC (permalink / raw)
  To: zimoun; +Cc: 44574

Hi,

zimoun <zimon.toutoune@gmail.com> skribis:

> On Mon, 16 Nov 2020 at 22:49, Efraim Flashner <efraim@flashner.co.il> wrote:
>
>>> >> > I would have assumed that it would check for all of the substitute urls
>>> >> > I listed and not just the first one. Most of the packages listed below
>>> >> > I've test built on my pine64 so they shouldn't appear in the list
>>> >> > anymore.
>>> >> 
>>> >> I think #44688 [1] fixes it.  Please let me know.
>>> >> 
>>> >> 1: <http://issues.guix.gnu.org/issue/44688>
>
>> Lets merge 44688 anyway, it does address something that's lacking.
>
> Ludo, does #44688 go to version-1.2.0 or master?  It is simple patch
> that fixes:
>
>   guix weather \
>        --substitute-urls=“https://bayfront.guix.gnu.org https://ci.guix.gnu.org”
>
> where the current behaviour process only one server.

It’s OK for ‘version-1.2.0’.  Thank you!

Ludo’.




^ permalink raw reply	[flat|nested] 7+ messages in thread

end of thread, other threads:[~2020-11-17 20:47 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-11-11 11:30 bug#44574: guix weather not checking all substitute urls Efraim Flashner
2020-11-16 17:12 ` zimoun
2020-11-16 19:30   ` Efraim Flashner
2020-11-16 20:41     ` zimoun
2020-11-16 20:49       ` Efraim Flashner
2020-11-17 16:01         ` zimoun
2020-11-17 20:45           ` Ludovic Courtès

unofficial mirror of bug-guix@gnu.org 

This inbox may be cloned and mirrored by anyone:

	git clone --mirror https://yhetil.org/guix-bugs/0 guix-bugs/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 guix-bugs guix-bugs/ https://yhetil.org/guix-bugs \
		bug-guix@gnu.org
	public-inbox-index guix-bugs

Example config snippet for mirrors.
Newsgroups are available over NNTP:
	nntp://news.yhetil.org/yhetil.gnu.guix.bugs
	nntp://news.gmane.io/gmane.comp.gnu.guix.bugs


AGPL code for this site: git clone https://public-inbox.org/public-inbox.git