From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id eFn6OFi0sl/7VQAA0tVLHw (envelope-from ) for ; Mon, 16 Nov 2020 17:18:16 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id qB/HNFi0sl8+bAAA1q6Kng (envelope-from ) for ; Mon, 16 Nov 2020 17:18:16 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 6C8A594021E for ; Mon, 16 Nov 2020 17:18:16 +0000 (UTC) Received: from localhost ([::1]:39610 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kei8p-0007Ox-8N for larch@yhetil.org; Mon, 16 Nov 2020 12:18:15 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:47666) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kei6k-0005z5-JE for bug-guix@gnu.org; Mon, 16 Nov 2020 12:16:02 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:45495) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1kei6k-0005oD-8J for bug-guix@gnu.org; Mon, 16 Nov 2020 12:16:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1kei6k-0006Ms-3Y for bug-guix@gnu.org; Mon, 16 Nov 2020 12:16:02 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#44574: guix weather not checking all substitute urls Resent-From: zimoun Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 16 Nov 2020 17:16:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 44574 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Efraim Flashner , 44574@debbugs.gnu.org Received: via spool by 44574-submit@debbugs.gnu.org id=B44574.160554693824433 (code B ref 44574); Mon, 16 Nov 2020 17:16:02 +0000 Received: (at 44574) by debbugs.gnu.org; 16 Nov 2020 17:15:38 +0000 Received: from localhost ([127.0.0.1]:57038 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kei6L-0006M0-S8 for submit@debbugs.gnu.org; Mon, 16 Nov 2020 12:15:38 -0500 Received: from mail-wm1-f42.google.com ([209.85.128.42]:39954) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1kei6J-0006Lm-Fp for 44574@debbugs.gnu.org; Mon, 16 Nov 2020 12:15:36 -0500 Received: by mail-wm1-f42.google.com with SMTP id a3so24299277wmb.5 for <44574@debbugs.gnu.org>; Mon, 16 Nov 2020 09:15:35 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:to:subject:in-reply-to:references:date:message-id:mime-version; bh=KSV3M0r2V1ymw8JtldyW2RlCCPhmqHaGjVOtf77gBUg=; b=ufTIGU1K51ueyV3XFAYxsUPJdP9aFRi8e8GcLk+k/awWX+5a1fYNUH91+ejdAUP0IW pgFWbOlW5gISRqP4yg3AVvhvAtNK6lKBr8d8WjTARjY0dkTX0nhutPHJkFrl+DU0NFW+ EqcYZhcrLhvOAKwnI4972YTp0J0g0E4rak9ZX5TFwKHEqj+R0wd5uSTo1+yjjuElqMjL TNehELJebpt45oWRBOOAZs3fXU/Oae8xnKcNQsKd4cD48l9QfpiXEbylyoLnHDopcQD9 E4GQsqYB709mVw8qRFsOpOl6jaUaxGy9GP6Ga3yQY7xqeWvDCe9E06v1mKYkTZXLB9IX 0szg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:to:subject:in-reply-to:references:date :message-id:mime-version; bh=KSV3M0r2V1ymw8JtldyW2RlCCPhmqHaGjVOtf77gBUg=; b=qTICH3Be/SgVEhqvlQl8IhknSZrY64QwgfEh67aNqzultlmReVxwHgRvx9AD+CivAr ymdgW0mkJqWY4U/Ynf2QhtACvXvj3oztF4W0sfc3yObnxoOqhalIyZhyOnRArTvFfFFS 6suJScHYliu5XLqGQF3WVTP49koa3T86mqL7r/oiMR8BHl/N+JDiqC/BjLEVNvJi/ROe YHuH3Jq/zQ4RcbZeEXcys8wqOJxPk+UZcO8CYULu5oXEFCIiOJvQxMdRzu1w3nsGSTbv yWEaCgnrGDBQ+KrtzG+Rf+QKzQHt8Dzs/Wcqb2UGb+r+aUymwPpmkYVsQGh3rmduL1RZ 9tyA== X-Gm-Message-State: AOAM530sk2hfZ6+hA64sbY3RSNauAh4ca9/JE20htIiWy/15YQmvEG8d nov/1K+bPU4nCR7CExsFr9MQVRVozMeAVA== X-Google-Smtp-Source: ABdhPJymsxEJUTF2xvTFL3FaKTqerTU+EcPCtU47WONP588Nc34fx1SLKcsKKSZk62ge9pnCSrLKEw== X-Received: by 2002:a7b:c937:: with SMTP id h23mr13147037wml.19.1605546929220; Mon, 16 Nov 2020 09:15:29 -0800 (PST) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id g11sm23968940wrq.7.2020.11.16.09.15.28 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 16 Nov 2020 09:15:28 -0800 (PST) From: zimoun In-Reply-To: <20201111113005.GB12414@E5400> References: <20201111113005.GB12414@E5400> Date: Mon, 16 Nov 2020 18:12:54 +0100 Message-ID: <86ft59ql7t.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Spam-Score: -1.0 (-) X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Scanner: ns3122888.ip-94-23-21.eu Authentication-Results: aspmx1.migadu.com; dkim=fail (headers rsa verify failed) header.d=gmail.com header.s=20161025 header.b=ufTIGU1K; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Spam-Score: 0.09 X-TUID: nX1Mr3wINhor Hi Efraim, On Wed, 11 Nov 2020 at 13:30, Efraim Flashner wrote: > I would have assumed that it would check for all of the substitute urls > I listed and not just the first one. Most of the packages listed below > I've test built on my pine64 so they shouldn't appear in the list > anymore. I think #44688 [1] fixes it. Please let me know. 1: Examples: --8<---------------cut here---------------start------------->8--- $ ./pre-inst-env guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org" computing 15,391 package derivations for x86_64-linux... looking for 16,707 store items on https://bayfront.guix.gnu.org... updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0% https://bayfront.guix.gnu.org 55.6% substitutes available (9,289 out of 16,707) at least 51,869.2 MiB of nars (compressed) 82,986.2 MiB on disk (uncompressed) 0.001 seconds per request (24.6 seconds in total) 679.0 requests per second 0.3% (20 out of 7,418) of the missing items are queued 32 queued builds x86_64-linux: 32 (100.0%) build rate: 13.83 builds per hour x86_64-linux: 13.83 builds per hour looking for 16,707 store items on https://ci.guix.gnu.org... updating substitutes from 'https://ci.guix.gnu.org'... 100.0% https://ci.guix.gnu.org 88.9% substitutes available (14,860 out of 16,707) at least 78,929.4 MiB of nars (compressed) 130,797.2 MiB on disk (uncompressed) 0.002 seconds per request (26.9 seconds in total) 620.2 requests per second 0.5% (10 out of 1,847) of the missing items are queued at least 1,000 queued builds x86_64-linux: 493 (49.3%) aarch64-linux: 140 (14.0%) i686-linux: 346 (34.6%) armhf-linux: 21 (2.1%) build rate: 38.98 builds per hour x86_64-linux: 13.29 builds per hour i686-linux: 12.32 builds per hour aarch64-linux: 6.78 builds per hour armhf-linux: 6.59 builds per hour --8<---------------cut here---------------end--------------->8--- or --8<---------------cut here---------------start------------->8--- $ ./pre-inst-env guix weather --substitute-urls="https://guix.tobias.gr https://ci.guix.gnu.org" -c 100 computing 15,391 package derivations for x86_64-linux... looking for 16,707 store items on https://guix.tobias.gr... updating substitutes from 'https://guix.tobias.gr'... 100.0% https://guix.tobias.gr 35.0% substitutes available (5,855 out of 16,707) unknown substitute sizes 52,230.7 MiB on disk (uncompressed) 0.017 seconds per request (291.8 seconds in total) 57.3 requests per second (continuous integration information unavailable) updating substitutes from 'https://guix.tobias.gr'... 100.0% 6777 packages are missing from 'https://guix.tobias.gr' for 'x86_64-linux', among which: 16564 bootar@1a /gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 16561 bootstrap-mes-rewired@0.19 /gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 16495 ld-wrapper-boot3@0 /gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 9743 bison@3.5.3 /gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 1831 xkbcomp-intermediate@1.4.3 /gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3 788 bootar@1a /gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 785 bootstrap-mes-rewired@0.19 /gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 719 ld-wrapper-boot3@0 /gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 595 bootar@1a /gnu/store/x2iy3ka299sk1x97an783jl4pfbn60pj-bootar-1a 592 bootstrap-mes-rewired@0.19 /gnu/store/a4m8c80mrys8w3vlm6vdnq05c7a1warl-bootstrap-mes-rewired-0.19 526 ld-wrapper-boot3@0 /gnu/store/v3wwjj9i9zqglq4g2yczf6cxsh028qfb-ld-wrapper-boot3-0 339 bison@3.5.3 /gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 305 go@1.4-bootstrap-20171003 /gnu/store/asw6676iy7i0a8azpra2870w5hkq7bvv-go-1.4-bootstrap-20171003-doc /gnu/store/j20pik1y8psi78v7zb5ksqybn198inx7-go-1.4-bootstrap-20171003 /gnu/store/csfqsyyysbg9afnck405wmkhrlrblmza-go-1.4-bootstrap-20171003-tests 211 xkbcomp-intermediate@1.4.3 /gnu/store/fjwjb14b5irngvv9r06dmkhhds566vw2-xkbcomp-intermediate-1.4.3 121 bison@3.5.3 /gnu/store/rxli27pbpr9x9c8mk9cbp6masnwaszrs-bison-3.5.3 113 r-codetools@0.2-16 /gnu/store/k217j4c4ra2hfdldva075dmvq89ww1dn-r-codetools-0.2-16 looking for 16,707 store items on https://ci.guix.gnu.org... https://ci.guix.gnu.org 88.9% substitutes available (14,860 out of 16,707) at least 78,929.4 MiB of nars (compressed) 130,797.2 MiB on disk (uncompressed) 0.001 seconds per request (10.1 seconds in total) 1,650.0 requests per second 0.5% (10 out of 1,847) of the missing items are queued at least 1,000 queued builds x86_64-linux: 493 (49.3%) aarch64-linux: 140 (14.0%) i686-linux: 346 (34.6%) armhf-linux: 21 (2.1%) build rate: 38.70 builds per hour x86_64-linux: 13.20 builds per hour i686-linux: 12.23 builds per hour aarch64-linux: 6.73 builds per hour armhf-linux: 6.54 builds per hour updating substitutes from 'https://ci.guix.gnu.org'... 100.0% 1251 packages are missing from 'https://ci.guix.gnu.org' for 'x86_64-linux', among which: 112 java-snappy@1.1.7.5 /gnu/store/mq1xagq5sn9mfhpfg7j2cn1dn4vsds72-java-snappy-1.1.7.5 --8<---------------cut here---------------end--------------->8--- compared to the current behaviour: --8<---------------cut here---------------start------------->8--- $ guix weather --substitute-urls="https://bayfront.guix.gnu.org https://ci.guix.gnu.org" computing 15,287 package derivations for x86_64-linux... looking for 16,584 store items on https://bayfront.guix.gnu.org... updating substitutes from 'https://bayfront.guix.gnu.org'... 100.0% https://bayfront.guix.gnu.org 54.4% substitutes available (9,026 out of 16,584) at least 49,365.8 MiB of nars (compressed) 81,792.9 MiB on disk (uncompressed) 0.003 seconds per request (41.6 seconds in total) 398.0 requests per second 0.1% (10 out of 7,558) of the missing items are queued 32 queued builds x86_64-linux: 32 (100.0%) build rate: 13.84 builds per hour x86_64-linux: 13.84 builds per hour --8<---------------cut here---------------end--------------->8--- (Note that Bayfront is working hard. ;-)) All the best, simon