From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp10.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms5.migadu.com with LMTPS id sHdWHbhMuGMVzgAAbAwnHQ (envelope-from ) for ; Fri, 06 Jan 2023 17:30:48 +0100 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp10.migadu.com with LMTPS id uEZdHLhMuGOL8gAAG6o9tA (envelope-from ) for ; Fri, 06 Jan 2023 17:30:48 +0100 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 20E899104 for ; Fri, 6 Jan 2023 17:30:48 +0100 (CET) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1pDpbr-0003cv-Sb; Fri, 06 Jan 2023 11:30:23 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1pDpbh-0003bk-MB for guix-devel@gnu.org; Fri, 06 Jan 2023 11:30:15 -0500 Received: from mail-wm1-x32a.google.com ([2a00:1450:4864:20::32a]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1pDpbf-000572-JK for guix-devel@gnu.org; Fri, 06 Jan 2023 11:30:13 -0500 Received: by mail-wm1-x32a.google.com with SMTP id i17-20020a05600c355100b003d99434b1cfso1444704wmq.1 for ; Fri, 06 Jan 2023 08:30:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=mime-version:message-id:date:subject:to:from:from:to:cc:subject :date:message-id:reply-to; bh=QK7a+yPpfqIjkgach7WUkvuD8tlaMML7/+RjcJkckN4=; b=ecXzG5K8e2eB84ZosKIdx1iC+6w7S+Y5dEvVdOk8SOmrnpF+EQ37DVfeYd7VoCWSLQ J6kCmd3iJIo78tB5rUJnxUZJTbH91H7/GH9gII1XXruYbX5NWJw2N5qPwEaY1l1UNrWI ljepitbq19N1Ulv88v0VvBnTfl+hIWsZSGCwKxl/dKTmLOGfzVw1pIXRXt9JmOlPT68d U3xNCRChWEEi6VA1mK2nVYbZdO/5QpBVLp5fqVNwQycOTZJOmvSz0UPutw/TcPFoRsEr W82DRWIi7MxfMEL9TNekZe8LLNVcDP7PA8lHRe1qbyznt51XlPo0QzFyIPh+NDgqRpDz AxLQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=mime-version:message-id:date:subject:to:from:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=QK7a+yPpfqIjkgach7WUkvuD8tlaMML7/+RjcJkckN4=; b=Ymg164lsB3dGCOwoeN1blrhghibkvQO/zbdnHI430zOVBvdkO1MGpQ1alfODk44PFC yjDab6ZpY42ai3V4A3h5YGCOoPbF0vHQh7MlfqjuIUWWsLIjKU/bvF8S1i3fhA1pPu++ bYQ+8PKoGPUXKT6hWY43EYBTNLeApPHloJf6sNtY+qq1BcYJPdQnnB3qxTHH5PPEcs8V 53h1z23pWbXTs5C9GDuea/swVhZJjDRyPGNUYBxi+cyjN2QSnAn4Wi/Pe2AHMYHOz90r 4KXVlbhs7XRfF2iWa/XcxWjajAKisOn+zkn844JvZWo5ibrN3evudP0VbgPCps25DoOz hx1Q== X-Gm-Message-State: AFqh2kqz82KivPOAzYHup/FNrEV949CTxRzQs0KpkiokH8UM0PidrQlI OF2s8vu7ut6WuN+REfhxX+BfAEYXLZM= X-Google-Smtp-Source: AMrXdXvRQDXu9jVzunzRT3HS3TNBr7Xaj2/BkWKyvG0EX2ivoMtP3XhO9rS3LlxluEurIYvCGJV6jA== X-Received: by 2002:a05:600c:3b9f:b0:3d3:3c93:af55 with SMTP id n31-20020a05600c3b9f00b003d33c93af55mr10123541wms.3.1673022609095; Fri, 06 Jan 2023 08:30:09 -0800 (PST) Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id z6-20020a05600c0a0600b003d96efd09b7sm8206396wmp.19.2023.01.06.08.30.08 for (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Fri, 06 Jan 2023 08:30:08 -0800 (PST) From: zimoun To: Guix Devel Subject: Be careful with PyPI Date: Fri, 06 Jan 2023 15:36:38 +0100 Message-ID: <87sfgnivbd.fsf@gmail.com> MIME-Version: 1.0 Content-Type: text/plain Received-SPF: pass client-ip=2a00:1450:4864:20::32a; envelope-from=zimon.toutoune@gmail.com; helo=mail-wm1-x32a.google.com X-Spam_score_int: 0 X-Spam_score: -0.0 X-Spam_bar: / X-Spam_report: (-0.0 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, LONG_HEX_URI=2.07, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1673022648; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-type:content-type:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=QK7a+yPpfqIjkgach7WUkvuD8tlaMML7/+RjcJkckN4=; b=HVYGVxUQ09nohTxgAg7Auq8CsyzyA09WrLPcEBG8mfJV6ageRqkkavPcaHH1U7b+iI9OFU tOO45zLaYy22SFuoah4SBsced9dBPCN4mWvPp3neJTtmPohv84OzOqU8kyuuwE/+zsGST5 7plmZ3iBD6Be5s2YeVnXKheLy+cCoerSrv36ppujlbYgQVqCK5V5lWykyxKo+73e1JgtJ4 Fn5sIJVlQoNW6j/urGzBBX5jp/c2hSBOEuntl3hMiP+GzEzeXM2ZxdDKzfmUs53zmCaJO4 MH7i0+9HNc8NH9JHwCKblDcY3vhKBSljEw9VSU5ADTOLNG5/DMaMGeEFOC5hcA== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=ecXzG5K8; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gmail.com ARC-Seal: i=1; s=key1; d=yhetil.org; t=1673022648; a=rsa-sha256; cv=none; b=V0/kFFNzamQy1Tp+sFr720Q2e+X0dlJys7d5MBVkKIttH5ljaHlVDgv8BOLqzLhlpCYB6o gB0KKqSN3xKMg8Ljg+tpNhL520h50+z2v7ivEVTu5gKx+k9gJB6oUkuioP9xh155BbnJ6E RLI63mIPGemB6UScnLRnYFzThnSyGNJLwsf3nJELVk0DLXFpR5ruCP7oo1Ho4XajEWERrB zsaD/pFPwJ1VPC9nEZdLKVebwaj271hUPVIvAeaa16cV3ZHIJhcU6nZCDPywX0xvEdBWYt qFV3sGOV4bbMWNKxH2DUSpsiE/+yTZprdQj1Ouwiz1sVWsBG1bDz0ajQTz7p4A== X-Spam-Score: -6.17 X-Migadu-Queue-Id: 20E899104 Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=gmail.com header.s=20210112 header.b=ecXzG5K8; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gmail.com X-Migadu-Scanner: scn1.migadu.com X-Migadu-Spam-Score: -6.17 X-TUID: 6v4fY/BoZ4eb Hi, If the origin does not exist upstream, then Guix try other servers as fallback. For instance, --8<---------------cut here---------------start------------->8--- Starting download of /gnu/store/lb0kb4c212f9f789ixd1c18bcm8qbsqi-Keras-2.11.0.tar.gz >From https://files.pythonhosted.org/packages/source/K/Keras/Keras-2.11.0.tar.gz... download failed "https://files.pythonhosted.org/packages/source/K/Keras/Keras-2.11.0.tar.gz" 404 "Not Found" Starting download of /gnu/store/lb0kb4c212f9f789ixd1c18bcm8qbsqi-Keras-2.11.0.tar.gz >From https://ci.guix.gnu.org/file/Keras-2.11.0.tar.gz/sha256/1j8bsqzh49vjdxy6l1k4iwax5vpjzniynyd041xjavdzvfii1dlh... download failed "https://ci.guix.gnu.org/file/Keras-2.11.0.tar.gz/sha256/1j8bsqzh49vjdxy6l1k4iwax5vpjzniynyd041xjavdzvfii1dlh" 404 "Not Found" Starting download of /gnu/store/lb0kb4c212f9f789ixd1c18bcm8qbsqi-Keras-2.11.0.tar.gz >From https://tarballs.nixos.org/sha256/1j8bsqzh49vjdxy6l1k4iwax5vpjzniynyd041xjavdzvfii1dlh... following redirection to `https://tarballs.nixos.org/sha512/0d57cb8e0af234a619ba3dec245c2ab73cbd0566194ed6b59377231183b2ef916514ba87abe04ec7e518770c9e0cb157747db87cedf0ebeced4ae0f56be401c3'... downloading from https://tarballs.nixos.org/sha256/1j8bsqzh49vjdxy6l1k4iwax5vpjzniynyd041xjavdzvfii1dlh ... 1j8bsqzh49vjdxy6l1k4iwax5vpjzniynyd041xjavdzvfii1dlh 748KiB 67.1MiB/s 00:00 [##################] 100.0% successfully built /gnu/store/75g4aq5b25g4j1qwd3ggl1sys24q63la-Keras-2.11.0.tar.gz.drv --8<---------------cut here---------------end--------------->8--- One potential issue is that the tarballs.nixos.org is using the checksum as lookup key. Therefore, when modifying only the version and not the checksum, the something is returned with an inconsistent name/content. First, let get the source of the current Keras (v2.2.4). --8<---------------cut here---------------start------------->8--- $ ./pre-inst-env guix build python-keras -S 0.5 MB will be downloaded: /gnu/store/k2wxrqzmr29rjy1w5b0nhd4k36sv8szb-Keras-2.2.4.tar.xz substituting /gnu/store/k2wxrqzmr29rjy1w5b0nhd4k36sv8szb-Keras-2.2.4.tar.xz... downloading from https://ci.guix.gnu.org/nar/k2wxrqzmr29rjy1w5b0nhd4k36sv8szb-Keras-2.2.4.tar.xz ... Keras-2.2.4.tar.xz 521KiB 3.6MiB/s 00:00 [##################] 100.0% /gnu/store/k2wxrqzmr29rjy1w5b0nhd4k36sv8szb-Keras-2.2.4.tar.xz --8<---------------cut here---------------end--------------->8--- Then, tweak only the version (update to 2.11.0) and get the source. --8<---------------cut here---------------start------------->8--- $ git diff diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm index 75cc100851..2cbe0eddd6 100644 --- a/gnu/packages/machine-learning.scm +++ b/gnu/packages/machine-learning.scm @@ -2831,7 +2831,7 @@ (define-public python-keras-preprocessing (define-public python-keras (package (name "python-keras") - (version "2.2.4") + (version "2.11.0") (source (origin (method url-fetch) $ ./pre-inst-env guix build python-keras -S ;;; note: source file /home/simon/src/guix/guix/gnu/packages/machine-learning.scm ;;; newer than compiled /home/simon/src/guix/guix/gnu/packages/machine-learning.go ;;; note: source file /home/simon/src/guix/guix/gnu/packages/machine-learning.scm ;;; newer than compiled /home/simon/src/guix/guix/gnu/packages/machine-learning.go ;;; note: source file /home/simon/src/guix/guix/gnu/packages/machine-learning.scm ;;; newer than compiled /home/simon/.config/guix/profiles/emacs/emacs/lib/guile/3.0/site-ccache/gnu/packages/machine-learning.go ;;; note: source file /home/simon/src/guix/guix/gnu/packages/machine-learning.scm ;;; newer than compiled /home/simon/.config/guix/profiles/emacs/emacs/lib/guile/3.0/site-ccache/gnu/packages/machine-learning.go substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0% substitute: updating substitutes from 'https://bordeaux.guix.gnu.org'... 100.0% The following derivations will be built: /gnu/store/by6pgdambmv4wrg2h40l287d7zhbwc17-Keras-2.11.0.tar.xz.drv /gnu/store/75g4aq5b25g4j1qwd3ggl1sys24q63la-Keras-2.11.0.tar.gz.drv building /gnu/store/75g4aq5b25g4j1qwd3ggl1sys24q63la-Keras-2.11.0.tar.gz.drv... Starting download of /gnu/store/lb0kb4c212f9f789ixd1c18bcm8qbsqi-Keras-2.11.0.tar.gz >From https://files.pythonhosted.org/packages/source/K/Keras/Keras-2.11.0.tar.gz... download failed "https://files.pythonhosted.org/packages/source/K/Keras/Keras-2.11.0.tar.gz" 404 "Not Found" Starting download of /gnu/store/lb0kb4c212f9f789ixd1c18bcm8qbsqi-Keras-2.11.0.tar.gz >From https://ci.guix.gnu.org/file/Keras-2.11.0.tar.gz/sha256/1j8bsqzh49vjdxy6l1k4iwax5vpjzniynyd041xjavdzvfii1dlh... download failed "https://ci.guix.gnu.org/file/Keras-2.11.0.tar.gz/sha256/1j8bsqzh49vjdxy6l1k4iwax5vpjzniynyd041xjavdzvfii1dlh" 404 "Not Found" Starting download of /gnu/store/lb0kb4c212f9f789ixd1c18bcm8qbsqi-Keras-2.11.0.tar.gz >From https://tarballs.nixos.org/sha256/1j8bsqzh49vjdxy6l1k4iwax5vpjzniynyd041xjavdzvfii1dlh... following redirection to `https://tarballs.nixos.org/sha512/0d57cb8e0af234a619ba3dec245c2ab73cbd0566194ed6b59377231183b2ef916514ba87abe04ec7e518770c9e0cb157747db87cedf0ebeced4ae0f56be401c3'... downloading from https://tarballs.nixos.org/sha256/1j8bsqzh49vjdxy6l1k4iwax5vpjzniynyd041xjavdzvfii1dlh ... 1j8bsqzh49vjdxy6l1k4iwax5vpjzniynyd041xjavdzvfii1dlh 748KiB 67.1MiB/s 00:00 [##################] 100.0% successfully built /gnu/store/75g4aq5b25g4j1qwd3ggl1sys24q63la-Keras-2.11.0.tar.gz.drv building /gnu/store/by6pgdambmv4wrg2h40l287d7zhbwc17-Keras-2.11.0.tar.xz.drv... Keras-2.2.4/ [...] Keras-2.2.4/Keras.egg-info/dependency_links.txt patching file tests/integration_tests/applications_test.py Hunk #1 succeeded at 64 (offset 6 lines). /gnu/store/g2ajyl8xk9aarxrgjbng2hkj3qm2v0z2-tar-1.34/bin/tar: Option --mtime: Treating date '@1' as 1970-01-01 00:00:01 Keras-2.2.4/ [...] Keras-2.2.4/tests/test_multiprocessing.py source is at 'Keras-2.2.4' applying '/gnu/store/xbzvc0ij9z7d13mmjk3pzfsnfwsimlm7-python-keras-integration-test.patch'... successfully built /gnu/store/by6pgdambmv4wrg2h40l287d7zhbwc17-Keras-2.11.0.tar.xz.drv /gnu/store/pxj6cnk8bis14jiz79igmp0k2813v21d-Keras-2.11.0.tar.xz --8<---------------cut here---------------end--------------->8--- It is not Keras-2.11.0 but Keras-2.2.4. --8<---------------cut here---------------start------------->8--- $ sha256sum /gnu/store/k2wxrqzmr29rjy1w5b0nhd4k36sv8szb-Keras-2.2.4.tar.xz /gnu/store/pxj6cnk8bis14jiz79igmp0k2813v21d-Keras-2.11.0.tar.xz 09220b37e2a8dddcf9db1ea0a1d77d710bf084086fa9339e9278b30eac59b6b7 /gnu/store/k2wxrqzmr29rjy1w5b0nhd4k36sv8szb-Keras-2.2.4.tar.xz 09220b37e2a8dddcf9db1ea0a1d77d710bf084086fa9339e9278b30eac59b6b7 /gnu/store/pxj6cnk8bis14jiz79igmp0k2813v21d-Keras-2.11.0.tar.xz --8<---------------cut here---------------end--------------->8--- Well, the core of the issue is that https://files.pythonhosted.org/packages/source/K/Keras/Keras-2.11.0.tar.gz does not exist, so the fallback uses the checksum (of Keras v2.2.4). Note that Keras 2.11.0 is available on PyPI, https://pypi.org/project/keras/2.11.0/ but not the source. They removed the source after 2.6.0, https://pypi.org/project/keras/2.6.0/#files Arf! Well, IMHO, we cannot do better except been really careful when fetching from PyPI. (And aside this kind of troubles [1]). Cheers, simon 1: