* bug#33419: guix package is not showing that the checksum is mismatching @ 2018-11-18 14:04 Björn Höfling 2018-11-18 22:59 ` Leo Famulari 2018-11-19 20:30 ` Ludovic Courtès 0 siblings, 2 replies; 6+ messages in thread From: Björn Höfling @ 2018-11-18 14:04 UTC (permalink / raw) To: 33419 [-- Attachment #1: Type: text/plain, Size: 2672 bytes --] (Note: this is on a private channel of me, but I think this is unrelated, it could happen with any Guix package). I updated a package-definition and forgot to update the Checksum. When then updating, it just fails, and the new, nice, logging-reduced UI doesn't tell: $ guix package -u guix-tools substitute: updating list of substitutes from 'https://berlin.guixsd.org'... 0 [..] building /gnu/store/vy3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv... build of /gnu/store/vy3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv failed View build log at '/var/log/guix/drvs/vy/3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv.bz2'. -guix package: error: build failed: build of `/gnu/store/iwma3gq778n32mqz6y7277g67nvx1abb-guix-tools-0.1.0-2.4f17b79.drv' failed The log was not very helpful: Initialized empty Git repository in /gnu/store/s399g9f1k19v01rs992w5dl6aif87har- From https://gitlab.com/hoebjo/guix-tools * branch 4f17b792a3882f10ca9496b2d9aeb12b97ee93e2 -> FETCH_HEAD Note: checking out 'FETCH_HEAD'. You are in 'detached HEAD' state. You can look around, make experimental changes and commit them, and you can discard any commits you make in this state without impacting any branches by performing another checkout. If you want to create a new branch to retain commits you create, you may do so (now or later) by using -b with the checkout command again. Example: git checkout -b <new-branch-name> HEAD is now at 4f17b79 gdev: Add more package to environment. environment variable `PATH' unset Only when I explicitly built it, the error was shown: $ guix build guix-tools HEAD is now at 4f17b79 gdev: Add more package to environment. environment variable `PATH' unset output path `/gnu/store/s399g9f1k19v01rs992w5dl6aif87har-guix-tools-0.1.0-2.4f17b79-checkout' should have r:sha256 hash `1j4q43hk7jrys7zsmws37g6w7babzshfdb1s5myl7qwr3mcx6hnf', instead has `0b61q29915b4i6adidx3zixnx3m0zp58rjbfa9byqcz13szznc52' build of /gnu/store/vy3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv failed View build log at '/var/log/guix/drvs/vy/3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv.bz2'. cannot build derivation `/gnu/store/iwma3gq778n32mqz6y7277g67nvx1abb-guix-tools-0.1.0-2.4f17b79.drv': 1 dependencies couldn't be built guix build: error: build failed: build of `/gnu/store/iwma3gq778n32mqz6y7277g67nvx1abb-guix-tools-0.1.0-2.4f17b79.drv' failed Is it intended that this build-failure detail is not shown? I suppose not. At least in a log it should be shown. Björn [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 181 bytes --] ^ permalink raw reply [flat|nested] 6+ messages in thread
* bug#33419: guix package is not showing that the checksum is mismatching 2018-11-18 14:04 bug#33419: guix package is not showing that the checksum is mismatching Björn Höfling @ 2018-11-18 22:59 ` Leo Famulari 2018-11-19 9:13 ` Björn Höfling 2018-11-19 20:30 ` Ludovic Courtès 1 sibling, 1 reply; 6+ messages in thread From: Leo Famulari @ 2018-11-18 22:59 UTC (permalink / raw) To: Björn Höfling; +Cc: 33419 [-- Attachment #1: Type: text/plain, Size: 3087 bytes --] On Sun, Nov 18, 2018 at 03:04:33PM +0100, Björn Höfling wrote: > I updated a package-definition and forgot to update the Checksum. When > then updating, it just fails, and the new, nice, logging-reduced UI > doesn't tell: Yes, this is a classic "gotcha" of Guix package development. In Guix, those "things" for which you provide a hash are called "fixed-output derivations": https://www.gnu.org/software/guix/manual/en/html_node/Derivations.html Unlike regular derivations, we know in advance what the output of the derivation will be. Therefore, it does not matter to us how it is built (from source, downloaded over HTTP, downloaded with Git, found in /gnu/store, etc). When building fixed-output derivations, Guix first looks in /gnu/store to see if they are already built. If so, it just uses what it finds there. So, if you give the wrong hash, as you did in your example, Guix will use that wrong source code. This failure mode is often discovered by people who used `guix download` to calculate a source hash, but then put the wrong URI in their package definition. Because the source is already in /gnu/store, the URI is not tested and their package doesn't work for anybody else. It may also happen when the source is only found on the content-addressed mirrors provided by Nix; no file-name checking is performed in that case. > $ guix package -u guix-tools > substitute: updating list of substitutes from 'https://berlin.guixsd.org'... 0 > [..] > building /gnu/store/vy3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv... > build of /gnu/store/vy3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv failed > View build log at '/var/log/guix/drvs/vy/3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv.bz2'. > -guix package: error: build failed: build of `/gnu/store/iwma3gq778n32mqz6y7277g67nvx1abb-guix-tools-0.1.0-2.4f17b79.drv' failed [...] > Only when I explicitly built it, the error was shown: > > $ guix build guix-tools > > HEAD is now at 4f17b79 gdev: Add more package to environment. > environment variable `PATH' unset > output path `/gnu/store/s399g9f1k19v01rs992w5dl6aif87har-guix-tools-0.1.0-2.4f17b79-checkout' should have r:sha256 hash `1j4q43hk7jrys7zsmws37g6w7babzshfdb1s5myl7qwr3mcx6hnf', instead has `0b61q29915b4i6adidx3zixnx3m0zp58rjbfa9byqcz13szznc52' > build of /gnu/store/vy3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv failed > View build log at '/var/log/guix/drvs/vy/3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv.bz2'. > cannot build derivation `/gnu/store/iwma3gq778n32mqz6y7277g67nvx1abb-guix-tools-0.1.0-2.4f17b79.drv': 1 dependencies couldn't be built > guix build: error: build failed: build of `/gnu/store/iwma3gq778n32mqz6y7277g67nvx1abb-guix-tools-0.1.0-2.4f17b79.drv' failed > > Is it intended that this build-failure detail is not shown? I suppose > not. At least in a log it should be shown. I agree that `guix package` should print the relevant error. [-- Attachment #2: signature.asc --] [-- Type: application/pgp-signature, Size: 833 bytes --] ^ permalink raw reply [flat|nested] 6+ messages in thread
* bug#33419: guix package is not showing that the checksum is mismatching 2018-11-18 22:59 ` Leo Famulari @ 2018-11-19 9:13 ` Björn Höfling 0 siblings, 0 replies; 6+ messages in thread From: Björn Höfling @ 2018-11-19 9:13 UTC (permalink / raw) To: Leo Famulari; +Cc: 33419 [-- Attachment #1: Type: text/plain, Size: 4501 bytes --] Hi Leo, On Sun, 18 Nov 2018 17:59:48 -0500 Leo Famulari <leo@famulari.name> wrote: > On Sun, Nov 18, 2018 at 03:04:33PM +0100, Björn Höfling wrote: > > I updated a package-definition and forgot to update the Checksum. > > When then updating, it just fails, and the new, nice, > > logging-reduced UI doesn't tell: > > Yes, this is a classic "gotcha" of Guix package development. > > In Guix, those "things" for which you provide a hash are called > "fixed-output derivations": > > https://www.gnu.org/software/guix/manual/en/html_node/Derivations.html > > Unlike regular derivations, we know in advance what the output of the > derivation will be. Therefore, it does not matter to us how it is > built (from source, downloaded over HTTP, downloaded with Git, found > in /gnu/store, etc). > > When building fixed-output derivations, Guix first looks in /gnu/store > to see if they are already built. If so, it just uses what it finds > there. > > So, if you give the wrong hash, as you did in your example, Guix will > use that wrong source code. > > This failure mode is often discovered by people who used `guix > download` to calculate a source hash, but then put the wrong URI in > their package definition. Because the source is already > in /gnu/store, the URI is not tested and their package doesn't work > for anybody else. > > It may also happen when the source is only found on the > content-addressed mirrors provided by Nix; no file-name checking is > performed in that case. > > > $ guix package -u guix-tools > > substitute: updating list of substitutes from > > 'https://berlin.guixsd.org'... 0 [..] > > building /gnu/store/vy3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv... > > build > > of /gnu/store/vy3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv > > failed View build log at > > '/var/log/guix/drvs/vy/3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv.bz2'. > > -guix package: error: build failed: build of > > `/gnu/store/iwma3gq778n32mqz6y7277g67nvx1abb-guix-tools-0.1.0-2.4f17b79.drv' > > failed > > [...] > > > Only when I explicitly built it, the error was shown: > > > > $ guix build guix-tools > > > > HEAD is now at 4f17b79 gdev: Add more package to environment. > > environment variable `PATH' unset > > output path > > `/gnu/store/s399g9f1k19v01rs992w5dl6aif87har-guix-tools-0.1.0-2.4f17b79-checkout' > > should have r:sha256 hash > > `1j4q43hk7jrys7zsmws37g6w7babzshfdb1s5myl7qwr3mcx6hnf', instead has > > `0b61q29915b4i6adidx3zixnx3m0zp58rjbfa9byqcz13szznc52' build > > of /gnu/store/vy3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv > > failed View build log at > > '/var/log/guix/drvs/vy/3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv.bz2'. > > cannot build derivation > > `/gnu/store/iwma3gq778n32mqz6y7277g67nvx1abb-guix-tools-0.1.0-2.4f17b79.drv': > > 1 dependencies couldn't be built guix build: error: build failed: > > build of > > `/gnu/store/iwma3gq778n32mqz6y7277g67nvx1abb-guix-tools-0.1.0-2.4f17b79.drv' > > failed > > > > Is it intended that this build-failure detail is not shown? I > > suppose not. At least in a log it should be shown. > > I agree that `guix package` should print the relevant error. thank you very much for your lengthy explanations. I'm just no longer sure we talk about the same problem :-) What you described is the fact that somethings wrong in the URL from beginning but someone seeded the store with 'guix download'. Or the URL 404s out but the sources are all available in the Content-Addressed-Network. Then Guix still downloads it by hash (though it is not locally searching in the store by hash, cmp this bug https://debbugs.gnu.org/cgi/bugreport.cgi?bug=32245). But that's not what I was referring to here: My point was: "guix build" failed, and it was failing because the hash of the (then newly downloaded) sources did not match the expected ones. And "guix build" is saying so in its output. But: A "guix package" (with -u or -i) is of cause also failing. But it hides the cause. And that is nice, the new UI is meant to hide all those details and backtraces from the user. It refers to the log for those details. But in the referenced log you cannot find the cause either. It is not fully equivalent with the "guix build" logs. Does that make sense? Björn [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 181 bytes --] ^ permalink raw reply [flat|nested] 6+ messages in thread
* bug#33419: guix package is not showing that the checksum is mismatching 2018-11-18 14:04 bug#33419: guix package is not showing that the checksum is mismatching Björn Höfling 2018-11-18 22:59 ` Leo Famulari @ 2018-11-19 20:30 ` Ludovic Courtès 2018-11-21 20:18 ` Björn Höfling 1 sibling, 1 reply; 6+ messages in thread From: Ludovic Courtès @ 2018-11-19 20:30 UTC (permalink / raw) To: Björn Höfling; +Cc: 33419 Hello, Björn Höfling <bjoern.hoefling@bjoernhoefling.de> skribis: > $ guix package -u guix-tools > substitute: updating list of substitutes from 'https://berlin.guixsd.org'... 0 > [..] > building /gnu/store/vy3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv... > build of /gnu/store/vy3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv failed > View build log at '/var/log/guix/drvs/vy/3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv.bz2'. > -guix package: error: build failed: build of `/gnu/store/iwma3gq778n32mqz6y7277g67nvx1abb-guix-tools-0.1.0-2.4f17b79.drv' failed [...] > $ guix build guix-tools > > HEAD is now at 4f17b79 gdev: Add more package to environment. > environment variable `PATH' unset > output path `/gnu/store/s399g9f1k19v01rs992w5dl6aif87har-guix-tools-0.1.0-2.4f17b79-checkout' should have r:sha256 hash `1j4q43hk7jrys7zsmws37g6w7babzshfdb1s5myl7qwr3mcx6hnf', instead has `0b61q29915b4i6adidx3zixnx3m0zp58rjbfa9byqcz13szznc52' > build of /gnu/store/vy3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv failed > View build log at '/var/log/guix/drvs/vy/3s1y7bv1w6d8gmp5b10xppy9skbgkd-guix-tools-0.1.0-2.4f17b79-checkout.drv.bz2'. > cannot build derivation `/gnu/store/iwma3gq778n32mqz6y7277g67nvx1abb-guix-tools-0.1.0-2.4f17b79.drv': 1 dependencies couldn't be built > guix build: error: build failed: build of `/gnu/store/iwma3gq778n32mqz6y7277g67nvx1abb-guix-tools-0.1.0-2.4f17b79.drv' failed > > > Is it intended that this build-failure detail is not shown? I suppose > not. At least in a log it should be shown. I suspect you’re running an “old” guix-daemon, aren’t you? Could you try again with an up-to-date daemon (and client)? The code that prints hash mismatch errors when talking to recent daemons is in (guix status). Thanks, Ludo’. ^ permalink raw reply [flat|nested] 6+ messages in thread
* bug#33419: guix package is not showing that the checksum is mismatching 2018-11-19 20:30 ` Ludovic Courtès @ 2018-11-21 20:18 ` Björn Höfling 2018-11-21 22:16 ` Ludovic Courtès 0 siblings, 1 reply; 6+ messages in thread From: Björn Höfling @ 2018-11-21 20:18 UTC (permalink / raw) To: Ludovic Courtès; +Cc: 33419-done [-- Attachment #1: Type: text/plain, Size: 3166 bytes --] On Mon, 19 Nov 2018 21:30:46 +0100 ludo@gnu.org (Ludovic Courtès) wrote: > Hello, > > Björn Höfling <bjoern.hoefling@bjoernhoefling.de> skribis: > > Is it intended that this build-failure detail is not shown? I > > suppose not. At least in a log it should be shown. > > I suspect you’re running an “old” guix-daemon, aren’t you? > > Could you try again with an up-to-date daemon (and client)? The code > that prints hash mismatch errors when talking to recent daemons is in > (guix status). Indeed! Short story: After really updating the daemon/root's Guix, it works now. Long story: I have a really old daemon here: $ tail -n 2 /etc/init/guix-daemon.conf exec /gnu/store/5drb0ijbszvy8xmps89qcav1p4vy9wqr-guix-0.11.0/bin/guix-daemon --build-users-group=guixbuild I have no clue how to update it correctly and it was always a mystery, so I read in the manual how to do that nowadays: https://guix.info/manual/en/Binary-Installation.html#Binary-Installation and did: $ sudo cp /root/.guix-profile/lib/upstart/system/guix-daemon.conf /etc/init/guix-daemon.conf $ tail -n 2 /etc/init/guix-daemon.conf exec /var/guix/profiles/per-user/root/guix-profile/bin/guix-daemon --build-users-group=guixbuild $ sudo systemctl stop guix-daemon $ sudo systemctl start guix-daemon $ ps -aux | grep guix root 6995 0.1 0.0 27976 3940 ? Ss 07:30 0:00 /var/guix/profiles/per-user/root/guix-profile/bin/guix-daemon --substitute-urls=https://berlinguixsd.org https://mirror.hydra.gnu.org --build-users-group=guixbuild bjoern 6998 0.0 0.0 15780 948 pts/16 S+ 07:30 0:00 grep --color=auto guix Now, let's introduce the wrong checksum again, pull, update: $ guix pull $ guix package -u guix-tools [...] I was about to say that it still doesn't work, until I thought maybe my guix in ~root/.guix-profile could also be a bit old: $ sudo guix package -I | grep guix guix 0.13.0 out /gnu/store/vir3lrwqy50pr8fkaf3m091dgbrja2n6-guix-0.13.0 Uh, better than 0.11, but still not the newest version. But how to get to a new one? Now, a `guix pull` for root failed with some error. So I did a /home/bjoern/.config/guix/current/bin/guix pull --commit=<the-one-of-my-normal-user> That worked, it updated guix. After guix package -u, restarting the daemon again, I'm happy to see the error directly on (as unpriviledged user bjoern: "guix package -u guix-tools"): substitute: updating substitutes from 'https://mirror.hydra.gnu.org'... 100.0% building /gnu/store/kx97aqz66lpibxjiw3g8k7xhz5mmniyp-guix-tools-0.1.0-3.295d0a0-checkout.drv... r:sha256 hash mismatch for /gnu/store/9d0djawpyjdl6jp900agmqfxrbk2vcra-guix-tools-0.1.0-3.295d0a0-checkout: expected hash: 11111111y50jcakricz36n1n5m99fxv8gxmk9ba3g0zfsl1a0918 actual hash: 06z0jhxpy50jcakricz36n1n5m99fxv8gxmk9ba3g0zfsl1a0918 hash mismatch for store item '/gnu/store/9d0djawpyjdl6jp900agmqfxrbk2vcra-guix-tools-0.1.0-3.295d0a0-checkout' build of /gnu/store/kx97aqz66lpibxjiw3g8k7xhz5mmniyp-guix-tools-0.1.0-3.295d0a0-checkout.drv failed Thanks, closing this bug. Björn [-- Attachment #2: OpenPGP digital signature --] [-- Type: application/pgp-signature, Size: 181 bytes --] ^ permalink raw reply [flat|nested] 6+ messages in thread
* bug#33419: guix package is not showing that the checksum is mismatching 2018-11-21 20:18 ` Björn Höfling @ 2018-11-21 22:16 ` Ludovic Courtès 0 siblings, 0 replies; 6+ messages in thread From: Ludovic Courtès @ 2018-11-21 22:16 UTC (permalink / raw) To: Björn Höfling; +Cc: 33419-done Björn Höfling <bjoern.hoefling@bjoernhoefling.de> skribis: > On Mon, 19 Nov 2018 21:30:46 +0100 > ludo@gnu.org (Ludovic Courtès) wrote: > >> Hello, >> >> Björn Höfling <bjoern.hoefling@bjoernhoefling.de> skribis: > >> > Is it intended that this build-failure detail is not shown? I >> > suppose not. At least in a log it should be shown. >> >> I suspect you’re running an “old” guix-daemon, aren’t you? >> >> Could you try again with an up-to-date daemon (and client)? The code >> that prints hash mismatch errors when talking to recent daemons is in >> (guix status). > > Indeed! Short story: After really updating the daemon/root's Guix, it > works now. Cool! > Long story: Pffew, quite a journey. Hopefully upgrading the daemon on foreign distro will be easier and more natural with <https://issues.guix.info/issue/33111>. Thanks, Ludo’. ^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2018-11-21 22:17 UTC | newest] Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2018-11-18 14:04 bug#33419: guix package is not showing that the checksum is mismatching Björn Höfling 2018-11-18 22:59 ` Leo Famulari 2018-11-19 9:13 ` Björn Höfling 2018-11-19 20:30 ` Ludovic Courtès 2018-11-21 20:18 ` Björn Höfling 2018-11-21 22:16 ` Ludovic Courtès
Code repositories for project(s) associated with this public inbox https://git.savannah.gnu.org/cgit/guix.git This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).