unofficial mirror of help-guix@gnu.org 
 help / color / mirror / Atom feed
* hash mismatch on permanently moved URL
@ 2020-07-02 12:32 Giovanni Biscuolo
  2020-07-02 12:56 ` Efraim Flashner
                   ` (3 more replies)
  0 siblings, 4 replies; 9+ messages in thread
From: Giovanni Biscuolo @ 2020-07-02 12:32 UTC (permalink / raw)
  To: help-guix

[-- Attachment #1: Type: text/plain, Size: 3556 bytes --]

Hi Guix,

yesterday I installed a new Guix System (on iron) using the installer
(latest stable
https://ftp.gnu.org/gnu/guix/guix-system-install-1.1.0.x86_64-linux.iso.xz
on USB)

The installation is fine but when I try to guix pull I get this:

--8<---------------cut here---------------start------------->8---

~$ sudo -i guix pull
Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
Building from this channel:
  guix      https://git.savannah.gnu.org/git/guix.git   b919d40
building /gnu/store/f99dg2cqqlskh5q07l9dw5la7l5s28lq-libgcrypt-1.8.4.tar.bz2.drv...
downloading from https://gnupg.org/ftp/gcrypt/libgcrypt/libgcrypt-1.8.4.tar.bz2...
building /gnu/store/4582v7day5c4v9qaidlkwmd6kllks2y4-icu4c-64_2-src.tgz.drv...
downloading from http://download.icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz...
|sha256 hash mismatch for /gnu/store/0zh5mvhgcx0198k7j6p5pgrc5krgxyqj-icu4c-64_2-src.tgz:
  expected hash: 0v0xsf14xwlj125y9fd8lrhsaych4d8liv8gr746zng6g225szb2
  actual hash:   1qfbm2kh7hzd8752rky9dzis8qhgkhs6dkq71k8zar8y74nz7265
hash mismatch for store item '/gnu/store/0zh5mvhgcx0198k7j6p5pgrc5krgxyqj-icu4c-64_2-src.tgz'
build of /gnu/store/4582v7day5c4v9qaidlkwmd6kllks2y4-icu4c-64_2-src.tgz.drv failed
View build log at '/var/log/guix/drvs/45/82v7day5c4v9qaidlkwmd6kllks2y4-icu4c-64_2-src.tgz.drv.bz2'.
cannot build derivation `/gnu/store/y9y4j318znj6xfdnljkc8q8n0kp75liw-icu4c-64_2-src.tar.xz.drv': 1 dependencies couldn't be built
building /gnu/store/22bdz5hk38p49xllw64xddrn9sgdm6b0-libgcrypt-1.8.4.drv...
cannot build derivation `/gnu/store/4wzc4ccnspff6hm00b82ma5c2p9ykh7k-icu4c-64.2.drv': 1 dependencies couldn't be built
cannot build derivation `/gnu/store/34kcbgv7ls6r214w071p35d18xpirzff-openldap-2.4.47.drv': 1 dependencies couldn't be built
building /gnu/store/03q5wvsw7f91rkmyawhkhrcqvrxrykrc-psutils.tar.gz.drv...
cannot build derivation `/gnu/store/8ij04934aafwspnrarm5c3lv9hnz34i2-curl-7.66.0.drv': 1 dependencies couldn't be built
guix pull: error: build of `/gnu/store/8ij04934aafwspnrarm5c3lv9hnz34i2-curl-7.66.0.drv' failed

--8<---------------cut here---------------end--------------->8---

I searched in the current guix master branch and found icu4c is at
version 66.1 now (the commit that upgraded to 64.2 is 27ed6960be)

The problem is that
http://download.icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz
moved pernamently:

--8<---------------cut here---------------start------------->8---

~$ curl -I http://download.icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz
HTTP/1.1 301 Moved Permanently
Date: Thu, 02 Jul 2020 12:27:32 GMT
Server: Apache/2.4.38 (Debian)
Content-Security-Policy: upgrade-insecure-requests;
Location: https://icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz
Content-Type: text/html; charset=iso-8859-1

--8<---------------cut here---------------end--------------->8---

This will be a build server so I'm not using substitutes:

--8<---------------cut here---------------start------------->8---

   (guix-service-type config =>
                                (guix-configuration
                                 (inherit config)
                                 (use-substitutes? #f)
                                 (authorized-keys
                                  %authorized-guix-keys))

--8<---------------cut here---------------end--------------->8---

Please how can I fix this situation?

Thanks! Gio'

-- 
Giovanni Biscuolo

Xelera IT Infrastructures

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: hash mismatch on permanently moved URL
  2020-07-02 12:32 hash mismatch on permanently moved URL Giovanni Biscuolo
@ 2020-07-02 12:56 ` Efraim Flashner
  2020-07-02 13:04 ` zimoun
                   ` (2 subsequent siblings)
  3 siblings, 0 replies; 9+ messages in thread
From: Efraim Flashner @ 2020-07-02 12:56 UTC (permalink / raw)
  To: Giovanni Biscuolo; +Cc: help-guix

[-- Attachment #1: Type: text/plain, Size: 4143 bytes --]

On Thu, Jul 02, 2020 at 02:32:06PM +0200, Giovanni Biscuolo wrote:
> Hi Guix,
> 
> yesterday I installed a new Guix System (on iron) using the installer
> (latest stable
> https://ftp.gnu.org/gnu/guix/guix-system-install-1.1.0.x86_64-linux.iso.xz
> on USB)
> 
> The installation is fine but when I try to guix pull I get this:
> 
> --8<---------------cut here---------------start------------->8---
> 
> ~$ sudo -i guix pull
> Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
> Building from this channel:
>   guix      https://git.savannah.gnu.org/git/guix.git   b919d40
> building /gnu/store/f99dg2cqqlskh5q07l9dw5la7l5s28lq-libgcrypt-1.8.4.tar.bz2.drv...
> downloading from https://gnupg.org/ftp/gcrypt/libgcrypt/libgcrypt-1.8.4.tar.bz2...
> building /gnu/store/4582v7day5c4v9qaidlkwmd6kllks2y4-icu4c-64_2-src.tgz.drv...
> downloading from http://download.icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz...
> |sha256 hash mismatch for /gnu/store/0zh5mvhgcx0198k7j6p5pgrc5krgxyqj-icu4c-64_2-src.tgz:
>   expected hash: 0v0xsf14xwlj125y9fd8lrhsaych4d8liv8gr746zng6g225szb2
>   actual hash:   1qfbm2kh7hzd8752rky9dzis8qhgkhs6dkq71k8zar8y74nz7265
> hash mismatch for store item '/gnu/store/0zh5mvhgcx0198k7j6p5pgrc5krgxyqj-icu4c-64_2-src.tgz'
> build of /gnu/store/4582v7day5c4v9qaidlkwmd6kllks2y4-icu4c-64_2-src.tgz.drv failed
> View build log at '/var/log/guix/drvs/45/82v7day5c4v9qaidlkwmd6kllks2y4-icu4c-64_2-src.tgz.drv.bz2'.
> cannot build derivation `/gnu/store/y9y4j318znj6xfdnljkc8q8n0kp75liw-icu4c-64_2-src.tar.xz.drv': 1 dependencies couldn't be built
> building /gnu/store/22bdz5hk38p49xllw64xddrn9sgdm6b0-libgcrypt-1.8.4.drv...
> cannot build derivation `/gnu/store/4wzc4ccnspff6hm00b82ma5c2p9ykh7k-icu4c-64.2.drv': 1 dependencies couldn't be built
> cannot build derivation `/gnu/store/34kcbgv7ls6r214w071p35d18xpirzff-openldap-2.4.47.drv': 1 dependencies couldn't be built
> building /gnu/store/03q5wvsw7f91rkmyawhkhrcqvrxrykrc-psutils.tar.gz.drv...
> cannot build derivation `/gnu/store/8ij04934aafwspnrarm5c3lv9hnz34i2-curl-7.66.0.drv': 1 dependencies couldn't be built
> guix pull: error: build of `/gnu/store/8ij04934aafwspnrarm5c3lv9hnz34i2-curl-7.66.0.drv' failed
> 
> --8<---------------cut here---------------end--------------->8---
> 
> I searched in the current guix master branch and found icu4c is at
> version 66.1 now (the commit that upgraded to 64.2 is 27ed6960be)
> 
> The problem is that
> http://download.icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz
> moved pernamently:
> 
> --8<---------------cut here---------------start------------->8---
> 
> ~$ curl -I http://download.icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz
> HTTP/1.1 301 Moved Permanently
> Date: Thu, 02 Jul 2020 12:27:32 GMT
> Server: Apache/2.4.38 (Debian)
> Content-Security-Policy: upgrade-insecure-requests;
> Location: https://icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz
> Content-Type: text/html; charset=iso-8859-1
> 
> --8<---------------cut here---------------end--------------->8---
> 
> This will be a build server so I'm not using substitutes:
> 
> --8<---------------cut here---------------start------------->8---
> 
>    (guix-service-type config =>
>                                 (guix-configuration
>                                  (inherit config)
>                                  (use-substitutes? #f)
>                                  (authorized-keys
>                                   %authorized-guix-keys))
> 
> --8<---------------cut here---------------end--------------->8---
> 
> Please how can I fix this situation?
> 
> Thanks! Gio'
> 

You can "preseed" the file into the store with 'guix download
https://icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz'. If the
hash matches then guix will use the tarball and not try to download it
again.


-- 
Efraim Flashner   <efraim@flashner.co.il>   אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: hash mismatch on permanently moved URL
  2020-07-02 12:32 hash mismatch on permanently moved URL Giovanni Biscuolo
  2020-07-02 12:56 ` Efraim Flashner
@ 2020-07-02 13:04 ` zimoun
  2020-07-02 13:37   ` Giovanni Biscuolo
  2020-07-02 13:06 ` Giovanni Biscuolo
  2020-07-24 15:21 ` Ludovic Courtès
  3 siblings, 1 reply; 9+ messages in thread
From: zimoun @ 2020-07-02 13:04 UTC (permalink / raw)
  To: Giovanni Biscuolo; +Cc: help-guix

Dear,

Ah the joy of in-place replacement! :-D


On Thu, 2 Jul 2020 at 14:33, Giovanni Biscuolo <g@xelera.eu> wrote:

> --8<---------------cut here---------------start------------->8---
> downloading from http://download.icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz...
>   expected hash: 0v0xsf14xwlj125y9fd8lrhsaych4d8liv8gr746zng6g225szb2
>   actual hash:   1qfbm2kh7hzd8752rky9dzis8qhgkhs6dkq71k8zar8y74nz7265
> --8<---------------cut here---------------end--------------->8---

--8<---------------cut here---------------start------------->8---
guix download  http://download.icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz
Starting download of /tmp/guix-file.t0yyia
From http://download.icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz...
following redirection to
`https://icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz'...
following redirection to
`http://site.icu-project.org/download/#/icu4c/64.2/icu4c-64_2-src.tgz'...
 …2-src.tgz
                                     2.4MiB/s 00:00 | 44KiB
transferred
/gnu/store/zpzx14sjr87pv6fjz10r9vbhfni9gvf9-icu4c-64_2-src.tgz
08m27r3wrlaxrzzgjqnqsbcz8hmll9sbd1z1wk3js9wr09q3l1q5
--8<---------------cut here---------------end--------------->8---

Wow!  The actual hash I get is different of the actual hash you get.

> Please how can I fix this situation?

guix download http://ci.guix.gnu.org/nar/0zh5mvhgcx0198k7j6p5pgrc5krgxyqj-icu4c-64_2-src.tgz

Or something like that. :-)


All the best,
simon


^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: hash mismatch on permanently moved URL
  2020-07-02 12:32 hash mismatch on permanently moved URL Giovanni Biscuolo
  2020-07-02 12:56 ` Efraim Flashner
  2020-07-02 13:04 ` zimoun
@ 2020-07-02 13:06 ` Giovanni Biscuolo
  2020-07-02 13:43   ` Tobias Geerinckx-Rice
  2020-07-24 15:21 ` Ludovic Courtès
  3 siblings, 1 reply; 9+ messages in thread
From: Giovanni Biscuolo @ 2020-07-02 13:06 UTC (permalink / raw)
  To: help-guix

[-- Attachment #1: Type: text/plain, Size: 2754 bytes --]

Hello,

I tried to build using the current upstream release channel (see below)
but I'm still stuck.

Giovanni Biscuolo <g@xelera.eu> writes:

[...]

> The problem is that
> http://download.icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz
> moved pernamently:
>
> --8<---------------cut here---------------start------------->8---
>
> ~$ curl -I http://download.icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz
> HTTP/1.1 301 Moved Permanently
> Date: Thu, 02 Jul 2020 12:27:32 GMT
> Server: Apache/2.4.38 (Debian)
> Content-Security-Policy: upgrade-insecure-requests;
> Location: https://icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz
> Content-Type: text/html; charset=iso-8859-1
>
> --8<---------------cut here---------------end--------------->8---

... AND:

--8<---------------cut here---------------start------------->8---

~$ curl -I https://icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz
HTTP/1.1 302 Found
Date: Thu, 02 Jul 2020 12:51:46 GMT
Server: Apache/2.4.38 (Debian)
Content-Security-Policy: upgrade-insecure-requests;
Location: http://site.icu-project.org/download/#/icu4c/64.2/icu4c-64_2-src.tgz
Content-Type: text/html; charset=iso-8859-1

--8<---------------cut here---------------end--------------->8---

so I got the source URL from the new releases official channel, and
built using:

--8<---------------cut here---------------start------------->8---

~$ guix build icu4c --with-source=https://github.com/unicode-org/icu/releases/download/release-64-2/icu4c-64_2-src.tgz
[...]
successfully built /gnu/store/waf07n3970nz183kvk947lpa1wj9ixvk-icu4c-64_2-src.drv
/gnu/store/8fxpn9b21gf782n6v6cq4q17jcfgm9ix-icu4c-64_2-src

--8<---------------cut here---------------end--------------->8---

After this, unfortunately, `guix pull` is still trying to build icu4c
since it is a different store item:

--8<---------------cut here---------------start------------->8---

building /gnu/store/4582v7day5c4v9qaidlkwmd6kllks2y4-icu4c-64_2-src.tgz.drv...
downloading from http://download.icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz...
/sha256 hash mismatch for /gnu/store/0zh5mvhgcx0198k7j6p5pgrc5krgxyqj-icu4c-64_2-src.tgz:
  expected hash: 0v0xsf14xwlj125y9fd8lrhsaych4d8liv8gr746zng6g225szb2
  actual hash:   19pfpqg5yl86nnzfkzkgq521y56wg1yhfiyis7m480rczyiqnbin
hash mismatch for store item '/gnu/store/0zh5mvhgcx0198k7j6p5pgrc5krgxyqj-icu4c-64_2-src.tgz'
build of /gnu/store/4582v7day5c4v9qaidlkwmd6kllks2y4-icu4c-64_2-src.tgz.drv failed

--8<---------------cut here---------------end--------------->8---

[...]

I still don't know how to solve this situation.

Any hint please?

Thanks! Gio'

-- 
Giovanni Biscuolo

Xelera IT Infrastructures

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: hash mismatch on permanently moved URL
  2020-07-02 13:04 ` zimoun
@ 2020-07-02 13:37   ` Giovanni Biscuolo
  2020-07-02 14:05     ` zimoun
  0 siblings, 1 reply; 9+ messages in thread
From: Giovanni Biscuolo @ 2020-07-02 13:37 UTC (permalink / raw)
  To: Efraim Flashner, zimoun; +Cc: help-guix

[-- Attachment #1: Type: text/plain, Size: 2393 bytes --]

Hi Efraim and Simon,

thank you for your very quick reply! I read your messages after I tried
my "guix build" attempt

zimoun <zimon.toutoune@gmail.com> writes:

> Dear,
>
> Ah the joy of in-place replacement! :-D

Actually this is a in-place *displacement* (with HTML) :-O

Fortunately Guix is amazing \O/

Anyway: I guess there will be potentially other issues like this one in
the future (permanent redirections to web pages instead of sources) and
unfortunately (AFAIU) Guix will not be able to use alternative sources
like Software Heritage: WDYT about considering 301 and 302 HTTP codes as
"soft failures" and making Guix considering the alternative sources?

Problems like this one are very bad for our time machine, I'm just
thinking if Guix can do something to prevent them.

[...]

>> Please how can I fix this situation?
>
> guix download http://ci.guix.gnu.org/nar/0zh5mvhgcx0198k7j6p5pgrc5krgxyqj-icu4c-64_2-src.tgz

Oh yes... download (preseed the file)!

I did:

--8<---------------cut here---------------start------------->8---

$ guix download https://github.com/unicode-org/icu/releases/download/release-64-2/icu4c-64_2-src.tgz

Starting download of /tmp/guix-file.QYSPMo
From https://github.com/unicode-org/icu/releases/download/release-64-2/icu4c-64_2-src.tgz...
following redirection to `https://github-production-release-asset-2e65be.s3.amazonaws.com/49244766/c239d900-615b-11e9-9f18-c7c2f6baa47b?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=AKIAIWNJYAX4CSVEH53A%2F20200702%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20200702T131303Z&X-Amz-Expires=300&X-Amz-Signature=5b743b3a38385952bde1807ac6c8f387e534650a49cf2f533bb04164cf0bc255&X-Amz-SignedHeaders=host&actor_id=0&repo_id=49244766&response-content-disposition=attachment%3B%20filename%3Dicu4c-64_2-src.tgz&response-content-type=application%2Foctet-stream'...
 icu4c-64_2-src.tgz  22.9MiB                                                                                                   11.5MiB/s 00:02 [##################] 100.0%
/gnu/store/0zh5mvhgcx0198k7j6p5pgrc5krgxyqj-icu4c-64_2-src.tgz
0v0xsf14xwlj125y9fd8lrhsaych4d8liv8gr746zng6g225szb2

--8<---------------cut here---------------end--------------->8---

and guix pull is going on now, building half of the world! :-)

[...]

Thanks a lot! Gio'

-- 
Giovanni Biscuolo

Xelera IT Infrastructures

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: hash mismatch on permanently moved URL
  2020-07-02 13:06 ` Giovanni Biscuolo
@ 2020-07-02 13:43   ` Tobias Geerinckx-Rice
  0 siblings, 0 replies; 9+ messages in thread
From: Tobias Geerinckx-Rice @ 2020-07-02 13:43 UTC (permalink / raw)
  To: Giovanni Biscuolo; +Cc: help-guix

Giovanni,

I'm not sure what the 'guix build' is supposed to accomplish, but can 
confirm that using 'guix download' as suggested upthread returns the 
correct 0v0 hash.

So just do that, then continue building without trying to change 
inputs--as you note, that will change their hash and defeat the purpose.

 > The problem is that <URL> moved pernamently:

Not in itself.  Many (most?) sources do.  Guix doesn't care about URLs 
or redirects, only where they end up.

Kind regards,

T G-R




^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: hash mismatch on permanently moved URL
  2020-07-02 13:37   ` Giovanni Biscuolo
@ 2020-07-02 14:05     ` zimoun
  2020-07-02 17:21       ` Giovanni Biscuolo
  0 siblings, 1 reply; 9+ messages in thread
From: zimoun @ 2020-07-02 14:05 UTC (permalink / raw)
  To: Giovanni Biscuolo; +Cc: help-guix

On Thu, 2 Jul 2020 at 15:38, Giovanni Biscuolo <g@xelera.eu> wrote:

> Actually this is a in-place *displacement* (with HTML) :-O

I do not know what is an "inplace displacement (with HTML)".

> Anyway: I guess there will be potentially other issues like this one in
> the future (permanent redirections to web pages instead of sources) and
> unfortunately (AFAIU) Guix will not be able to use alternative sources
> like Software Heritage: WDYT about considering 301 and 302 HTTP codes as
> "soft failures" and making Guix considering the alternative sources?

Redirection should not be an issue.  The important point is the
integrity of the data (the sha256 field).
And here, there is a mismatch:

expected hash: 0v0xsf14xwlj125y9fd8lrhsaych4d8liv8gr746zng6g225szb2
actual hash:   1qfbm2kh7hzd8752rky9dzis8qhgkhs6dkq71k8zar8y74nz7265
                     08m27r3wrlaxrzzgjqnqsbcz8hmll9sbd1z1wk3js9wr09q3l1q5

Well, even I am not sure if the tarball is stable and if the checksum
does not vary.  Anyway!

> Problems like this one are very bad for our time machine, I'm just
> thinking if Guix can do something to prevent them.

I agree.  But Guix cannot fix the world. :-)
What is currently done seems The Right Thing:

 1. fetch from the Guix farm
 2. try with the current upstream
2b. try a mirror if any
 3. fallback to SWH

You hit the problem because you turn off the fallback to the Guix farm,

BTW, the fallback to SWH is not ready yet for 2 main reasons:

 a) SWH has not yet ingested all the source tarballs in existence of
Guix; and it is not ready.  What is ready is to ingest the current
source tarballs but nothing has been done to feed with all the past
source tarballs.
 b) It is not clear how to fetch back the raw tarball from SWH since
they do not store the checksum but their own hash id (SWHID).  Some
discussion about correspondence and so on is happening right now. :-)

> and guix pull is going on now, building half of the world! :-)

Nice if it works for you! :-)

Cheers,
simon


^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: hash mismatch on permanently moved URL
  2020-07-02 14:05     ` zimoun
@ 2020-07-02 17:21       ` Giovanni Biscuolo
  0 siblings, 0 replies; 9+ messages in thread
From: Giovanni Biscuolo @ 2020-07-02 17:21 UTC (permalink / raw)
  To: zimoun; +Cc: help-guix

[-- Attachment #1: Type: text/plain, Size: 1805 bytes --]

zimoun <zimon.toutoune@gmail.com> writes:

> On Thu, 2 Jul 2020 at 15:38, Giovanni Biscuolo <g@xelera.eu> wrote:
>
>> Actually this is a in-place *displacement* (with HTML) :-O
>
> I do not know what is an "inplace displacement (with HTML)".

Just a nonsense of mine :-)

[...]

> Redirection should not be an issue.  The important point is the
> integrity of the data (the sha256 field).
> And here, there is a mismatch

Yes I go it, the very unusual thing is that the (double) redirection is
pointing to a web page (AFAIU) and *not* to the tgz source file 

[...]

>> Problems like this one are very bad for our time machine, I'm just
>> thinking if Guix can do something to prevent them.
>
> I agree.  But Guix cannot fix the world. :-)

...unfortunately not: it can fix *almost* all that is software related

> What is currently done seems The Right Thing:
>
>  1. fetch from the Guix farm
>  2. try with the current upstream
> 2b. try a mirror if any
>  3. fallback to SWH
>
> You hit the problem because you turn off the fallback to the Guix
> farm,

Yes I see, and actually it's a very specific use case

> BTW, the fallback to SWH is not ready yet for 2 main reasons:
>
>  a) SWH has not yet ingested all the source tarballs in existence of
> Guix; and it is not ready.  What is ready is to ingest the current
> source tarballs but nothing has been done to feed with all the past
> source tarballs.
>  b) It is not clear how to fetch back the raw tarball from SWH since
> they do not store the checksum but their own hash id (SWHID).  Some
> discussion about correspondence and so on is happening right now. :-)

I was not aware of this second point: thanks!

[...]

Happy hacking! Gio'

-- 
Giovanni Biscuolo

Xelera IT Infrastructures

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 832 bytes --]

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: hash mismatch on permanently moved URL
  2020-07-02 12:32 hash mismatch on permanently moved URL Giovanni Biscuolo
                   ` (2 preceding siblings ...)
  2020-07-02 13:06 ` Giovanni Biscuolo
@ 2020-07-24 15:21 ` Ludovic Courtès
  3 siblings, 0 replies; 9+ messages in thread
From: Ludovic Courtès @ 2020-07-24 15:21 UTC (permalink / raw)
  To: Giovanni Biscuolo; +Cc: help-guix

Hi Giovanni,

Giovanni Biscuolo <g@xelera.eu> skribis:

> yesterday I installed a new Guix System (on iron) using the installer
> (latest stable
> https://ftp.gnu.org/gnu/guix/guix-system-install-1.1.0.x86_64-linux.iso.xz
> on USB)
>
> The installation is fine but when I try to guix pull I get this:
>
>
> ~$ sudo -i guix pull
> Updating channel 'guix' from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
> Building from this channel:
>   guix      https://git.savannah.gnu.org/git/guix.git   b919d40
> building /gnu/store/f99dg2cqqlskh5q07l9dw5la7l5s28lq-libgcrypt-1.8.4.tar.bz2.drv...
> downloading from https://gnupg.org/ftp/gcrypt/libgcrypt/libgcrypt-1.8.4.tar.bz2...
> building /gnu/store/4582v7day5c4v9qaidlkwmd6kllks2y4-icu4c-64_2-src.tgz.drv...
> downloading from http://download.icu-project.org/files/icu4c/64.2/icu4c-64_2-src.tgz...
> |sha256 hash mismatch for /gnu/store/0zh5mvhgcx0198k7j6p5pgrc5krgxyqj-icu4c-64_2-src.tgz:
>   expected hash: 0v0xsf14xwlj125y9fd8lrhsaych4d8liv8gr746zng6g225szb2
>   actual hash:   1qfbm2kh7hzd8752rky9dzis8qhgkhs6dkq71k8zar8y74nz7265
> hash mismatch for store item '/gnu/store/0zh5mvhgcx0198k7j6p5pgrc5krgxyqj-icu4c-64_2-src.tgz'
> build of /gnu/store/4582v7day5c4v9qaidlkwmd6kllks2y4-icu4c-64_2-src.tgz.drv failed

I looked into this.  Following
<http://data.guix.gnu.org/repository/1/branch/master/package/icu4c> I
found a revision around the one you were using and then reproduced the
issue using:

  guix time-machine --commit=897f303d2fa61497a931cf5fcb43349eb5f44c14 -- \
    build -S icu4c@62.1 --check

(In the meantime, I had to fix <https://issues.guix.gnu.org/42519>…)

The core issue is that the web server returns 200 instead of 404:

--8<---------------cut here---------------start------------->8---
$ wget --debug -O /tmp/tgz http://site.icu-project.org/download/#/icu4c/62.1/icu4c-62_1-src.tgz
Setting --output-document (outputdocument) to /tmp/tgz
Setting --output-document (outputdocument) to /tmp/tgz
DEBUG output created by Wget 1.20.3 on linux-gnu.

Reading HSTS entries from /home/ludo/.wget-hsts
URI encoding = 'UTF-8'
--2020-07-24 17:14:24--  http://site.icu-project.org/download/
Ni solvigas site.icu-project.org (site.icu-project.org)... 2a00:1450:4007:810::2013, 216.58.213.147
Caching site.icu-project.org => 2a00:1450:4007:810::2013 216.58.213.147
Konektado al site.icu-project.org (site.icu-project.org)|2a00:1450:4007:810::2013|:80... konektita.
Created socket 4.
Releasing 0x00000000016bf6a0 (new refcount 1).

---request begin---
GET /download/ HTTP/1.1
User-Agent: Wget/1.20.3 (linux-gnu)
Accept: */*
Accept-Encoding: identity
Host: site.icu-project.org
Connection: Keep-Alive

---request end---
HTTP peto sendita, ni atendas respondon...
---response begin---
HTTP/1.1 200 OK
Content-Type: text/html; charset=utf-8
X-Frame-Options: SAMEORIGIN
X-Robots-Tag: noarchive
Last-Modified: Wed, 22 Jul 2020 18:34:34 GMT
Expires: Fri, 24 Jul 2020 15:14:24 GMT
Date: Fri, 24 Jul 2020 15:14:24 GMT
Cache-Control: private, max-age=5
X-Content-Type-Options: nosniff
X-XSS-Protection: 1; mode=block
Server: GSE
Accept-Ranges: none
Vary: Accept-Encoding
Transfer-Encoding: chunked

---response end---
200 OK
Registered socket 4 for persistent reuse.
URI content encoding = 'utf-8'
Grando: nespecifita [text/html]
Ni konservas al: '/tmp/tgz'

/tmp/tgz                                             [ <=>                                                                                                       ]  44.43K  --.-KB/s    en 0.04s

2020-07-24 17:14:24 (1006 KB/s) - '/tmp/tgz' konservita [45498]

$ file /tmp/tgz
/tmp/tgz: HTML document, UTF-8 Unicode text, with very long lines
--8<---------------cut here---------------end--------------->8---

Someone™ should contact the icu-project.org admins.

The other issue is <https://issues.guix.gnu.org/28659>, which still
deserves a fix.

Anyway, the file is available at
<https://ci.guix.gnu.org/file/icu4c-62_1-src.tgz/sha256/18ssgnwzzpm1g1fvbm9h1fvryiwxvvn5wc3fdakdsl33cs6qdn9x>.

Thanks,
Ludo’.


^ permalink raw reply	[flat|nested] 9+ messages in thread

end of thread, other threads:[~2020-07-24 15:21 UTC | newest]

Thread overview: 9+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-07-02 12:32 hash mismatch on permanently moved URL Giovanni Biscuolo
2020-07-02 12:56 ` Efraim Flashner
2020-07-02 13:04 ` zimoun
2020-07-02 13:37   ` Giovanni Biscuolo
2020-07-02 14:05     ` zimoun
2020-07-02 17:21       ` Giovanni Biscuolo
2020-07-02 13:06 ` Giovanni Biscuolo
2020-07-02 13:43   ` Tobias Geerinckx-Rice
2020-07-24 15:21 ` Ludovic Courtès

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).