libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Pjotr Prins]

Problem on mirror:

Recent guix pull. 

Downloading 9rvydp...-libcap-2.24 (125KiB installed)...
 http://mirror.guixsd.org/nar/9rvydpss0n9hva68jrmbg5qcjvyf3yc2-libcap-2.24 0B/s 00:00 | 0B transferred
bzip2: Compressed file ends unexpectedly;
        perhaps it is corrupted?  *Possible* reason follows.
bzip2: Inappropriate ioctl for device
        Input file = (stdin), output file = (stdout)

It is possible that the compressed file(s) have become corrupted.

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Pjotr Prins]

On Sat, Mar 19, 2016 at 04:25:40PM +0100, Pjotr Prins wrote:
> Problem on mirror:
> 
> Recent guix pull. 
> 
> Downloading 9rvydp...-libcap-2.24 (125KiB installed)...
>  http://mirror.guixsd.org/nar/9rvydpss0n9hva68jrmbg5qcjvyf3yc2-libcap-2.24 0B/s 00:00 | 0B transferred
> bzip2: Compressed file ends unexpectedly;
>         perhaps it is corrupted?  *Possible* reason follows.
> bzip2: Inappropriate ioctl for device
>         Input file = (stdin), output file = (stdout)
> 
> It is possible that the compressed file(s) have become corrupted.

Fixed by compiling libcap instead. I have noticed the store can become
unbalanced when you interrupt the guix-daemon when it is
building/installing. I.e. kill daemon is not transaction safe ;)

Pj.
-- 

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Ludovic Courtès]

Pjotr Prins <pjotr.public12@thebird.nl> skribis:

> On Sat, Mar 19, 2016 at 04:25:40PM +0100, Pjotr Prins wrote:
>> Problem on mirror:
>> 
>> Recent guix pull. 
>> 
>> Downloading 9rvydp...-libcap-2.24 (125KiB installed)...
>>  http://mirror.guixsd.org/nar/9rvydpss0n9hva68jrmbg5qcjvyf3yc2-libcap-2.24 0B/s 00:00 | 0B transferred
>> bzip2: Compressed file ends unexpectedly;
>>         perhaps it is corrupted?  *Possible* reason follows.
>> bzip2: Inappropriate ioctl for device
>>         Input file = (stdin), output file = (stdout)
>> 
>> It is possible that the compressed file(s) have become corrupted.
>
> Fixed by compiling libcap instead. I have noticed the store can become
> unbalanced when you interrupt the guix-daemon when it is
> building/installing. I.e. kill daemon is not transaction safe ;)

What do you mean by “unbalanced”?

Ludo’.

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Pjotr Prins]

On Sat, Mar 19, 2016 at 10:15:55PM +0100, Ludovic Courtès wrote:
> >> It is possible that the compressed file(s) have become corrupted.
> >
> > Fixed by compiling libcap instead. I have noticed the store can become
> > unbalanced when you interrupt the guix-daemon when it is
> > building/installing. I.e. kill daemon is not transaction safe ;)
> 
> What do you mean by “unbalanced”?

Start giving errors :)

Pj.

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Leo Famulari]

On Sat, Mar 19, 2016 at 04:25:40PM +0100, Pjotr Prins wrote:
> Problem on mirror:
> 
> Recent guix pull. 
> 
> Downloading 9rvydp...-libcap-2.24 (125KiB installed)...
>  http://mirror.guixsd.org/nar/9rvydpss0n9hva68jrmbg5qcjvyf3yc2-libcap-2.24 0B/s 00:00 | 0B transferred
> bzip2: Compressed file ends unexpectedly;
>         perhaps it is corrupted?  *Possible* reason follows.
> bzip2: Inappropriate ioctl for device
>         Input file = (stdin), output file = (stdout)
> 
> It is possible that the compressed file(s) have become corrupted.

I've been getting a lot of these in the past day or so.

> 
> 

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Ludovic Courtès]

Pjotr Prins <pjotr.public12@thebird.nl> skribis:

> Downloading 9rvydp...-libcap-2.24 (125KiB installed)...
>  http://mirror.guixsd.org/nar/9rvydpss0n9hva68jrmbg5qcjvyf3yc2-libcap-2.24 0B/s 00:00 | 0B transferred
> bzip2: Compressed file ends unexpectedly;

Indeed, this file had zero length.

I’ve manually removed it from the nginx cache, but clearly it’d be
problematic it empty/incomplete files ended up being cached.

If you stumble upon other such things, please let me know and give me
the URL to we can check what’s going on.

Thank you!

Ludo’.

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Pjotr Prins]

On Sat, Mar 19, 2016 at 10:22:39PM +0100, Ludovic Courtès wrote:
> Pjotr Prins <pjotr.public12@thebird.nl> skribis:
> 
> > Downloading 9rvydp...-libcap-2.24 (125KiB installed)...
> >  http://mirror.guixsd.org/nar/9rvydpss0n9hva68jrmbg5qcjvyf3yc2-libcap-2.24 0B/s 00:00 | 0B transferred
> > bzip2: Compressed file ends unexpectedly;
> 
> Indeed, this file had zero length.
> 
> I’ve manually removed it from the nginx cache, but clearly it’d be
> problematic it empty/incomplete files ended up being cached.
> 
> If you stumble upon other such things, please let me know and give me
> the URL to we can check what’s going on.

Another one:

Found valid signature for /gnu/store/ayhkddrnqwyz80f1g93mjk301imsy88i-libatomic-ops-7.4.2
From http://mirror.guixsd.org/nar/ayhkddrnqwyz80f1g93mjk301imsy88i-libatomic-ops-7.4.2
Downloading ayhkdd...-libatomic-ops-7.4.2 (625KiB installed)...
 http://mirror.guixsd.org/nar/ayhkddrnqwyz80f1g93mjk301imsy88i-libatomic-ops-7.4.2 0B/s 00:00 | 0B transferred
bzip2: Compressed file ends unexpectedly;

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Pjotr Prins]

And another

Found valid signature for /gnu/store/7zay07fqmmqqjmg0r5rrfnyia0jn7h14-fontconfig-2.11.94
From http://mirror.guixsd.org/nar/7zay07fqmmqqjmg0r5rrfnyia0jn7h14-fontconfig-2.11.94
Downloading 7zay07...-fontconfig-2.11.94 (2.0MiB installed)...
 http://mirror.guixsd.org/nar/7zay07fqmmqqjmg0r5rrfnyia0jn7h14-fontconfig-2.11.94 0B/s 00:00 | 0B transferred
bzip2: Compressed file ends unexpectedly;
        perhaps it is corrupted?  *Possible* reason follows.
bzip2: Inappropriate ioctl for device
        Input file = (stdin), output file = (stdout)

It is possible that the compressed file(s) have become corrupted.

On Sun, Mar 20, 2016 at 04:40:52PM +0100, Pjotr Prins wrote:
> On Sat, Mar 19, 2016 at 10:22:39PM +0100, Ludovic Courtès wrote:
> > Pjotr Prins <pjotr.public12@thebird.nl> skribis:
> > 
> > > Downloading 9rvydp...-libcap-2.24 (125KiB installed)...
> > >  http://mirror.guixsd.org/nar/9rvydpss0n9hva68jrmbg5qcjvyf3yc2-libcap-2.24 0B/s 00:00 | 0B transferred
> > > bzip2: Compressed file ends unexpectedly;
> > 
> > Indeed, this file had zero length.
> > 
> > I’ve manually removed it from the nginx cache, but clearly it’d be
> > problematic it empty/incomplete files ended up being cached.
> > 
> > If you stumble upon other such things, please let me know and give me
> > the URL to we can check what’s going on.
> 
> Another one:
> 
> Found valid signature for /gnu/store/ayhkddrnqwyz80f1g93mjk301imsy88i-libatomic-ops-7.4.2
> From http://mirror.guixsd.org/nar/ayhkddrnqwyz80f1g93mjk301imsy88i-libatomic-ops-7.4.2
> Downloading ayhkdd...-libatomic-ops-7.4.2 (625KiB installed)...
>  http://mirror.guixsd.org/nar/ayhkddrnqwyz80f1g93mjk301imsy88i-libatomic-ops-7.4.2 0B/s 00:00 | 0B transferred
> bzip2: Compressed file ends unexpectedly;
> 

-- 

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Pjotr Prins]

Maybe a regen of the mirror is an idea.

Pj.

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Ludovic Courtès]

Hi,

Thanks for the URLs.

I’ve audited the cache and found out that these files were empty in the
mirror’s cache (in addition to the two you mentioned):

  http://mirror.guixsd.org/nar/d701fy71y7sf78mwbk44hab5i1027l5x-python-sphinxcontrib-newsfeed-0.1.4
  http://mirror.guixsd.org/nar/vi7a6z963g2571a8a8wmbpddwmsyk2ps-udev-rules
  http://mirror.guixsd.org/nar/i82122isrbyw7lb9zpb9ybppl31c7lq8-Unidecode-0.04.18.tar.gz
  http://mirror.guixsd.org/nar/ba23v3j6v6ix8bhwr3nz4f5cr5f32dqq-gnome-icon-theme-3.12.0
  http://mirror.guixsd.org/nar/c6i9dj0mwipizb81gpn71c4d5fw1izwy-emms-4.0
  http://mirror.guixsd.org/nar/ak6smnq29ajz6d5qf5w9bnizv3jbq057-python2-werkzeug-0.11.2
  http://mirror.guixsd.org/nar/bsbbsd72j99hifdlg5axymi55n0d2r4v-kbd-2.0.2
  http://mirror.guixsd.org/nar/4hgmpcplv1mjl96cnpklzqsilrp66c25-python-minimal-3.4.3
  http://mirror.guixsd.org/nar/2x8bg76lmjy2g39zj9z638k9riqscg9n-bash43-021
  http://mirror.guixsd.org/nar/f7zbx10dy9xa3alabxvr43mif9gg4yin-ed-1.12.tar.lz
  http://mirror.guixsd.org/nar/1bxr5gvgjmjr6ld29jx0v0g3pvlcqmfp-python2-pytest-2.6.1
  http://mirror.guixsd.org/nar/397hgyxdsgpbs5m1hhf0dpb5a5pyv3dc-python2-wheel-0.29.0
  http://mirror.guixsd.org/nar/d697rmig44i8yc3yvmpml2yji8jk0iw3-ibus-1.5.11.tar.gz
  http://mirror.guixsd.org/nar/g7cqhvyv4pl437a8vhmcd7sxzkmh3lwd-geiser-0.8.1

I’ve removed them now.

I’ll monitor the cache, but you’re always welcome to report other
issues!

Thank you,
Ludo’.

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Leo Famulari]

On Sat, Mar 19, 2016 at 10:22:39PM +0100, Ludovic Courtès wrote:
> Pjotr Prins <pjotr.public12@thebird.nl> skribis:
> 
> > Downloading 9rvydp...-libcap-2.24 (125KiB installed)...
> >  http://mirror.guixsd.org/nar/9rvydpss0n9hva68jrmbg5qcjvyf3yc2-libcap-2.24 0B/s 00:00 | 0B transferred
> > bzip2: Compressed file ends unexpectedly;
> 
> Indeed, this file had zero length.
> 
> I’ve manually removed it from the nginx cache, but clearly it’d be
> problematic it empty/incomplete files ended up being cached.
> 
> If you stumble upon other such things, please let me know and give me
> the URL to we can check what’s going on.

Can you take a look at python-2.7.10?

Specifically, /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10

This is from "ifur" on #guix:
http://paste.lisp.org/display/311051

> 
> Thank you!
> 
> Ludo’.

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Ricardo Wurmus]

Leo Famulari <leo@famulari.name> writes:

> On Sat, Mar 19, 2016 at 10:22:39PM +0100, Ludovic Courtès wrote:
>> Pjotr Prins <pjotr.public12@thebird.nl> skribis:
>> 
>> > Downloading 9rvydp...-libcap-2.24 (125KiB installed)...
>> >  http://mirror.guixsd.org/nar/9rvydpss0n9hva68jrmbg5qcjvyf3yc2-libcap-2.24 0B/s 00:00 | 0B transferred
>> > bzip2: Compressed file ends unexpectedly;
>> 
>> Indeed, this file had zero length.
>> 
>> I’ve manually removed it from the nginx cache, but clearly it’d be
>> problematic it empty/incomplete files ended up being cached.
>> 
>> If you stumble upon other such things, please let me know and give me
>> the URL to we can check what’s going on.
>
> Can you take a look at python-2.7.10?
>
> Specifically, /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10
>
> This is from "ifur" on #guix:
> http://paste.lisp.org/display/311051

Boost at

  http://hydra.gnu.org/nar/wkj46vmxw2zl4amia2iav2wsn7c7pb9j-boost-1.60.0

probably also needs fixing.

~~ Ricardo

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Leo Famulari]

Two more:

/gnu/store/2wakfpr67rnh8f1m0lm45wcaa1j2r29g-shishi-1.0.2
/gnu/store/7v3093adf31b2sg2c46y3z2m24x2cjmi-gs-fonts-8.11

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Leo Famulari]

Another:

/gnu/store/nv4qhmad49imc789l63plb3wd2cqambr-python2-cffi-1.4.2

Re: libcap: bzip2: Compressed file ends unexpectedly on http://mirror.guixsd.org

[Ludovic Courtès]

Leo Famulari <leo@famulari.name> skribis:

> /gnu/store/2wakfpr67rnh8f1m0lm45wcaa1j2r29g-shishi-1.0.2
> /gnu/store/7v3093adf31b2sg2c46y3z2m24x2cjmi-gs-fonts-8.11

> /gnu/store/nv4qhmad49imc789l63plb3wd2cqambr-python2-cffi-1.4.2

All fixed now.

Thanks,
Ludo’.

Hash mismatch for Python 2.7.10 (x86_64-linux)

[Ludovic Courtès]

Leo Famulari <leo@famulari.name> skribis:

> Can you take a look at python-2.7.10?
>
> Specifically, /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10
>
> This is from "ifur" on #guix:
> http://paste.lisp.org/display/311051

This is an “interesting” case.  There’s indeed a hash mismatch between
that narinfo and the nar (hydra.gnu.org and mirror.guixsd.org provide
the exact same narinfo and nar though):

--8<---------------cut here---------------start------------->8---
$ wget -q -O - https://hydra.gnu.org/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv.narinfo |grep Hash
NarHash: sha256:1ifhxz7ng64ckrsfp0cy6rcybwrdf2mgq7p9w73ynbwy1w2frhp5
$ wget -q -O - https://hydra.gnu.org/nar/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10 | bunzip2 | guix hash /dev/stdin
1rb34mfv32zj6ir9nkrmw2mrc00n2gf9p2chihh1qpl9fmsxhhif
$ guix hash -r /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10
1ifhxz7ng64ckrsfp0cy6rcybwrdf2mgq7p9w73ynbwy1w2frhp5
--8<---------------cut here---------------end--------------->8---

To spot the differences, I did:

--8<---------------cut here---------------start------------->8---
$ wget -O - https://mirror.guixsd.org/nar/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10 | bunzip2 | guix archive -x /tmp/python
$ diff -ur --no-dereference /tmp/python /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10
Binary files /tmp/python/lib/python2.7/_abcoll.pyc and /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10/lib/python2.7/_abcoll.pyc differ
Binary files /tmp/python/lib/python2.7/abc.pyc and /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10/lib/python2.7/abc.pyc differ
Binary files /tmp/python/lib/python2.7/codecs.pyc and /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10/lib/python2.7/codecs.pyc differ
Binary files /tmp/python/lib/python2.7/copy_reg.pyc and /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10/lib/python2.7/copy_reg.pyc differ
Binary files /tmp/python/lib/python2.7/encodings/aliases.pyc and /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10/lib/python2.7/encodings/aliases.pyc differ
Binary files /tmp/python/lib/python2.7/encodings/__init__.pyc and /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10/lib/python2.7/encodings/__init__.pyc differ
Binary files /tmp/python/lib/python2.7/encodings/utf_8.pyc and /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10/lib/python2.7/encodings/utf_8.pyc differ
[...]
$ diffoscope --html t.html /tmp/python/lib/python2.7 /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10/lib/python2.7/
--8<---------------cut here---------------end--------------->8---

Diffoscope shows several hundred of bytes of differences in several .pyc
files (so it’s not just 32-byte timestamps as discussed in
<http://bugs.gnu.org/22010>, IIRC.)

That the differences are so important is fishy.  Could you check what
you have on your machine?  Is anyone able to make an independent build
of this thing?


For non-deterministic packages, something that could in theory happen
(although it seems unlikely) is this:

  1. nginx caches the narinfo of a first build with hash X;

  2. nobody downloads the corresponding nar, and the result is
     eventually GC’d from hydra;

  3. Hydra rebuilds the thing, obtains hash Y; the nar with hash Y is
     downloaded and cached by nginx, but, no luck, it doesn’t match the
     hash in the narinfo that was cached in step #1.

That could happen, but it seems pretty far-fetched, especially for a
package like Python.


On my machine I looked for the corresponding “derivers”:

--8<---------------cut here---------------start------------->8---
scheme@(guile-user)> ,use(guix)
scheme@(guile-user)> (define s (open-connection))
scheme@(guile-user)> (valid-derivers s "/gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10")
$4 = ("/gnu/store/a5s3mkl387wwkklj3ss5hw34ib9rb2p6-python-2.7.10.drv" "/gnu/store/pvsdsjn15rj1ciwr37vl2vqprvl57szg-python-2.7.10.drv")
--8<---------------cut here---------------end--------------->8---

And then run:

--8<---------------cut here---------------start------------->8---
$ guix build "/gnu/store/pvsdsjn15rj1ciwr37vl2vqprvl57szg-python-2.7.10.drv" --check  
--8<---------------cut here---------------end--------------->8---

However that’s not very helpful since it unsurprisingly fails with a
“may not be deterministic” error.

Ludo’.

Re: Hash mismatch for Python 2.7.10 (x86_64-linux)

[Ben Woodcroft]

On 22/03/16 03:22, Ludovic Courtès wrote:
> Leo Famulari <leo@famulari.name> skribis:
>
>> Can you take a look at python-2.7.10?
>>
>> Specifically, /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10
>>
>> This is from "ifur" on #guix:
>> http://paste.lisp.org/display/311051
> This is an “interesting” case.  There’s indeed a hash mismatch between
> that narinfo and the nar (hydra.gnu.org and mirror.guixsd.org provide
> the exact same narinfo and nar though):
I think perhaps tcl might be a similar case? It has non-zero size so 
wasn't picked up in Ludo's latest sweep.

From http://mirror.guixsd.org/nar/6kvy3ryb04nl49wwdy0dmhhfnfbwrmna-tcl-8.6.4
Downloading 6kvy3r...-tcl-8.6.4 (24.8MiB installed)...
  http://mirror.guixsd.org/nar/6kvy3ryb04nl49wwdy0dmhhfnfbwrmna-tcl-8.6.4 710KiB/s 00:03 | 1.7MiB transferredd
bzip2: Compressed file ends unexpectedly;
     perhaps it is corrupted?  *Possible* reason follows.
bzip2: Inappropriate ioctl for device
     Input file = (stdin), output file = (stdout)

It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.

You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.


But it is not interesting in the way python2 is:

$ wget -q -O - 
https://hydra.gnu.org/6kvy3ryb04nl49wwdy0dmhhfnfbwrmna.narinfo |grep Hash
NarHash: sha256:03dm95xz885jhy57b2r5hqh7v4dfwbpdxj1jbfxc1z99pvwnx07j
$ wget -q -O - 
https://hydra.gnu.org/nar/6kvy3ryb04nl49wwdy0dmhhfnfbwrmna-tcl-8.6.4 | 
bunzip2 | guix hash /dev/stdin
03dm95xz885jhy57b2r5hqh7v4dfwbpdxj1jbfxc1z99pvwnx07j

ben

Re: Hash mismatch for Python 2.7.10 (x86_64-linux)

[Ludovic Courtès]

Ben Woodcroft <b.woodcroft@uq.edu.au> skribis:

> On 22/03/16 03:22, Ludovic Courtès wrote:
>> Leo Famulari <leo@famulari.name> skribis:
>>
>>> Can you take a look at python-2.7.10?
>>>
>>> Specifically, /gnu/store/4bs4mx6xyx0jx9827vmmbxyhjln7cmcv-python-2.7.10
>>>
>>> This is from "ifur" on #guix:
>>> http://paste.lisp.org/display/311051
>> This is an “interesting” case.  There’s indeed a hash mismatch between
>> that narinfo and the nar (hydra.gnu.org and mirror.guixsd.org provide
>> the exact same narinfo and nar though):
> I think perhaps tcl might be a similar case? It has non-zero size so
> wasn't picked up in Ludo's latest sweep.
>
> From http://mirror.guixsd.org/nar/6kvy3ryb04nl49wwdy0dmhhfnfbwrmna-tcl-8.6.4
> Downloading 6kvy3r...-tcl-8.6.4 (24.8MiB installed)...
>  http://mirror.guixsd.org/nar/6kvy3ryb04nl49wwdy0dmhhfnfbwrmna-tcl-8.6.4 710KiB/s 00:03 | 1.7MiB transferredd
> bzip2: Compressed file ends unexpectedly;

I remove this truncated file from mirror.guixsd.org when Pjotr reported
it, a couple of days ago.  Hopefully it just works now (and indeed, this
one was less “interesting” than Python ;-)).

Ludo’.