* bug#23103: A number of corrupt packages on Hydra?
@ 2016-03-23 23:48 Christopher Allan Webber
2016-03-24 13:25 ` Pjotr Prins
0 siblings, 1 reply; 13+ messages in thread
From: Christopher Allan Webber @ 2016-03-23 23:48 UTC (permalink / raw)
To: 23103
For at least boost and hydra I'm getting errors like the following:
From http://hydra.gnunet.org/nar/jaf2s3paa3fswfpzi6amlqjxd3fwiw9x-ruby-2.3.0
Downloading jaf2s3...-ruby-2.3.0 (41.9MiB installed)...
http://hydra.gnunet.org/nar/jaf2s3paa3fswfpzi6amlqjxd3fwiw9x-ruby-2.3.0 2.0MiB/s 00:02 | 3.4MiB transferredd
bzip2: Compressed file ends unexpectedly;
perhaps it is corrupted? *Possible* reason follows.
bzip2: Inappropriate ioctl for device
Input file = (stdin), output file = (stdout)
It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.
You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.
guix substitute: error: corrupt input while restoring '/gnu/store/jaf2s3paa3fswfpzi6amlqjxd3fwiw9x-ruby-2.3.0/lib/ruby/2.3.0/rdoc/generator/template/darkfish/fonts/SourceCodePro-Regular.ttf' from #{read pipe}#
killing process 8510
guix package: error: build failed: some substitutes for the outputs of derivation `/gnu/store/l7ffwqbkrvd4vk3h51p597psyl44gv67-ruby-2.3.0.drv' failed (usually happens due to networking issues); try `--fallback' to build derivation from source
^ permalink raw reply [flat|nested] 13+ messages in thread
* bug#23103: A number of corrupt packages on Hydra?
2016-03-23 23:48 bug#23103: A number of corrupt packages on Hydra? Christopher Allan Webber
@ 2016-03-24 13:25 ` Pjotr Prins
2016-03-24 23:08 ` Pjotr Prins
0 siblings, 1 reply; 13+ messages in thread
From: Pjotr Prins @ 2016-03-24 13:25 UTC (permalink / raw)
To: Christopher Allan Webber; +Cc: 23103
I am also seeing such corruption on my substitutes server. Is there a way
we can validate files in a running cache so they can be rebuild? Would
be useful for the mirror.guixsd.org too.
I am glad they get picked up (even so) and that we have the --fallback
option :)
Pj.
On Wed, Mar 23, 2016 at 04:48:50PM -0700, Christopher Allan Webber wrote:
> For at least boost and hydra I'm getting errors like the following:
>
> From http://hydra.gnunet.org/nar/jaf2s3paa3fswfpzi6amlqjxd3fwiw9x-ruby-2.3.0
> Downloading jaf2s3...-ruby-2.3.0 (41.9MiB installed)...
> http://hydra.gnunet.org/nar/jaf2s3paa3fswfpzi6amlqjxd3fwiw9x-ruby-2.3.0 2.0MiB/s 00:02 | 3.4MiB transferredd
> bzip2: Compressed file ends unexpectedly;
> perhaps it is corrupted? *Possible* reason follows.
> bzip2: Inappropriate ioctl for device
> Input file = (stdin), output file = (stdout)
>
> It is possible that the compressed file(s) have become corrupted.
> You can use the -tvv option to test integrity of such files.
>
> You can use the `bzip2recover' program to attempt to recover
> data from undamaged sections of corrupted files.
>
> guix substitute: error: corrupt input while restoring '/gnu/store/jaf2s3paa3fswfpzi6amlqjxd3fwiw9x-ruby-2.3.0/lib/ruby/2.3.0/rdoc/generator/template/darkfish/fonts/SourceCodePro-Regular.ttf' from #{read pipe}#
> killing process 8510
> guix package: error: build failed: some substitutes for the outputs of derivation `/gnu/store/l7ffwqbkrvd4vk3h51p597psyl44gv67-ruby-2.3.0.drv' failed (usually happens due to networking issues); try `--fallback' to build derivation from source
>
>
>
--
^ permalink raw reply [flat|nested] 13+ messages in thread
* bug#23103: A number of corrupt packages on Hydra?
2016-03-24 13:25 ` Pjotr Prins
@ 2016-03-24 23:08 ` Pjotr Prins
2016-03-25 13:47 ` Ludovic Courtès
2016-03-26 23:24 ` Christopher Allan Webber
0 siblings, 2 replies; 13+ messages in thread
From: Pjotr Prins @ 2016-03-24 23:08 UTC (permalink / raw)
Cc: 23103
http://mirror.guixsd.org/nar/7v3093adf31b2sg2c46y3z2m24x2cjmi-gs-fonts-8.11 815KiB/s 00:02 | 1.2MiB transferred
bzip2: Compressed file ends unexpectedly;
perhaps it is corrupted? *Possible* reason follows.
^ permalink raw reply [flat|nested] 13+ messages in thread
* bug#23103: A number of corrupt packages on Hydra?
2016-03-24 23:08 ` Pjotr Prins
@ 2016-03-25 13:47 ` Ludovic Courtès
2016-03-26 23:24 ` Christopher Allan Webber
1 sibling, 0 replies; 13+ messages in thread
From: Ludovic Courtès @ 2016-03-25 13:47 UTC (permalink / raw)
To: Pjotr Prins; +Cc: 23103
Pjotr Prins <pjotr.public12@thebird.nl> skribis:
> http://mirror.guixsd.org/nar/7v3093adf31b2sg2c46y3z2m24x2cjmi-gs-fonts-8.11 815KiB/s 00:02 | 1.2MiB transferred
> bzip2: Compressed file ends unexpectedly;
> perhaps it is corrupted? *Possible* reason follows.
This one should be fixed now.
I’m considering about removing all the cached items that could
potentially be corrupt (those that were transferred before we forced the
use of chunked transfer encoding, in commit
ea01e13f185b6e02c795b3c162c9a551162e4c9d of guix-maintenance.git, March
22nd) but that would cause 7.3 GiB of transfers. Needs more thought.
I’ll followup on guix-sysadmin.
Ludo’.
^ permalink raw reply [flat|nested] 13+ messages in thread
* bug#23103: A number of corrupt packages on Hydra?
2016-03-24 23:08 ` Pjotr Prins
2016-03-25 13:47 ` Ludovic Courtès
@ 2016-03-26 23:24 ` Christopher Allan Webber
2016-03-27 21:22 ` Ludovic Courtès
1 sibling, 1 reply; 13+ messages in thread
From: Christopher Allan Webber @ 2016-03-26 23:24 UTC (permalink / raw)
To: Pjotr Prins; +Cc: 23103-done
Allegedly, Ludo has fixed this, or at least
https://lists.gnu.org/archive/html/guix-devel/2016-03/msg01039.html
makes it sound like it :)
^ permalink raw reply [flat|nested] 13+ messages in thread
* bug#23103: A number of corrupt packages on Hydra?
2016-03-26 23:24 ` Christopher Allan Webber
@ 2016-03-27 21:22 ` Ludovic Courtès
2016-03-29 21:23 ` Leo Famulari
0 siblings, 1 reply; 13+ messages in thread
From: Ludovic Courtès @ 2016-03-27 21:22 UTC (permalink / raw)
To: 23103
Christopher Allan Webber <cwebber@dustycloud.org> skribis:
> Allegedly, Ludo has fixed this, or at least
> https://lists.gnu.org/archive/html/guix-devel/2016-03/msg01039.html
> makes it sound like it :)
Right. :-) AIUI, in its current config nginx is not support to cache
truncated items, but Mark thinks it’s already done so in the past.
So if that pops up again, do let us know!
Ludo’.
^ permalink raw reply [flat|nested] 13+ messages in thread
* bug#23103: A number of corrupt packages on Hydra?
2016-03-27 21:22 ` Ludovic Courtès
@ 2016-03-29 21:23 ` Leo Famulari
2016-04-03 8:20 ` Pjotr Prins
0 siblings, 1 reply; 13+ messages in thread
From: Leo Famulari @ 2016-03-29 21:23 UTC (permalink / raw)
To: Ludovic Courtès; +Cc: 23103
On Sun, Mar 27, 2016 at 11:22:03PM +0200, Ludovic Courtès wrote:
> Christopher Allan Webber <cwebber@dustycloud.org> skribis:
>
> > Allegedly, Ludo has fixed this, or at least
> > https://lists.gnu.org/archive/html/guix-devel/2016-03/msg01039.html
> > makes it sound like it :)
>
> Right. :-) AIUI, in its current config nginx is not support to cache
> truncated items, but Mark thinks it’s already done so in the past.
>
> So if that pops up again, do let us know!
IRC user 'ziz15' had problems downloading these archives while
initializing a new system:
/gnu/store/kcc3cxnx9l2hbg7pjhxsa0r5ypq2j2f38-python-2.7.10
/gnu/store/klb2s6r0f6cgpns65gkjwd5m8ygw73wj-wicd-1.7.3.drv
^ permalink raw reply [flat|nested] 13+ messages in thread
* bug#23103: A number of corrupt packages on Hydra?
2016-03-29 21:23 ` Leo Famulari
@ 2016-04-03 8:20 ` Pjotr Prins
2016-04-03 10:55 ` Ben Woodcroft
` (2 more replies)
0 siblings, 3 replies; 13+ messages in thread
From: Pjotr Prins @ 2016-04-03 8:20 UTC (permalink / raw)
To: Leo Famulari; +Cc: 23103
http://mirror.guixsd.org/nar/6kvy3ryb04nl49wwdy0dmhhfnfbwrmna-tcl-8.6.4 1017KiB/s 00:02 | 1.7MiB transferred
bzip2: Compressed file ends unexpectedly;
perhaps it is corrupted? *Possible* reason follows.
bzip2: Inappropriate ioctl for device
Input file = (stdin), output file = (stdout)
It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.
You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.
guix substitute: error: corrupt input while restoring '/gnu/store/6kvy3ryb04nl49wwdy0dmhhfnfbwrmna-tcl-8.6.4/lib/tcl8.6/encoding/cp936.enc' from #{read pipe}#
killing process 55815
^ permalink raw reply [flat|nested] 13+ messages in thread
* bug#23103: A number of corrupt packages on Hydra?
2016-04-03 8:20 ` Pjotr Prins
@ 2016-04-03 10:55 ` Ben Woodcroft
2016-04-03 18:16 ` Leo Famulari
2016-04-03 20:42 ` Ludovic Courtès
2016-04-04 15:14 ` Pjotr Prins
2 siblings, 1 reply; 13+ messages in thread
From: Ben Woodcroft @ 2016-04-03 10:55 UTC (permalink / raw)
To: Pjotr Prins, Leo Famulari; +Cc: 23103
On 03/04/16 18:20, Pjotr Prins wrote:
> http://mirror.guixsd.org/nar/6kvy3ryb04nl49wwdy0dmhhfnfbwrmna-tcl-8.6.4 1017KiB/s 00:02 | 1.7MiB transferred
> bzip2: Compressed file ends unexpectedly;
> perhaps it is corrupted? *Possible* reason follows.
> bzip2: Inappropriate ioctl for device
> Input file = (stdin), output file = (stdout)
I think this only is a problem on the mirror, substituting from hydra
itself works for me. You?
ben
^ permalink raw reply [flat|nested] 13+ messages in thread
* bug#23103: A number of corrupt packages on Hydra?
2016-04-03 10:55 ` Ben Woodcroft
@ 2016-04-03 18:16 ` Leo Famulari
0 siblings, 0 replies; 13+ messages in thread
From: Leo Famulari @ 2016-04-03 18:16 UTC (permalink / raw)
To: Ben Woodcroft; +Cc: 23103
On Sun, Apr 03, 2016 at 08:55:59PM +1000, Ben Woodcroft wrote:
>
>
> On 03/04/16 18:20, Pjotr Prins wrote:
> > http://mirror.guixsd.org/nar/6kvy3ryb04nl49wwdy0dmhhfnfbwrmna-tcl-8.6.4 1017KiB/s 00:02 | 1.7MiB transferred
> >bzip2: Compressed file ends unexpectedly;
> > perhaps it is corrupted? *Possible* reason follows.
> >bzip2: Inappropriate ioctl for device
> > Input file = (stdin), output file = (stdout)
> I think this only is a problem on the mirror, substituting from hydra itself
> works for me. You?
Most of these recent corrupt archives problems are due to corruptions in
the mirror's cache — the mirror will only try (and possibly fail) to
pull an archive from hydra.gnu.org if hydra has built it successfully.
So, passing --substitute-urls=https://hydra.gnu.org or --fallback are
both reasonable ways to work around the failure.
Please keep reporting these!
^ permalink raw reply [flat|nested] 13+ messages in thread
* bug#23103: A number of corrupt packages on Hydra?
2016-04-03 8:20 ` Pjotr Prins
2016-04-03 10:55 ` Ben Woodcroft
@ 2016-04-03 20:42 ` Ludovic Courtès
2016-04-04 15:14 ` Pjotr Prins
2 siblings, 0 replies; 13+ messages in thread
From: Ludovic Courtès @ 2016-04-03 20:42 UTC (permalink / raw)
To: Pjotr Prins; +Cc: 23103
Pjotr Prins <pjotr.public12@thebird.nl> skribis:
> http://mirror.guixsd.org/nar/6kvy3ryb04nl49wwdy0dmhhfnfbwrmna-tcl-8.6.4 1017KiB/s 00:02 | 1.7MiB transferred
Fixed, thanks for reporting it!
Ludo’.
^ permalink raw reply [flat|nested] 13+ messages in thread
* bug#23103: A number of corrupt packages on Hydra?
2016-04-03 8:20 ` Pjotr Prins
2016-04-03 10:55 ` Ben Woodcroft
2016-04-03 20:42 ` Ludovic Courtès
@ 2016-04-04 15:14 ` Pjotr Prins
2016-04-04 20:44 ` Ludovic Courtès
2 siblings, 1 reply; 13+ messages in thread
From: Pjotr Prins @ 2016-04-04 15:14 UTC (permalink / raw)
To: Pjotr Prins; +Cc: 23103
Eeep
http://mirror.guixsd.org/nar/kcc3cxnx9l2hbg7pjhxsa0r5yq2j2f38-python-2.7.10 1.9MiB/s 00:03 | 5.2MiB transferred
bzip2: Compressed file ends unexpectedly;
perhaps it is corrupted? *Possible* reason follows.
bzip2: Inappropriate ioctl for device
Input file = (stdin), output file = (stdout)
It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.
You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.
guix substitute: error: corrupt input while restoring '/gnu/store/kcc3cxnx9l2hbg7pjhxsa0r5yq2j2f38-python-2.7.10/lib/python2.7/email/test/test_email_renamed.pyc' from #{read pipe}#
killing process 17595
On Sun, Apr 03, 2016 at 10:20:00AM +0200, Pjotr Prins wrote:
> http://mirror.guixsd.org/nar/6kvy3ryb04nl49wwdy0dmhhfnfbwrmna-tcl-8.6.4 1017KiB/s 00:02 | 1.7MiB transferred
> bzip2: Compressed file ends unexpectedly;
> perhaps it is corrupted? *Possible* reason follows.
> bzip2: Inappropriate ioctl for device
> Input file = (stdin), output file = (stdout)
>
> It is possible that the compressed file(s) have become corrupted.
> You can use the -tvv option to test integrity of such files.
>
> You can use the `bzip2recover' program to attempt to recover
> data from undamaged sections of corrupted files.
>
> guix substitute: error: corrupt input while restoring '/gnu/store/6kvy3ryb04nl49wwdy0dmhhfnfbwrmna-tcl-8.6.4/lib/tcl8.6/encoding/cp936.enc' from #{read pipe}#
> killing process 55815
>
>
>
>
--
^ permalink raw reply [flat|nested] 13+ messages in thread
* bug#23103: A number of corrupt packages on Hydra?
2016-04-04 15:14 ` Pjotr Prins
@ 2016-04-04 20:44 ` Ludovic Courtès
0 siblings, 0 replies; 13+ messages in thread
From: Ludovic Courtès @ 2016-04-04 20:44 UTC (permalink / raw)
To: Pjotr Prins; +Cc: 23103
Pjotr Prins <pjotr.public12@thebird.nl> skribis:
> http://mirror.guixsd.org/nar/kcc3cxnx9l2hbg7pjhxsa0r5yq2j2f38-python-2.7.10 1.9MiB/s 00:03 | 5.2MiB transferred
> bzip2: Compressed file ends unexpectedly;
Argh, fixed now, thanks!
Ludo’.
^ permalink raw reply [flat|nested] 13+ messages in thread
end of thread, other threads:[~2016-04-04 20:45 UTC | newest]
Thread overview: 13+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2016-03-23 23:48 bug#23103: A number of corrupt packages on Hydra? Christopher Allan Webber
2016-03-24 13:25 ` Pjotr Prins
2016-03-24 23:08 ` Pjotr Prins
2016-03-25 13:47 ` Ludovic Courtès
2016-03-26 23:24 ` Christopher Allan Webber
2016-03-27 21:22 ` Ludovic Courtès
2016-03-29 21:23 ` Leo Famulari
2016-04-03 8:20 ` Pjotr Prins
2016-04-03 10:55 ` Ben Woodcroft
2016-04-03 18:16 ` Leo Famulari
2016-04-03 20:42 ` Ludovic Courtès
2016-04-04 15:14 ` Pjotr Prins
2016-04-04 20:44 ` Ludovic Courtès
Code repositories for project(s) associated with this public inbox
https://git.savannah.gnu.org/cgit/guix.git
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).