hydra.gnu.org down

hydra.gnu.org down

[Ludovic Courtès]

[-- Attachment #1: Type: text/plain, Size: 360 bytes --]

Hello!

Since yesterday evening (CET), hydra.gnu.org is down.  The FSF sysadmins
are working on it and will keep us updated.

Note that mirror.hydra.gnu.org is available and has substitutes for the
vast majority of the packages in ‘master’.  Use
“--substitute-urls=https://mirror.hydra.gnu.org” to ignore hydra.gnu.org
altogether.

Ludo’.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 818 bytes --]

Re: hydra.gnu.org down

[Ludovic Courtès]

Hi!

ludo@gnu.org (Ludovic Courtès) skribis:

> Since yesterday evening (CET), hydra.gnu.org is down.  The FSF sysadmins
> are working on it and will keep us updated.

The bad news is that there was a hard disk failure so the FSF staff will
need to restore a backup of the machine, which will take some time.  :-/

In the meantime, if you have a machine with recent binaries and would
like to share them, run ‘guix publish’ and post in a signed message the
machine’s public key (usually /etc/guix/signing-key.pub).
Decentralization is the key!

Ludo’.

Re: hydra.gnu.org down

[Chris Marusich]

[-- Attachment #1: Type: text/plain, Size: 792 bytes --]

ludo@gnu.org (Ludovic Courtès) writes:

> Hi!
>
> ludo@gnu.org (Ludovic Courtès) skribis:
>
>> Since yesterday evening (CET), hydra.gnu.org is down.  The FSF sysadmins
>> are working on it and will keep us updated.
>
> The bad news is that there was a hard disk failure so the FSF staff will
> need to restore a backup of the machine, which will take some time.  :-/
>
> In the meantime, if you have a machine with recent binaries and would
> like to share them, run ‘guix publish’ and post in a signed message the
> machine’s public key (usually /etc/guix/signing-key.pub).
> Decentralization is the key!

FWIW, my mirror might have some binaries cached, but it certainly won't
have all of them:

https://hydra-mirror.marusich.info

Hope it helps,
-- 
Chris

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 818 bytes --]

Re: hydra.gnu.org down

[Leo Famulari]

On Wed, Jul 13, 2016 at 09:58:35PM -0700, Chris Marusich wrote:
> ludo@gnu.org (Ludovic Courtès) writes:
> > In the meantime, if you have a machine with recent binaries and would
> > like to share them, run ‘guix publish’ and post in a signed message the
> > machine’s public key (usually /etc/guix/signing-key.pub).
> > Decentralization is the key!
> 
> FWIW, my mirror might have some binaries cached, but it certainly won't
> have all of them:
> 
> https://hydra-mirror.marusich.info

Thanks!

Where can we get a copy of your PGP public key? 

Re: hydra.gnu.org down

[Chris Marusich]

[-- Attachment #1: Type: text/plain, Size: 759 bytes --]

Leo Famulari <leo@famulari.name> writes:

> On Wed, Jul 13, 2016 at 09:58:35PM -0700, Chris Marusich wrote:
>> ludo@gnu.org (Ludovic Courtès) writes:
>> > In the meantime, if you have a machine with recent binaries and would
>> > like to share them, run ‘guix publish’ and post in a signed message the
>> > machine’s public key (usually /etc/guix/signing-key.pub).
>> > Decentralization is the key!
>> 
>> FWIW, my mirror might have some binaries cached, but it certainly won't
>> have all of them:
>> 
>> https://hydra-mirror.marusich.info
>
> Thanks!
>
> Where can we get a copy of your PGP public key? 

The key is the usual Hydra's key, since my mirror is a caching proxy
which uses the usual Hydra as its origin.

-- 
Chris

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 818 bytes --]

Re: hydra.gnu.org down

[Ludovic Courtès]

Hello,

ludo@gnu.org (Ludovic Courtès) skribis:

> ludo@gnu.org (Ludovic Courtès) skribis:
>
>> Since yesterday evening (CET), hydra.gnu.org is down.  The FSF sysadmins
>> are working on it and will keep us updated.
>
> The bad news is that there was a hard disk failure so the FSF staff will
> need to restore a backup of the machine, which will take some time.  :-/

The FSF folks restored a backup of the machine but the store is empty
(it was purposefully not backed up.)  We’ve started to populate it, and
we should be able restart Hydra, hopefully later today.  I’ve restarted
nginx already, and its cache is not empty, so that might help a little
already.

We’ll have to rebuild a large subset of master and core-updates (a
“large subset” because the build machines still have some of the
binaries, which will just need to be transferred back to hydra.gnu.org
via the offload mechanism.)

The SourceForge issue may make things more difficult because downloads
are normally not offloaded so hydra.gnu.org will just stop if it fails
to download the source of some package.

Ludo’.

Re: hydra.gnu.org down

[Ludovic Courtès]

[-- Attachment #1: Type: text/plain, Size: 320 bytes --]

Hello!

An update: hydra.gnu.org has started building again current master and
core-updates branches.

However, its web server (the ‘hydra-server’ program of Hydra) is
currently very unstable.  We are investigating, but in the meantime,
binaries cannot be reliably downloaded from hydra.gnu.org.

Ludo’.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 818 bytes --]

Re: hydra.gnu.org down

[Ludovic Courtès]

[-- Attachment #1: Type: text/plain, Size: 593 bytes --]

Hello,

After more bug hunting, the web server at hydra.gnu.org is back up.  You
should now be able to get substitutes from there and, more importantly,
mirror.hydra.gnu.org will be able to do that too.

If you notice any issues related to substitutes, please report them
here!

(In the past 24 hours or so, you may have experienced problems with
substitutes when the web server at hydra.gnu.org was unstable.  Notably,
it could drop connections prematurely, which one could experience even
when connecting to mirror.hydra.gnu.org since it’s just a proxy.)

Thanks,
Ludo’.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 818 bytes --]