From mboxrd@z Thu Jan  1 00:00:00 1970
From: ludo@gnu.org (Ludovic =?UTF-8?Q?Court=C3=A8s?=)
Subject: bug#28664: Old narinfos of tarballs purged on berlin
Date: Wed, 08 Nov 2017 21:29:06 +0100
Message-ID: <87d14stsz1.fsf@gnu.org>
References: <87tvyvl9fs.fsf@gnu.org> <87vainer6c.fsf@gnu.org>
	<87inem59jt.fsf@gnu.org>
Mime-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Return-path: <bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org>
Received: from eggs.gnu.org ([2001:4830:134:3::10]:53788)
	by lists.gnu.org with esmtp (Exim 4.71)
	(envelope-from <Debian-debbugs@debbugs.gnu.org>) id 1eCWz8-0007as-Lh
	for bug-guix@gnu.org; Wed, 08 Nov 2017 15:30:07 -0500
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <Debian-debbugs@debbugs.gnu.org>) id 1eCWz5-0008Vi-Gy
	for bug-guix@gnu.org; Wed, 08 Nov 2017 15:30:06 -0500
Received: from debbugs.gnu.org ([208.118.235.43]:50274)
	by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16)
	(Exim 4.71) (envelope-from <Debian-debbugs@debbugs.gnu.org>)
	id 1eCWz5-0008VS-Dn
	for bug-guix@gnu.org; Wed, 08 Nov 2017 15:30:03 -0500
Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2)
	(envelope-from <Debian-debbugs@debbugs.gnu.org>) id 1eCWz5-0004k9-7A
	for bug-guix@gnu.org; Wed, 08 Nov 2017 15:30:03 -0500
Sender: "Debbugs-submit" <debbugs-submit-bounces@debbugs.gnu.org>
Resent-Message-ID: <handler.28664.D28664.151017295518125@debbugs.gnu.org>
In-Reply-To: <87inem59jt.fsf@gnu.org> ("Ludovic
	\=\?utf-8\?Q\?Court\=C3\=A8s\=22'\?\=
	\=\?utf-8\?Q\?s\?\= message of "Tue, 07 Nov 2017 17:37:58 +0100")
List-Id: Bug reports for GNU Guix <bug-guix.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/bug-guix>,
	<mailto:bug-guix-request@gnu.org?subject=unsubscribe>
List-Archive: <http://lists.gnu.org/archive/html/bug-guix/>
List-Post: <mailto:bug-guix@gnu.org>
List-Help: <mailto:bug-guix-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/bug-guix>,
	<mailto:bug-guix-request@gnu.org?subject=subscribe>
Errors-To: bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org
Sender: "bug-Guix" <bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org>
To: guix-sysadmin@gnu.org
Cc: 28664-done@debbugs.gnu.org

ludo@gnu.org (Ludovic Court=C3=A8s) skribis:

> ludo@gnu.org (Ludovic Court=C3=A8s) skribis:
>
>> ludo@gnu.org (Ludovic Court=C3=A8s) skribis:
>>
>>> As a followup to <https://bugs.gnu.org/28664>, Ricardo upgraded to the
>>> latest Guix on berlin, and I=E2=80=99ve now removed old .narinfos corre=
sponding
>>> to tarballs for which we potentially lacked the corresponding nar:
>>>
>>>   sudo find /var/cache/guix/publish/none -mtime +7 -exec rm -v {} \;
>>
>> This missed ~100 of them, so I=E2=80=99ve run the following command, whi=
ch is
>> more accurate:
>>
>>   root@berlin /var/cache/guix/publish/none# rm -v $(for i in *.narinfo ;=
 do [ -f `echo $i | sed -es/narinfo/nar/g` ] || echo $i ; done)
>
> I just did the same on hydra.gnu.org, which was starting to have 404 for
> these substitutes.

With narinfo caching people were starting to get 404s for
mirror.hydra.gnu.org/guix/nar/xyz.  Based on an incomplete log of the
command above, I=E2=80=99ve repopulated /var/cache/guix/publish/none on
hydra.gnu.org in a pretty crude way:

  for i in $(sed -es/'^removed `\([^-]\+\)-.*/\1/g' < /tmp/file-list ); do =
wget -q -O /dev/null http://localhost:9999/$i.narinfo || echo $i ; done

That=E2=80=99s 1,135 tarballs back in /var/cache/guix/publish/none.

The remaining missing items will come back eventually as narinfo
requests hit =E2=80=98guix publish=E2=80=99 itself (i.e., when narinfo cach=
es on user
machines and in nginx have expired).

Ludo=E2=80=99.