From mboxrd@z Thu Jan 1 00:00:00 1970 From: ludo@gnu.org (Ludovic =?UTF-8?Q?Court=C3=A8s?=) Subject: bug#26201: hydra.gnu.org uses =?UTF-8?Q?=E2=80=98guix_?= =?UTF-8?Q?publish=E2=80=99?= for nars and narinfos Date: Wed, 22 Mar 2017 23:22:37 +0100 Message-ID: <87r31pyms2.fsf_-_@gnu.org> References: <20170320184449.5ac06051@khaalida> <144e9ba8-af93-fb18-d2b9-f198ae7c11e9@tobias.gr> <20170320195247.05f72fc9@khaalida> <8e7e07d1-563f-666f-2c32-2a772757c86f@tobias.gr> <8760j2wpfy.fsf@gnu.org> <9889a4b5-c300-cd03-1095-1115428067fb@tobias.gr> Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:43740) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1cqoet-00015t-4m for bug-guix@gnu.org; Wed, 22 Mar 2017 18:23:14 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1cqoek-0002tn-8w for bug-guix@gnu.org; Wed, 22 Mar 2017 18:23:05 -0400 Received: from debbugs.gnu.org ([208.118.235.43]:41682) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1cqoek-0002tj-5j for bug-guix@gnu.org; Wed, 22 Mar 2017 18:23:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1cqoek-0005Kp-0y for bug-guix@gnu.org; Wed, 22 Mar 2017 18:23:02 -0400 Sender: "Debbugs-submit" Resent-Message-ID: In-Reply-To: <9889a4b5-c300-cd03-1095-1115428067fb@tobias.gr> (Tobias Geerinckx-Rice's message of "Tue, 21 Mar 2017 18:08:02 +0100") List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org Sender: "bug-Guix" To: Tobias Geerinckx-Rice Cc: 26201@debbugs.gnu.org, guix-sysadmin@gnu.org Hi again! Until now hydra.gnu.org was using Hydra (the software) to serve not only the Web interface but also all the .narinfo and /nar URLs (substitute meta-data and substitutes). Starting from now, hydra.gnu.org directs all .narinfo and corresponding nar requests to =E2=80=98guix publish=E2=80=99 instead of Hydra. =E2=80=98guix publish=E2=80=99 should be faster and less resource-hungry th= an Hydra. It uses in-process gzip for nar compression instead of bzip2 (I chose level 7, which seems to provide compression ratios close to what bzip2 provides with its default compression level, while being 3 times faster). Unlike Hydra it never forks so for instance, 404 responses for .narinfo URLs should be quicker. Hopefully, that will improve the worst-case (cache miss) throughput. I configured nginx in such a way that the former Hydra-provided /nar URLs (which are cached in nginx instances, in our /var/guix/substitute/cache directories, etc.) are still available. =E2=80=98guix publish=E2=80=99 uses the /guix/nar URLs while Hydra uses /na= r, so the nginx config redirects to either Hydra or =E2=80=98guix publish=E2=80=99 de= pending on the URL: https://git.savannah.gnu.org/cgit/guix/maintenance.git/tree/hydra/nginx/h= ydra.gnu.org-locations.conf#n29 Hydra-provided .narinfos are still cached here and there; they=E2=80=99ll be progressively expire and be replaced by =E2=80=98guix publish=E2=80=99-prov= ided .narinfos. Let me know if you notice anything fishy! Ludo=E2=80=99.