From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms0.migadu.com with LMTPS id EBXYG2CMrmG6ogAAgWs5BA (envelope-from ) for ; Mon, 06 Dec 2021 23:19:12 +0100 Received: from aspmx1.migadu.com ([2001:41d0:8:6d80::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id IEGHF2CMrmFEOAAAB5/wlQ (envelope-from ) for ; Mon, 06 Dec 2021 22:19:12 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 182D5B38A for ; Mon, 6 Dec 2021 23:19:12 +0100 (CET) Received: from localhost ([::1]:40768 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1muMKF-0001JN-2w for larch@yhetil.org; Mon, 06 Dec 2021 17:19:11 -0500 Received: from eggs.gnu.org ([209.51.188.92]:33916) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1muMK6-0001JA-5i for bug-guix@gnu.org; Mon, 06 Dec 2021 17:19:02 -0500 Received: from debbugs.gnu.org ([209.51.188.43]:52298) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1muMK5-0000V1-Sz for bug-guix@gnu.org; Mon, 06 Dec 2021 17:19:01 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1muMK5-0002UR-Ny for bug-guix@gnu.org; Mon, 06 Dec 2021 17:19:01 -0500 X-Loop: help-debbugs@gnu.org Subject: bug#52338: [maintenance] hydra: berlin: Create robots.txt. References: In-Reply-To: Resent-From: Leo Famulari Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Mon, 06 Dec 2021 22:19:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 52338 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 52338@debbugs.gnu.org Received: via spool by 52338-submit@debbugs.gnu.org id=B52338.16388291019517 (code B ref 52338); Mon, 06 Dec 2021 22:19:01 +0000 Received: (at 52338) by debbugs.gnu.org; 6 Dec 2021 22:18:21 +0000 Received: from localhost ([127.0.0.1]:35611 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1muMJR-0002TR-BP for submit@debbugs.gnu.org; Mon, 06 Dec 2021 17:18:21 -0500 Received: from out2-smtp.messagingengine.com ([66.111.4.26]:60679) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1muMJP-0002TE-Nw for 52338@debbugs.gnu.org; Mon, 06 Dec 2021 17:18:20 -0500 Received: from compute1.internal (compute1.nyi.internal [10.202.2.41]) by mailout.nyi.internal (Postfix) with ESMTP id 4FB8A5C0227; Mon, 6 Dec 2021 17:18:14 -0500 (EST) Received: from mailfrontend2 ([10.202.2.163]) by compute1.internal (MEProxy); Mon, 06 Dec 2021 17:18:14 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=famulari.name; h=from:to:subject:date:message-id:mime-version :content-transfer-encoding; s=mesmtp; bh=mFU1BiXur1urRvIk4SysYUz QRlRjZevakml5r6IXBG4=; b=OndJF9pkFbMlePbxo5GYki3dXwrArxue/bvTLRB 9RO8AEVkE/BYwGvs1a6imO6BMcecsuSfA2b5g+/Hf/WXzBXQdhCrPwliNR0NI20E OQTecsXnpBaZoohHy7YV7Xyq8jPgFbI6fX15pkTcy7c9NpKOMGE6oOt5Lv4rcihc it3M= DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=content-transfer-encoding:date:from :message-id:mime-version:subject:to:x-me-proxy:x-me-proxy :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=mFU1BiXur1urRvIk4 SysYUzQRlRjZevakml5r6IXBG4=; b=n8xPLa1Dqgfh/ho3M8VUgM2iVoCLRUkOU U1QzBOWMQtkDx9fIYb8ZguhELWbbBxQch3fDz59NgPPbX9TWR44ub9duPlihNRZ2 IdAwnpmP/dYahtGVZzsZwldc8DQ2i6M6qAue9pQ4z4As7l3vaYGCSG3zJCzimDjH a26/mXznRGXl7yZEtPUYeO2UfiJXWO25yMCqYeNEfEo6DF/P3UQYLdeZfTyAVqUA /W5yX8GwXY17rHh4Ci5FRMQIGfsyPzWxzwFY52ueGKJCvvAjGH9u1jLsxrAAJYuh Dia8gbMMHxjqCLAh3rntGnp/+kX/r7V52+XolYjiCgdsA5Xh4rT5g== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvuddrjeefgdduheelucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefhvffufffkofgggfestdekredtre dttdenucfhrhhomhepnfgvohcuhfgrmhhulhgrrhhiuceolhgvohesfhgrmhhulhgrrhhi rdhnrghmvgeqnecuggftrfgrthhtvghrnhephedvleejudevleethfefueevteelvdelge dutdejvdegveelkeethfelgfehveehnecuffhomhgrihhnpehguhhigihsugdrohhrghdp ghhnuhdrohhrghenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepmhgrihhlfh hrohhmpehlvghosehfrghmuhhlrghrihdrnhgrmhgv X-ME-Proxy: Received: by mail.messagingengine.com (Postfix) with ESMTPA for <52338@debbugs.gnu.org>; Mon, 6 Dec 2021 17:18:14 -0500 (EST) From: Leo Famulari Date: Mon, 6 Dec 2021 17:18:10 -0500 Message-Id: <2f52f6b48db55f8a79b07dbb242b297ab49d6083.1638828946.git.leo@famulari.name> X-Mailer: git-send-email 2.34.0 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Migadu-Flow: FLOW_IN X-Migadu-Country: US ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1638829152; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding:resent-cc: resent-from:resent-sender:resent-message-id:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=mFU1BiXur1urRvIk4SysYUzQRlRjZevakml5r6IXBG4=; b=cSFbCpsMmjngpxLNOnOXsQfBD7L5Hw7c0HfKqOViSO1urHfpAYJFfxEuWQsIzr7epijza3 LSIU587VQNQBmsFdjVaiYheQrbvlUqfcJqZl4TnQXL/+k3Ar9VU/ULfWfKl314+tHKXC89 CmqFoUzXQcb3JHrCZPU6n2qSZZURuRWKXQi6JJ+4ln2uNDuyQmO6SiOtxtgl8SwxoyYgPy iOeOwZpvBWLSkiSHO985VDKleQ7AM1E9iYNTShorhdOi5u3vf98slvrao+vraUvTUOteCA Itk9Z88zszG9Q8tvSg0lbFrwST6X5XiANPl7GUaMNEg2ao8NtsZovO1XhUESmw== ARC-Seal: i=1; s=key1; d=yhetil.org; t=1638829152; a=rsa-sha256; cv=none; b=q2+63HZokF4ayDOahUnWEbJGKn2JKKWuF0Le6RT6nuJ8Qel2k48ad7GJP5kwjeTJBVGT+r jIUym/683Rfr+yCc+BLHKqEDPxiH4jLsAtRRDpc2npoTwRN/Yds/Vj8a+ZlOIPRmj/zdjv LTtDartSAcmtsCVvtI2hxceCqntiHBvOmpKRxEYT1eewNuT6DYBuz7zFepAlw5M+a/UvLt qc8HUpeaEqEEeoCdPMAtgvOYK6xtgaWR5EM27hpSQb4ghDmby+uQHPFemm0+9/R4EvJrpD aJYKheqZi5CcpqTc9R6PM45wcdD6MM3qfPhdaTJD19zqpVR9uE/I1urYsAuRaw== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=famulari.name header.s=mesmtp header.b=OndJF9pk; dkim=fail ("headers rsa verify failed") header.d=messagingengine.com header.s=fm1 header.b=n8xPLa1D; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Spam-Score: -0.54 Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=famulari.name header.s=mesmtp header.b=OndJF9pk; dkim=fail ("headers rsa verify failed") header.d=messagingengine.com header.s=fm1 header.b=n8xPLa1D; dmarc=none; spf=pass (aspmx1.migadu.com: domain of "bug-guix-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="bug-guix-bounces+larch=yhetil.org@gnu.org" X-Migadu-Queue-Id: 182D5B38A X-Spam-Score: -0.54 X-Migadu-Scanner: scn0.migadu.com X-TUID: wv8TTSTxcCEz I tested that `guix system build` does succeed with this change, but I would like a review on whether the resulting Nginx configuration is correct, and if this is the correct path to disallow. It generates an Nginx location block like this: ------ location /robots.txt { add_header Content-Type text/plain; return 200 "User-agent: * Disallow: /nar "; } ------ * hydra/nginx/berlin.scm (berlin-locations): Add a robots.txt Nginx location. --- hydra/nginx/berlin.scm | 9 ++++++++- 1 file changed, 8 insertions(+), 1 deletion(-) diff --git a/hydra/nginx/berlin.scm b/hydra/nginx/berlin.scm index 1f4b0be..3bb2129 100644 --- a/hydra/nginx/berlin.scm +++ b/hydra/nginx/berlin.scm @@ -174,7 +174,14 @@ PUBLISH-URL." (nginx-location-configuration (uri "/berlin.guixsd.org-export.pub") (body - (list "root /var/www/guix;")))))) + (list "root /var/www/guix;"))) + + (nginx-location-configuration + (uri "/robots.txt") + (body + (list + "add_header Content-Type text/plain;" + "return 200 \"User-agent: *\nDisallow: /nar/\n\";")))))) (define guix.gnu.org-redirect-locations (list -- 2.34.0