From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id oLjrJOW/DF87BwAA0tVLHw (envelope-from ) for ; Mon, 13 Jul 2020 20:11:17 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id KCSiIOW/DF9ZbwAAbx9fmQ (envelope-from ) for ; Mon, 13 Jul 2020 20:11:17 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 1B2199401CF for ; Mon, 13 Jul 2020 20:11:17 +0000 (UTC) Received: from localhost ([::1]:37874 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jv4nE-0002q4-0b for larch@yhetil.org; Mon, 13 Jul 2020 16:11:16 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:33872) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jv4n6-0002pw-8X for guix-devel@gnu.org; Mon, 13 Jul 2020 16:11:08 -0400 Received: from mira.cbaines.net ([212.71.252.8]:42260) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jv4n4-0007Si-9p; Mon, 13 Jul 2020 16:11:07 -0400 Received: from localhost (unknown [46.237.175.173]) by mira.cbaines.net (Postfix) with ESMTPSA id 30BDB27BBE1; Mon, 13 Jul 2020 21:11:04 +0100 (BST) Received: from localhost (localhost [local]) by localhost (OpenSMTPD) with ESMTPA id 2a1c01b7; Mon, 13 Jul 2020 20:11:01 +0000 (UTC) References: <878sfnpl9j.fsf@gnu.org> User-agent: mu4e 1.4.10; emacs 26.3 From: Christopher Baines To: Ludovic =?utf-8?Q?Court=C3=A8s?= Subject: Re: [Guix Website] A Search Page for Packages In-reply-to: <878sfnpl9j.fsf@gnu.org> Date: Mon, 13 Jul 2020 21:10:59 +0100 Message-ID: <874kqbjhv0.fsf@cbaines.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=212.71.252.8; envelope-from=mail@cbaines.net; helo=mira.cbaines.net X-detected-operating-system: by eggs.gnu.org: First seen = 2020/07/13 15:20:32 X-ACL-Warn: Detected OS = Linux 2.2.x-3.x [generic] X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, UNPARSEABLE_RELAY=0.001, URIBL_BLOCKED=0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Daniela Lura , guix-devel@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Spam-Score: 0.19 X-TUID: YNUleP2o7RMT --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Ludovic Court=C3=A8s writes: > Heya Danjela, > > Daniela Lura skribis: > >> Taking into consideration the suggestion made in this thread: >> https://lists.gnu.org/archive/html/guix-devel/2020-05/msg00096.html, my >> mentor, Christopher Baines suggested me to write a script that serves a >> search page for packages using the search functionality within the Guix >> Data Service, >> https://data.guix.gnu.org/repository/1/branch/master/latest-processed-re= vision/packages?search_query=3Dgit&field=3Dversion&field=3Dsynopsis&after_n= ame=3D&limit_results=3D100 >> . >> >> The prototype page can be accessed through a test version of the Guix >> website that Chris deployed: >> http://guix-website-test.cbaines.net/packages/search > > Cool! To be clear, guix-website-test actually makes a search query on a > Data Service instance, right? I guess that explains part of the > slowness, but maybe we could tweak nginx to keep search results in cache > for a few hours. > > Florian raised an important issue regarding the possibility of denial of > service. Ideas on how to mitigate that, either in the Data Service, or > nginx at guix.gnu.org? On this point specifically, I've used the rate limiting functionality in NGinx before, and that's probably a low cost approach to guarding against this. It's not going to stop a DDOS, but might help avoid lots of requests from one IP address causing load issues. --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEEPonu50WOcg2XVOCyXiijOwuE9XcFAl8Mv9NfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcACgkQXiijOwuE 9Xca/RAAgfT9dFx2uXEK5ZuBC0SUwgIjM9eCPIX8AvHXDFzaGB0Qd+6sA8kUkEGO xj9H0iKXlJjrkw0lZS3r7F3TLZLsjgIKSCrjJigesy2cDsB22Umt/x2MCljU0jMp zzAhWoFoYMDOvX+aW4UHP8RwgiH++BMwWgv9ZBZesiXrHHKbdoKKJZbz7j3rqeas JDOjdJ7M6y8qb9FjhbScb7GUx1Q12uVfdOCFoEIiMF66cuHt+bOiiWS6gebWJUKF lzaSKSTYweGE0T+iYwQRezDatLcH16I6l98B10XmGHz2LvCF7y7CO2sOI1YaocwD A82XjDOCQlyL/LFCvoDb4ne7MLJ9Mgk04IQKXLvLV+tbsaBnHbl976N2/FEuC4tF s71oLt7jD9EVD9nOtjwIbY4xbPK78vVErmTYb6U8MtVzzFvYf94ikwwZA/CmhBXo 57UEcsQyKyzaSpH9CmimlTz2UaKJXQXqciuUDtgTbv+jmoyf5YAyrEfQutX+4yZJ w8PUposLeq5BZueeTLZ8AuBS57J5NZSVqjb88gdK5aKKWf7mVRAQgbZ4cgYjo7vc su8k860QcYG6azUdmBqdH637uThALp4Y0qfVXjS/mEm2B9OZzhrZeBO/+Rf0BKJH kj0oSFKTtzwU4J8Smbmu0AquqjyyhrcjVDraQUFaWXLbptAccnk= =BZ9W -----END PGP SIGNATURE----- --=-=-=--