From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp1 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id KLeqJdV4DV88BgAA0tVLHw (envelope-from ) for ; Tue, 14 Jul 2020 09:20:21 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp1 with LMTPS id 4E9tIdV4DV+5HAAAbx9fmQ (envelope-from ) for ; Tue, 14 Jul 2020 09:20:21 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 230AB940276 for ; Tue, 14 Jul 2020 09:20:21 +0000 (UTC) Received: from localhost ([::1]:45502 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jvH6q-0003dV-3a for larch@yhetil.org; Tue, 14 Jul 2020 05:20:20 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:48448) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1jvH6f-0003dH-Qu for guix-devel@gnu.org; Tue, 14 Jul 2020 05:20:09 -0400 Received: from mail-ej1-x634.google.com ([2a00:1450:4864:20::634]:40495) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jvH6d-00080q-OB; Tue, 14 Jul 2020 05:20:09 -0400 Received: by mail-ej1-x634.google.com with SMTP id o18so20752136eje.7; Tue, 14 Jul 2020 02:20:06 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=SK/kHj+7rBk5TGVPgOotnWxqET3VFHYY5OhBuoAr80Y=; b=E9x598Bi9jS6XhKBhUZLLVRXyoVITRp2PQ0CgbcaLcEnhsXSYZ0bXt0IdE4XxDNwC4 javVYNctr8b+GvveROlsc1yD5D24Tt3E+t3Idx0OuWgH7IHnCXCqFWrj9hpZcOaOlgIR WyUZ3VjD57AGvFCnbc5gX6f6iRHDP3wUvvbV7PctXg/kvRAt76T4P3lnp3rI7RRFkSuG cNPgmg+zqUGseWpKv39mHiNzhpMO5ErJtmThR6o2lCpA2MZiuYmtAXbWwTGc1kHV1cXW OvvigsIFEX5YHI5XsT3T5PhFxUZM7ly31LL7Hx1frKpY08dztd247ggo01y4H0zRDKm5 vAqA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=SK/kHj+7rBk5TGVPgOotnWxqET3VFHYY5OhBuoAr80Y=; b=ZMX7K7ekan76jyklIeH1S4P5ZY9matUSbNm+QdJtvLgOSNmeA0xkWiBdWYiVX13zbQ c3NezIjpwTDhPtHjGk8RO+EBOxgZvqB1n69dSyOQEle632TYGWap6F+kAtBpFxv0ggh/ ahIzC8dJFd0Arm8Ji8mMAKD3E4l4LR26zShk0FlCYZWhzDbRkJsNjZac4ngwzxQVjKg1 et4qg2bg12uPRbikPMPOGon7d/1wvNAz8z/pK8dD1e652WYvgVnu6uUUdeltItbSXEtG lFW9Z390QZuW48l7z4hloGvUzp8+XhUypc+UwwV7rO+FwzZEZ9DQuZm0LesF86xbV4ZS rJFg== X-Gm-Message-State: AOAM53191L6LPoThrXg2IvKgZUuCwc94XIOuZuf57ySvOrxwPyNeK8pr L5PDBoxNKMYZq4dmJpP1D7tZXWagqzoSeu11j0c+U0Mn X-Google-Smtp-Source: ABdhPJyLrXWxC4nQ1cjwLQBmojGgpCF9ajhFUtIG4Bh+ZT16ppOUQ2942xZUj+AfZiRvvmCXfkGuCdOqDl/RYuDXal0= X-Received: by 2002:a17:906:492:: with SMTP id f18mr3594147eja.279.1594718404954; Tue, 14 Jul 2020 02:20:04 -0700 (PDT) MIME-Version: 1.0 References: <878sfnpl9j.fsf@gnu.org> In-Reply-To: <878sfnpl9j.fsf@gnu.org> From: Daniela Lura Date: Tue, 14 Jul 2020 11:19:21 +0200 Message-ID: Subject: Re: [Guix Website] A Search Page for Packages To: =?UTF-8?Q?Ludovic_Court=C3=A8s?= , guix-devel@gnu.org Content-Type: multipart/alternative; boundary="0000000000000b4e6a05aa635078" Received-SPF: pass client-ip=2a00:1450:4864:20::634; envelope-from=danielaluraa@gmail.com; helo=mail-ej1-x634.google.com X-detected-operating-system: by eggs.gnu.org: No matching host in p0f cache. That's all we know. X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=fail (rsa verify failed) header.d=gmail.com header.s=20161025 header.b=E9x598Bi; dmarc=fail reason="SPF not aligned (relaxed)" header.from=gmail.com (policy=none); spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Spam-Score: 1.09 X-TUID: GRTZsmTG2BZO --0000000000000b4e6a05aa635078 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hi Ludo, > To be clear, guix-website-test actually makes a search query on a Data Service instance, right? That's right. I'm currently learning how to read and understand query plans: https://www.postgresql.org/docs/10/using-explain.html#USING-EXPLAIN-ANALYZE so that the query can hopefully be optimized. > Ideas on how to mitigate that, either in the Data Service, or nginx at guix.gnu.org? To be honest, I'm not that familiar with nginx, so my opinion on that wouldn't be that valuable. Thank you for the feedback! Best, Danjela On Mon, 13 Jul 2020 at 16:00, Ludovic Court=C3=A8s wrote: > Heya Danjela, > > Daniela Lura skribis: > > > Taking into consideration the suggestion made in this thread: > > https://lists.gnu.org/archive/html/guix-devel/2020-05/msg00096.html, my > > mentor, Christopher Baines suggested me to write a script that serves a > > search page for packages using the search functionality within the Guix > > Data Service, > > > https://data.guix.gnu.org/repository/1/branch/master/latest-processed-rev= ision/packages?search_query=3Dgit&field=3Dversion&field=3Dsynopsis&after_na= me=3D&limit_results=3D100 > > . > > > > The prototype page can be accessed through a test version of the Guix > > website that Chris deployed: > > http://guix-website-test.cbaines.net/packages/search > > Cool! To be clear, guix-website-test actually makes a search query on a > Data Service instance, right? I guess that explains part of the > slowness, but maybe we could tweak nginx to keep search results in cache > for a few hours. > > Florian raised an important issue regarding the possibility of denial of > service. Ideas on how to mitigate that, either in the Data Service, or > nginx at guix.gnu.org? > > > I'd like to know if you find the page useful so that I can hopefully > start > > working on incorporating the search functionality into this page: > > https://guix.gnu.org/packages/. > > I=E2=80=99d be happy to see that happen! We would need the changes again= st > guix-artwork.git as well as (maybe) changes to the nginx config in > maintenance.git. How should we proceed? > > Thanks! > > Ludo=E2=80=99. > --0000000000000b4e6a05aa635078 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hi Ludo,
=

> To be clear, guix-website-test actually makes a se= arch query on a
Data Service instance, right?
That's right. I'm currently= learning how to read and understand query plans: https://www.= postgresql.org/docs/10/using-explain.html#USING-EXPLAIN-ANALYZE so that= the query can hopefully be optimized.

> Id= eas on how to mitigate that, either in the Data Service, or
nginx at guix.gnu.org?
To be honest, I'm not that familiar with= nginx, so my opinion on that wouldn't be that valuable.=C2=A0

Thank you for the feedback!

= Best,
Danjela

On Mon, 13 Jul 2020 at 16= :00, Ludovic Court=C3=A8s <ludo@gnu.org<= /a>> wrote:
H= eya Danjela,

Daniela Lura <danielaluraa@gmail.com> skribis:

> Taking into consideration the suggestion made in this thread:
> https://lists.gnu.org/archiv= e/html/guix-devel/2020-05/msg00096.html, my
> mentor, Christopher Baines suggested me to write a script that serves = a
> search page for packages using the search functionality within the Gui= x
> Data Service,
> https://data.guix.gnu.org/repository/1/branch/master/lat= est-processed-revision/packages?search_query=3Dgit&field=3Dversion&= field=3Dsynopsis&after_name=3D&limit_results=3D100
> .
>
> The prototype page can be accessed through a test version of the Guix<= br> > website that Chris deployed:
> http://guix-website-test.cbaines.net/pack= ages/search

Cool!=C2=A0 To be clear, guix-website-test actually makes a search query on= a
Data Service instance, right?=C2=A0 I guess that explains part of the
slowness, but maybe we could tweak nginx to keep search results in cache for a few hours.

Florian raised an important issue regarding the possibility of denial of service.=C2=A0 Ideas on how to mitigate that, either in the Data Service, o= r
nginx at guix.gnu.org?

> I'd like to know if you find the page useful so that I can hopeful= ly start
> working on incorporating the search functionality into this page:
> https://guix.gnu.org/packages/.

I=E2=80=99d be happy to see that happen!=C2=A0 We would need the changes ag= ainst
guix-artwork.git as well as (maybe) changes to the nginx config in
maintenance.git.=C2=A0 How should we proceed?

Thanks!

Ludo=E2=80=99.
--0000000000000b4e6a05aa635078--