From mboxrd@z Thu Jan  1 00:00:00 1970
From: zimoun <zimon.toutoune@gmail.com>
Subject: Re: Inverted index to accelerate guix package search
Date: Wed, 15 Jan 2020 15:25:17 +0100
Message-ID: <CAJ3okZ1FP939F8XnCUsJrNXQqLAUhe=ApqJnqW8hGqpxqxEOng@mail.gmail.com>
References: <cu7h810emy0.fsf@systemreboot.net> <87a76r68u6.fsf@ambrevar.xyz>
 <cu7a76re6nj.fsf@systemreboot.net>
 <CAJ3okZ23f4kuygoj_HS0+uKYGCad2ZV=u7DWuZ=-3vQXM_QYtQ@mail.gmail.com>
 <87muaqnmod.fsf@ambrevar.xyz> <87h80y12k3.fsf@roquette.mug.biscuolo.net>
 <CAJ3okZ06JKoq1=SNSH0hRm6xBJL+xoerOf7i5dHRsCu9VTMbpw@mail.gmail.com>
 <877e1tyaut.fsf@ambrevar.xyz>
 <CAJ3okZ1Xw=PxYuw2i_QSiySjYxxxQrVMRXyTcRd6Mh3u=oXxrw@mail.gmail.com>
 <875zhdw0a0.fsf@ambrevar.xyz>
Mime-Version: 1.0
Content-Type: text/plain; charset="UTF-8"
Return-path: <guix-devel-bounces+gcggd-guix-devel=m.gmane-mx.org@gnu.org>
Received: from eggs.gnu.org ([2001:470:142:3::10]:40939)
 by lists.gnu.org with esmtp (Exim 4.90_1)
 (envelope-from <zimon.toutoune@gmail.com>) id 1irjbu-0001K1-RF
 for guix-devel@gnu.org; Wed, 15 Jan 2020 09:25:31 -0500
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <zimon.toutoune@gmail.com>) id 1irjbt-0005ad-Np
 for guix-devel@gnu.org; Wed, 15 Jan 2020 09:25:30 -0500
Received: from mail-qt1-x82e.google.com ([2607:f8b0:4864:20::82e]:43081)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16)
 (Exim 4.71) (envelope-from <zimon.toutoune@gmail.com>)
 id 1irjbt-0005Zv-JE
 for guix-devel@gnu.org; Wed, 15 Jan 2020 09:25:29 -0500
Received: by mail-qt1-x82e.google.com with SMTP id d18so15864224qtj.10
 for <guix-devel@gnu.org>; Wed, 15 Jan 2020 06:25:29 -0800 (PST)
In-Reply-To: <875zhdw0a0.fsf@ambrevar.xyz>
List-Id: "Development of GNU Guix and the GNU System distribution."
 <guix-devel.gnu.org>
List-Unsubscribe: <https://lists.gnu.org/mailman/options/guix-devel>,
 <mailto:guix-devel-request@gnu.org?subject=unsubscribe>
List-Archive: <https://lists.gnu.org/archive/html/guix-devel>
List-Post: <mailto:guix-devel@gnu.org>
List-Help: <mailto:guix-devel-request@gnu.org?subject=help>
List-Subscribe: <https://lists.gnu.org/mailman/listinfo/guix-devel>,
 <mailto:guix-devel-request@gnu.org?subject=subscribe>
Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane-mx.org@gnu.org
Sender: "Guix-devel"
 <guix-devel-bounces+gcggd-guix-devel=m.gmane-mx.org@gnu.org>
To: Pierre Neidhardt <mail@ambrevar.xyz>
Cc: Guix Devel <guix-devel@gnu.org>

Hi Pierre,

On Wed, 15 Jan 2020 at 10:12, Pierre Neidhardt <mail@ambrevar.xyz> wrote:

> > What about the "build time" size? Other said, all one needs to build
> > to have xapian, i.e., the size of the full bag: starting from the
> > bootstrap seed and having Guix+Xapian (vs. Guix alone).
>
> As shows with guix graph?
>
> This yields a small graph:
> --8<---------------cut here---------------start------------->8---
> guix graph --type=bag-emerged xapian | dot -Tpdf > dag.pdf
> --8<---------------cut here---------------end--------------->8---
>
> This yields a big graph:
> --8<---------------cut here---------------start------------->8---
> guix graph --type=bag xapian | dot -Tpdf > dag.pdf
> --8<---------------cut here---------------end--------------->8---
>
> I don't know how it compares to other packages.

I do not know neither. But I guess that Xapian does not add extra
dependencies then itself.


I do not know if this filter is correct.

--8<---------------cut here---------------start------------->8---
guixdot=/tmp/guix.dot

guix graph --type=bag guix > $guixdot

for what in `guix graph --type=bag xapian | grep '@' | cut -d'[' -f1`;
do
    grep '@' $guixdot | grep $what > /dev/null
    if [ $? -eq 0 ]
    then
        echo "OK -- $what"
    else
        echo "KO -- $what"
    fi
done
--8<---------------cut here---------------end--------------->8---

Roughly, it compares the '/gnu/store'  hashes of the nodes. And all
the nodes of Xapian are already in the graph of Guix, except Xapian
itself. So there is not extra cost (really low). I mean if I
understand well.


Well, guile-xapian bindings is the blocking point.
Any taker? ;-)


All the best,
simon