From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:470:142:3::10]:36457) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jDa4F-00050W-8q for guix-patches@gnu.org; Sun, 15 Mar 2020 16:41:05 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1jDa4E-0001UH-8j for guix-patches@gnu.org; Sun, 15 Mar 2020 16:41:03 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:57924) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1jDa4E-0001Sh-0v for guix-patches@gnu.org; Sun, 15 Mar 2020 16:41:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1jDa4D-0007sD-Qj for guix-patches@gnu.org; Sun, 15 Mar 2020 16:41:01 -0400 Subject: [bug#39258] [PATCH v2 0/3] Xapian for Guix package search Resent-Message-ID: From: Ludovic =?UTF-8?Q?Court=C3=A8s?= References: <20200307133116.11443-1-arunisaac@systemreboot.net> <87sgijgb1v.fsf@gnu.org> <875zffcc87.fsf@gnu.org> <87r1y13jew.fsf@gnu.org> <87sgifj8zo.fsf@gnu.org> Date: Sun, 15 Mar 2020 21:40:10 +0100 In-Reply-To: (Arun Isaac's message of "Fri, 13 Mar 2020 11:07:09 +0530") Message-ID: <87imj5ic7p.fsf@gnu.org> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-patches-bounces+kyle=kyleam.com@gnu.org Sender: "Guix-patches" To: Arun Isaac Cc: mail@ambrevar.xyz, 39258@debbugs.gnu.org, zimon.toutoune@gmail.com Hi Arun, Arun Isaac skribis: >> Currently, profile hooks such as =E2=80=98%channel-profile-hooks=E2=80= =99, receive a >> complete profile=E2=80=94in this case, the composition of all the channe= ls the >> user chose. >> >> So if we want to achieve what you propose, we=E2=80=99d need to find ano= ther way >> to hook database generation. > > Hmmm. Tough luck, I suppose. Do you have suggestions for anywhere else > to hook database generation? For the core database (packages that come with Guix), (guix self) could take care of it. >> BTW, there=E2=80=99s also the problem of modules added dynamically with >> $GUIX_PACKAGE_PATH or =E2=80=98-L=E2=80=99. With the proposed scheme, i= t seems that >> they could no longer be searched. Is that correct? > > Unfortunately, that is correct. To address this, we discussed retaining > the current search implementation along with the new xapian > implementation. But, that changes the search query behaviour and > adds a lot of complexity. I'll think of some other way out. Yeah, I think we=E2=80=99d want to have roughly a single implementation. I wonder if the relevant metrics that Xapian implements, like zimoun mentioned, could be available directly in Scheme in a way that allows us to compute them at run time when the pre-built cache is unavailable. Or would that be necessarily too slow? If so, perhaps a slightly less fancy metric could work with better performance? Thanks, Ludo=E2=80=99.