From mboxrd@z Thu Jan 1 00:00:00 1970 From: Giovanni Biscuolo Subject: Re: Inverted index to accelerate guix package search Date: Wed, 15 Jan 2020 12:53:07 +0100 Message-ID: <87wo9tylzw.fsf@roquette.mug.biscuolo.net> References: <87a76r68u6.fsf@ambrevar.xyz> <87muaqnmod.fsf@ambrevar.xyz> <87h80y12k3.fsf@roquette.mug.biscuolo.net> Mime-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Return-path: Received: from eggs.gnu.org ([2001:470:142:3::10]:43573) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1irhEt-0006DI-Sp for guix-devel@gnu.org; Wed, 15 Jan 2020 06:53:39 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1irhEp-00064z-K5 for guix-devel@gnu.org; Wed, 15 Jan 2020 06:53:35 -0500 Received: from ns13.heimat.it ([46.4.214.66]:49630) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1irhEp-00063m-9z for guix-devel@gnu.org; Wed, 15 Jan 2020 06:53:31 -0500 In-Reply-To: List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+gcggd-guix-devel=m.gmane-mx.org@gnu.org Sender: "Guix-devel" To: zimoun Cc: Guix Devel --=-=-= Content-Type: text/plain Content-Transfer-Encoding: quoted-printable Hi Simon and all other developers first and foremost: I'm sorry I still cannot help in developing this "xapian feature" or even explore pros and cons of this feature for now mine it's just a user and possible beta-tester POV... let's call it food for thought :-) zimoun writes: [...] >> Actually I would love to search (tag?!?) for packages/services/machines >> (profiles?) the same way I query my email database with notmuch: it >> would give me a fourth dimension in "DevOps" :-) > > Currently, you can output all the packages with 'guix search ""' and > index them using the Python API. It is not so nice but it should give > an idea about what to expose first to Guile. interesting approach for an indexer external to Guix, let's call it a proof of concept... I'd really like to experiment this directly in Guile but I'm not able to help with Guile bindings >> I cannot find Guile in Xapian bindings [1] but NotDeft [2] have some >> Emacs Lisp code to interact with Xapian > > There is some work. IMHO. for sure :-) this is why i defined this low-pri in the general Guix plans > If Guix goes to Xapian, all the Git history of all the packages should > be indexed. Today, it is really hard to find the right commit > corresponding to the right version -- the only solution I have is "git > log"+grep; not really friendly. indexing the all the history could be very interesting, but it's enough interesting to me having a system to query (and tag if needed) Guix info from a point in time, i.e. index creation thinking about implementation, IMHO indexing the output of "guix search" is doable but indexing the commit logs of git is complex, probably too much complex > Some discussion spoke about using an external index, fetched for > example on the Guix Data Service. But I personally do not like to rely > on external service accessible through the network. me too, as I said I'd like something like notmuch - guixmuch :-) - that indexes my mailbox; in Guix terms I see "my mailbox" [1] as packages/services/machines and all other useful metadata I have in all my channels/profiles ...then I have muchsync to sync the notmuch database across different machines, and a similar feature whould be nice for guixmuch :-O [1] where IMAP is replaced by git (in various repos, for packages/config/channels) and offlineimap is replaced by guix pull > However, note that index all the packages of all the Guix history > using guile-git+fold-packages is not straightforward: resource > consuming and piece of well-thought data structures. > > Well, now "guix time-machine" is here, Guix is lacking tools to browse > the history of all the packages. we are asking too much to Guix, but it is an interesting feature Thanks! Gio' [...] =2D-=20 Giovanni Biscuolo Xelera IT Infrastructures --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQIzBAEBCgAdFiEERcxjuFJYydVfNLI5030Op87MORIFAl4e/SMACgkQ030Op87M ORKZgQ//QMLefZnEla4gH2bXBMPNzjpeaWhvojwJadfr0P8OZ3uaw8spFI1koxHm 1yzJ10zXY/iro9v7F48NrczqA9D0ljdl1dn5ucgkln+ERGP7i6FtPTPwbzlvEEik 1lGOY2/1oDyd/qbF1rdYL7M/x8kQ89cVDm9jbbp7eo29y2vc3MNaI3FBlPEdAb0W 7Iu3RqrL10XWrZeHRnlBWAx2t/p+aF4uBvGo/g4i3fgjM1A/cas/A2pY95zWCxWS 4jDJXSRpnjo7UYr+hDXPrjJlzaCyr3h2lTWhxDa5DFi3AVpDdwxzLGS4R+UV255t 0rfwBrAzFlpDeqngXRBdxjIMcSt7TkbAOT2nWyQOXxjxuj31F1wjGWp9aodEhOpM 9OzOOlsoCKwOahmbgxrbeTHgpQCSdxEvvuu0eYLnaY1mSPIIUTbYWtLl1rkpGF0i b+gM/5te/fJEa/UqxE4J6RVlqHPtrtLavhl8EdXdl4mpEX80DEtNcEyHB//vbWM7 w1S2RWBOAt5voEZqqeYQ8NxHfHCiwHp1qTZvGkej9Da847/GMGydG8bpmSJhJaTf 02Ae2+Fb/aQ5zTa8Y1SlNDMRAkdAL+etbxod9LX+u2n+odUQvGxAWBodpHbwtBUj sRqLBbYhOjS70Jn/uJjea4B2HKQi0bnWZAgsjBhjglMybKIEM2k= =m2lM -----END PGP SIGNATURE----- --=-=-=--