From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp2 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id oNJ1MKpLb19VagAA0tVLHw (envelope-from ) for ; Sat, 26 Sep 2020 14:09:46 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp2 with LMTPS id UFUuLKpLb1+6bAAAB5/wlQ (envelope-from ) for ; Sat, 26 Sep 2020 14:09:46 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 55446940274 for ; Sat, 26 Sep 2020 14:09:46 +0000 (UTC) Received: from localhost ([::1]:38696 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1kMAtV-0006MS-BZ for larch@yhetil.org; Sat, 26 Sep 2020 10:09:45 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:54382) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kMApJ-0000vL-9g for guix-devel@gnu.org; Sat, 26 Sep 2020 10:05:25 -0400 Received: from relay6-d.mail.gandi.net ([217.70.183.198]:47767) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1kMApG-0005TE-83; Sat, 26 Sep 2020 10:05:24 -0400 X-Originating-IP: 90.92.160.122 Received: from bababa (lfbn-idf2-1-1094-122.w90-92.abo.wanadoo.fr [90.92.160.122]) (Authenticated sender: mail@ambrevar.xyz) by relay6-d.mail.gandi.net (Postfix) with ESMTPSA id 0E465C0009; Sat, 26 Sep 2020 14:05:15 +0000 (UTC) From: Pierre Neidhardt To: zimoun , guix-devel@gnu.org Subject: Re: File search progress: database review and question on triggers In-Reply-To: <87zh6gns4l.fsf@ambrevar.xyz> References: <87sgcuh8rb.fsf@ambrevar.xyz> <86imd4e7cr.fsf@gmail.com> <87eenspcf8.fsf@ambrevar.xyz> <865z94dz83.fsf@gmail.com> <87zh6gns4l.fsf@ambrevar.xyz> Date: Sat, 26 Sep 2020 16:04:53 +0200 Message-ID: <87zh5c7hx6.fsf@ambrevar.xyz> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature" Received-SPF: pass client-ip=217.70.183.198; envelope-from=mail@ambrevar.xyz; helo=relay6-d.mail.gandi.net X-detected-operating-system: by eggs.gnu.org: First seen = 2020/09/26 10:05:17 X-ACL-Warn: Detected OS = Linux 3.11 and newer [fuzzy] X-Spam_score_int: -12 X-Spam_score: -1.3 X-Spam_bar: - X-Spam_report: (-1.3 / 5.0 requ) BAYES_00=-1.9, FROM_SUSPICIOUS_NTLD=0.498, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, TRACKER_ID=0.1, T_PDS_OTHER_BAD_TLD=0.01 autolearn=no autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Mathieu Othacehe Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Spam-Score: 0.89 X-TUID: JD2TCEF0NZoS --=-=-= Content-Type: text/plain Content-Transfer-Encoding: quoted-printable Sorry for the delay. I've pushed a commit which adds the synopsis and the description to the database. 0127cfa5d0898222257a716bf7b0a167f31cc6dd The quite surprising result is that these new details only cost 1 MiB extra! I can then search packages and it's super fast: =2D-8<---------------cut here---------------start------------->8--- > ,time (search-package "org" "equival")=20 $51 =3D (("emacs-org-contrib")) ;; 0.002930s real time, 0.002925s run time. 0.000000s spent in GC. =2D-8<---------------cut here---------------end--------------->8--- My local database only includes the store items, that is to say some 1800 items, but even with the 15000 packages the search would not be impacted by much. The size might grow by some 10 MiB though, but that's reasonable and it compresses very well (down to 6-7 MiB in zstd). It seems to me that Simon had a very good hunch: the filesearch implementation could fix the slow search issue for free. Thoughts? =2D-=20 Pierre Neidhardt https://ambrevar.xyz/ --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQFGBAEBCAAwFiEEUPM+LlsMPZAEJKvom9z0l6S7zH8FAl9vSoUSHG1haWxAYW1i cmV2YXIueHl6AAoJEJvc9Jeku8x/r0QH/0Fik2vpnzr56sw2U+Ig4nyU80muh/Fd b1eIL6pLCCCm6B6n8NAS61IYqIAZk5cJTx+BdDTHDxyCPAQcH6JnizgJWKjr87ce h7f8oapX0SgKAkRmNA5T/qLoN9r15jCykW1cEpPYYrVlXV08tr09K4sCBFWhQD5L sE9WBhIK0btc/X8G1QCponw0UPzSHJHzOrGERAh96MxjYBYfpJTWgxeS4tX2MD9n joVwItr+G2RJT0qcb8wdoTZsZo1ileFScMaZwqnmHZKLxxU18nPqxslA4KJJXvAk P8yXPXfiyJ2JW14N8N/sSmvezfSK8G/wP8mke4ZfOkHuVfeWTv0tAts= =Z8vg -----END PGP SIGNATURE----- --=-=-=--