From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id CAeWMk4wNV/KHQAA0tVLHw (envelope-from ) for ; Thu, 13 Aug 2020 12:21:34 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id EBVmLk4wNV8+FAAA1q6Kng (envelope-from ) for ; Thu, 13 Aug 2020 12:21:34 +0000 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 892A5940142 for ; Thu, 13 Aug 2020 12:21:34 +0000 (UTC) Received: from localhost ([::1]:46406 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1k6CEf-0008AP-CB for larch@yhetil.org; Thu, 13 Aug 2020 08:21:33 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:44734) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1k6CEK-0008AI-8C for guix-devel@gnu.org; Thu, 13 Aug 2020 08:21:13 -0400 Received: from mugam.systemreboot.net ([139.59.75.54]:59346) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1k6CEG-0002mV-ON for guix-devel@gnu.org; Thu, 13 Aug 2020 08:21:11 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=systemreboot.net; s=default; h=Content-Type:MIME-Version:Message-ID:Date: References:In-Reply-To:Subject:Cc:To:From:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=Z/3w/Dt5sg9Bm4hGmruBlGHYwR8YVEpNsfY4HR6GZDU=; b=eYasRNhhK8291WNoztAc/TBjM /IxmXd1mDdG7aJ19DeV07k8pB4wcOLvLWugCmlz1GKoDS0I/dcqTg63VzUdgmp+Hda7gm4nEXdpG/ g70HMwF8feOcsK09vvyEvMVjaFcRQzf2ISbYmDetzdKFHc5BCVJsIf/aTLskFyyGNWrkm5BZaGWSu HJKCx98MTExoZkc8Znq4kTKqDtyQ7u2kEFY8Lq4Wju9MDKJN+jkT3NWK09iGyx4WllsVwYf0F9pR2 HAlkjB0PWHvqUwuynLMdSHue+CavHZJIbgqQkgN4P9vWYe7UAvg2KM32dFk6BpIoarji4mtJgypjP LhXv/xYiw==; Received: from [192.168.2.1] (helo=steel) by systemreboot.net with esmtpsa (TLS1.3) tls TLS_AES_256_GCM_SHA384 (Exim 4.94) (envelope-from ) id 1k6CDw-0003Vr-BL; Thu, 13 Aug 2020 17:50:48 +0530 From: Arun Isaac To: Pierre Neidhardt , Ricardo Wurmus Subject: Re: File search progress: database review and question on triggers In-Reply-To: <87d03uevdq.fsf@ambrevar.xyz> References: <87sgcuh8rb.fsf@ambrevar.xyz> <87y2ml429i.fsf@elephly.net> <87364tgja3.fsf@ambrevar.xyz> <87y2mlf4jw.fsf@ambrevar.xyz> <87pn7x3pyw.fsf@elephly.net> <87r1sbel4f.fsf@ambrevar.xyz> <87eeobh01d.fsf@systemreboot.net> <87d03uevdq.fsf@ambrevar.xyz> Date: Thu, 13 Aug 2020 17:50:55 +0530 Message-ID: <875z9mhh3s.fsf@systemreboot.net> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha256; protocol="application/pgp-signature" Received-SPF: pass client-ip=139.59.75.54; envelope-from=arunisaac@systemreboot.net; helo=mugam.systemreboot.net X-detected-operating-system: by eggs.gnu.org: First seen = 2020/08/13 08:21:03 X-ACL-Warn: Detected OS = Linux 2.2.x-3.x [generic] [fuzzy] X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_NONE=0.001, SPF_PASS=-0.001, URIBL_BLOCKED=0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: guix-devel@gnu.org Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: "Guix-devel" X-Scanner: scn0 Authentication-Results: aspmx1.migadu.com; dkim=fail (rsa verify failed) header.d=systemreboot.net header.s=default header.b=eYasRNhh; dmarc=fail reason="SPF not aligned (relaxed)" header.from=systemreboot.net (policy=none); spf=pass (aspmx1.migadu.com: domain of guix-devel-bounces@gnu.org designates 209.51.188.17 as permitted sender) smtp.mailfrom=guix-devel-bounces@gnu.org X-Spam-Score: -2.01 X-TUID: vmdSXpmB7PlT --=-=-= Content-Type: text/plain >> sqlite insert statements can be very fast. sqlite.org claims 50000 >> or... > > I tried it, and got it down to... 30s! That's great! :-) > - Or do you think SQLite patterns (using "%") would do for now? As > Mathieu pointed out, it's an unfortunate inconsistency with the rest of > Guix. But maybe regexp support can be added in a second stage. The inconsistency is unfortunate. Personally, I am in favor of dropping regexp support everywhere in Guix, and only having literal string search. But that is backward incompatible, and may be controversial. In this specific case of file search, we could use the sqlite like patterns, but not expose them to the user. For example, if the search query is "", we search for the LIKE pattern "%%". I think this addresses how users normally search for files. I don't think regexps add much value. Full text search may not be relevant to file search. Full text search is more suited for natural language search involving such things as stemming algorithms. --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQEzBAEBCAAdFiEEf3MDQ/Lwnzx3v3nTLiXui2GAK7MFAl81MCcACgkQLiXui2GA K7N5pgf/fJlbsKX6Pkn++vlMn+QNV9pTZiDVMxuf3miGpBUp3Ieoc2zoh5CSJTvk jINpfbE0qtQnUfCvT13LCsvLIInwyKBX0+WvRQbYAGFJJ6zIwGXzdRNF4COOKCU6 3KQMFtkzEYDt2+gF3vWJPZWkEwrm/ES5w736es3fjaFkILMqVWPnwwvN/qBemCVk eELs+yzPTobG85zdHH9gBWDJVx4TZe6IsN860AHqANfQ6fpfWb3YBFvNJvHvfSHE mV8qjn0uagpLh7f5BzA8i8kSDLxGtvU5BK5791cjoWhVaiovvikUG+Ykp+wQAbLM Bm7ikXMydDz+9mYq+XLEPWFCyj0xVA== =O95V -----END PGP SIGNATURE----- --=-=-=--