From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Juri Linkov Newsgroups: gmane.emacs.bugs Subject: bug#13041: 24.2; diacritic-fold-search Date: Sat, 08 Dec 2012 01:55:22 +0200 Organization: JURTA Message-ID: <87ehj18l9p.fsf@mail.jurta.org> References: <20121130182205.C722F14B8D@panix1.panix.com> <87ip8fjzwn.fsf@gnu.org> <871uf2647i.fsf@mail.jurta.org> <50C1C6CC.9020103@gmx.at> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Trace: ger.gmane.org 1354925152 12023 80.91.229.3 (8 Dec 2012 00:05:52 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Sat, 8 Dec 2012 00:05:52 +0000 (UTC) Cc: 13041@debbugs.gnu.org, perin@panix.com, perin@acm.org To: martin rudalics Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Sat Dec 08 01:06:05 2012 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1Th7ve-0003uS-SI for geb-bug-gnu-emacs@m.gmane.org; Sat, 08 Dec 2012 01:06:02 +0100 Original-Received: from localhost ([::1]:56149 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Th7vS-0004cL-JZ for geb-bug-gnu-emacs@m.gmane.org; Fri, 07 Dec 2012 19:05:50 -0500 Original-Received: from eggs.gnu.org ([208.118.235.92]:38701) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Th7vN-0004Xm-VV for bug-gnu-emacs@gnu.org; Fri, 07 Dec 2012 19:05:47 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1Th7vM-0007fj-36 for bug-gnu-emacs@gnu.org; Fri, 07 Dec 2012 19:05:45 -0500 Original-Received: from debbugs.gnu.org ([140.186.70.43]:49295) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1Th7vL-0007ff-VC for bug-gnu-emacs@gnu.org; Fri, 07 Dec 2012 19:05:43 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.72) (envelope-from ) id 1Th7vg-000092-Ij for bug-gnu-emacs@gnu.org; Fri, 07 Dec 2012 19:06:04 -0500 X-Loop: help-debbugs@gnu.org Resent-From: Juri Linkov Original-Sender: debbugs-submit-bounces@debbugs.gnu.org Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sat, 08 Dec 2012 00:06:04 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 13041 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: Original-Received: via spool by 13041-submit@debbugs.gnu.org id=B13041.1354925150526 (code B ref 13041); Sat, 08 Dec 2012 00:06:04 +0000 Original-Received: (at 13041) by debbugs.gnu.org; 8 Dec 2012 00:05:50 +0000 Original-Received: from localhost ([127.0.0.1]:59545 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1Th7vR-00008Q-GK for submit@debbugs.gnu.org; Fri, 07 Dec 2012 19:05:49 -0500 Original-Received: from ps18281.dreamhost.com ([69.163.218.105]:44947 helo=ps18281.dreamhostps.com) by debbugs.gnu.org with esmtp (Exim 4.72) (envelope-from ) id 1Th7vJ-000087-VT for 13041@debbugs.gnu.org; Fri, 07 Dec 2012 19:05:44 -0500 Original-Received: from localhost (ps18281.dreamhostps.com [69.163.218.105]) by ps18281.dreamhostps.com (Postfix) with ESMTP id 4B18846FA011; Fri, 7 Dec 2012 16:05:17 -0800 (PST) In-Reply-To: <50C1C6CC.9020103@gmx.at> (martin rudalics's message of "Fri, 07 Dec 2012 11:37:00 +0100") User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.3.50 (x86_64-pc-linux-gnu) X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.13 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-Received-From: 140.186.70.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.bugs:68155 Archived-At: > - leave the text alone but give each string that should be handled > specially a text property with the normalized form. In this case > searching has to pay attention to these properties, if present. > > - normalize the text and give each normalized string a text property > with the original text. In this case searching will proceed as usual > but you have to restore the original text when done. This reminds an idea that searching should take into account the text displayed with the `display' property and other display-related propertie= s. It seems this is more difficult to implement. > Also I don't know how to handle the return value and/or highlighting > when, for example, finding a match for "suf" within "su=EF=AC=80er". F= or > example, replacing each occurrence of "suf" with the empty string shoul= d > leave us with "fer" here. I believe such ligature characters should be handled as a whole, i.e. "suf" doesn't match "su=EF=AC=80er", only "suff" should match it. > I have no idea how many mappings like "=C3=9F" -> "ss" exist. The prob= lem is > that we don't get them from UnicodeData.txt IIUC. I can't find them in UnicodeData.txt too. Looking at the files in http://www.unicode.org/Public/UNIDATA/ can find them in the file http://www.unicode.org/Public/UNIDATA/DerivedNormalizationProps.txt that is derived from http://www.unicode.org/Public/UNIDATA/CaseFolding.txt http://www.unicode.org/Public/UNIDATA/SpecialCasing.txt