From mboxrd@z Thu Jan 1 00:00:00 1970 Path: main.gmane.org!not-for-mail From: Kenichi Handa Newsgroups: gmane.emacs.devel Subject: Re: Cyrillic vs UTF-8 Date: Sat, 26 Apr 2003 17:11:06 +0900 (JST) Sender: emacs-devel-bounces+emacs-devel=quimby.gnus.org@gnu.org Message-ID: <200304260811.RAA08227@etlken.m17n.org> References: <1858-Fri25Apr2003194023+0300-eliz@elta.co.il> NNTP-Posting-Host: main.gmane.org Mime-Version: 1.0 (generated by SEMI 1.14.3 - "Ushinoya") Content-Type: text/plain; charset=US-ASCII X-Trace: main.gmane.org 1051344668 32037 80.91.224.249 (26 Apr 2003 08:11:08 GMT) X-Complaints-To: usenet@main.gmane.org NNTP-Posting-Date: Sat, 26 Apr 2003 08:11:08 +0000 (UTC) Cc: emacs-devel@gnu.org Original-X-From: emacs-devel-bounces+emacs-devel=quimby.gnus.org@gnu.org Sat Apr 26 10:11:00 2003 Return-path: Original-Received: from quimby.gnus.org ([80.91.224.244]) by main.gmane.org with esmtp (Exim 3.35 #1 (Debian)) id 199Klw-0008Je-00 for ; Sat, 26 Apr 2003 10:11:00 +0200 Original-Received: from monty-python.gnu.org ([199.232.76.173]) by quimby.gnus.org with esmtp (Exim 3.12 #1 (Debian)) id 199Kt2-0004ah-00 for ; Sat, 26 Apr 2003 10:18:21 +0200 Original-Received: from localhost ([127.0.0.1] helo=monty-python.gnu.org) by monty-python.gnu.org with esmtp (Exim 4.10.13) id 199KmR-0006u4-0A for emacs-devel@quimby.gnus.org; Sat, 26 Apr 2003 04:11:31 -0400 Original-Received: from list by monty-python.gnu.org with tmda-scanned (Exim 4.10.13) id 199KmB-0006s0-00 for emacs-devel@gnu.org; Sat, 26 Apr 2003 04:11:15 -0400 Original-Received: from mail by monty-python.gnu.org with spam-scanned (Exim 4.10.13) id 199KmA-0006pT-00 for emacs-devel@gnu.org; Sat, 26 Apr 2003 04:11:14 -0400 Original-Received: from tsukuba.m17n.org ([192.47.44.130]) by monty-python.gnu.org with esmtp (Exim 4.10.13) id 199Km9-0006mz-00 for emacs-devel@gnu.org; Sat, 26 Apr 2003 04:11:13 -0400 Original-Received: from fs.m17n.org (fs.m17n.org [192.47.44.2])h3Q8B7o09075; Sat, 26 Apr 2003 17:11:07 +0900 (JST) (envelope-from handa@m17n.org) Original-Received: from etlken.m17n.org (etlken.m17n.org [192.47.44.125]) h3Q8B6A09999; Sat, 26 Apr 2003 17:11:06 +0900 (JST) Original-Received: (from handa@localhost) by etlken.m17n.org (8.8.8+Sun/3.7W-2001040620) id RAA08227; Sat, 26 Apr 2003 17:11:06 +0900 (JST) Original-To: jas@extundo.com In-reply-to: (message from Simon Josefsson on Fri, 25 Apr 2003 19:09:07 +0200) User-Agent: SEMI/1.14.3 (Ushinoya) FLIM/1.14.2 (Yagi-Nishiguchi) APEL/10.2 Emacs/21.2.92 (sparc-sun-solaris2.6) MULE/5.0 (SAKAKI) Original-cc: eliz@elta.co.il X-BeenThere: emacs-devel@gnu.org X-Mailman-Version: 2.1b5 Precedence: list List-Id: Emacs development discussions. List-Help: List-Post: List-Subscribe: , List-Archive: List-Unsubscribe: , Errors-To: emacs-devel-bounces+emacs-devel=quimby.gnus.org@gnu.org Xref: main.gmane.org gmane.emacs.devel:13466 X-Report-Spam: http://spam.gmane.org/gmane.emacs.devel:13466 In article , Simon Josefsson writes: > It seems binary is preferred over utf-8 and utf-16-* in > coding-category-list. This seems extremely conservative. I guess it > means UTF-8 can never be autodetected by default? Is the unicode > support so bad it shouldn't even be preferred over binary? UTF-8 is > well formed and restricted; detecting it properly (even compared to > Latin-n) can be done well enough that failures rarely happen in > practice. > Can't we move binary down below UTF-8 in CVS? IMHO we should move > UTF-8 earlier still, since determining whether data is UTF-8 or not > can be done with good probability. Prefering binary over UTF-8 seems > just wrong. Unfortunately, the current Emacs doesn't have a facility to detect UTF-8 byte sequence. So, if we put UTF-8 the higher priority, all files are detected as UTF-8. :-( > There used to be (in Emacs 21.2) a PROBLEMS entry suggesting what you > say, but it has been removed both in 21.3 and in CVS. I thought that > meant UTF-8 was better supported now, but this doesn't seem to be the > case. The UTF-8 support was surely improved but not that much as you expect. By the way, all these problems are solved in emacs-unicode. It's available from CVS server as a branch tag "emacs-unicode" (see http://savannah.gnu.org/cvs/?group=emacs). --- Ken'ichi HANDA handa@m17n.org