From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!not-for-mail From: Random832 Newsgroups: gmane.emacs.bugs Subject: bug#22169: 25.0.50; File name compiletion doesn't work with non-ASCII characters on OS X Date: Thu, 17 Dec 2015 21:46:15 -0500 Message-ID: References: <83y4cw3kie.fsf@gnu.org> <83twnk3fg1.fsf@gnu.org> <83oads2x99.fsf@gnu.org> <83io3z3drh.fsf@gnu.org> <831tan32q2.fsf@gnu.org> NNTP-Posting-Host: plane.gmane.org Mime-Version: 1.0 Content-Type: text/plain X-Trace: ger.gmane.org 1450406846 30463 80.91.229.3 (18 Dec 2015 02:47:26 GMT) X-Complaints-To: usenet@ger.gmane.org NNTP-Posting-Date: Fri, 18 Dec 2015 02:47:26 +0000 (UTC) To: 22169@debbugs.gnu.org Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Fri Dec 18 03:47:14 2015 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by plane.gmane.org with esmtp (Exim 4.69) (envelope-from ) id 1a9l4a-000226-Fd for geb-bug-gnu-emacs@m.gmane.org; Fri, 18 Dec 2015 03:47:12 +0100 Original-Received: from localhost ([::1]:58156 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1a9l4Z-0003pa-SV for geb-bug-gnu-emacs@m.gmane.org; Thu, 17 Dec 2015 21:47:11 -0500 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:37895) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1a9l4V-0003pL-Mg for bug-gnu-emacs@gnu.org; Thu, 17 Dec 2015 21:47:08 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1a9l4R-0000bu-JU for bug-gnu-emacs@gnu.org; Thu, 17 Dec 2015 21:47:07 -0500 Original-Received: from debbugs.gnu.org ([208.118.235.43]:47301) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1a9l4R-0000bq-5k for bug-gnu-emacs@gnu.org; Thu, 17 Dec 2015 21:47:03 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84) (envelope-from ) id 1a9l4R-0000am-0b for bug-gnu-emacs@gnu.org; Thu, 17 Dec 2015 21:47:03 -0500 X-Loop: help-debbugs@gnu.org In-Reply-To: Resent-From: Random832 Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Fri, 18 Dec 2015 02:47:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 22169 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: X-Debbugs-Original-To: bug-gnu-emacs@gnu.org Original-Received: via spool by submit@debbugs.gnu.org id=B.14504068132246 (code B ref -1); Fri, 18 Dec 2015 02:47:02 +0000 Original-Received: (at submit) by debbugs.gnu.org; 18 Dec 2015 02:46:53 +0000 Original-Received: from localhost ([127.0.0.1]:54901 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84) (envelope-from ) id 1a9l4G-0000aA-Ru for submit@debbugs.gnu.org; Thu, 17 Dec 2015 21:46:53 -0500 Original-Received: from eggs.gnu.org ([208.118.235.92]:46835) by debbugs.gnu.org with esmtp (Exim 4.84) (envelope-from ) id 1a9l4F-0000Zy-DO for submit@debbugs.gnu.org; Thu, 17 Dec 2015 21:46:51 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1a9l49-0000aB-LC for submit@debbugs.gnu.org; Thu, 17 Dec 2015 21:46:46 -0500 Original-Received: from lists.gnu.org ([2001:4830:134:3::11]:44989) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1a9l49-0000a7-HZ for submit@debbugs.gnu.org; Thu, 17 Dec 2015 21:46:45 -0500 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:37802) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1a9l48-0003nv-N1 for bug-gnu-emacs@gnu.org; Thu, 17 Dec 2015 21:46:45 -0500 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1a9l44-0000ZY-K4 for bug-gnu-emacs@gnu.org; Thu, 17 Dec 2015 21:46:44 -0500 Original-Received: from plane.gmane.org ([80.91.229.3]:48040) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1a9l44-0000ZU-DH for bug-gnu-emacs@gnu.org; Thu, 17 Dec 2015 21:46:40 -0500 Original-Received: from list by plane.gmane.org with local (Exim 4.69) (envelope-from ) id 1a9l3w-0000nO-Rc for bug-gnu-emacs@gnu.org; Fri, 18 Dec 2015 03:46:33 +0100 Original-Received: from c-68-39-146-59.hsd1.in.comcast.net ([68.39.146.59]) by main.gmane.org with esmtp (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 18 Dec 2015 03:46:32 +0100 Original-Received: from random832 by c-68-39-146-59.hsd1.in.comcast.net with local (Gmexim 0.1 (Debian)) id 1AlnuQ-0007hv-00 for ; Fri, 18 Dec 2015 03:46:32 +0100 X-Injected-Via-Gmane: http://gmane.org/ Original-Lines: 33 Original-X-Complaints-To: usenet@ger.gmane.org X-Gmane-NNTP-Posting-Host: c-68-39-146-59.hsd1.in.comcast.net User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.5 (darwin) Cancel-Lock: sha1:E4KmY3fpb+KEmmS3PNhETKanJBo= X-detected-operating-system: by eggs.gnu.org: Genre and OS details not recognized. X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 208.118.235.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Xref: news.gmane.org gmane.emacs.bugs:110099 Archived-At: Anders Lindgren writes: > Below is a patch where I have dropped the old encoder and use the new > instead. The only thing noteworthy is that `ucs-normalize' is loaded > by loadup (when ns is used) and thus included in the dumped Emacs (if > I understand correctly). Unless anybody objects, I'll push it in a > couple of days. Out of sheer morbid curiosity, I decided to see what happens if I create a filesystem with both NFC and NFD characters (For thoroughness, I tested both colliding and non-colliding names, on FAT32 and NFS. On a FAT32 volume, Linux creates all of them fine, obviously. OSX completely fails to do anything meaningful with the files that are in NFD on disk: They are returned by readdir, but cannot be opened or statted (opening one that has a name collision with an NFC file opens the NFC file). To my under- standing the same behavior would be present for SMB and UDF volumes. The filenames are normalized to NFD when returned by readdir, but only the filenames that are normalized to NFC on disk are accessible. On NFS, the story is a bit more interesting. OSX does not perform any normalization on filenames on an NFS share. After being bitten by a similar bug in zsh's globbing, I was able to determine that Emacs is able to open and save files in both formats with utf-8-nfd (since encoding passes values through unchanged), but _not_ with utf-8-hfs. Arguably, for the rare users who use NFS or other filesystems and work with characters whose representations differ, they can simply use the utf-8 encoding and be explicit about what filenames they want. It is something to be aware of, though.