Bugs with German umlauts in file name

Bugs with German umlauts in file name

[David Reitter]

[-- Attachment #1: Type: text/plain, Size: 365 bytes --]

I can confirm general display problems with umlauts in file names (see  
also screenshot) in current 22 builds (Carbon).
Incidentally: does Emacs still crash when started from a path name  
that contains anything but 7-bit ASCII characters?

Emacs also brings up an annoying question about encoding when  
automatically saving 'places' at the end of the session.



[-- Attachment #2: pastedGraphic.png --]
[-- Type: image/png, Size: 15790 bytes --]

[-- Attachment #3: Type: text/plain, Size: 3972 bytes --]






Begin forwarded message:

> From: Markus Nißl <mnissl@gmx.de>
> Date: 11 November 2007 14:14:08 GMT
> To: aquamacs-bugs@aquamacs.org
> Subject: [Aquamacs-bugs] Bugs with German umlauts in file name
>
> Hey!
>
> Aquamacs (or Emacs in general) has problems with dealing with German
> umlauts in file names. The inline file browser (C-x C-f) has problems
> in displaying the German umlauts and accepting the umlaut itself ...
> typing e.g. ü and <tab> won't autocomplete the filename ... u and
> <tab> does ...
>
> The umlaut problem also leads to LaTeX compile errors when invoking
> with AUCTeX:
>
> ---
>
> Running `LaTeX' on `rückerstattung-kontaktlinsen_2006' with
> ``pdflatex  -interaction=nonstopmode "\input" ru\̈ckerstattung-
> kontaktlinsen_2006.tex''
> This is pdfTeXk, Version 3.141592-1.40.3 (Web2C 7.5.6)
> %&-line parsing enabled.
> entering extended mode
> LaTeX2e <2005/12/01>
> ! I can't find file `ru?ckerstattung-kontaktlinsen_2006.tex'.
> <*> \input ru?ckerstattung-kontaktlinsen_2006.tex
>
> Please type another input file name
> ! Emergency stop.
> <*> \input ru?ckerstattung-kontaktlinsen_2006.tex
>
> !  ==> Fatal error occurred, no output PDF file produced!
> Transcript written on texput.log.
>
> LaTeX exited abnormally with code 1 at Sun Nov 11 15:06:07
>
> ---
>
> Emacs is finally in version 22 ... but why can't it still handle
> umlauts in file names??
>
> Maybe you can fix this. Thank you,
> Markus
>
>
> In GNU Emacs 22.1.50.1 (powerpc-apple-darwin7.9.0, Carbon Version  
> 1.6.0)
> of 2007-10-02 on applecore.inf.ed.ac.uk - Aquamacs Distribution 1.2a
> Windowing system distributor `Apple Inc.', version 10.5.0
> configured using `configure  '--without-x' '--prefix=/usr/local''
>
> Important settings:
> value of $LC_ALL: nil
> value of $LC_COLLATE: nil
> value of $LC_CTYPE: nil
> value of $LC_MESSAGES: nil
> value of $LC_MONETARY: nil
> value of $LC_NUMERIC: nil
> value of $LC_TIME: nil
> value of $LANG: nil
> locale-coding-system: iso-latin-1
> default-enable-multibyte-characters: t
>
> Major mode: PDFLaTeX/F
>
> Minor modes in effect:
> reftex-mode: t
> TeX-fold-mode: t
> TeX-PDF-mode: t
> smart-frame-positioning-mode: t
> aquamacs-styles-mode: t
> recentf-mode: t
> emulate-mac-german-keyboard-mode: t
> encoded-kbd-mode: t
> osx-key-mode: t
> show-paren-mode: t
> delete-selection-mode: t
> pc-selection-mode: t
> cua-mode: t
> tooltip-mode: t
> mac-input-method-mode: t
> tool-bar-mode: 0
> mouse-wheel-mode: t
> menu-bar-mode: t
> file-name-shadow-mode: t
> global-font-lock-mode: t
> font-lock-mode: t
> blink-cursor-mode: t
> unify-8859-on-encoding-mode: t
> utf-translate-cjk-mode: t
> auto-compression-mode: t
> column-number-mode: t
> line-number-mode: t
> transient-mark-mode: t
>
> Recent input:
> <help-echo> <help-echo> <tool-bar> <latex> <help-echo>
> <help-echo> <help-echo> <help-echo> <tool-bar> <view>
> <down-mouse-1> <mouse-1> <backspace> <backspace> <backspace>
> <backspace> <backspace> <backspace> A-s <help-echo>
> <down-mouse-1> <mouse-1> , 1 1 p t A-s <help-echo>
> <help-echo> <help-echo> <help-echo> <tool-bar> <latex>
> <help-echo> <help-echo> <help-echo> <help-echo> A-w
> <menu-bar> <help-menu> <report-emacs-bug> <help-echo>
> <help-echo> <help-echo> <menu-bar> <file> <Open Recent>
> <ru=512c8ckerstattung-kontaktlinsen_2006.tex> <help-echo>
> <help-echo> <help-echo> <help-echo> <tool-bar> <latex>
> <help-echo> <menu-bar> <help-menu> <report-emacs-b
> ug>
>
> Recent messages:
> Sending...
> Loading mailclient...done
> Loading browse-url...done
> Sending...done
> Applying style hooks... done
> Sorting environment...
> Removing duplicates... done
> Applying style hooks... done
> Type `C-c C-l' to display results of compilation.
> LaTeX errors in `*~/Documents/TeX/privat/ru=512c8ckerstattung-
> kontaktlinsen_2006 output*'. Use C-c ` to display.

Bugs with German umlauts in file name

[David Reitter]

[-- Attachment #1: Type: text/plain, Size: 413 bytes --]

(repost)

Please see the bug report below.

I can confirm general display problems with umlauts in file names (see  
also screenshot) in current CVS 22 builds (Carbon).
Incidentally: does Emacs still crash when started from a path name  
that contains anything but 7-bit ASCII characters?

Emacs also brings up an annoying question about encoding when  
automatically saving 'places' at the end of the session.



[-- Attachment #2: pastedGraphic.png --]
[-- Type: image/png, Size: 15790 bytes --]

[-- Attachment #3: Type: text/plain, Size: 3972 bytes --]






Begin forwarded message:

> From: Markus Nißl <mnissl@gmx.de>
> Date: 11 November 2007 14:14:08 GMT
> To: aquamacs-bugs@aquamacs.org
> Subject: [Aquamacs-bugs] Bugs with German umlauts in file name
>
> Hey!
>
> Aquamacs (or Emacs in general) has problems with dealing with German
> umlauts in file names. The inline file browser (C-x C-f) has problems
> in displaying the German umlauts and accepting the umlaut itself ...
> typing e.g. ü and <tab> won't autocomplete the filename ... u and
> <tab> does ...
>
> The umlaut problem also leads to LaTeX compile errors when invoking
> with AUCTeX:
>
> ---
>
> Running `LaTeX' on `rückerstattung-kontaktlinsen_2006' with
> ``pdflatex  -interaction=nonstopmode "\input" ru\̈ckerstattung-
> kontaktlinsen_2006.tex''
> This is pdfTeXk, Version 3.141592-1.40.3 (Web2C 7.5.6)
> %&-line parsing enabled.
> entering extended mode
> LaTeX2e <2005/12/01>
> ! I can't find file `ru?ckerstattung-kontaktlinsen_2006.tex'.
> <*> \input ru?ckerstattung-kontaktlinsen_2006.tex
>
> Please type another input file name
> ! Emergency stop.
> <*> \input ru?ckerstattung-kontaktlinsen_2006.tex
>
> !  ==> Fatal error occurred, no output PDF file produced!
> Transcript written on texput.log.
>
> LaTeX exited abnormally with code 1 at Sun Nov 11 15:06:07
>
> ---
>
> Emacs is finally in version 22 ... but why can't it still handle
> umlauts in file names??
>
> Maybe you can fix this. Thank you,
> Markus
>
>
> In GNU Emacs 22.1.50.1 (powerpc-apple-darwin7.9.0, Carbon Version  
> 1.6.0)
> of 2007-10-02 on applecore.inf.ed.ac.uk - Aquamacs Distribution 1.2a
> Windowing system distributor `Apple Inc.', version 10.5.0
> configured using `configure  '--without-x' '--prefix=/usr/local''
>
> Important settings:
> value of $LC_ALL: nil
> value of $LC_COLLATE: nil
> value of $LC_CTYPE: nil
> value of $LC_MESSAGES: nil
> value of $LC_MONETARY: nil
> value of $LC_NUMERIC: nil
> value of $LC_TIME: nil
> value of $LANG: nil
> locale-coding-system: iso-latin-1
> default-enable-multibyte-characters: t
>
> Major mode: PDFLaTeX/F
>
> Minor modes in effect:
> reftex-mode: t
> TeX-fold-mode: t
> TeX-PDF-mode: t
> smart-frame-positioning-mode: t
> aquamacs-styles-mode: t
> recentf-mode: t
> emulate-mac-german-keyboard-mode: t
> encoded-kbd-mode: t
> osx-key-mode: t
> show-paren-mode: t
> delete-selection-mode: t
> pc-selection-mode: t
> cua-mode: t
> tooltip-mode: t
> mac-input-method-mode: t
> tool-bar-mode: 0
> mouse-wheel-mode: t
> menu-bar-mode: t
> file-name-shadow-mode: t
> global-font-lock-mode: t
> font-lock-mode: t
> blink-cursor-mode: t
> unify-8859-on-encoding-mode: t
> utf-translate-cjk-mode: t
> auto-compression-mode: t
> column-number-mode: t
> line-number-mode: t
> transient-mark-mode: t
>
> Recent input:
> <help-echo> <help-echo> <tool-bar> <latex> <help-echo>
> <help-echo> <help-echo> <help-echo> <tool-bar> <view>
> <down-mouse-1> <mouse-1> <backspace> <backspace> <backspace>
> <backspace> <backspace> <backspace> A-s <help-echo>
> <down-mouse-1> <mouse-1> , 1 1 p t A-s <help-echo>
> <help-echo> <help-echo> <help-echo> <tool-bar> <latex>
> <help-echo> <help-echo> <help-echo> <help-echo> A-w
> <menu-bar> <help-menu> <report-emacs-bug> <help-echo>
> <help-echo> <help-echo> <menu-bar> <file> <Open Recent>
> <ru=512c8ckerstattung-kontaktlinsen_2006.tex> <help-echo>
> <help-echo> <help-echo> <help-echo> <tool-bar> <latex>
> <help-echo> <menu-bar> <help-menu> <report-emacs-b
> ug>
>
> Recent messages:
> Sending...
> Loading mailclient...done
> Loading browse-url...done
> Sending...done
> Applying style hooks... done
> Sorting environment...
> Removing duplicates... done
> Applying style hooks... done
> Type `C-c C-l' to display results of compilation.
> LaTeX errors in `*~/Documents/TeX/privat/ru=512c8ckerstattung-
> kontaktlinsen_2006 output*'. Use C-c ` to display.

[-- Attachment #4: Type: text/plain, Size: 142 bytes --]

_______________________________________________
Emacs-devel mailing list
Emacs-devel@gnu.org
http://lists.gnu.org/mailman/listinfo/emacs-devel

Re: Bugs with German umlauts in file name

[Aidan Kehoe]

 Ar an t-ochtú lá déag de mí na Samhain, scríobh David Reitter: 

 > (repost)
 > 
 > Please see the bug report below.
 > 
 > I can confirm general display problems with umlauts in file names (see  
 > also screenshot) in current CVS 22 builds (Carbon).

OS X uses something close to UTF-8 in normal form D--see
http://developer.apple.com/qa/qa2001/qa1173.html for details--for file name
encoding, where the canonical form for a precomposed character is the base
character followed by a combining character.

If you do C-u C-x = on the box, it should tell you that it represents U+0308
COMBINING DIAERESIS; that it is not shown as a combined diaeresis is
redisplay problem with GNU Emacs.

The most common encoding of "ö" in UTF-8 is the representation of U+00F6,
"\xc3\xe6". GNU Emacs handles that fine, which is why you won’t see this
problem on Linux, where as a rule normalisation is not done. U+006F followed
by U+0308 (what you’re seeing: "o\xcc\x88" on disk) is preserved on reading
and writing, which is good, and the OS X libraries automatically normalise
when presented with non-normalised UTF-8 text, which is also good.

So the bug is basically that character composition is not supported for
UTF-8 path names under OS X. Actual support for normalisation in the Unicode
coding systems would also be nice to have, but is not amazingly relevant for
this particular problem, since the OS does it already.

 > Incidentally: does Emacs still crash when started from a path name  
 > that contains anything but 7-bit ASCII characters?
 > 
 > Emacs also brings up an annoying question about encoding when  
 > automatically saving 'places' at the end of the session.
 > 
 > 
 > 
 > 
 > 
 > 
 > 
 > Begin forwarded message:
 > 
 > > From: Markus Nißl <mnissl@gmx.de>
 > > Date: 11 November 2007 14:14:08 GMT
 > > To: aquamacs-bugs@aquamacs.org
 > > Subject: [Aquamacs-bugs] Bugs with German umlauts in file name
 > >
 > > Hey!
 > >
 > > Aquamacs (or Emacs in general) has problems with dealing with German
 > > umlauts in file names. The inline file browser (C-x C-f) has problems
 > > in displaying the German umlauts and accepting the umlaut itself ...
 > > typing e.g. ü and <tab> won't autocomplete the filename ... u and
 > > <tab> does ...
 > >
 > > The umlaut problem also leads to LaTeX compile errors when invoking
 > > with AUCTeX:
 > >
 > > ---
 > >
 > > Running `LaTeX' on `rückerstattung-kontaktlinsen_2006' with
 > > ``pdflatex  -interaction=nonstopmode "\input" ru\̈ckerstattung-
 > > kontaktlinsen_2006.tex''
 > > This is pdfTeXk, Version 3.141592-1.40.3 (Web2C 7.5.6)
 > > %&-line parsing enabled.
 > > entering extended mode
 > > LaTeX2e <2005/12/01>
 > > ! I can't find file `ru?ckerstattung-kontaktlinsen_2006.tex'.
 > > <*> \input ru?ckerstattung-kontaktlinsen_2006.tex
 > >
 > > Please type another input file name
 > > ! Emergency stop.
 > > <*> \input ru?ckerstattung-kontaktlinsen_2006.tex
 > >
 > > !  ==> Fatal error occurred, no output PDF file produced!
 > > Transcript written on texput.log.
 > >
 > > LaTeX exited abnormally with code 1 at Sun Nov 11 15:06:07
 > >
 > > ---
 > >
 > > Emacs is finally in version 22 ... but why can't it still handle
 > > umlauts in file names??
 > >
 > > Maybe you can fix this. Thank you,
 > > Markus
 > >
 > >
 > > In GNU Emacs 22.1.50.1 (powerpc-apple-darwin7.9.0, Carbon Version  
 > > 1.6.0)
 > > of 2007-10-02 on applecore.inf.ed.ac.uk - Aquamacs Distribution 1.2a
 > > Windowing system distributor `Apple Inc.', version 10.5.0
 > > configured using `configure  '--without-x' '--prefix=/usr/local''
 > >
 > > Important settings:
 > > value of $LC_ALL: nil
 > > value of $LC_COLLATE: nil
 > > value of $LC_CTYPE: nil
 > > value of $LC_MESSAGES: nil
 > > value of $LC_MONETARY: nil
 > > value of $LC_NUMERIC: nil
 > > value of $LC_TIME: nil
 > > value of $LANG: nil
 > > locale-coding-system: iso-latin-1
 > > default-enable-multibyte-characters: t
 > >
 > > Major mode: PDFLaTeX/F
 > >
 > > Minor modes in effect:
 > > reftex-mode: t
 > > TeX-fold-mode: t
 > > TeX-PDF-mode: t
 > > smart-frame-positioning-mode: t
 > > aquamacs-styles-mode: t
 > > recentf-mode: t
 > > emulate-mac-german-keyboard-mode: t
 > > encoded-kbd-mode: t
 > > osx-key-mode: t
 > > show-paren-mode: t
 > > delete-selection-mode: t
 > > pc-selection-mode: t
 > > cua-mode: t
 > > tooltip-mode: t
 > > mac-input-method-mode: t
 > > tool-bar-mode: 0
 > > mouse-wheel-mode: t
 > > menu-bar-mode: t
 > > file-name-shadow-mode: t
 > > global-font-lock-mode: t
 > > font-lock-mode: t
 > > blink-cursor-mode: t
 > > unify-8859-on-encoding-mode: t
 > > utf-translate-cjk-mode: t
 > > auto-compression-mode: t
 > > column-number-mode: t
 > > line-number-mode: t
 > > transient-mark-mode: t
 > >
 > > Recent input:
 > > <help-echo> <help-echo> <tool-bar> <latex> <help-echo>
 > > <help-echo> <help-echo> <help-echo> <tool-bar> <view>
 > > <down-mouse-1> <mouse-1> <backspace> <backspace> <backspace>
 > > <backspace> <backspace> <backspace> A-s <help-echo>
 > > <down-mouse-1> <mouse-1> , 1 1 p t A-s <help-echo>
 > > <help-echo> <help-echo> <help-echo> <tool-bar> <latex>
 > > <help-echo> <help-echo> <help-echo> <help-echo> A-w
 > > <menu-bar> <help-menu> <report-emacs-bug> <help-echo>
 > > <help-echo> <help-echo> <menu-bar> <file> <Open Recent>
 > > <ru=512c8ckerstattung-kontaktlinsen_2006.tex> <help-echo>
 > > <help-echo> <help-echo> <help-echo> <tool-bar> <latex>
 > > <help-echo> <menu-bar> <help-menu> <report-emacs-b
 > > ug>
 > >
 > > Recent messages:
 > > Sending...
 > > Loading mailclient...done
 > > Loading browse-url...done
 > > Sending...done
 > > Applying style hooks... done
 > > Sorting environment...
 > > Removing duplicates... done
 > > Applying style hooks... done
 > > Type `C-c C-l' to display results of compilation.
 > > LaTeX errors in `*~/Documents/TeX/privat/ru=512c8ckerstattung-
 > > kontaktlinsen_2006 output*'. Use C-c ` to display.
 > _______________________________________________
 > Emacs-devel mailing list
 > Emacs-devel@gnu.org
 > http://lists.gnu.org/mailman/listinfo/emacs-devel
-- 
¿Dónde estará ahora mi sobrino Yoghurtu Nghé, que tuvo que huir
precipitadamente de la aldea por culpo de la escasez de rinocerontes?

Re: Bugs with German umlauts in file name

[Jason Rumney]

David Reitter wrote:
> (repost)
>
> Please see the bug report below.
>
> I can confirm general display problems with umlauts in file names (see
> also screenshot) in current CVS 22 builds (Carbon).
> Incidentally: does Emacs still crash when started from a path name
> that contains anything but 7-bit ASCII characters?
>
> Emacs also brings up an annoying question about encoding when
> automatically saving 'places' at the end of the session.
>
>
>> locale-coding-system: iso-latin-1


I'm not a mac expert, but my impression was that the locale should
always be utf-8 on mac. What is file-name-coding-system (or
default-file-name-coding-system) set to? If not utf-8, does setting
file-name-coding-system to utf-8 help?

      (setq file-name-coding-system 'utf-8)

Re: Bugs with German umlauts in file name

[Aidan Kehoe]

 Ar an t-ochtú lá déag de mí na Samhain, scríobh Jason Rumney: 

 > David Reitter wrote:
 > > (repost)
 > >
 > > Please see the bug report below.
 > >
 > > I can confirm general display problems with umlauts in file names (see
 > > also screenshot) in current CVS 22 builds (Carbon).
 > > Incidentally: does Emacs still crash when started from a path name
 > > that contains anything but 7-bit ASCII characters?
 > >
 > > Emacs also brings up an annoying question about encoding when
 > > automatically saving 'places' at the end of the session.
 > >
 > >
 > >> locale-coding-system: iso-latin-1
 > 
 > 
 > I'm not a mac expert, but my impression was that the locale should
 > always be utf-8 on mac. 

#'set-locale-environment and #'set-default-coding-systems always set
default-file-name-coding-system to utf-8 if (eq 'darwin system-type).

 > What is file-name-coding-system (or
 > default-file-name-coding-system) set to? If not utf-8, does setting
 > file-name-coding-system to utf-8 help?
 > 
 >       (setq file-name-coding-system 'utf-8)

-- 
¿Dónde estará ahora mi sobrino Yoghurtu Nghé, que tuvo que huir
precipitadamente de la aldea por culpo de la escasez de rinocerontes?

Re: Bugs with German umlauts in file name

[David Reitter]

On 18 Nov 2007, at 20:55, Jason Rumney wrote:
>
> I'm not a mac expert, but my impression was that the locale should
> always be utf-8 on mac. What is file-name-coding-system (or
> default-file-name-coding-system) set to? If not utf-8, does setting
> file-name-coding-system to utf-8 help?
>
>     (setq file-name-coding-system 'utf-8)

It's already set to 'utf-8 and produces the problem with that setting.
This happens on OS X 10.5.1 and on 10.4.10.