21.1.50; [Gnus] Broken characters in iso-8859-15 formatted emails

21.1.50; [Gnus] Broken characters in iso-8859-15 formatted emails

[Thomas Christensen]

In Gnus the danish æøå characters are shown as "squares" if the email
is formatted as iso-8859-15; but if I view the email as iso-8859-1
(which is the same but without the € character I think), it shows
correctly.

The email is generated through the alpine MUA, and shows properly in
all other MUAs I have tried: mutt, thunderbird (icedove), squirrelmail,
and of course alpine.

		Thomas


In GNU Emacs 22.1.50.1 (i686-pc-linux-gnu, GTK+ Version 2.10.14)
 of 2007-09-06 on foobar
Windowing system distributor `The X.Org Foundation', version 11.0.70200000
configured using `configure  '--prefix=/usr' '--host=i686-pc-linux-gnu' '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--datadir=/usr/share' '--sysconfdir=/etc' '--localstatedir=/var/lib' '--program-suffix=-emacs-22-cvs' '--infodir=/usr/share/info/emacs-22-cvs' '--without-carbon' '--with-sound' '--with-x' '--without-toolkit-scroll-bars' '--with-jpeg' '--without-tiff' '--without-gif' '--with-png' '--with-xpm' '--with-x-toolkit=gtk' '--without-hesiod' '--build=i686-pc-linux-gnu' 'build_alias=i686-pc-linux-gnu' 'host_alias=i686-pc-linux-gnu' 'CFLAGS=-O2 -march=prescott -pipe''

Important settings:
  value of $LC_ALL: nil
  value of $LC_COLLATE: nil
  value of $LC_CTYPE: nil
  value of $LC_MESSAGES: nil
  value of $LC_MONETARY: nil
  value of $LC_NUMERIC: nil
  value of $LC_TIME: nil
  value of $LANG: en_US.utf8
  locale-coding-system: utf-8
  default-enable-multibyte-characters: t

Major mode: Summary

Minor modes in effect:
  iswitchb-mode: t
  jabber-activity-mode: t
  tooltip-mode: t
  mouse-wheel-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  unify-8859-on-encoding-mode: t
  utf-translate-cjk-mode: t
  auto-compression-mode: t
  line-number-mode: t
  transient-mark-mode: t

Recent input:
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> q <up> ^ <down> <down> 
<down> <return> C-s e m a c s C-s C-s C-s <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> <down> <down> <down> 
<down> <down> <down> <down> <down> u q q g <up> <up> 
<up> <up> <up> <up> <up> <return> 1 0 0 0 <return> 
M-> M-< C-s g n u s C-s <C-right> <C-right> <C-right> 
C-s C-s <left> <left> <C-left> C-s C-s <C-left> <C-left> 
<C-left> <C-left> <C-left> <return> <down> <return> 
<down> <return> C-s C-s C-s M-> <up> C-x 1 C-x 5 2 
M-x <switch-frame> <switch-frame> C-g C-g <switch-frame> 
M-x b u g <tab> <backspace> <backspace> <backspace> 
s e n <tab> <tab> <backspace> <backspace> <backspace> 
b <backspace> e m <tab> a <tab> b <tab> <tab> <backspace> 
C-g C-g C-h a b u g <return> C-M-v M-x r e p o r <tab> 
<return>

Recent messages:
Mark set [2 times]
Mark saved where search started [4 times]
Mark set
Quit [2 times]
Making completion list...
Quit [2 times]
Loading apropos...done
Type C-x 1 to remove help window.  
Loading emacsbug...done
call-interactively: End of buffer

Re: 21.1.50; [Gnus] Broken characters in iso-8859-15 formatted emails

[Thomas Christensen]

It seems gnus is not a part of the problem.  I tried to start emacs
with:

	$ LANG=en_US.iso885915 emacs

and the æøå character became squares as I typed them in the scratch
buffer.

To ensure I had iso-8859-15 fonts installed, I did:

	$ LANG=en_US.iso885915 xterm

where æøå showed properly.

Both applications use the standard 'fixed' font.

		Thomas

Re: 21.1.50; [Gnus] Broken characters in iso-8859-15 formatted emails

[Thomas Christensen]

I must apologize for the noise.  It appears to be that Gentoo is
hardcoded to only generate iso-8859-1 fonts in modular X.

		Thomas

Re: 21.1.50; [Gnus] Broken characters in iso-8859-15 formatted emails

[Kenichi Handa]

In article <871wd9ebxv.fsf@foobar.localdomain>, Thomas Christensen <christensenthomas@gmail.com> writes:

> I must apologize for the noise.  It appears to be that Gentoo is
> hardcoded to only generate iso-8859-1 fonts in modular X.

Does it mean that the problem was solved by installing
iso-8859-15 fonts?

---
Kenichi Handa
handa@m17n.org

Re: 21.1.50; [Gnus] Broken characters in iso-8859-15 formatted emails

[Thomas Christensen]

On Mon, Sep 10, 2007 at 11:41:06AM +0900, Kenichi Handa wrote:
> In article <871wd9ebxv.fsf@foobar.localdomain>, Thomas Christensen <christensenthomas@gmail.com> writes:
> 
> > I must apologize for the noise.  It appears to be that Gentoo is
> > hardcoded to only generate iso-8859-1 fonts in modular X.
> 
> Does it mean that the problem was solved by installing
> iso-8859-15 fonts?

Yes, it solved the problem completely.  I puzzles me a bit though,
that Emacs is the only application that could not handle the
iso-8859-15 without these fonts, and also how the others applications
*did* handle this.  But I know little of these matters.

		Thomas

Re: 21.1.50; [Gnus] Broken characters in iso-8859-15 formatted emails

[Kenichi Handa]

In article <20070910072629.GA12677@foobar>, Thomas Christensen <christensenthomas@gmail.com> writes:

> On Mon, Sep 10, 2007 at 11:41:06AM +0900, Kenichi Handa wrote:
> > In article <871wd9ebxv.fsf@foobar.localdomain>, Thomas Christensen <christensenthomas@gmail.com> writes:
> > 
> > > I must apologize for the noise.  It appears to be that Gentoo is
> > > hardcoded to only generate iso-8859-1 fonts in modular X.
> > 
> > Does it mean that the problem was solved by installing
> > iso-8859-15 fonts?

> Yes, it solved the problem completely.  I puzzles me a bit though,
> that Emacs is the only application that could not handle the
> iso-8859-15 without these fonts, and also how the others applications
> *did* handle this.  But I know little of these matters.

Emacs still doesn't uses Unicode character codes internally,
thus iso-8859-1 characters and iso-8859-15 characters are
treated differently.  In many cases, user don't notice this
difference because they are automatically converted from/to
each other.  The emacs-unicode-2 branch of Emacs CVS
repository does uses Unicode internally and doesn't have
such a problem.

---
Kenichi Handa
handa@m17n.org

Re: 21.1.50; [Gnus] Broken characters in iso-8859-15 formatted emails

[Thomas Christensen]

On Mon, Sep 10, 2007 at 04:38:57PM +0900, Kenichi Handa wrote:
> In article <20070910072629.GA12677@foobar>, Thomas Christensen <christensenthomas@gmail.com> writes:
> 
> > Yes, it solved the problem completely.  I puzzles me a bit though,
> > that Emacs is the only application that could not handle the
> > iso-8859-15 without these fonts, and also how the others applications
> > *did* handle this.  But I know little of these matters.
> 
> Emacs still doesn't uses Unicode character codes internally,
> thus iso-8859-1 characters and iso-8859-15 characters are
> treated differently.  In many cases, user don't notice this
> difference because they are automatically converted from/to
> each other.  The emacs-unicode-2 branch of Emacs CVS
> repository does uses Unicode internally and doesn't have
> such a problem.

Thanks for the explanation.

		Thomas