bug#2830: 23.0.91; Private use area

bug#2830: 23.0.91; Private use area

[Jonathan Coxhead]

Please write in English if possible, because the Emacs maintainers
usually do not have translators to read other languages for them.

Your bug report will be posted to the emacs-pretest-bug@gnu.org mailing 
list.

Please describe exactly what actions triggered the bug
and the precise symptoms of the bug:

(Not sure if this is a bug or a feature request.)

I have a file with characters from the Private Use Area of Unicode. I 
also have
a font, Code2000, "http://code2000.net/CODE2000.ZIP" which has the 
characters in
it. But emacs shows me squares instead of the characters. (Notepad can 
display
it.)

Here are a few lines from my file:

s/b//g; # umbar
s/c//g; # quesse
s/d//g; # ando
s/f//g; # formen
s/g//g; # ungwe

If Emacs crashed, and you have the Emacs process in the gdb debugger,
please include the output from the following gdb commands:
`bt full' and `xbacktrace'.
If you would like to further debug the crash, please read the file
c:/pf/emacs-23.0.91/etc/DEBUG for instructions.


In GNU Emacs 23.0.91.1 (i386-mingw-nt5.1.2600)
of 2009-02-26 on SOFT-MJASON
Windowing system distributor `Microsoft Corp.', version 5.1.2600
configured using `configure --with-gcc (3.4)'

Important settings:
value of $LC_ALL: nil
value of $LC_COLLATE: nil
value of $LC_CTYPE: nil
value of $LC_MESSAGES: nil
value of $LC_MONETARY: nil
value of $LC_NUMERIC: nil
value of $LC_TIME: nil
value of $LANG: ENU
value of $XMODIFIERS: nil
locale-coding-system: cp1252
default-enable-multibyte-characters: t

Major mode: Perl

Minor modes in effect:
tooltip-mode: t
tool-bar-mode: t
mouse-wheel-mode: t
menu-bar-mode: t
file-name-shadow-mode: t
global-font-lock-mode: t
font-lock-mode: t
blink-cursor-mode: t
global-auto-composition-mode: t
auto-composition-mode: t
auto-encryption-mode: t
auto-compression-mode: t
line-number-mode: t
transient-mark-mode: t

Recent input:
C-x C-f ~ / b i n / c i r t h . p l <return> <S-down-mouse-1>
C-l <down-mouse-3> <mouse-3> <down-mouse-1> <mouse-1>
C-x C-f u n c i a l . p l <return> M-> <S-down-mouse-1>
<help-echo> <help-echo> <help-echo> <help-echo> <help-echo>
<help-echo> <help-echo> <help-echo> <help-echo> <help-echo>
<help-echo> <help-echo> <help-echo> <help-echo> <help-echo>
<help-echo> <help-echo> <help-echo> <help-echo> <help-echo>
<help-echo> <help-echo> <help-echo> <menu-bar> <options>
<menu-set-font> <help-echo> <help-echo> C-x C-f v i
r t h <M-left> <delete> c <right> <right> <right> <right>
. p l <return> M-M M-< M-M M-< M-> M-< C-x C-f t e
n g w a r . <tab> p l <return> <next> <next> <next>
<next> <next> <next> <next> <next> <next> <next> <next>
<next> M-< <down-mouse-1> <mouse-1> <right> <down>
<down> <down> <down> <down> <down> <down> <down> <down>
<down> <down> <down> <down> <down> <down> <down> <down>
<down> <down> <down> <down> <down> <down> <down> <right>
<right> <right> <right> <right> <right> <right> <right>
<right> <right> <right> <right> <right> <right> <right>
<right> <right> <right> <right> <right> <right> <right>
<right> <right> <right> <right> <down> <down> <down>
<help-echo> <help-echo> <help-echo> <help-echo> <help-echo>
<help-echo> <help-echo> <menu-bar> <help-menu> <se
nd-emacs-bug-report>

Recent messages:
Loading faces...done
For information about GNU Emacs and the GNU system, type C-h C-a.
Buffer-Face mode enabled
Mark set
mouse-appearance-menu: Invalid font object
Mark set [6 times]
Making completion list...
call-interactively: End of buffer
Mark set

bug#2830: 23.0.91; Private use area

[Jason Rumney]

Jonathan Coxhead wrote:
> I have a file with characters from the Private Use Area of Unicode. I 
> also have
> a font, Code2000, "http://code2000.net/CODE2000.ZIP" which has the 
> characters in
> it. But emacs shows me squares instead of the characters. (Notepad can 
> display
> it.)

How are you telling Emacs which font to use to display those characters?

bug#2830: 23.0.91; Private use area

[Jonathan Coxhead]

Jason Rumney wrote:

> Jonathan Coxhead wrote:

> > I have a file with characters from the Private Use Area of Unicode. I 
> > also have
> > a font, Code2000, "http://code2000.net/CODE2000.ZIP" which has the 
> > characters in
> > it. But emacs shows me squares instead of the characters. (Notepad can 
> > display
> > it.)
>
> How are you telling Emacs which font to use to display those characters?

   I used the mouse. Shift-click didn't behave as it used to, but I found "Set Default Font..." on the "Options" menu on the menu bar. It seemed to work as I expected: the font is distinctive enough that I'm sure the buffer was using the font I chose (Code2000). But the private-use characters were displayed as empty boxes.

   Thanks for looking at this---I'd love to be able to edit Elvish (and other PUA scripts) with Emacs!

---Jonathan

bug#2830: 23.0.91; Private use area

[Jason Rumney]

jonathan@doves.demon.co.uk wrote:

>    I used the mouse. Shift-click didn't behave as it used to, but I found "Set Default Font..." on the "Options" menu on the menu bar. It seemed to work as I expected: the font is distinctive enough that I'm sure the buffer was using the font I chose (Code2000). But the private-use characters were displayed as empty boxes.
>   

Because these characters are from the Private Use Area, Emacs cannot 
assume that just because a font has glyphs at those code points that 
they are the right glyphs. You will need to explicitly tell Emacs that 
you want to use Code2000 to represent the PUA range:

(set-fontset-font t '(#xe000 . #xf8ff) (font-spec :family "Code2000"))

bug#2830: 23.0.91; Private use area

[Stefan Monnier]

> Because these characters are from the Private Use Area, Emacs cannot assume
> that just because a font has glyphs at those code points that they are the
> right glyphs. You will need to explicitly tell Emacs that you want to use
> Code2000 to represent the PUA range:

> (set-fontset-font t '(#xe000 . #xf8ff) (font-spec :family "Code2000"))

It would probably make sense to just "use the default font" for any PUA
chars supported by that font.  It's not strictly correct, but in the
absence of any additional info, it seems like a good heuristic.


        Stefan

bug#2830: 23.0.91; Private use area

[Kenichi Handa]

In article <jwvd4bxuqlk.fsf-monnier+emacsbugreports@gnu.org>, Stefan Monnier <monnier@iro.umontreal.ca> writes:

> > Because these characters are from the Private Use Area, Emacs cannot assume
> > that just because a font has glyphs at those code points that they are the
> > right glyphs. You will need to explicitly tell Emacs that you want to use
> > Code2000 to represent the PUA range:

> > (set-fontset-font t '(#xe000 . #xf8ff) (font-spec :family "Code2000"))

> It would probably make sense to just "use the default font" for any PUA
> chars supported by that font.  It's not strictly correct, but in the
> absence of any additional info, it seems like a good heuristic.

I agree.  I'll modify the setting of the default fontset to
do that.

---
Kenichi Handa
handa@m17n.org

bug#2830: 23.0.91; Private use area

[Kenichi Handa]

In article <E1LopV2-00067C-5N@etlken>, Kenichi Handa <handa@m17n.org> writes:

> In article <jwvd4bxuqlk.fsf-monnier+emacsbugreports@gnu.org>, Stefan Monnier <monnier@iro.umontreal.ca> writes:
> > > Because these characters are from the Private Use Area, Emacs cannot assume
> > > that just because a font has glyphs at those code points that they are the
> > > right glyphs. You will need to explicitly tell Emacs that you want to use
> > > Code2000 to represent the PUA range:

> > > (set-fontset-font t '(#xe000 . #xf8ff) (font-spec :family "Code2000"))

> > It would probably make sense to just "use the default font" for any PUA
> > chars supported by that font.  It's not strictly correct, but in the
> > absence of any additional info, it seems like a good heuristic.

> I agree.  I'll modify the setting of the default fontset to
> do that.

Done.

---
Kenichi Handa
handa@m17n.org