squares in buffer instead of utf-8 characters

squares in buffer instead of utf-8 characters

[rahed]

Hi,

I created a file using input method and saved as utf-8. The file is
rendered ok in a browser but in an emacs buffer all unicode characters
are mere boxes.

Unicode characters have typically this property:

character: ? (331835, #o1210073, #x5103b, U+011B)
charset: mule-unicode-0100-24ff (Unicode characters of the range U+0100..U+24FF.)
code point: #x20 #x3B
syntax: w 	which means: word
category: l:Latin
buffer code: #x9C #xF4 #xA0 #xBB
file code: #xC4 #x9B (encoded by coding system mule-utf-8-unix)
display: no font available

Don't know how to remedy unavailability of the font. OS is Solaris and
emacs version 22.0.91.1.

Thanks much.

-- 
Radek

Re: squares in buffer instead of utf-8 characters

[Peter Dyballa]

Am 13.04.2007 um 12:24 schrieb rahed:

> Don't know how to remedy unavailability of the font. OS is Solaris and
> emacs version 22.0.91.1.

You could use the Lucida Sans Typewriter font that comes with Java.  
It has ě.

Keywords: fontset, X resources.

Outside the scope of GNU Emacs: X11's font path (xset q, xset fp),  
fontconfig (fc-list).

--
Greetings

   Pete

Some day we may discover how to make magnets that can point in any  
direction.

Re: squares in buffer instead of utf-8 characters

[Tim X]

rahed <raherh@gmail.com> writes:

> Hi,
>
> I created a file using input method and saved as utf-8. The file is
> rendered ok in a browser but in an emacs buffer all unicode characters
> are mere boxes.
>
> Unicode characters have typically this property:
>
> character: ? (331835, #o1210073, #x5103b, U+011B)
> charset: mule-unicode-0100-24ff (Unicode characters of the range U+0100..U+24FF.)
> code point: #x20 #x3B
> syntax: w 	which means: word
> category: l:Latin
> buffer code: #x9C #xF4 #xA0 #xBB
> file code: #xC4 #x9B (encoded by coding system mule-utf-8-unix)
> display: no font available
>
> Don't know how to remedy unavailability of the font. OS is Solaris and
> emacs version 22.0.91.1.
>

At a guess, I suspect you are running under X. This means you have either a
fontpath setting that points to directories containing the fonts your X server
is able to provide or you have a font server configured. The boxes indicate
that emacs wants to display the characters with a specific font, but it cannot
find that font (either in your font path or from the font server). 

There are a couple of points to keep in mind here. If your connecting to the
solaris box from a remote system, such as a workstation, then the fonts need to
be available to your local workstation X server, not on the solaris X server.
In this case, the issue is with your local X configuration or the fonts it has
available. 

You can use a program like xfontsel, which will allow you to select fonts from
those which are available to the X server. Use this program and try to identify
a suitable font. Set the font for emacs to this font and things should work.
This can be done in a number of ways, but to begin with and for
experimentation, set it on the command line using the -fn option (I think its
-fn, check the manual). Don't forget that since the font names contain *, you
will need to quote the font string to prevent the shell from trying to expand
the *. Once you have a font that works, set it in either your .Xresources file,
your .emacs file or via customize. 

HTH

Tim



-- 
tcross (at) rapttech dot com dot au

Re: squares in buffer instead of utf-8 characters

[rahed]

Tim X <timx@nospam.dev.null> writes:

> At a guess, I suspect you are running under X. This means you have either a
> fontpath setting that points to directories containing the fonts your X server
> is able to provide or you have a font server configured. The boxes indicate
> that emacs wants to display the characters with a specific font, but it cannot
> find that font (either in your font path or from the font server). 
>
> There are a couple of points to keep in mind here. If your connecting to the
> solaris box from a remote system, such as a workstation, then the fonts need to
> be available to your local workstation X server, not on the solaris X server.
> In this case, the issue is with your local X configuration or the fonts it has
> available. 
>
> You can use a program like xfontsel, which will allow you to select fonts from
> those which are available to the X server. Use this program and try to identify
> a suitable font. Set the font for emacs to this font and things should work.
> This can be done in a number of ways, but to begin with and for
> experimentation, set it on the command line using the -fn option (I think its
> -fn, check the manual). Don't forget that since the font names contain *, you
> will need to quote the font string to prevent the shell from trying to expand
> the *. Once you have a font that works, set it in either your .Xresources file,
> your .emacs file or via customize. 
>

Thank you for your detailed reply.

I set a new unicode font with xset but when I use xfontsel to look at
the chars there are only boxes there.

So the issue is with Solaris.

-- 
Radek

Re: squares in buffer instead of utf-8 characters

[Peter Dyballa]

Am 24.04.2007 um 13:18 schrieb rahed:

> I set a new unicode font with xset but when I use xfontsel to look at
> the chars there are only boxes there.

You can't set a font with xset – xset can be used, among other  
things, to set or modify the path to directories with usable fonts in  
them.

--
Greetings

   Pete

When people run around and around in circles we say they are crazy.  
When planets do it we say they are orbiting.

Re: squares in buffer instead of utf-8 characters

[rahed]

Peter Dyballa <Peter_Dyballa@Web.DE> writes:

> You can't set a font with xset – xset can be used, among other
> things, to set or modify the path to directories with usable fonts in
> them.

Sorry, I meant I had set a font path...

-- 
Radek

Re: squares in buffer instead of utf-8 characters

[Peter Dyballa]

Am 24.04.2007 um 20:34 schrieb rahed:

> Peter Dyballa <Peter_Dyballa@Web.DE> writes:
>
>> You can't set a font with xset – xset can be used, among other
>> things, to set or modify the path to directories with usable fonts in
>> them.
>
> Sorry, I meant I had set a font path...
>

Then try to localise the Lucida fonts inside the Java RTE, or install  
it first, and then add their home (<java version>/lib/fonts or such)  
to font path.


BTW, when you're changing the font path while X11 is running, then  
you need to invoke

	xset fp rehash

to make the change work. You've probably recorded your changes in  
your ~/.xinitrc file?

--
Greetings

   Pete

A morning without coffee is like something without something else.

Re: squares in buffer instead of utf-8 characters

[Karl Hegbloom]

[-- Attachment #1: Type: text/plain, Size: 65 bytes --]

Here's the ~/.Xresources file that I'm using.  Hope this helps.


[-- Attachment #2: .Xresources --]
[-- Type: text/plain, Size: 5067 bytes --]


!!! ~/.Xresources
!!!
!!! The use of `flyspell-mode' will help ensure that resource names are not misspelled.
!!! It still highlights the second occurrence of a double word word... -dejavu-dejavu  :-)
!!! To have it always on , you can put `flyspell-mode' into your `xrdb-mode-hook'.
!!!
!!!
!!! Resources for class "Emacs".  See: info(emacs) Resources X
!!!

#include "/etc/X11/Xresources/x11-common"


#define UIFONT         -dejavu-dejavu sans mono-medium-r-normal-*-*-100-*-*-m-*-iso8859-1
#define UIBACKGROUND1  gray15
#define UIBACKGROUND2  gray25
#define UIFOREGROUND   white
#define UIHIGHLIGHT    yellow

#define TEXTFONT           -dejavu-dejavu sans mono-medium-r-normal-*-*-100-*-*-m-*-iso8859-1
#define BOLDFONT           -dejavu-dejavu sans mono-bold-r-normal-*-*-100-*-*-m-*-iso8859-1
#define ITALICFONT         -dejavu-dejavu sans mono-medium-o-normal-*-*-100-*-*-m-*-iso8859-1
#define BOLDITALICFONT     -dejavu-dejavu sans mono-bold-o-normal-*-*-100-*-*-m-*-iso8859-1
#define FIXEDPITCHFONT     -dejavu-dejavu sans mono-medium-r-normal-*-*-100-*-*-m-*-iso8859-1
#define VARIABLEPITCHFONT  -dejavu-dejavu sans-medium-r-normal-*-*-100-*-*-p-*-iso8859-1

#define TEXTBACKGROUND  black
#define TEXTFOREGROUND  white



     *Emacs.Title: Emacs21
*Emacs.BitmapIcon: on
      *Emacs.Font: TEXTFONT
   *Emacs.MenuBar: 1
   *Emacs.ToolBar: 0
*Emacs.ScrollBars: off



!!!
!!! Lucid Widget Resources for class "Emacs".  See:  info(emacs) Lucid Resources
!!!
	    *Emacs*pane.menubar.font: UIFONT
      *Emacs*pane.menubar.background: UIBACKGROUND1
      *Emacs*pane.menubar.foreground: UIFOREGROUND
*Emacs*pane.menubar.buttonForeground: UIHIGHLIGHT

	    *Emacs*menu*font: UIFONT
      *Emacs*menu*background: UIBACKGROUND1
      *Emacs*menu*foreground: UIFOREGROUND
*Emacs*menu*buttonForeground: UIHIGHLIGHT

	    *Emacs*dialog*font: UIFONT
      *Emacs*dialog*background: UIBACKGROUND1
      *Emacs*dialog*foreground: UIFOREGROUND
*Emacs*dialog*buttonForeground: UIHIGHLIGHT



!!!
!!! Default Faces
!!!
	    *Emacs*default.attributeFont: TEXTFONT
      *Emacs*default.attributeBackground: TEXTBACKGROUND
      *Emacs*default.attributeForeground: TEXTFOREGROUND
       *Emacs*default.attributeUnderline: false
   *Emacs*default.attributeStrikeThrough: false
	*Emacs*default.attributeOverline: false
	     *Emacs*default.attributeBox: false
	 *Emacs*default.attributeInverse: false
	 *Emacs*default.attributeStipple: false
*Emacs*default.attributeBackgroundPixmap: false

	  *Emacs*bold.attributeFont: BOLDFONT
	*Emacs*italic.attributeFont: ITALICFONT
   *Emacs*bold-italic.attributeFont: BOLDITALICFONT
   *Emacs*fixed-pitch.attributeFont: FIXEDPITCHFONT
*Emacs*variable-pitch.attributeFont: VARIABLEPITCHFONT

!!!
!!! User Interface Faces
!!!
      *Emacs*menu.attributeFont: UIFONT
*Emacs*menu.attributeBackground: UIBACKGROUND1
*Emacs*menu.attributeForeground: UIFOREGROUND

*Emacs*scroll-bar.attributeBackground: UIBACKGROUND2
*Emacs*scroll-bar.attributeForeground: UIFOREGROUND
*Emacs*tool-bar.attributeBackground: UIBACKGROUND2
*Emacs*tool-bar.attributeForeground: UIFOREGROUND

      *Emacs*mode-line.attributeFont: UIFONT
*Emacs*mode-line.attributeBackground: UIBACKGROUND1
*Emacs*mode-line.attributeForeground: UIFOREGROUND

       *Emacs*tabbar-default-face.attributeFont: UIFONT
 *Emacs*tabbar-default-face.attributeBackground: UIBACKGROUND1
 *Emacs*tabbar-default-face.attributeForeground: UIFOREGROUND
*Emacs*tabbar-selected-face.attributeForeground: UIHIGHLIGHT



!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!
!!! Resource Settings for Other Software
!!!


!!!
!!! XDvi
!!!
	    *XDvi*background: white
 *XDvi*statusline.background: skyblue
  *XDvi*Composite.background: gray25
       *XDvi*List.background: gray75
 *XDvi*MenuButton*background: skyblue
 *XDvi*MenuButton*foreground: black
*XDvi*MenuButton*borderColor: darkblue
 *XDvi*SimpleMenu*background: skyblue
 *XDvi*SimpleMenu*foreground: black
*XDvi*SimpleMenu*borderColor: darkblue

!!!
!!! Editres
!!!
 *Editres*MenuButton*background: skyblue
 *Editres*MenuButton*foreground: black
*Editres*MenuButton*borderColor: darkblue
 *Editres*SimpleMenu*background: skyblue
 *Editres*SimpleMenu*foreground: black
*Editres*SimpleMenu*borderColor: darkblue


!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
!!!
!!! Local Variables:
!!! mode: xrdb
!!! End:
!!!
!  LocalWords:  attributeFont attributeBackground attributeForeground dejavu Xresources iso menubar
!  LocalWords:  xrdb buttonForeground modeline emacs MenuButton SimpleMenu XDvi
!  LocalWords:  Editres skyblue borderColor darkblue ViewPort statusline tabbar
!  LocalWords:  MenuBar ToolBar ScrollBars attributeUnderline attributeOverline
!  LocalWords:  attributeStrikeThrough attributeBox attributeInverse BitmapIcon
!  LocalWords:  attributeStipple attributeBackgroundPixmap UIFONT UIBACKGROUND
!  LocalWords:  UIFOREGROUND UIHIGHLIGHT TEXTFONT BOLDFONT ITALICFONT
!  LocalWords:  BOLDITALICFONT FIXEDPITCHFONT VARIABLEPITCHFONT TEXTBACKGROUND
!  LocalWords:  TEXTFOREGROUND

[-- Attachment #3: Type: text/plain, Size: 152 bytes --]

_______________________________________________
help-gnu-emacs mailing list
help-gnu-emacs@gnu.org
http://lists.gnu.org/mailman/listinfo/help-gnu-emacs

Re: squares in buffer instead of utf-8 characters

[rahed]

Peter Dyballa <Peter_Dyballa@Web.DE> writes:

> Then try to localise the Lucida fonts inside the Java RTE, or install
> it first, and then add their home (<java version>/lib/fonts or such)
> to font path.

I set a font path to /usr/j2se/jre/lib/fonts and now I can see the
Lucida fonts with xfontsel. But these fonts miss again the characters I want
(such as ě which I mentioned in my first quest for help). Registry
parameter in the xfontsel menu for Lucida family is always iso8859 which is
probably wrong.

Thank you much.

-- 
Radek

Re: squares in buffer instead of utf-8 characters

[Peter Dyballa]

Am 26.04.2007 um 17:29 schrieb rahed:

> Registry parameter in the xfontsel menu for Lucida family is always  
> iso8859 which is
> probably wrong.

Right, that's wrong! LATIN SMALL LETTER E WITH CARON is at Unicode  
position U+011B in the Latin Extended-A character block of the Basic  
Multilingual Plane (BMP). You should use an iso10646-1 encoded font!  
Or some fontset.

--
Greetings

   Pete

Globalisation -- communism from above.