need help in using a 10646 font with cp1251 text

need help in using a 10646 font with cp1251 text

[Ted Zlatanov]

Hi,

My cp1251 setup is simply

(codepage-setup 1251)

If I open a cp1251 document, I don't have a suitable font for it, for
instance:

  character: З (07067, 3639, 0xe37)
    charset: cyrillic-iso8859-5 (Right-Hand Part of Latin/Cyrillic Alphabet (ISO/IEC 8859-5): ISO-IR-144)
 code point: 55
     syntax: word
   category: y:Cyrillic  
buffer code: 0x8C 0xB7
  file code: 0xC7 (encoded by coding system cp1251-unix)
       font: -- none --

But when I save the document in UTF-8 encoding and then read it back,
I get the characters displayed normally:

  character: З (01212067, 332855, 0x51437)
    charset: mule-unicode-0100-24ff (Unicode characters of the range U+0100..U+24FF.)
 code point: 40 55
     syntax: word
   category: y:Cyrillic  
buffer code: 0x9C 0xF4 0xA8 0xB7
  file code: 0xD0 0x97 (encoded by coding system mule-utf-8-unix)
       font: -Misc-Fixed-Medium-R-Normal--10-100-75-75-C-60-ISO10646-1


What can I do to get the 8859-5 charset obtained from the cp1251
encoding displayed as a UCS charset?  I don't want to install a 8859-5
font.

Thanks
Ted

Re: need help in using a 10646 font with cp1251 text

[Eli Zaretskii]

> From: Ted Zlatanov <tzz@lifelogs.com>
> Newsgroups: gnu.emacs.help
> Date: Wed, 06 Aug 2003 16:30:21 -0400
> 
> What can I do to get the 8859-5 charset obtained from the cp1251
> encoding displayed as a UCS charset?  I don't want to install a 8859-5
> font.

Try using code-pages.el.  You didn't say what version of Emacs you
use, so I don't know whether it has code-pages.el bundled.  If not,
you can find it either in the Emacs CVS or (I think) on
gnu.emacs.sources.

Re: need help in using a 10646 font with cp1251 text

[Oliver Scholz]

Eli Zaretskii <eliz@elta.co.il> writes:

>> From: Ted Zlatanov <tzz@lifelogs.com>
>> Newsgroups: gnu.emacs.help
>> Date: Wed, 06 Aug 2003 16:30:21 -0400
>> 
>> What can I do to get the 8859-5 charset obtained from the cp1251
>> encoding displayed as a UCS charset?  I don't want to install a 8859-5
>> font.
>
> Try using code-pages.el.  You didn't say what version of Emacs you
> use, so I don't know whether it has code-pages.el bundled.  If not,
> you can find it either in the Emacs CVS or (I think) on
> gnu.emacs.sources.

I just ask out of curiosity: I don't know anything about cyrrillic,
but from a quick glance it seems that the order of cyrillic characters
is the same in UCS and in ISO 8859-5. So wouldn't it be an option to
do some simple transposing for font encoding, like [only slightly
tested]:

(define-ccl-program tz-8859-5-to-ucs
  `(0
    ;; In: r0 = charset-id; r1 = position code
    ;; Out: r1 = 1st octet; r2 = 2nd octet in UCS-2 as the font
    ;; encoding.
    ((if (r0 == ,(charset-id 'cyrillic-iso8859-5))
    ;; Transpose chars from the cyrillic charset by #x3E0.
	 ((r1 += #x3e0)
	  (r2 = r1)
	  (r1 = (r1 >> 8))
	  (r2 &= #xff))
       ;; Everything else: business as usual.
       (call ccl-encode-unicode-font)))))

(push '("ISO10646-1" . tz-8859-5-to-ucs)
      font-ccl-encoder-alist)

(setq font-ccl-encoder-alist '(("ISO10646.*-*" . tz-8859-5-to-ucs)))

(set-fontset-font "fontset-ADJUSTTHIS" 'cyrillic-iso8859-5
		  "-misc-fixed-medium-r-*-*-*-140-*-*-*-*-ISO10646-1")


Or is this too kludgy?

    Oliver
-- 
20 Thermidor an 211 de la Révolution
Liberté, Egalité, Fraternité!

Re: need help in using a 10646 font with cp1251 text

[Ted Zlatanov]

On 07 Aug 2003, eliz@elta.co.il wrote:

>> From: Ted Zlatanov <tzz@lifelogs.com>
>> Newsgroups: gnu.emacs.help
>> Date: Wed, 06 Aug 2003 16:30:21 -0400
>> 
>> What can I do to get the 8859-5 charset obtained from the cp1251
>> encoding displayed as a UCS charset?  I don't want to install a
>> 8859-5 font.
> 
> Try using code-pages.el.  You didn't say what version of Emacs you
> use, so I don't know whether it has code-pages.el bundled.  

The User-Agent header of my message showed the version, sorry I forgot
to say it explicitly.

> If not, you can find it either in the Emacs CVS or (I think) on
> gnu.emacs.sources.

This was the final kick I needed to jump to the CVS Emacs, so all in
all it was a good thing :)

code-pages.el works perfectly.  I now get all my 8859-5/CP1251
Cyrillic text displayed in the 10646 font I use for Latin editing as
well.

Thanks
Ted

Re: need help in using a 10646 font with cp1251 text

[Ted Zlatanov]

On Thu, 07 Aug 2003, alkibiades@gmx.de wrote:

> Eli Zaretskii <eliz@elta.co.il> writes:
> 
>>> From: Ted Zlatanov <tzz@lifelogs.com>
>>> Newsgroups: gnu.emacs.help
>>> Date: Wed, 06 Aug 2003 16:30:21 -0400
>>> 
>>> What can I do to get the 8859-5 charset obtained from the cp1251
>>> encoding displayed as a UCS charset?  I don't want to install a
>>> 8859-5 font.
>>
>> Try using code-pages.el.  You didn't say what version of Emacs you
>> use, so I don't know whether it has code-pages.el bundled.  If not,
>> you can find it either in the Emacs CVS or (I think) on
>> gnu.emacs.sources.
> 
> I just ask out of curiosity: I don't know anything about cyrrillic,
> but from a quick glance it seems that the order of cyrillic
> characters is the same in UCS and in ISO 8859-5. So wouldn't it be
> an option to do some simple transposing for font encoding, like
> [only slightly tested]:
> 
[...] 
> 
> Or is this too kludgy?

It may be OK, but I think code-pages.el is a more generic solution,
and it makes sense to use what comes with Emacs.  Thank you!

Ted

Re: need help in using a 10646 font with cp1251 text

[Eli Zaretskii]

> From: Ted Zlatanov <tzz@lifelogs.com>
> Newsgroups: gnu.emacs.help
> Date: Fri, 08 Aug 2003 11:29:59 -0400
> 
> The User-Agent header of my message showed the version, sorry I forgot
> to say it explicitly.

I don't usually assume that the MUA used to post the message is the
same one where the described problem was found.

> code-pages.el works perfectly.  I now get all my 8859-5/CP1251
> Cyrillic text displayed in the 10646 font I use for Latin editing as
> well.

I'm glad I could be of help.