Emacs (git HEAD) having issues rendering devanagari text

Emacs (git HEAD) having issues rendering devanagari text

[Ashish Shukla]

Hi all,

On my recently compiled GNU Emacs (from Git repository) on Arch
GNU/Linux, I'm having issues rendering some devanagari text. Following
is the output of '(emacs-version)'  in my Emacs.

GNU Emacs 24.0.50.1 (x86_64-unknown-linux-gnu, GTK+ Version 2.18.7) of
2010-03-11 on monte-cristo.france

Following is the an image of rendered text is
http://www.flickr.com/photos/wahjava/4426527542/sizes/l/

outputs of C-u C-x =
-----------------------------

        character: क़ (2392, #o4530, #x958)
preferred charset: unicode (Unicode (ISO10646))
       code point: 0x0958
           syntax: w 	which means: word
         category: .:Base, i:Indian
         to input: type "qa" with devanagari-itrans
      buffer code: #xE0 #xA5 #x98
        file code: #xE0 #xA5 #x98 (encoded by coding system utf-8)
          display: by this font (glyph code)
    xft:-unknown-Lohit
Hindi-normal-normal-normal-*-17-*-*-*-*-0-iso10646-1 (#x81)

Character code properties: customize what to show
  name: DEVANAGARI LETTER QA
  general-category: Lo (Letter, Other)
  decomposition: (2325 2364) ('क' '़')

There are text properties here:
  fontified            t

[back]

        character: ि (2367, #o4477, #x93f)
preferred charset: unicode (Unicode (ISO10646))
       code point: 0x093F
           syntax: w 	which means: word
         category: i:Indian
      buffer code: #xE0 #xA4 #xBF
        file code: #xE0 #xA4 #xBF (encoded by coding system utf-8)
          display: by this font (glyph code)
    xft:-unknown-Lohit
Hindi-normal-normal-normal-*-17-*-*-*-*-0-iso10646-1 (#x6D)

Character code properties: customize what to show
  name: DEVANAGARI VOWEL SIGN I
  general-category: Mc (Mark, Spacing Combining)

There are text properties here:
  fontified            t

[back]



Let me know if there is any other information required from me.

Thanks
-- 
Ashish Shukla आशीष शुक्ल                      http://wahjava.wordpress.com/
·-- ·- ···· ·--- ·- ···- ·- ·--·-· --· -- ·- ·· ·-·· ·-·-·- -·-· --- --

Re: Emacs (git HEAD) having issues rendering devanagari text

[Kenichi Handa]

In article <ffb595fe1003112043h2516f302raabf390292db2b63@mail.gmail.com>, Ashish Shukla <wahjava.ml@gmail.com> writes:

> On my recently compiled GNU Emacs (from Git repository) on Arch
> GNU/Linux, I'm having issues rendering some devanagari text. Following
> is the output of '(emacs-version)'  in my Emacs.

> GNU Emacs 24.0.50.1 (x86_64-unknown-linux-gnu, GTK+ Version 2.18.7) of
> 2010-03-11 on monte-cristo.france

> Following is the an image of rendered text is
> http://www.flickr.com/photos/wahjava/4426527542/sizes/l/

It seems that your Emacs is not compiled with libraries
libotf and m17n-lib.  Please check the output of "configure"
script.

---
Kenichi Handa
handa@m17n.org

Re: Emacs (git HEAD) having issues rendering devanagari text

[Ashish Shukla]

On Fri, Mar 12, 2010 at 1:38 PM, Kenichi Handa <handa@m17n.org> wrote:
> In article <ffb595fe1003112043h2516f302raabf390292db2b63@mail.gmail.com>, Ashish Shukla <wahjava.ml@gmail.com> writes:
>
>> On my recently compiled GNU Emacs (from Git repository) on Arch
>> GNU/Linux, I'm having issues rendering some devanagari text. Following
>> is the output of '(emacs-version)'  in my Emacs.
>
>> GNU Emacs 24.0.50.1 (x86_64-unknown-linux-gnu, GTK+ Version 2.18.7) of
>> 2010-03-11 on monte-cristo.france
>
>> Following is the an image of rendered text is
>> http://www.flickr.com/photos/wahjava/4426527542/sizes/l/
>
> It seems that your Emacs is not compiled with libraries
> libotf and m17n-lib.  Please check the output of "configure"
> script.

abbe [~] monte-cristo % ldd $(which emacs) |egrep 'otf|m17n'
        libotf.so.0 => /usr/lib/libotf.so.0 (0x00007f0c6cc53000)
        libm17n-flt.so.0 => /usr/lib/libm17n-flt.so.0 (0x00007f0c6ca4a000)
        libm17n-core.so.0 => /usr/lib/libm17n-core.so.0 (0x00007f0c6c81f000)

abbe [~] monte-cristo % pacman -Q m17n-{lib,db} libotf
m17n-lib 1.5.5-1
m17n-db 1.5.4-1
libotf 0.9.9-1

Following is the value of 'system-configuration-options' in my Emacs:

'--prefix=/usr' '--localstatedir=/var/lib/emacs'
'--libexecdir=/usr/lib/emacs' '--with-xpm' '--with-jpeg' '--with-tiff'
'--with-gif' '--with-xim' '--with-png' '--with-x-toolkit=gtk'
'--with-m17n-flt' '--with-rsvg' '--with-xft' '--with-libotf'
'--with-gpm' '--with-dbus' '--with-sound' '--with-makeinfo'
'CFLAGS=-march=x86-64 -mtune=core2 -O2 -pipe'


Thanks
-- 
Ashish Shukla आशीष शुक्ल                      http://wahjava.wordpress.com/
·-- ·- ···· ·--- ·- ···- ·- ·--·-· --· -- ·- ·· ·-·· ·-·-·- -·-· --- --

Re: Emacs (git HEAD) having issues rendering devanagari text

[Kenichi Handa]

[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain; charset=euc-jis-2004, Size: 840 bytes --]

In article <ffb595fe1003120056m2fb7e6b8td791adcf7fcd3c25@mail.gmail.com>, Ashish Shukla <wahjava.ml@gmail.com> writes:

>>> Following is the an image of rendered text is
>>> http://www.flickr.com/photos/wahjava/4426527542/sizes/l/
> >
> > It seems that your Emacs is not compiled with libraries
> > libotf and m17n-lib. ©¢Please check the output of "configure"
> > script.

> abbe [~] monte-cristo % ldd $(which emacs) |egrep 'otf|m17n'
>         libotf.so.0 => /usr/lib/libotf.so.0 (0x00007f0c6cc53000)
>         libm17n-flt.so.0 => /usr/lib/libm17n-flt.so.0 (0x00007f0c6ca4a000)
>         libm17n-core.so.0 => /usr/lib/libm17n-core.so.0 (0x00007f0c6c81f000)

Hmm, ok, so your Emacs is appropriately compiled.  Please
show me the sequence of characters that is rendered wrongly.

---
Kenichi Handa
handa@m17n.org

Re: Emacs (git HEAD) having issues rendering devanagari text

[Ashish SHUKLA]

[-- Attachment #1: Type: text/plain, Size: 1149 bytes --]

Kenichi Handa writes:
> In article <ffb595fe1003120056m2fb7e6b8td791adcf7fcd3c25@mail.gmail.com>, Ashish Shukla <wahjava.ml@gmail.com> writes:

>>>> Following is the an image of rendered text is
>>>> http://www.flickr.com/photos/wahjava/4426527542/sizes/l/
>> >
>> > It seems that your Emacs is not compiled with libraries
>> > libotf and m17n-lib.  Please check the output of "configure"
>> > script.

>> abbe [~] monte-cristo % ldd $(which emacs) |egrep 'otf|m17n'
>> libotf.so.0 => /usr/lib/libotf.so.0 (0x00007f0c6cc53000)
>> libm17n-flt.so.0 => /usr/lib/libm17n-flt.so.0 (0x00007f0c6ca4a000)
>> libm17n-core.so.0 => /usr/lib/libm17n-core.so.0 (0x00007f0c6c81f000)

> Hmm, ok, so your Emacs is appropriately compiled.  Please
> show me the sequence of characters that is rendered wrongly.

Following are the characters (in sequence) mentioned in the above image:

ज़ - 095Bh
ा - 093Eh
क़ - 0958h
ि - 093Fh
र - 0930h

The following composition renders incorrectly. If you copy-paste the following
composition in an Xfce application e.g. mousepad/leafpad, it renders fine, but not in
Emacs.

क़ि - 0958h + 093Fh

HTH
-- 
Ashish SHUKLA

[-- Attachment #2: Type: application/pgp-signature, Size: 197 bytes --]

Re: Emacs (git HEAD) having issues rendering devanagari text

[Kenichi Handa]

In article <86d3z4eskv.fsf@chateau.d.if>, wahjava.ml@gmail.com (Ashish SHUKLA) writes:

> Following are the characters (in sequence) mentioned in the above image:

> ज़ - 095Bh
> ा - 093Eh
> क़ - 0958h
> ि - 093Fh
> र - 0930h

Ah, I see.  I have forgotten to add consonants
U+0958..U+095F and etc. in devanagari-composable-pattern.
I've just installed the folloing patch in emacs-23 branch.

---
Kenichi Handa
handa@m17n.org

=== modified file 'lisp/language/indian.el'
--- lisp/language/indian.el	2010-01-13 08:35:10 +0000
+++ lisp/language/indian.el	2010-03-16 06:58:18 +0000
@@ -141,7 +141,7 @@
 (defconst devanagari-composable-pattern
   (let ((table
 	 '(("V" . "[\u0904-\u0914\u0960-\u0961\u0972]") ; independent vowel
-	   ("C" . "[\u0915-\u0939]")		 ; consonant
+	   ("C" . "[\u0915-\u0939\u0958-\u095F\u097B-\u097C\u097E-\u097F]") ; consonant
 	   ("R" . "\u0930")			 ; RA
 	   ("n" . "\u093C")			 ; NUKTA
 	   ("H" . "\u094D")			 ; HALANT

Re: Emacs (git HEAD) having issues rendering devanagari text

[Ashish SHUKLA]

[-- Attachment #1: Type: text/plain, Size: 1145 bytes --]

Kenichi Handa writes:
> In article <86d3z4eskv.fsf@chateau.d.if>, wahjava.ml@gmail.com (Ashish SHUKLA) writes:

>> Following are the characters (in sequence) mentioned in the above image:

>> ज़ - 095Bh
>> ा - 093Eh
>> क़ - 0958h
>> ि - 093Fh
>> र - 0930h

> Ah, I see.  I have forgotten to add consonants
> U+0958..U+095F and etc. in devanagari-composable-pattern.
> I've just installed the folloing patch in emacs-23 branch.

> ---
> Kenichi Handa
> handa@m17n.org

> === modified file 'lisp/language/indian.el'
> --- lisp/language/indian.el	2010-01-13 08:35:10 +0000
> +++ lisp/language/indian.el	2010-03-16 06:58:18 +0000
> @@ -141,7 +141,7 @@
>  (defconst devanagari-composable-pattern
>    (let ((table
>  	 '(("V" . "[\u0904-\u0914\u0960-\u0961\u0972]") ; independent vowel
> -	   ("C" . "[\u0915-\u0939]")		 ; consonant
> +	   ("C" . "[\u0915-\u0939\u0958-\u095F\u097B-\u097C\u097E-\u097F]") ; consonant
>  	   ("R" . "\u0930")			 ; RA
>  	   ("n" . "\u093C")			 ; NUKTA
>  	   ("H" . "\u094D")			 ; HALANT

Your patch works[1] for me.

References:
[1]  http://www.flickr.com/photos/wahjava/4437998520/

Thanks
-- 
Ashish SHUKLA

[-- Attachment #2: Type: application/pgp-signature, Size: 197 bytes --]

Re: Emacs (git HEAD) having issues rendering devanagari text

[Kenichi Handa]

In article <86ocio4kqv.fsf@chateau.d.if>, wahjava.ml@gmail.com (Ashish SHUKLA) writes:
> > Ah, I see.  I have forgotten to add consonants
> > U+0958..U+095F and etc. in devanagari-composable-pattern.
> > I've just installed the folloing patch in emacs-23 branch.
[...]
> Your patch works[1] for me.

> References:
> [1]  http://www.flickr.com/photos/wahjava/4437998520/

Thank you for confirming that.

---
Kenichi Handa
handa@m17n.org