bug#1033: Indic language rendering problem

bug#1033: Indic language rendering problem

[Parag N(पराग़)]

[-- Attachment #1: Type: text/plain, Size: 3606 bytes --]

Hi,
      When I tried to view unicode text with emacs23.0.60 snapshot of date
20080801, I see rendering is broken. Combinations of characters are
appearing broken. I have comparsion done on Fedora 10 Beta system with gedit
application. Following is snapshot image link of both applications when
tried to view same file.
 http://paragn.fedorapeople.org/emacs-23.0.60vsgedit-2.23.92.rendering.png
       I tried to set Devanagari but no effects on loaded text file to
correct broken combinations. Also, output of Hello text from
Options->MULE->Multi-lingual Text is broken for Indian languages.
       This is first time I am reporting bug for emacs. If needed please ask
for more input. Sorry If I have not followed any guidelines for reporting
bug ro emacs bugs list.

In GNU Emacs 23.0.60.1 (i386-redhat-linux-gnu, GTK+ Version 2.14.0)
of 2008-09-18 on localhost
Windowing system distributor `The X.Org Foundation', version 11.0.10500000
configured using `configure  '--build=i386-redhat-linux-gnu'
'--host=i386-redhat-linux-gnu' '--target=i386-redhat-linux-gnu'
'--program-prefix=' '--prefix=/usr' '--exec-prefix=/usr' '--bindir=/usr/bin'
'--sbindir=/usr/sbin' '--sysconfdir=/etc' '--datadir=/usr/share'
'--includedir=/usr/include' '--libdir=/usr/lib' '--libexecdir=/usr/libexec'
'--localstatedir=/var' '--sharedstatedir=/usr/com' '--mandir=/usr/share/man'
'--infodir=/usr/share/info' 'build_alias=i386-redhat-linux-gnu'
'host_alias=i386-redhat-linux-gnu' 'target_alias=i386-redhat-linux-gnu'
'CFLAGS=-DMAIL_USE_LOCKF -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2
-fexceptions -fstack-protector --param=ssp-buffer-size=4 -m32 -march=i386
-mtune=generic -fasynchronous-unwind-tables''

Important settings:
 value of $LC_ALL: nil
 value of $LC_COLLATE: nil
 value of $LC_CTYPE: nil
 value of $LC_MESSAGES: nil
 value of $LC_MONETARY: nil
 value of $LC_NUMERIC: nil
 value of $LC_TIME: nil
 value of $LANG: en_US.UTF-8
 value of $XMODIFIERS: nil
 locale-coding-system: utf-8-unix
 default-enable-multibyte-characters: t

Major mode: Text

Minor modes in effect:
 tooltip-mode: t
 tool-bar-mode: t
 mouse-wheel-mode: t
 menu-bar-mode: t
 file-name-shadow-mode: t
 global-font-lock-mode: t
 font-lock-mode: t
 blink-cursor-mode: t
 global-auto-composition-mode: t
 auto-composition-mode: t
 auto-encryption-mode: t
 auto-compression-mode: t
 line-number-mode: t
 transient-mark-mode: t

Recent input:
<help-echo> <help-echo> <help-echo> <down-mouse-5>
<mouse-5> <down-mouse-5> <mouse-5> <double-down-mouse-5>
<double-mouse-5> <triple-down-mouse-5> <triple-mouse-5>
<triple-down-mouse-5> <triple-mouse-5> <triple-down-mouse-5>
<triple-mouse-5> <down-mouse-5> <mouse-5> <double-down-mouse-5>
<double-mouse-5> <triple-down-mouse-5> <triple-mouse-5>
<triple-down-mouse-5> <triple-mouse-5> <help-echo>
<help-echo> <help-echo> <help-echo> <help-echo> <help-echo>
<help-echo> <help-echo> <help-echo> <help-echo> <menu-bar>
<help-menu> <send-emacs-bug-report>

Recent messages:
Loading /usr/share/emacs/site-lisp/site-start.d/focus-init.el
(source)...done
Loading /usr/share/emacs/site-lisp/site-start.d/git-init.el (source)...done
Loading /usr/share/emacs/site-lisp/site-start.d/igrep-init.el
(source)...done
Loading /usr/share/emacs/site-lisp/site-start.d/php-mode-init.el
(source)...done
Loading /usr/share/emacs/site-lisp/site-start.d/po-mode-init.el
(source)...done
Loading /usr/share/emacs/site-lisp/site-start.d/rpm-spec-mode-init.el
(source)...done
Loading /usr/share/emacs/site-lisp/site-start.d/rpmdev-init.el
(source)...done
For information about GNU Emacs and the GNU system, type C-h C-a.

Regards,
Parag.

[-- Attachment #2: Type: text/html, Size: 4627 bytes --]

bug#1033: Indic language rendering problem

[Chong Yidong]

>       When I tried to view unicode text with emacs23.0.60 snapshot of
> date 20080801, I see rendering is broken. Combinations of characters
> are appearing broken.

The HELLO file Works for me with a new CVS build.  Does the problem
still occur with latest Emacs CVS?

bug#1033: Indic language rendering problem

[Parag N(पराग़)]

[-- Attachment #1: Type: text/plain, Size: 804 bytes --]

Hi,

On Tue, Sep 30, 2008 at 10:42 PM, Chong Yidong <cyd@stupidchicken.com>wrote:

> >       When I tried to view unicode text with emacs23.0.60 snapshot of
> > date 20080801, I see rendering is broken. Combinations of characters
> > are appearing broken.
>
> The HELLO file Works for me with a new CVS build.  Does the problem
> still occur with latest Emacs CVS?
>

  Yes. I can see problem is still present in CVS build. I got following
details of emacs now
In GNU Emacs 23.0.60.1 (i686-pc-linux-gnu, GTK+ Version 2.14.3)
 of 2008-10-01 on dhcp1-48.pnq.redhat.com
Windowing system distributor `The X.Org Foundation', version 11.0.10500000
configured using `configure  '--prefix=/usr''

How can I help you to fix this issue. If you need some input from me please
ask for same.
Thanks & Regards,
Parag.

[-- Attachment #2: Type: text/html, Size: 1264 bytes --]

bug#1033: Indic language rendering problem

[Chong Yidong]

[-- Attachment #1: Type: text/plain, Size: 815 bytes --]

""Parag N(पराग़)"" <paragn@fedoraproject.org> writes:

>   Yes. I can see problem is still present in CVS build. I got
> following details of emacs now In GNU Emacs 23.0.60.1
> (i686-pc-linux-gnu, GTK+ Version 2.14.3) of 2008-10-01 on
> dhcp1-48.pnq.redhat.com Windowing system distributor `The X.Org
> Foundation', version 11.0.10500000 configured using `configure
> '--prefix=/usr''
>
> How can I help you to fix this issue. If you need some input from me
> please ask for same.

I don't read Devanagari, so I can't tell if the script is rendered
incorrectly (gedit doesn't seem to render the HELLO file at all).
Here's a screenshot of the HELLO file that I see.  Leaving aside the
blank boxes (the font I'm using apparently doesn't contain all the
glyphs), is the file shown correctly?


[-- Attachment #2: hello.png --]
[-- Type: image/png, Size: 76637 bytes --]

bug#1033: Indic language rendering problem

[Parag N(पराग़)]

[-- Attachment #1: Type: text/plain, Size: 1264 bytes --]

Hi,
On Fri, Oct 3, 2008 at 4:02 AM, Chong Yidong <cyd@stupidchicken.com> wrote:

> ""Parag N(पराग़)"" <paragn@fedoraproject.org> writes:
>
> >   Yes. I can see problem is still present in CVS build. I got
> > following details of emacs now In GNU Emacs 23.0.60.1
> > (i686-pc-linux-gnu, GTK+ Version 2.14.3) of 2008-10-01 on
> > dhcp1-48.pnq.redhat.com Windowing system distributor `The X.Org
> > Foundation', version 11.0.10500000 configured using `configure
> > '--prefix=/usr''
> >
> > How can I help you to fix this issue. If you need some input from me
> > please ask for same.
>
> I don't read Devanagari, so I can't tell if the script is rendered
> incorrectly (gedit doesn't seem to render the HELLO file at all).
> Here's a screenshot of the HELLO file that I see.  Leaving aside the
> blank boxes (the font I'm using apparently doesn't contain all the
> glyphs), is the file shown correctly?
>

   Please have a look at image I posted in my initial mail. Its available
at
http://paragn.fedorapeople.org/emacs-23.0.60vsgedit-2.23.92.rendering.png
  From that you can see required rendering for Indic text should be from
left side(gedit application rendering output) whereas emacs is showing wrong
rendering for same text.

Thanks & Regards,
Parag.

[-- Attachment #2: Type: text/html, Size: 2016 bytes --]

bug#1033: Indic language rendering problem

[Parag N(पराग़)]

[-- Attachment #1: Type: text/plain, Size: 1694 bytes --]

Hi again,

On Fri, Oct 3, 2008 at 2:53 PM, Parag N(पराग़) <paragn@fedoraproject.org>wrote:

> Hi,
> On Fri, Oct 3, 2008 at 4:02 AM, Chong Yidong <cyd@stupidchicken.com>wrote:
>
>> ""Parag N(पराग़)"" <paragn@fedoraproject.org> writes:
>>
>> >   Yes. I can see problem is still present in CVS build. I got
>> > following details of emacs now In GNU Emacs 23.0.60.1
>> > (i686-pc-linux-gnu, GTK+ Version 2.14.3) of 2008-10-01 on
>> > dhcp1-48.pnq.redhat.com Windowing system distributor `The X.Org
>> > Foundation', version 11.0.10500000 configured using `configure
>> > '--prefix=/usr''
>> >
>> > How can I help you to fix this issue. If you need some input from me
>> > please ask for same.
>>
>> I don't read Devanagari, so I can't tell if the script is rendered
>> incorrectly (gedit doesn't seem to render the HELLO file at all).
>> Here's a screenshot of the HELLO file that I see.  Leaving aside the
>> blank boxes (the font I'm using apparently doesn't contain all the
>> glyphs), is the file shown correctly?
>
>
         Sorry, I missed to answer above question. Yes image you gave is
showing wrong rendering. I have created one more screenshot of comparison
between Gedit and Emacs applications rendering for Hello text. Its available
at  http://paragn.fedorapeople.org/GeditvsEmacs_hellotext.png


>    Please have a look at image I posted in my initial mail. Its available
> at
> http://paragn.fedorapeople.org/emacs-23.0.60vsgedit-2.23.92.rendering.png
>   From that you can see required rendering for Indic text should be from
> left side(gedit application rendering output) whereas emacs is showing wrong
> rendering for same text.
>
> Thanks & Regards,
> Parag.
>
>

[-- Attachment #2: Type: text/html, Size: 3136 bytes --]

bug#1033: Indic language rendering problem

[Ashish Shukla आशीष =?UTF-8?Q?=E0=A4=B6=E0=A5=81=E0=A4=95=E0=A5=8D=E0=A4=B2]

[-- Attachment #1: Type: text/plain, Size: 2041 bytes --]

Hi Parag,

I reported similar bug (# 320) in May, 2008 where it is concluded that Emacs
is not selecting the proper font for Indic script, for which I've applied the
following temporary workaround for Devanagari script rendering to force the
use of "Lohit Hindi" font.

,---- M-x my-setup-devanagari-rendering
| (defun my-setup-devanagari-rendering()
|   "Setup devanagari rendering"
|   (interactive)
|   (set-fontset-font "fontset-default"
| 					(cons (decode-char 'ucs ?\x0900)
| 						  (decode-char 'ucs ?\x097f))
| 					"Lohit Hindi-12"))
`----

But that problem also went away in June or July, 2008, IIRC. So, that
workaround is not needed anymore. Following is the link to the screenshot of
the HELLO file rendered in "GNU Emacs 23.0.60.1 (x86_64-pc-linux-gnu, X
toolkit, Xaw3d scroll bars) of 2008-11-16 on chateau":

http://flickr.com/photos/wahjava/3043187881/

What I think, the problem at your end will be is lack of m17n support in
Emacs. Following is the './configure' command line of my Emacs build:

,----
| ./configure '--prefix=/usr' '--host=x86_64-pc-linux-gnu'
| '--mandir=/usr/share/man' '--infodir=/usr/share/info' '--datadir=/usr/share'
| '--sysconfdir=/etc' '--localstatedir=/var/lib' '--program-suffix=-emacs-23'
| '--infodir=/usr/share/info/emacs-23' '--with-sound' '--with-x'
| '--with-toolkit-scroll-bars' '--with-gif' '--with-jpeg' '--with-png'
| '--with-rsvg' '--with-tiff' '--with-xpm' '--with-freetype' '--with-xft'
| '--with-libotf' '--with-m17n-flt' '--with-x-toolkit=athena' '--without-hesiod'
| '--without-kerberos' '--without-kerberos5' '--with-gpm' '--with-dbus'
| '--libdir=/usr/lib64' '--build=x86_64-pc-linux-gnu'
| 'build_alias=x86_64-pc-linux-gnu' 'host_alias=x86_64-pc-linux-gnu' 'CFLAGS=-O2
| -pipe -mtune=nocona -march=nocona -ggdb' 'LDFLAGS=-Wl,--hash-style,both' 
`----

To figure out which font is used to render a particular character, move cursor
to the character and do "C-u C-x =" as pointed to me by Kenichi Handa.

HTH
-- 
Ashish Shukla

[-- Attachment #2: Type: application/pgp-signature, Size: 196 bytes --]

bug#1033: Indic language rendering problem

[Parag N(पराग़)]

[-- Attachment #1: Type: text/plain, Size: 2395 bytes --]

Hi Ashish,
On Wed, Nov 19, 2008 at 11:04 PM, Ashish Shukla आशीष शुक्ल <
wahjava@gmail.com> wrote:

> Hi Parag,
>
> I reported similar bug (# 320) in May, 2008 where it is concluded that
> Emacs
> is not selecting the proper font for Indic script, for which I've applied
> the
> following temporary workaround for Devanagari script rendering to force the
> use of "Lohit Hindi" font.
>
> ,---- M-x my-setup-devanagari-rendering
> | (defun my-setup-devanagari-rendering()
> |   "Setup devanagari rendering"
> |   (interactive)
> |   (set-fontset-font "fontset-default"
> |                                       (cons (decode-char 'ucs ?\x0900)
> |                                                 (decode-char 'ucs
> ?\x097f))
> |                                       "Lohit Hindi-12"))
> `----
>
> But that problem also went away in June or July, 2008, IIRC. So, that
> workaround is not needed anymore. Following is the link to the screenshot
> of
> the HELLO file rendered in "GNU Emacs 23.0.60.1 (x86_64-pc-linux-gnu, X
> toolkit, Xaw3d scroll bars) of 2008-11-16 on chateau":
>
> http://flickr.com/photos/wahjava/3043187881/
>
> What I think, the problem at your end will be is lack of m17n support in
> Emacs. Following is the './configure' command line of my Emacs build:
>
> ,----
> | ./configure '--prefix=/usr' '--host=x86_64-pc-linux-gnu'
> | '--mandir=/usr/share/man' '--infodir=/usr/share/info'
> '--datadir=/usr/share'
> | '--sysconfdir=/etc' '--localstatedir=/var/lib'
> '--program-suffix=-emacs-23'
> | '--infodir=/usr/share/info/emacs-23' '--with-sound' '--with-x'
> | '--with-toolkit-scroll-bars' '--with-gif' '--with-jpeg' '--with-png'
> | '--with-rsvg' '--with-tiff' '--with-xpm' '--with-freetype' '--with-xft'
> | '--with-libotf' '--with-m17n-flt' '--with-x-toolkit=athena'
> '--without-hesiod'
> | '--without-kerberos' '--without-kerberos5' '--with-gpm' '--with-dbus'
> | '--libdir=/usr/lib64' '--build=x86_64-pc-linux-gnu'
> | 'build_alias=x86_64-pc-linux-gnu' 'host_alias=x86_64-pc-linux-gnu'
> 'CFLAGS=-O2
> | -pipe -mtune=nocona -march=nocona -ggdb' 'LDFLAGS=-Wl,--hash-style,both'
> `----
>
> To figure out which font is used to render a particular character, move
> cursor
> to the character and do "C-u C-x =" as pointed to me by Kenichi Handa.
>

         Thanks very much. I now got correct rendering for Indic languages
in emacs.

Regards,
Parag.

[-- Attachment #2: Type: text/html, Size: 3625 bytes --]

bug#1033: Indic language rendering problem

[Ashish Shukla आशीष =?UTF-8?Q?=E0=A4=B6=E0=A5=81=E0=A4=95=E0=A5=8D=E0=A4=B2]

[-- Attachment #1: Type: text/plain, Size: 155 bytes --]

"Parag N(पराग़)" writes:

[snip]

>          Thanks very much. I now got correct rendering for Indic languages in emacs.

Cool :)
-- 
Ashish Shukla

[-- Attachment #2: Type: application/pgp-signature, Size: 196 bytes --]