bug#36020: problems displaying tibetan characters

bug#36020: problems displaying tibetan characters

[Mayer Goldberg]

[-- Attachment #1.1: Type: text/plain, Size: 6358 bytes --]

Hello:

I think there is a problem in how Tibetan characters are displayed:

The character sequence

\u0f68\u0f7c\u0f7e\u0fc6\u0020\u0020\u0020\u0020\u0f40\u0fc6\u0020\u0020\u0020\u0020\u0f42\u0fc6

Should display as

[image: image.png]

But instead displays as

[image: image.png]

The issue has to do with the character

\u0fc6 = "TIBETAN SYMBOL PADMA GDAN"

which should appear under the previous character, and appears on the right.

I'm using the same font in both the example that works (in Libre Office)
and the one that doesn't (in emacs).

The font I'm using is Tibetan Machine Unicode, available freely at:

http://www.pktc.org/pktc/SFTtypefacesfree.htm

Can someone please look at this?

Thanks,

Mayer Goldberg

Configured using:
 'configure 'LDFLAGS= -ldl -lm -ldl -lm''

Configured features:
XPM JPEG TIFF GIF PNG RSVG SOUND GPM DBUS GSETTINGS NOTIFY LIBSELINUX
GNUTLS LIBXML2 FREETYPE M17N_FLT LIBOTF XFT ZLIB TOOLKIT_SCROLL_BARS
GTK2 X11 THREADS LIBSYSTEMD LCMS2

Important settings:
  value of $LC_MONETARY: en_US.UTF-8
  value of $LC_NUMERIC: en_US.UTF-8
  value of $LC_TIME: en_US.UTF-8
  value of $LANG: en_US.UTF-8
  value of $XMODIFIERS: @im=none
  locale-coding-system: utf-8-unix

Major mode: Fundamental

Minor modes in effect:
  diff-auto-refine-mode: t
  shell-dirtrack-mode: t
  global-pretty-mode: t
  tooltip-mode: t
  global-eldoc-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  column-number-mode: t
  line-number-mode: t
  transient-mark-mode: t

Load-path shadows:
~/emacs/emacs-fsharp-mode-master/fsharp-mode-completion hides
/home/gmayer/.emacs.d/elpa/fsharp-mode-20190304.1317/fsharp-mode-completion
~/emacs/emacs-fsharp-mode-master/fsharp-mode-indent-smie hides
/home/gmayer/.emacs.d/elpa/fsharp-mode-20190304.1317/fsharp-mode-indent-smie
~/emacs/emacs-fsharp-mode-master/fsharp-doc hides
/home/gmayer/.emacs.d/elpa/fsharp-mode-20190304.1317/fsharp-doc
~/emacs/emacs-fsharp-mode-master/fsharp-mode hides
/home/gmayer/.emacs.d/elpa/fsharp-mode-20190304.1317/fsharp-mode
~/emacs/emacs-fsharp-mode-master/fsharp-mode-indent hides
/home/gmayer/.emacs.d/elpa/fsharp-mode-20190304.1317/fsharp-mode-indent
~/emacs/emacs-fsharp-mode-master/fsharp-mode-font hides
/home/gmayer/.emacs.d/elpa/fsharp-mode-20190304.1317/fsharp-mode-font
~/emacs/emacs-fsharp-mode-master/fsharp-mode-util hides
/home/gmayer/.emacs.d/elpa/fsharp-mode-20190304.1317/fsharp-mode-util
~/emacs/emacs-fsharp-mode-master/flycheck-fsharp hides
/home/gmayer/.emacs.d/elpa/fsharp-mode-20190304.1317/flycheck-fsharp
~/emacs/emacs-fsharp-mode-master/fsharp-mode-pkg hides
/home/gmayer/.emacs.d/elpa/fsharp-mode-20190304.1317/fsharp-mode-pkg
~/emacs/emacs-fsharp-mode-master/inf-fsharp-mode hides
/home/gmayer/.emacs.d/elpa/fsharp-mode-20190304.1317/inf-fsharp-mode
~/emacs/markdown-mode hides
/home/gmayer/.emacs.d/elpa/markdown-mode-20190305.319/markdown-mode
~/emacs/sqlite hides /home/gmayer/.emacs.d/elpa/sqlite-20180708.1711/sqlite
~/emacs/prolog hides /usr/local/share/emacs/26.1/lisp/progmodes/prolog
~/emacs/my-input-methods/greek hides
/usr/local/share/emacs/26.1/lisp/language/greek
~/emacs/my-input-methods/hebrew hides
/usr/local/share/emacs/26.1/lisp/language/hebrew
~/emacs/my-input-methods/tibetan hides
/usr/local/share/emacs/26.1/lisp/language/tibetan

Features:
(shadow sort mail-extr emacsbug message rmc puny dired dired-loaddefs
rfc822 mml mml-sec epa epg gnus-util rmail rmail-loaddefs mm-decode
mm-bodies mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader
sendmail rfc2047 rfc2045 ietf-drums mm-util mail-prsvr mail-utils
face-remap elec-pair vc-git diff-mode brain brain-basic-lisp-functions
proof-site proof-autoloads pg-vars prolog align info htmlize fsharp-mode
fsharp-mode-indent-smie smie compile inf-fsharp-mode fsharp-doc
flycheck-fsharp flycheck cl-extra fsharp-mode-completion
fsharp-mode-util etags xref project company pcase dash subr-x s tramp
tramp-compat tramp-loaddefs trampver ucs-normalize shell parse-time
ox-beamer ox-odt rng-loc rng-uri rng-parse rng-match rng-dt rng-util
rng-pttrn nxml-parse nxml-ns nxml-enc xmltok nxml-util ox-latex
ox-icalendar ox-html table ox-ascii ox-publish ox org-element avl-tree
generator org advice org-macro org-footnote org-pcomplete pcomplete
org-list org-faces org-entities noutline outline org-version
ob-emacs-lisp ob ob-tangle org-src ob-ref ob-lob ob-table ob-keys
ob-comint comint ansi-color ring org-loaddefs format-spec find-func
cal-menu calendar cal-loaddefs ob-exp ob-core org-compat ob-eval
org-macs org-install cobol-mode skeleton pretty-mode easy-mmode cl aes
time-stamp quail help-mode 2048-game nasm-mode derived imenu edmacro
kmacro rust-mode rx json map finder-inf package easymenu epg-config
url-handlers url-parse auth-source cl-seq eieio eieio-core cl-macs
eieio-loaddefs password-cache url-vars seq byte-opt gv bytecomp
byte-compile cconv cl-loaddefs cl-lib time-date mule-util tooltip eldoc
electric uniquify ediff-hook vc-hooks lisp-float-type mwheel term/x-win
x-win term/common-win x-dnd tool-bar dnd fontset image regexp-opt fringe
tabulated-list replace newcomment text-mode elisp-mode lisp-mode
prog-mode register page menu-bar rfn-eshadow isearch timer select
scroll-bar mouse jit-lock font-lock syntax facemenu font-core
term/tty-colors frame cl-generic cham georgian utf-8-lang misc-lang
vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms cp51932
hebrew greek romanian slovak czech european ethiopic indian cyrillic
chinese composite charscript charprop case-table epa-hook jka-cmpr-hook
help simple abbrev obarray minibuffer cl-preloaded nadvice loaddefs
button faces cus-face macroexp files text-properties overlay sha1 md5
base64 format env code-pages mule custom widget hashtable-print-readable
backquote dbusbind inotify lcms2 dynamic-setting system-font-setting
font-render-setting move-toolbar gtk x-toolkit x multi-tty
make-network-process emacs)

Memory information:
((conses 16 408555 17260)
 (symbols 48 35841 2)
 (miscs 40 406 141)
 (strings 32 93257 2037)
 (string-bytes 1 2759857)
 (vectors 16 58872)
 (vector-slots 8 944939 18342)
 (floats 8 145 280)
 (intervals 56 348 0)
 (buffers 992 14))

[-- Attachment #1.2: Type: text/html, Size: 7407 bytes --]

[-- Attachment #2: image.png --]
[-- Type: image/png, Size: 11719 bytes --]

[-- Attachment #3: image.png --]
[-- Type: image/png, Size: 7954 bytes --]

bug#36020: problems displaying tibetan characters

[Basil L. Contovounesios]

[-- Attachment #1: Type: text/plain, Size: 1132 bytes --]

Mayer Goldberg <gmayer@little-lisper.org> writes:

> I think there is a problem in how Tibetan characters are displayed:
>
> The character sequence 
>
> \u0f68\u0f7c\u0f7e\u0fc6\u0020\u0020\u0020\u0020\u0f40\u0fc6\u0020\u0020\u0020\u0020\u0f42\u0fc6
>
> Should display as 
>
> image.png
>
> But instead displays as
>
> image.png
>
> The issue has to do with the character 
>
> \u0fc6 = "TIBETAN SYMBOL PADMA GDAN"
>
> which should appear under the previous character, and appears on the right.
>
> I'm using the same font in both the example that works (in Libre Office) and the one that doesn't (in emacs). 
>
> The font I'm using is Tibetan Machine Unicode, available freely at:
>
> http://www.pktc.org/pktc/SFTtypefacesfree.htm

FWIW, I can't seem to reproduce this on the Emacs master and emacs-26
branches (build info follows my signature).  Here's what I tried after
installing the fonts-tibetan-machine package on Debian:

0. emacs -Q
1. M-: (set-fontset-font nil 'tibetan "Tibetan Machine Uni") RET
2. M-: (insert "\u0f68\u0f7c\u0f7e\u0fc6\u0020\u0f40\u0fc6\u0020\u0f42\u0fc6") RET
3. C-x C-= = = = = = =   [Text scale +7]


[-- Attachment #2: tibetan.png --]
[-- Type: image/png, Size: 13676 bytes --]

[-- Attachment #3: Type: text/plain, Size: 3524 bytes --]


4. C-a C-u C-x =

--8<---------------cut here---------------start------------->8---
             position: 146 of 155 (94%), column: 0
            character: ཨ (displayed as ཨ) (codepoint 3944, #o7550, #xf68)
              charset: unicode (Unicode (ISO10646))
code point in charset: 0x0F68
               script: tibetan
               syntax: w 	which means: word
             category: .:Base, 0:consonant, L:Left-to-right (strong), q:Tibetan
             to input: type "C-x 8 RET f68" or "C-x 8 RET TIBETAN LETTER A"
          buffer code: #xE0 #xBD #xA8
            file code: #xE0 #xBD #xA8 (encoded by coding system utf-8-unix)
              display: composed to form "ཨོཾ" (see below)

Composed with the following character(s) "ོཾ" using this font:
  xft:-thdl-Tibetan Machine Uni-normal-normal-normal-*-54-*-*-*-*-0-iso10646-1
by these glyphs:
  [0 2 3944 3869 35 1 34 40 -10 nil]
  [0 2 0 4137 0 -26 10 62 -41 nil]

Character code properties: customize what to show
  name: TIBETAN LETTER A
  general-category: Lo (Letter, Other)
  decomposition: (3944) ('ཨ')

There are text properties here:
  fontified            nil
--8<---------------cut here---------------end--------------->8---

> Configured features:
> XPM JPEG TIFF GIF PNG RSVG SOUND GPM DBUS GSETTINGS NOTIFY LIBSELINUX
> GNUTLS LIBXML2 FREETYPE M17N_FLT LIBOTF XFT ZLIB TOOLKIT_SCROLL_BARS
> GTK2 X11 THREADS LIBSYSTEMD LCMS2

This report initially looked to me like bug#35024[1], but I see that you
are now reporting from an Emacs built with libotf and m17n-flt, so I
don't know where the problem lies.  Perhaps someone more experienced in
this area will have some ideas.

[1]: https://debbugs.gnu.org/35024

Thanks,

-- 
Basil

In GNU Emacs 27.0.50 (build 6, x86_64-pc-linux-gnu, X toolkit, Xaw3d scroll bars)
 of 2019-06-01 built on thunk
Repository revision: f2a7acdde7207f92de53352f17dd7f506e15a851
Repository branch: master
Windowing system distributor 'The X.Org Foundation', version 11.0.12003000
System Description: Debian GNU/Linux 10 (buster)

Configured using:
 'configure 'CC=ccache gcc' 'CFLAGS=-O2 -march=native' --config-cache
 --prefix=/home/blc/.local --with-mailutils --with-x-toolkit=lucid
 --with-modules --with-file-notification=yes --with-x'

Configured features:
XAW3D XPM JPEG TIFF GIF PNG RSVG SOUND GPM DBUS GSETTINGS GLIB NOTIFY
INOTIFY ACL LIBSELINUX GNUTLS LIBXML2 FREETYPE M17N_FLT LIBOTF XFT ZLIB
TOOLKIT_SCROLL_BARS LUCID X11 XDBE XIM MODULES THREADS LIBSYSTEMD JSON
PDUMPER LCMS2 GMP

Important settings:
  value of $LANG: en_IE.UTF-8
  locale-coding-system: utf-8-unix


In GNU Emacs 26.2.50 (build 8, x86_64-pc-linux-gnu, X toolkit, Xaw3d scroll bars)
 of 2019-05-27 built on thunk
Repository revision: c4d4dcf17e407a3c68e150f22b9756ef6c943070
Windowing system distributor 'The X.Org Foundation', version 11.0.12003000
System Description:	Debian GNU/Linux 10 (buster)

Configured using:
 'configure 'CC=ccache gcc' 'CFLAGS=-O0 -g3 -ggdb -gdwarf-4'
 --config-cache --prefix=/home/blc/.local --program-suffix=26
 --enable-checking=yes,glyphs --enable-check-lisp-object-type
 --with-mailutils --with-x-toolkit=lucid --with-modules
 --with-file-notification=yes --with-x'

Configured features:
XAW3D XPM JPEG TIFF GIF PNG RSVG IMAGEMAGICK SOUND GPM DBUS GSETTINGS
GLIB NOTIFY ACL LIBSELINUX GNUTLS LIBXML2 FREETYPE M17N_FLT LIBOTF XFT
ZLIB TOOLKIT_SCROLL_BARS LUCID X11 XDBE XIM MODULES THREADS LIBSYSTEMD
LCMS2

bug#36020: problems displaying tibetan characters

[Eli Zaretskii]

> From: "Basil L. Contovounesios" <contovob@tcd.ie>
> Date: Sat, 01 Jun 2019 19:04:43 +0100
> Cc: 36020@debbugs.gnu.org
> 
> FWIW, I can't seem to reproduce this on the Emacs master and emacs-26
> branches (build info follows my signature).  Here's what I tried after
> installing the fonts-tibetan-machine package on Debian:

We don't know the Emacs version of the OP.  In addition, it could be
due to a difference in the installed versions of the m17n-flt library.

bug#36020: problems displaying tibetan characters

[Mayer Goldberg]

[-- Attachment #1: Type: text/plain, Size: 954 bytes --]

Thanks for both emails. Basil "fixed" my problem:
Apparently I have two fonts installed on my system --- "Tibetan Machine
Uni" and "Tibetan Machine Unicode", the and the former displays things
correctly while the latter does not. I'm sorry for bothering you with this,
but until I received Basil's reply, I hadn't realized that these are two
fonts...

Thanks again, and sorry for the alarm!

Mayer

On Sat, Jun 1, 2019 at 9:11 PM Eli Zaretskii <eliz@gnu.org> wrote:

> > From: "Basil L. Contovounesios" <contovob@tcd.ie>
> > Date: Sat, 01 Jun 2019 19:04:43 +0100
> > Cc: 36020@debbugs.gnu.org
> >
> > FWIW, I can't seem to reproduce this on the Emacs master and emacs-26
> > branches (build info follows my signature).  Here's what I tried after
> > installing the fonts-tibetan-machine package on Debian:
>
> We don't know the Emacs version of the OP.  In addition, it could be
> due to a difference in the installed versions of the m17n-flt library.
>

[-- Attachment #2: Type: text/html, Size: 1555 bytes --]

bug#36020: problems displaying tibetan characters

[Eli Zaretskii]

> From: Mayer Goldberg <gmayer@little-lisper.org>
> Date: Sat, 1 Jun 2019 21:14:41 +0300
> Cc: "Basil L. Contovounesios" <contovob@tcd.ie>, 36020@debbugs.gnu.org
> 
> Apparently I have two fonts installed on my system --- "Tibetan Machine Uni" and "Tibetan Machine Unicode",
> the and the former displays things correctly while the latter does not. I'm sorry for bothering you with this, but
> until I received Basil's reply, I hadn't realized that these are two fonts...

Thanks, I'm therefore closing the bug.