From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED!not-for-mail From: Eli Zaretskii Newsgroups: gmane.emacs.bugs Subject: bug#28339: 25.2; Emacs shows ZWNJ character (Zero Width non-Joiner) as Space Date: Mon, 04 Sep 2017 07:26:43 +0300 Message-ID: <83lglv2inw.fsf@gnu.org> References: <833783yana.fsf@gnu.org> <831snnyaem.fsf@gnu.org> Reply-To: Eli Zaretskii NNTP-Posting-Host: blaine.gmane.org X-Trace: blaine.gmane.org 1504499691 6295 195.159.176.226 (4 Sep 2017 04:34:51 GMT) X-Complaints-To: usenet@blaine.gmane.org NNTP-Posting-Date: Mon, 4 Sep 2017 04:34:51 +0000 (UTC) Cc: 28339@debbugs.gnu.org To: Nima Aryan Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Mon Sep 04 06:34:37 2017 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by blaine.gmane.org with esmtp (Exim 4.84_2) (envelope-from ) id 1doj5c-0000BU-CK for geb-bug-gnu-emacs@m.gmane.org; Mon, 04 Sep 2017 06:34:24 +0200 Original-Received: from localhost ([::1]:56018 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1doj5e-00064V-CS for geb-bug-gnu-emacs@m.gmane.org; Mon, 04 Sep 2017 00:34:26 -0400 Original-Received: from eggs.gnu.org ([208.118.235.92]:44407) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1doj40-0004p1-0i for bug-gnu-emacs@gnu.org; Mon, 04 Sep 2017 00:34:21 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1doj1O-0000fZ-EY for bug-gnu-emacs@gnu.org; Mon, 04 Sep 2017 00:31:08 -0400 Original-Received: from debbugs.gnu.org ([208.118.235.43]:38714) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1doj1O-0000f1-79 for bug-gnu-emacs@gnu.org; Mon, 04 Sep 2017 00:30:02 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1doj1N-0000tE-VI for bug-gnu-emacs@gnu.org; Mon, 04 Sep 2017 00:30:01 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Eli Zaretskii Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Mon, 04 Sep 2017 04:30:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 28339 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: Original-Received: via spool by 28339-submit@debbugs.gnu.org id=B28339.15044993463335 (code B ref 28339); Mon, 04 Sep 2017 04:30:01 +0000 Original-Received: (at 28339) by debbugs.gnu.org; 4 Sep 2017 04:29:06 +0000 Original-Received: from localhost ([127.0.0.1]:47394 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1doj0U-0000ri-Ho for submit@debbugs.gnu.org; Mon, 04 Sep 2017 00:29:06 -0400 Original-Received: from eggs.gnu.org ([208.118.235.92]:57054) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1doj0T-0000rG-Ap for 28339@debbugs.gnu.org; Mon, 04 Sep 2017 00:29:05 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1doiz9-0006Nj-RZ for 28339@debbugs.gnu.org; Mon, 04 Sep 2017 00:29:00 -0400 Original-Received: from fencepost.gnu.org ([2001:4830:134:3::e]:41916) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1doiyF-0005dE-3q; Mon, 04 Sep 2017 00:26:47 -0400 Original-Received: from 84.94.185.246.cable.012.net.il ([84.94.185.246]:1360 helo=home-c4e4a596f7) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from ) id 1doiyD-0005jO-Vw; Mon, 04 Sep 2017 00:26:46 -0400 In-reply-to: (message from Nima Aryan on Sun, 03 Sep 2017 19:31:16 +0000) X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 208.118.235.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.org gmane.emacs.bugs:136564 Archived-At: > From: Nima Aryan > Date: Sun, 03 Sep 2017 19:31:16 +0000 > > The problem is specific (as it could be tested) to non-English Alphabet. At least Persian. > > I've tested the 'glyphless-char-display-control' and I can confirm that as It seems, it's working on English input > as expected. For example choosing to set `Hex box` cause ZWNJ be replaced as hex box. Other options > (including defaults) seems to works as expected. > > But the same option (on the same session) does not work as expected for Persian (and possibly other > similar) alphabets. Ah, that changes everything. When Emacs displays the Persian script, it composes the ZWNJ character with surrounding characters to provide correct shaping. The rules for this character composition are in lisp/language/misc-lang.el, near the end. I don't read Persian, but if the resulting shaping is incorrect, please show specific examples with characters from the Persian script, and please show screenshots of their correct display (in some other application) vs what Emacs produces on your system. Then we can investigate what could possibly be wrong with the Emacs display. > p.s. Just as a hypothesis, BiDi most interfere here as well and causes such behavior. I'm not sure this is the reason, but I need a clear example to investigate. Thanks.