From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED!not-for-mail From: Nima Aryan Newsgroups: gmane.emacs.bugs Subject: bug#28339: 25.2; Emacs shows ZWNJ character (Zero Width non-Joiner) as Space Date: Sun, 03 Sep 2017 19:31:16 +0000 Message-ID: References: <833783yana.fsf@gnu.org> <831snnyaem.fsf@gnu.org> NNTP-Posting-Host: blaine.gmane.org Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="001a113e7762562dc905584e0a64" X-Trace: blaine.gmane.org 1504478735 18118 195.159.176.226 (3 Sep 2017 22:45:35 GMT) X-Complaints-To: usenet@blaine.gmane.org NNTP-Posting-Date: Sun, 3 Sep 2017 22:45:35 +0000 (UTC) To: 28339@debbugs.gnu.org Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Mon Sep 04 00:45:19 2017 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane.org Original-Received: from lists.gnu.org ([208.118.235.17]) by blaine.gmane.org with esmtp (Exim 4.84_2) (envelope-from ) id 1doddj-0003pn-4W for geb-bug-gnu-emacs@m.gmane.org; Mon, 04 Sep 2017 00:45:15 +0200 Original-Received: from localhost ([::1]:33619 helo=lists.gnu.org) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1doddq-0004KO-4N for geb-bug-gnu-emacs@m.gmane.org; Sun, 03 Sep 2017 18:45:22 -0400 Original-Received: from eggs.gnu.org ([2001:4830:134:3::10]:35209) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1doddb-00047s-6A for bug-gnu-emacs@gnu.org; Sun, 03 Sep 2017 18:45:12 -0400 Original-Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1doddW-000769-Ai for bug-gnu-emacs@gnu.org; Sun, 03 Sep 2017 18:45:07 -0400 Original-Received: from debbugs.gnu.org ([208.118.235.43]:38379) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1doddW-000765-5c for bug-gnu-emacs@gnu.org; Sun, 03 Sep 2017 18:45:02 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1doddV-0001Lw-UP for bug-gnu-emacs@gnu.org; Sun, 03 Sep 2017 18:45:01 -0400 X-Loop: help-debbugs@gnu.org Resent-From: Nima Aryan Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sun, 03 Sep 2017 22:45:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 28339 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: Original-Received: via spool by 28339-submit@debbugs.gnu.org id=B28339.15044786535128 (code B ref 28339); Sun, 03 Sep 2017 22:45:01 +0000 Original-Received: (at 28339) by debbugs.gnu.org; 3 Sep 2017 22:44:13 +0000 Original-Received: from localhost ([127.0.0.1]:47059 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1dodci-0001Kd-RI for submit@debbugs.gnu.org; Sun, 03 Sep 2017 18:44:13 -0400 Original-Received: from mail-yw0-f176.google.com ([209.85.161.176]:36377) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1doacH-0005Lt-Nm for 28339@debbugs.gnu.org; Sun, 03 Sep 2017 15:31:34 -0400 Original-Received: by mail-yw0-f176.google.com with SMTP id h127so17842202ywf.3 for <28339@debbugs.gnu.org>; Sun, 03 Sep 2017 12:31:33 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=bJ60XL333aV28gIBjaXLkMA5883d3RHy1X5eO7yOzHE=; b=PH5+Y1+05or4sgkHJCVyrby1WkBfo7zPSWR5t64rqqdoDVqVASVyv2WhYgWTonAaTL 1clZfVYYhi5KfClOHCS8ldz3kHBOl/Ad8DWQuLnKaER7rdFulOSgWmjlOvIZjUTP3dqx EDmtLU2tXCkD1wyy7+fafUyc8GC1PqcHh1NTegW19m5rCdapvM+M9ujG4sdBlSWcyNW+ CH1XUKjObCEaxwuedA20N3LuWZuUG74zH9Bxi6GAR3/b4D0tDpHCGMsn4IZO6ppjTfZD NMQ4wEN/2moWgyCOW+5m88E3GxMRotcaRAPDi9AD6GWUUxqzh1Qs1O0bkV0YKZadD7oJ 5EAw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=bJ60XL333aV28gIBjaXLkMA5883d3RHy1X5eO7yOzHE=; b=Am3tWVZc1tXVe4XmvZWWWIvzDoFhYJyt7pK2YUJeH4IO9BlhP9Mat6TyDjrT0Ai0zw cada1+238/wzbWFDB1IJT4wYQwk2DM1oPTnVxijCutvkUUff+kHeKolCJUL/tmUT6xDc ibOGZp/899XJCWuq9CNiWt0p4Fsokwiov+8+2kT2hydUXAP0jB2A0jVSiazMyXJxQMIp X9YJF/Ba2nIvSH+VTtIWDb85lUcBpojg3X64ycSpEfmBqf/tOBKXlvumJRMQsDpzEBm1 6L9uswPB55Uekn5SFZFG4KUArlhkNEnj90E5JUDP6XswIflGNXEizvheHsRSMI1EuNng Pd/Q== X-Gm-Message-State: AHPjjUgIUn2VhOCUsySKJjRbVf25bwYyQD5+8zE1yDEMM2vH85NwYAXU 1uh4s/8N2a2rPLY2F5lvt+37ZYFVFPdc X-Google-Smtp-Source: ADKCNb6J6o/3sjKgKqhlPeBYdDs4Pw3iGK6cQCvHEt8TXb921PjOdOl7FabFl4TodWrwPuI4Yx2ilECfTBzGsz5lJvE= X-Received: by 10.37.74.134 with SMTP id x128mr7634048yba.340.1504467087664; Sun, 03 Sep 2017 12:31:27 -0700 (PDT) In-Reply-To: <831snnyaem.fsf@gnu.org> X-Mailman-Approved-At: Sun, 03 Sep 2017 18:44:11 -0400 X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Received-From: 208.118.235.43 X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.org gmane.emacs.bugs:136559 Archived-At: --001a113e7762562dc905584e0a64 Content-Type: text/plain; charset="UTF-8" The problem is specific (as it could be tested) to non-English Alphabet. At least Persian. I've tested the 'glyphless-char-display-control' and I can confirm that as It seems, it's working on English input as expected. For example choosing to set `Hex box` cause ZWNJ be replaced as hex box. Other options (including defaults) seems to works as expected. But the same option (on the same session) does not work as expected for Persian (and possibly other similar) alphabets. Actually with exactly same option using Persian characters a clear normal space is shown instead of Hex box (completely different behavior). No matter what the option for non-English alphabet is, the ZWNJ is shown as a normal space character. Using Persian, ZWNJ really matters. For example while `A+ZWNJ+B` should be displayed as `AB` it's shown as `A B` in Persian but `AB` in English. ZWNJ might not have any application in English but it's vital for some other languages. It's a kind of an end-immediate-start in continuous scripts. In Latin alphabet it might have some uses in German language (fl). However it very important for Persian, Hebrew,, Arabic, Urdu, Hindi and some other alphabets. Thanks p.s. Just as a hypothesis, BiDi most interfere here as well and causes such behavior. On Sun, Sep 3, 2017 at 9:42 PM Eli Zaretskii wrote: > > Date: Sun, 03 Sep 2017 20:06:33 +0300 > > From: Eli Zaretskii > > Cc: 28339@debbugs.gnu.org > > > > Emacs traditionally tries not to hide characters from the user. > > Maybe there's a misunderstanding on my part: are you saying that you > do NOT see ZWNJ on display? In that case, it could be because the > character is by default displayed as a very thin (1-pixel) space. > When you move the cursor across it, you should see a very thin bar > instead of the normal cursor. > > In any case, the variable I mentioned lets you change how this > character is displayed. > --001a113e7762562dc905584e0a64 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
The problem is specific (as it could be tested) to no= n-English Alphabet. At least Persian.

I've tested the 'glyphless-char-display-cont= rol' a= nd I can confirm that as It seems, it's working on English=C2=A0input a= s expected. For example choosing to set `Hex box` cause ZWNJ be replaced as= hex box. Other options (including defaults) seems to works as expected.=C2= =A0

But the same option (on the same session) does not work as expec= ted=C2=A0 for Persian (and possibly other similar) alphabets. Actually with= exactly same option using Persian characters a clear normal space is shown= instead of Hex box (completely different behavior). No matter what the opt= ion for non-English alphabet is, the ZWNJ is shown as a normal space charac= ter.=C2=A0

Using Persian, ZWNJ really matters. For example whi= le `A+ZWNJ+B` should be displayed as `AB` it's shown as `A =C2=A0B` in = Persian but `AB` in English. ZWNJ might not have any application in English= but it's vital for some other languages.=C2=A0It's a kind of an end-immed= iate-start in continuous=C2=A0scripts. In Latin=C2=A0alphabet it might have some uses in = German=C2=A0language (fl). However it very important for Persian, Hebrew,, = Arabic, Urdu, Hindi and some other alphabets.=C2=A0

Thanks
p.s. Just as a hypothesis, BiDi most interfere=C2=A0here as well = and causes such behavior.=C2=A0

On Sun, Sep 3, 2017 at 9:42 PM Eli Zaretskii <eliz@gnu.org> wrote:
> Date: Sun, 03 Sep 2017 20:06:33 +0300
> From: Eli Zaretskii <eliz@gnu.org>
> Cc: 28339@d= ebbugs.gnu.org
>
> Emacs traditionally tries not to hide characters from the user.

Maybe there's a misunderstanding on my part: are you saying that you do NOT see ZWNJ on display?=C2=A0 In that case, it could be because the
character is by default displayed as a very thin (1-pixel) space.
When you move the cursor across it, you should see a very thin bar
instead of the normal cursor.

In any case, the variable I mentioned lets you change how this
character is displayed.
--001a113e7762562dc905584e0a64--