From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: =?UTF-8?Q?=D0=94=D0=B8=D0=BB=D1=8F=D0=BD_?= =?UTF-8?Q?=D0=9F=D0=B0=D0=BB=D0=B0=D1=83=D0=B7=D0=BE=D0=B2?= Newsgroups: gmane.emacs.bugs Subject: bug#66664: On modified lines containing =?UTF-8?Q?=F0=9F=8C=90=EF=B8=8E?= and Unicode VS15 in text mode emacs does not show the real content of the lines Date: Sat, 21 Oct 2023 15:12:03 +0200 Message-ID: <7e1f9e947a191eca18429cd20e5e71a4dcd34f2f.camel@aegee.org> References: <2ae9c4a6f49438103a21ff4144e2e11bdf2f7b2e.camel@aegee.org> <83pm18qh5w.fsf@gnu.org> Mime-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="19201"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Evolution 3.51.1 Cc: 66664@debbugs.gnu.org To: Eli Zaretskii Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Sat Oct 21 15:12:57 2023 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1quBmj-0004kI-5M for geb-bug-gnu-emacs@m.gmane-mx.org; Sat, 21 Oct 2023 15:12:57 +0200 Original-Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1quBmO-0008Ql-BJ; Sat, 21 Oct 2023 09:12:36 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1quBmM-0008QH-7e for bug-gnu-emacs@gnu.org; Sat, 21 Oct 2023 09:12:34 -0400 Original-Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1quBmL-00078p-V2 for bug-gnu-emacs@gnu.org; Sat, 21 Oct 2023 09:12:33 -0400 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1quBmn-0008Dn-Me for bug-gnu-emacs@gnu.org; Sat, 21 Oct 2023 09:13:01 -0400 X-Loop: help-debbugs@gnu.org Resent-From: =?UTF-8?Q?=D0=94=D0=B8=D0=BB=D1=8F=D0=BD_?= =?UTF-8?Q?=D0=9F=D0=B0=D0=BB=D0=B0=D1=83=D0=B7=D0=BE=D0=B2?= Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Sat, 21 Oct 2023 13:13:01 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 66664 X-GNU-PR-Package: emacs Original-Received: via spool by 66664-submit@debbugs.gnu.org id=B66664.169789395731564 (code B ref 66664); Sat, 21 Oct 2023 13:13:01 +0000 Original-Received: (at 66664) by debbugs.gnu.org; 21 Oct 2023 13:12:37 +0000 Original-Received: from localhost ([127.0.0.1]:42544 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quBmO-0008D2-Io for submit@debbugs.gnu.org; Sat, 21 Oct 2023 09:12:36 -0400 Original-Received: from mail.aegee.org ([144.76.142.78]:36218) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1quBmM-0008Cq-0H for 66664@debbugs.gnu.org; Sat, 21 Oct 2023 09:12:35 -0400 Authentication-Results: mail.aegee.org/39LDC47P1888627; auth=pass (LOGIN) smtp.auth=didopalauzov@aegee.org DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=aegee.org; s=k4096; t=1697893924; i=dkim+MSA-ssl@aegee.org; bh=kKiWUy/hKJZbcBOKKzvIM1VheatQykjl7VxhyKB0eGI=; h=Subject:From:To:Cc:Date:In-Reply-To:References; b=Nsrv16KVHypm6Z+wO3t982ei24OPHtbnrqqPJsAqVTscyi/Qy1gFEP4SJnFCY/Sms ubTg+GMthTJkElTlAhKDD0+TWaC7qzJj9cr2RK+0g95/xeTJSmDUJsDPUavvOOnvyx +A2fi5XaBNlG/gOeNmx9VdVgGZM83hF5oKA2bOQaLJRQ3npkggLMk2Qdm1p838tL6H 5C5zSphEEp7Uh8uD/Y31hhAYOcGw1SCtuOdvRJG58aRXkhP0ICuR/z7dtWKbqM9/j1 7f4xIPyuG1frhsIHaxuiIXL+epuN5vkMaVzqrWYRCndTOTXrbq1nKWolxJeWsrPRJT 7TAcR+aT5bgadio561qdBlacW/+z+DPT8A3zitwPUPa+yfOc+iIXRy5yOhxQE2/ja/ rooiH4FxpxuBer7WUnItxDQ8Wvm1ie9UOWVQzIesL32NR8tFFdthZv0bKvzyTbyznZ nmSQuX8sgymi+DINzYIewGgtif22wNxZpTx2GNGVYQqJwoX8FBWdmLgfD7hm2wNGS1 tGgI7KKyxX+48e2uVMYARGQp3l6rvz2IXw8RsPIRqVPunPcaGZaoA/7QzfE3PlvmwE kPEB7nTB3bFeFF2qytPZxBjV3o35YZWKV0jw1o/LrdpJFIhwdtdBtLvF3Gy1Xa3KdC 1 Authentication-Results: mail.aegee.org/39LDC47P1888627; dkim=none Original-Received: from [10.57.6.126] ([192.19.207.250]) (authenticated bits=0) by mail.aegee.org (8.17.2/8.17.2) with ESMTPSA id 39LDC47P1888627 (version=TLSv1.3 cipher=TLS_AES_256_GCM_SHA384 bits=256 verify=NO); Sat, 21 Oct 2023 13:12:04 GMT In-Reply-To: <83pm18qh5w.fsf@gnu.org> X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: bug-gnu-emacs@gnu.org List-Id: "Bug reports for GNU Emacs, the Swiss army knife of text editors" List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Xref: news.gmane.io gmane.emacs.bugs:272893 Archived-At: Hello Eli, thanks for your answer. I am using Gnome Terminal 3.48.1 on Fedora 38, but = with MATE Terminal 1.26.1 the same happens. I tried to follow your advice.= I start emacs -nw u.txt , then M-x auto-composition-mode. =20 Emacs changes the displayed text from t.add('=F0=9F=8C=90=EF=B8=8E ' + 'abcd') to=20 t.add('=F0=9F=8C=90 ' + 'abcd') and prints =E2=80=9CAuto-Composition mode disabled in current buffer=E2=80= =9D. After the change the globe is coloured in the terminal and there is a= n underscore after the globe. I again press several times the right arrow = to go over the letter c and then press x. Emacs again deletes (actually hid= es) the letter c and shows on its place the letter x. So in this example turning off auto-composition-mode does not help. I expect that the letter c stays visible. What terminals and OSes do you recommend, which work good with enabled auto= -composition-mode? Kind regards =D0=94=D0=B8=D0=BB=D1=8F=D0=BD -----Original Message----- From: Eli Zaretskii To: =D0=94=D0=B8=D0=BB=D1=8F=D0=BD =D0=9F=D0=B0=D0=BB=D0=B0=D1=83=D0=B7=D0= =BE=D0=B2 Cc: 66664@debbugs.gnu.org Subject: Re: bug#66664: On modified lines containing =F0=9F=8C=90=EF=B8=8E = and Unicode VS15 in text mode emacs does not show the real content of the l= ines Date: 10/21/2023 02:44:11 PM > From: =D0=94=D0=B8=D0=BB=D1=8F=D0=BD =D0=9F=D0=B0=D0=BB=D0=B0=D1=83=D0=B7= =D0=BE=D0=B2 > =C2=A0 > Date: Sat, 21 Oct 2023 14:07:52 +0200 >=20 > Hello, >=20 > I have a text unix file u.txt where I insert this line: >=20 >=20 > t.add('=F0=9F=8C=90=EF=B8=8E ' + 'abcd') >=20 > That is a globe U+1F310 followed by Unicode Variation Selector 15 to remo= ve the colour of the globe. >=20 > $ hexdump -C=C2=A0 u.txt > 00000000=C2=A0 74 2e 61 64 64 28 27 f0=C2=A0 9f 8c 90 ef b8 8e 20 27=C2= =A0 |t.add('....... '| > 00000010=C2=A0 20 2b 20 27 61 62 63 64=C2=A0 27 29 0a=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 | + 'abcd').| > 0000001b >=20 > I open the file in text mode, emacs-fedora-28.3 -nw, and press the right = arrow repeatedly to go over c.=C2=A0 Then I press x.=C2=A0 emacs shows that= c is deleted and on its place appears x. I press Ctrl+L to refresh.=C2=A0 = Now c appears before x. >=20 > I close emacs, repeat the above steps and get consistent results.=C2=A0 I= try this on a different system with self-compiled emacs 29.1, same results= . What is the terminal emulator you are using, and on what OS? Basically, what the above means is that the text terminal you are using doesn't support the sequence of U+1F310 followed by VS-15 as Emacs expects it.=C2=A0 On such a terminal you need to disable auto-composition-mode to be able to edit such text.