bug#23628: 25.1.50; wrong saving of unicode characters into kill ring

bug#23628: 25.1.50; wrong saving of unicode characters into kill ring

[Peter Münster]

Hi,

When inserting "€" in a buffer, killing it, than reinserting (yank) it,
I get "?" instead of "€".

This is needed for reproducing:

1.) Call "LC_ALL=en_GB.utf8 emacs -Q"

2.) Evaluate the following line:

    (setq select-active-regions nil)

3.) Type "€"

4.) Kill the "€" (select it and than C-w)

5.) C-y

Configured features:
XPM JPEG TIFF GIF PNG RSVG IMAGEMAGICK SOUND DBUS GSETTINGS NOTIFY
GNUTLS LIBXML2 FREETYPE XFT ZLIB TOOLKIT_SCROLL_BARS GTK2 X11

Important settings:
  value of $LC_ALL: en_GB.utf8
  value of $LC_CTYPE: en_GB.utf8
  value of $XMODIFIERS: @im=local
  locale-coding-system: utf-8-unix

Major mode: Lisp Interaction

TIA for investigation,
-- 
           Peter

bug#23628: 25.1.50; wrong saving of unicode characters into kill ring

[Eli Zaretskii]

> From: Peter Münster <pmlists@free.fr>
> Date: Fri, 27 May 2016 08:57:22 +0200
> 
> When inserting "€" in a buffer, killing it, than reinserting (yank) it,
> I get "?" instead of "€".

Not reproducible on my system.  (Btw, you omitted the details about
your OS and build.)

How did you type "€", and what does Emacs say when you type "C-u C-x ="
with the cursor on that character?

Thanks.

bug#23628: 25.1.50; wrong saving of unicode characters into kill ring

[Peter Münster]

On Fri, May 27 2016, Eli Zaretskii wrote:

> Not reproducible on my system.  (Btw, you omitted the details about
> your OS and build.)

Sorry, by mistake I killed too much...

--8<---------------cut here---------------start------------->8---
In GNU Emacs 25.1.50.1 (x86_64-suse-linux-gnu, GTK+ Version 2.24.30)
 of 2016-05-25 built on micropit
Repository revision: 1ee91bf89176251f6e399c8436dca0248cdd6f6b
Windowing system distributor 'The X.Org Foundation', version 11.0.11702000
System Description:	openSUSE Leap 42.1 (x86_64)
--8<---------------cut here---------------end--------------->8---


> How did you type "€",

"Alt Gr + e" because I have this line in my .Xmodmap:
keycode  26 = e E EuroSign EuroSign EuroSign EuroSign

But "M-x insert-char" and then "euro sign" works too.


> and what does Emacs say when you type "C-u C-x =" with the cursor on
> that character?

--8<---------------cut here---------------start------------->8---
             position: 35 of 36 (94%), column: 1
            character: € (displayed as €) (codepoint 8364, #o20254, #x20ac)
    preferred charset: unicode (Unicode (ISO10646))
code point in charset: 0x20AC
               script: symbol
               syntax: _ 	which means: symbol
             category: .:Base, c:Chinese, h:Korean, j:Japanese
             to input: type "C-x 8 RET 20ac" or "C-x 8 RET EURO SIGN"
          buffer code: #xE2 #x82 #xAC
            file code: #xE2 #x82 #xAC (encoded by coding system prefer-utf-8-unix)
              display: by this font (glyph code)
    xft:-adobe-Source Code Pro-normal-normal-normal-*-15-*-*-*-m-0-iso10646-1 (#x446)

Character code properties: customize what to show
  name: EURO SIGN
  general-category: Sc (Symbol, Currency)
  decomposition: (8364) ('€')

There are text properties here:
  fontified            t
--8<---------------cut here---------------end--------------->8---


-- 
           Peter

bug#23628: 25.1.50; wrong saving of unicode characters into kill ring

[Eli Zaretskii]

> From: Peter Münster <pmlists@free.fr>
> Cc: 23628@debbugs.gnu.org
> Date: Fri, 27 May 2016 10:28:36 +0200
> 
> In GNU Emacs 25.1.50.1 (x86_64-suse-linux-gnu, GTK+ Version 2.24.30)
>  of 2016-05-25 built on micropit
> Repository revision: 1ee91bf89176251f6e399c8436dca0248cdd6f6b
> Windowing system distributor 'The X.Org Foundation', version 11.0.11702000
> System Description:	openSUSE Leap 42.1 (x86_64)
> --8<---------------cut here---------------end--------------->8---
> 
> 
> > How did you type "€",
> 
> "Alt Gr + e" because I have this line in my .Xmodmap:
> keycode  26 = e E EuroSign EuroSign EuroSign EuroSign
> 
> But "M-x insert-char" and then "euro sign" works too.
> 
> 
> > and what does Emacs say when you type "C-u C-x =" with the cursor on
> > that character?
> 
> --8<---------------cut here---------------start------------->8---
>              position: 35 of 36 (94%), column: 1
>             character: € (displayed as €) (codepoint 8364, #o20254, #x20ac)
>     preferred charset: unicode (Unicode (ISO10646))
> code point in charset: 0x20AC
>                script: symbol
>                syntax: _ 	which means: symbol
>              category: .:Base, c:Chinese, h:Korean, j:Japanese
>              to input: type "C-x 8 RET 20ac" or "C-x 8 RET EURO SIGN"
>           buffer code: #xE2 #x82 #xAC
>             file code: #xE2 #x82 #xAC (encoded by coding system prefer-utf-8-unix)
>               display: by this font (glyph code)
>     xft:-adobe-Source Code Pro-normal-normal-normal-*-15-*-*-*-m-0-iso10646-1 (#x446)
> 
> Character code properties: customize what to show
>   name: EURO SIGN
>   general-category: Sc (Symbol, Currency)
>   decomposition: (8364) ('€')
> 
> There are text properties here:
>   fontified            t
> --8<---------------cut here---------------end--------------->8---

Strange.  Do you have some clipboard-related agent active that tries
to do something with stuff pasted from the clipboard?  What happens if
you set interprogram-paste-function to always return nil?

bug#23628: 25.1.50; wrong saving of unicode characters into kill ring

[Eli Zaretskii]

> From: Peter Münster <pmlists@free.fr>
> Cc: 23628@debbugs.gnu.org
> Date: Fri, 27 May 2016 10:28:36 +0200
> 
> In GNU Emacs 25.1.50.1 (x86_64-suse-linux-gnu, GTK+ Version 2.24.30)
>  of 2016-05-25 built on micropit
> Repository revision: 1ee91bf89176251f6e399c8436dca0248cdd6f6b
> Windowing system distributor 'The X.Org Foundation', version 11.0.11702000
> System Description:	openSUSE Leap 42.1 (x86_64)
> --8<---------------cut here---------------end--------------->8---
> 
> 
> > How did you type "€",
> 
> "Alt Gr + e" because I have this line in my .Xmodmap:
> keycode  26 = e E EuroSign EuroSign EuroSign EuroSign
> 
> But "M-x insert-char" and then "euro sign" works too.
> 
> 
> > and what does Emacs say when you type "C-u C-x =" with the cursor on
> > that character?
> 
> --8<---------------cut here---------------start------------->8---
>              position: 35 of 36 (94%), column: 1
>             character: € (displayed as €) (codepoint 8364, #o20254, #x20ac)
>     preferred charset: unicode (Unicode (ISO10646))
> code point in charset: 0x20AC
>                script: symbol
>                syntax: _ 	which means: symbol
>              category: .:Base, c:Chinese, h:Korean, j:Japanese
>              to input: type "C-x 8 RET 20ac" or "C-x 8 RET EURO SIGN"
>           buffer code: #xE2 #x82 #xAC
>             file code: #xE2 #x82 #xAC (encoded by coding system prefer-utf-8-unix)
>               display: by this font (glyph code)
>     xft:-adobe-Source Code Pro-normal-normal-normal-*-15-*-*-*-m-0-iso10646-1 (#x446)
> 
> Character code properties: customize what to show
>   name: EURO SIGN
>   general-category: Sc (Symbol, Currency)
>   decomposition: (8364) ('€')
> 
> There are text properties here:
>   fontified            t
> --8<---------------cut here---------------end--------------->8---

Oh, one more question: what is the value of selection-coding-system?

bug#23628: 25.1.50; wrong saving of unicode characters into kill ring

[Peter Münster]

On Fri, May 27 2016, Eli Zaretskii wrote:

> Strange.  Do you have some clipboard-related agent active that tries
> to do something with stuff pasted from the clipboard?

xcb is running. (no problem since 1995...)

I've killed it, but that does not change anything.


> What happens if you set interprogram-paste-function to always return
> nil?

Indeed, this solves the problem. But it's no more possible to insert
text from other programs with C-y.

-- 
           Peter

bug#23628: 25.1.50; wrong saving of unicode characters into kill ring

[Peter Münster]

On Fri, May 27 2016, Eli Zaretskii wrote:

> Oh, one more question: what is the value of selection-coding-system?

nil

-- 
           Peter

bug#23628: 25.1.50; wrong saving of unicode characters into kill ring

[Peter Münster]

On Fri, May 27 2016, Peter Münster wrote:

> On Fri, May 27 2016, Eli Zaretskii wrote:
>
>> Strange.  Do you have some clipboard-related agent active that tries
>> to do something with stuff pasted from the clipboard?
>
> xcb is running. (no problem since 1995...)

I've found another one: vncviewer

The copy-paste-problem happens only, when at least one vncviewer is
running.

After further investigation, copy-paste in xterm has the same problem,
that means, that this is not (or not only) an emacs-bug.

I'll report it to the vncviewer list.

Sorry about the needless bug-report.
-- 
           Peter

bug#23628: 25.1.50; wrong saving of unicode characters into kill ring

[Eli Zaretskii]

> From: Peter Münster <pmlists@free.fr>
> Cc: 23628@debbugs.gnu.org
> Date: Fri, 27 May 2016 10:58:32 +0200
> 
> On Fri, May 27 2016, Eli Zaretskii wrote:
> 
> > Strange.  Do you have some clipboard-related agent active that tries
> > to do something with stuff pasted from the clipboard?
> 
> xcb is running. (no problem since 1995...)
> 
> I've killed it, but that does not change anything.

Right, as expected.

> > What happens if you set interprogram-paste-function to always return
> > nil?
> 
> Indeed, this solves the problem.

Strange, AFAIR Emacs is not supposed to get text from the clipboard if
the text there came from the same Emacs session.  It should take the
text from the kill-ring.

bug#23628: 25.1.50; wrong saving of unicode characters into kill ring

[Eli Zaretskii]

> From: Peter Münster <pmlists@free.fr>
> Cc: 23628@debbugs.gnu.org
> Date: Fri, 27 May 2016 11:29:16 +0200
> 
> On Fri, May 27 2016, Peter Münster wrote:
> 
> > On Fri, May 27 2016, Eli Zaretskii wrote:
> >
> >> Strange.  Do you have some clipboard-related agent active that tries
> >> to do something with stuff pasted from the clipboard?
> >
> > xcb is running. (no problem since 1995...)
> 
> I've found another one: vncviewer
> 
> The copy-paste-problem happens only, when at least one vncviewer is
> running.
> 
> After further investigation, copy-paste in xterm has the same problem,
> that means, that this is not (or not only) an emacs-bug.
> 
> I'll report it to the vncviewer list.
> 
> Sorry about the needless bug-report.

OK, thanks.  Closing the bug report.