bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> Date: Sat, 12 Sep 2020 20:57:17 +0200
> 
> Expected behavior:
> When a single line comment that is wrapped gets selected (or when cursor is positioned on that line) text
> color should be the one defined with the emacs color theme.
> 
> Detected behavior:
> Instead of expected behavior text is colored partially as a comment and partially as a regular text.

This is very strange.  I cannot reproduce this on my system, so the
reason is somehow specific to what you have there.

You didn't show the details collected by report-emacs-bug, so it's
hard to make educated guesses regarding the most probable reasons.
Therefore, what's below are stabs in the dark:

 . does it help to disable double-buffering?
 . if this is a Cairo build, can you try --without-cairo?
 . if you have some advanced optimization features of your system's
   display software turned on, try turning them off

Also, what was the Emacs version before the upgrade to 27.1?

Thanks.

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Драгољуб Шишовић]

[-- Attachment #1: Type: text/plain, Size: 8906 bytes --]

Thank you for your reply,

I have sent this bug report directly from my email (in a web browser)... so
I guess I evaded the regular way of reporting bugs, thus helpful info from
report-emacs-bug was not automatically attached.
Really sorry about that, I will add those details at the end of this
message.
Also, I'm not sure if replying to you in this manner (directly through
email) is good practice or not... sorry if it's not.

Unfortunately, even emacs running without cairo doesn't help. The issue
remains. The same goes for harfbuzz.
As for double-buffering, wasn't it removed in emacs v25... so I'm not sure
how/what to disable here?
As for advanced optimization features of my system... not sure if
compton/picom can qualify as such, but nevertheless I've disabled it,
however the issue was still there.

The previous emacs version was 26.3. and when I downgrade emacs to that
version, the issue is gone. I will attach details collected by
report-emacs-bug for that version as well.

Thanks


In GNU Emacs 27.1 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.24.22,
cairo version 1.17.3)
 of 2020-08-28 built on juergen
Windowing system distributor 'The X.Org Foundation', version 11.0.12009000
System Description: Arch Linux

Recent messages:
For information about GNU Emacs and the GNU system, type C-h C-a.
Mark set [27 times]
Making completion list...

Configured using:
 'configure --prefix=/usr --sysconfdir=/etc --libexecdir=/usr/lib
 --localstatedir=/var --with-x-toolkit=gtk3 --with-xft --with-wide-int
 --with-modules --with-cairo --with-harfbuzz 'CFLAGS=-march=x86-64
 -mtune=generic -O2 -pipe -fno-plt' CPPFLAGS=-D_FORTIFY_SOURCE=2
 LDFLAGS=-Wl,-O1,--sort-common,--as-needed,-z,relro,-z,now'

Configured features:
XPM JPEG TIFF GIF PNG RSVG CAIRO SOUND GPM DBUS GSETTINGS GLIB NOTIFY
INOTIFY ACL GNUTLS LIBXML2 FREETYPE HARFBUZZ M17N_FLT LIBOTF ZLIB
TOOLKIT_SCROLL_BARS GTK3 X11 XDBE XIM MODULES THREADS LIBSYSTEMD JSON
PDUMPER LCMS2 GMP

Important settings:
  value of $LC_TIME: sr_RS.UTF-8
  value of $LANG: en_US.UTF-8
  locale-coding-system: utf-8-unix

Major mode: Lisp Interaction

Minor modes in effect:
  tooltip-mode: t
  global-eldoc-mode: t
  eldoc-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  line-number-mode: t
  transient-mark-mode: t

Load-path shadows:
None found.

Features:
(shadow sort mail-extr emacsbug message rmc puny dired dired-loaddefs
format-spec rfc822 mml easymenu mml-sec password-cache epa derived epg
epg-config gnus-util rmail rmail-loaddefs text-property-search time-date
subr-x seq byte-opt gv bytecomp byte-compile cconv mm-decode mm-bodies
mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader cl-loaddefs
cl-lib sendmail rfc2047 rfc2045 ietf-drums mm-util mail-prsvr mail-utils
tooltip eldoc electric uniquify ediff-hook vc-hooks lisp-float-type
mwheel term/x-win x-win term/common-win x-dnd tool-bar dnd fontset image
regexp-opt fringe tabulated-list replace newcomment text-mode elisp-mode
lisp-mode prog-mode register page tab-bar menu-bar rfn-eshadow isearch
timer select scroll-bar mouse jit-lock font-lock syntax facemenu
font-core term/tty-colors frame minibuffer cl-generic cham georgian
utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean
japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european
ethiopic indian cyrillic chinese composite charscript charprop
case-table epa-hook jka-cmpr-hook help simple abbrev obarray
cl-preloaded nadvice loaddefs button faces cus-face macroexp files
text-properties overlay sha1 md5 base64 format env code-pages mule
custom widget hashtable-print-readable backquote threads dbusbind
inotify lcms2 dynamic-setting system-font-setting font-render-setting
cairo move-toolbar gtk x-toolkit x multi-tty make-network-process emacs)

Memory information:
((conses 16 46301 9196)
 (symbols 48 6004 1)
 (strings 32 15750 1765)
 (string-bytes 1 515528)
 (vectors 16 10212)
 (vector-slots 8 133109 13846)
 (floats 8 21 45)
 (intervals 56 310 11)
 (buffers 1000 12))








In GNU Emacs 26.3 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.24.20)
 of 2020-05-19 built on felixonmars2
Windowing system distributor 'The X.Org Foundation', version 11.0.12009000
Recent messages:
For information about GNU Emacs and the GNU system, type C-h C-a.
GNU Emacs 26.3 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.24.20) of
2020-05-19
Mark set [2 times]
previous-line: Beginning of buffer [3 times]
Quit
Configured using:
 'configure --prefix=/usr --sysconfdir=/etc --libexecdir=/usr/lib
 --localstatedir=/var --with-x-toolkit=gtk3 --with-xft --with-wide-int
 --with-modules 'CFLAGS=-march=x86-64 -mtune=generic -O2 -pipe -fno-plt'
 CPPFLAGS=-D_FORTIFY_SOURCE=2
 LDFLAGS=-Wl,-O1,--sort-common,--as-needed,-z,relro,-z,now'

Configured features:
XPM JPEG TIFF GIF PNG RSVG IMAGEMAGICK SOUND GPM DBUS GSETTINGS GLIB
NOTIFY ACL GNUTLS LIBXML2 FREETYPE M17N_FLT LIBOTF XFT ZLIB
TOOLKIT_SCROLL_BARS GTK3 X11 XDBE XIM MODULES THREADS LIBSYSTEMD LCMS2

Important settings:
  value of $LC_TIME: sr_RS.UTF-8
  value of $LANG: en_US.UTF-8
  locale-coding-system: utf-8-unix

Major mode: Lisp Interaction

Minor modes in effect:
  tooltip-mode: t
  global-eldoc-mode: t
  eldoc-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  line-number-mode: t
  transient-mark-mode: t

Load-path shadows:
None found.

Features:
(shadow sort mail-extr emacsbug message rmc puny seq byte-opt gv
bytecomp byte-compile cconv cl-loaddefs cl-lib dired dired-loaddefs
format-spec rfc822 mml easymenu mml-sec password-cache epa derived epg
epg-config gnus-util rmail rmail-loaddefs mm-decode mm-bodies mm-encode
mail-parse rfc2231 mailabbrev gmm-utils mailheader sendmail rfc2047
rfc2045 ietf-drums mm-util mail-prsvr mail-utils elec-pair time-date
mule-util tooltip eldoc electric uniquify ediff-hook vc-hooks
lisp-float-type mwheel term/x-win x-win term/common-win x-dnd tool-bar
dnd fontset image regexp-opt fringe tabulated-list replace newcomment
text-mode elisp-mode lisp-mode prog-mode register page menu-bar
rfn-eshadow isearch timer select scroll-bar mouse jit-lock font-lock
syntax facemenu font-core term/tty-colors frame cl-generic cham georgian
utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean
japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european
ethiopic indian cyrillic chinese composite charscript charprop
case-table epa-hook jka-cmpr-hook help simple abbrev obarray minibuffer
cl-preloaded nadvice loaddefs button faces cus-face macroexp files
text-properties overlay sha1 md5 base64 format env code-pages mule
custom widget hashtable-print-readable backquote threads dbusbind
inotify lcms2 dynamic-setting system-font-setting font-render-setting
move-toolbar gtk x-toolkit x multi-tty make-network-process emacs)

Memory information:
((conses 16 95190 5384)
 (symbols 48 20385 1)
 (miscs 40 59 118)
 (strings 32 28709 989)
 (string-bytes 1 751949)
 (vectors 16 13954)
 (vector-slots 8 502510 11290)
 (floats 8 50 104)
 (intervals 56 224 0)
 (buffers 992 11))



Best regards.

P.S.
Eli, Sorry for the second message.

нед, 13. сеп 2020. у 17:08 Eli Zaretskii <eliz@gnu.org> је написао/ла:

> > From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> > Date: Sat, 12 Sep 2020 20:57:17 +0200
> >
> > Expected behavior:
> > When a single line comment that is wrapped gets selected (or when cursor
> is positioned on that line) text
> > color should be the one defined with the emacs color theme.
> >
> > Detected behavior:
> > Instead of expected behavior text is colored partially as a comment and
> partially as a regular text.
>
> This is very strange.  I cannot reproduce this on my system, so the
> reason is somehow specific to what you have there.
>
> You didn't show the details collected by report-emacs-bug, so it's
> hard to make educated guesses regarding the most probable reasons.
> Therefore, what's below are stabs in the dark:
>
>  . does it help to disable double-buffering?
>  . if this is a Cairo build, can you try --without-cairo?
>  . if you have some advanced optimization features of your system's
>    display software turned on, try turning them off
>
> Also, what was the Emacs version before the upgrade to 27.1?
>
> Thanks.
>

[-- Attachment #2: Type: text/html, Size: 9890 bytes --]

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> Date: Mon, 14 Sep 2020 15:20:26 +0200
> Cc: 43363@debbugs.gnu.org
> 
> Also, I'm not sure if replying to you in this manner (directly through email) is good practice or not... sorry if it's
> not.

That's exactly what we expect and ask for.  Just remember to have the
bug address on the CC line, so that this whole discussion is recorded
by our bug tracker.

> Unfortunately, even emacs running without cairo doesn't help. The issue remains. The same goes for
> harfbuzz.
> As for double-buffering, wasn't it removed in emacs v25... so I'm not sure how/what to disable here?

Double buffering was added in Emacs 26, and the way to disable it is
explained in NEWS of that version (NEWS.26 if you have the Emacs 27.1
sources):

  ** Emacs now uses double buffering to reduce flicker when editing and
  resizing graphical Emacs frames on the X Window System.  This support
  requires the DOUBLE-BUFFER extension, which major X servers have
  supported for many years.  If your system has this extension, but an
  Emacs built with double buffering misbehaves on some displays you use,
  you can disable the feature by adding

    '(inhibit-double-buffering . t)

  to default-frame-alist.  Or inject this parameter into the selected
  frame by evaluating this form:

    (modify-frame-parameters nil '((inhibit-double-buffering . t)))

Please try this.

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Драгољуб Шишовић]

[-- Attachment #1: Type: text/plain, Size: 333 bytes --]

Sadly, it didn't help.

I've disabled double buffering like you've said, but the bug remained.
Then I've tried again to run emacs without cairo and harfbuzz and with
disabled double buffering the issue remained.

I have also tried to run "emacs -nw" and "emacs -nw -Q" with all
aforementioned setup, sadly the same problem occurred.

[-- Attachment #2: Type: text/html, Size: 491 bytes --]

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> Date: Mon, 14 Sep 2020 21:37:57 +0200
> Cc: 43363@debbugs.gnu.org
> 
> Sadly, it didn't help.
> 
> I've disabled double buffering like you've said, but the bug remained.
> Then I've tried again to run emacs without cairo and harfbuzz and with disabled double buffering the issue
> remained.
> 
> I have also tried to run "emacs -nw" and "emacs -nw -Q" with all aforementioned setup, sadly the same
> problem occurred.

Then it must be something other than Emacs.  Perhaps Emacs 26.3 was
linked against different versions of system libraries or something?

What you show is some sort of lag between the drawing by Emacs and the
stuff actually appearing on glass.  It is hard for me to believe
something like that is due to some Emacs problem, as Emacs doesn't
distinguish between the characters it draws.  Also, no one has
reported this before.

What other characters except Cyrillic ones trigger this problem?

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Драгољуб Шишовић]

[-- Attachment #1: Type: text/plain, Size: 998 bytes --]

I haven't seen this problem with any other characters, only when commenting
with Cyrillic letters and with word wrapping.

Not sure if this can help in tracking down the cause of the problem, but
I've tested emacs 27.1 on a different computer and I've managed to
replicate the issue. However, it had a clean Manjaro install (which is Arch
based distro, and I assume they use pretty much the same libraries). Also,
I've tried a number of other distros in VirtualBox (Fedora, Kubuntu...) and
I've managed to replicate the exact problem on each and single one of those
virtual machines.

When I downgraded to emacs 26, to test the issue, I was using the same
system libraries like with emacs 27. And, as I understand, the only
difference is with cairo, harfbuzz (emacs 27) and libmagick6 (emacs 26).
Also, I have experimented with different GTK settings, with font
antialiasing, hinting, sub-pixel geometry, but nothing helps. The issue
manifests even without X11 started, in plain command line mode.

[-- Attachment #2: Type: text/html, Size: 1076 bytes --]

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> Date: Tue, 15 Sep 2020 14:37:18 +0200
> Cc: 43363@debbugs.gnu.org
> 
> I haven't seen this problem with any other characters, only when commenting with Cyrillic letters and with
> word wrapping.
> 
> Not sure if this can help in tracking down the cause of the problem, but I've tested emacs 27.1 on a different
> computer and I've managed to replicate the issue. However, it had a clean Manjaro install (which is Arch
> based distro, and I assume they use pretty much the same libraries). Also, I've tried a number of other
> distros in VirtualBox (Fedora, Kubuntu...) and I've managed to replicate the exact problem on each and single
> one of those virtual machines.
> 
> When I downgraded to emacs 26, to test the issue, I was using the same system libraries like with emacs
> 27. And, as I understand, the only difference is with cairo, harfbuzz (emacs 27) and libmagick6 (emacs 26).
> Also, I have experimented with different GTK settings, with font antialiasing, hinting, sub-pixel geometry, but
> nothing helps. The issue manifests even without X11 started, in plain command line mode.

Well, someone who can reproduce the issue will have to debug it.  I
cannot reproduce this, so I cannot debug it.

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Alan Third]

On Tue, Sep 15, 2020 at 05:46:03PM +0300, Eli Zaretskii wrote:
> > From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> > Date: Tue, 15 Sep 2020 14:37:18 +0200
> > Cc: 43363@debbugs.gnu.org
> > 
> > I haven't seen this problem with any other characters, only when commenting with Cyrillic letters and with
> > word wrapping.
> > 
> > Not sure if this can help in tracking down the cause of the problem, but I've tested emacs 27.1 on a different
> > computer and I've managed to replicate the issue. However, it had a clean Manjaro install (which is Arch
> > based distro, and I assume they use pretty much the same libraries). Also, I've tried a number of other
> > distros in VirtualBox (Fedora, Kubuntu...) and I've managed to replicate the exact problem on each and single
> > one of those virtual machines.
> > 
> > When I downgraded to emacs 26, to test the issue, I was using the same system libraries like with emacs
> > 27. And, as I understand, the only difference is with cairo, harfbuzz (emacs 27) and libmagick6 (emacs 26).
> > Also, I have experimented with different GTK settings, with font antialiasing, hinting, sub-pixel geometry, but
> > nothing helps. The issue manifests even without X11 started, in plain command line mode.
> 
> Well, someone who can reproduce the issue will have to debug it.  I
> cannot reproduce this, so I cannot debug it.

I can reproduce it only with frame-resize-pixelwise set to t and the
frame not being an exact number of characters wide.

But I don't see how that situation could happen in a Linux terminal!
-- 
Alan Third

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> Date: Mon, 5 Oct 2020 00:08:10 +0100
> From: Alan Third <alan@idiocy.org>
> Cc: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>,
> 	43363@debbugs.gnu.org
> 
> I can reproduce it only with frame-resize-pixelwise set to t and the
> frame not being an exact number of characters wide.

You are right.  After playing with "C-x C-+" a bit, I can see this as
well.

Very strange bug.

Observation #1: It is not some simple redisplay glitch, as "M-x
redraw-display" doesn't fix the problem.  Looks like the region face
and the text face aren't merged properly for some reason.

Observation #2: It doesn't happen only with Cyrillic characters, of
course, it seems to happen with any non-ASCII non-Latin characters.

Observation #3: It never happens in the initial portion of a continued
line, only in the continuation lines.

Hmm...

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> Date: Mon, 05 Oct 2020 11:20:42 +0300
> From: Eli Zaretskii <eliz@gnu.org>
> Cc: 43363@debbugs.gnu.org, dragoljub.sisovic@gmail.com
> 
> Observation #1: It is not some simple redisplay glitch, as "M-x
> redraw-display" doesn't fix the problem.  Looks like the region face
> and the text face aren't merged properly for some reason.
> 
> Observation #2: It doesn't happen only with Cyrillic characters, of
> course, it seems to happen with any non-ASCII non-Latin characters.
> 
> Observation #3: It never happens in the initial portion of a continued
> line, only in the continuation lines.
> 
> Hmm...

Should be fixed now on the emacs-27 branch.

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Alan Third]

On Mon, Oct 05, 2020 at 12:36:30PM +0300, Eli Zaretskii wrote:
> > Date: Mon, 05 Oct 2020 11:20:42 +0300
> > From: Eli Zaretskii <eliz@gnu.org>
> > Cc: 43363@debbugs.gnu.org, dragoljub.sisovic@gmail.com
> > 
> > Observation #1: It is not some simple redisplay glitch, as "M-x
> > redraw-display" doesn't fix the problem.  Looks like the region face
> > and the text face aren't merged properly for some reason.
> > 
> > Observation #2: It doesn't happen only with Cyrillic characters, of
> > course, it seems to happen with any non-ASCII non-Latin characters.
> > 
> > Observation #3: It never happens in the initial portion of a continued
> > line, only in the continuation lines.
> > 
> > Hmm...
> 
> Should be fixed now on the emacs-27 branch.

It's fixed for me now.
-- 
Alan Third

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> Date: Mon, 5 Oct 2020 20:50:22 +0100
> From: Alan Third <alan@idiocy.org>
> Cc: 43363@debbugs.gnu.org, dragoljub.sisovic@gmail.com
> 
> > Should be fixed now on the emacs-27 branch.
> 
> It's fixed for me now.

Thanks for testing, I'm therefore closing this bug.

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Драгољуб Шишовић]

[-- Attachment #1: Type: text/plain, Size: 467 bytes --]

Unfortunately, I still have the bug even after using the fixed emacs-27
branch.

уто, 6. окт 2020. у 08:21 Eli Zaretskii <eliz@gnu.org> је написао/ла:

> > Date: Mon, 5 Oct 2020 20:50:22 +0100
> > From: Alan Third <alan@idiocy.org>
> > Cc: 43363@debbugs.gnu.org, dragoljub.sisovic@gmail.com
> >
> > > Should be fixed now on the emacs-27 branch.
> >
> > It's fixed for me now.
>
> Thanks for testing, I'm therefore closing this bug.
>

[-- Attachment #2: Type: text/html, Size: 969 bytes --]

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> Date: Tue, 6 Oct 2020 10:13:13 +0200
> Cc: Alan Third <alan@idiocy.org>, 43363-done@debbugs.gnu.org
> 
> Unfortunately, I still have the bug even after using the fixed emacs-27 branch. 

Are you sure you've rebuilt Emacs completely?

In any case, I will need a detailed recipe that reproduces the
problem, because I'm no longer able to reproduce it after the change.

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Драгољуб Шишовић]

[-- Attachment #1: Type: text/plain, Size: 4072 bytes --]

Hopefully I'm doing something wrong here.

I'm not sure what do you mean by "rebuilt Emacs completely", I've
downloaded
https://git.savannah.gnu.org/cgit/emacs.git/snapshot/emacs-acc9b461538d65190cd88f87fd997f733f382ad9.tar.gz
and used it to build Emacs.
I've even tried to use it without cairo.

Also, I'm not sure what do you mean by "recipe", but the way to reproduce
the error for me is the same like it was... and with this new build I get
these details collected


In GNU Emacs 27.1 (build 3, x86_64-pc-linux-gnu, GTK+ Version 3.24.23)
 of 2020-10-06 built on delpas
Windowing system distributor 'The X.Org Foundation', version 11.0.12009000
System Description: Arch Linux

Recent messages:
user-error: No further undo information
C-x M-x is undefined
Quit [2 times]
Making completion list...
Quit [2 times]
Making completion list...
You can run the command ‘kill-buffer’ with C-x k
Making completion list...

Configured using:
 'configure --prefix=/usr --sysconfdir=/etc --libexecdir=/usr/lib
 --localstatedir=/var --with-x-toolkit=gtk3 --with-xft --with-modules
 --without-cairo 'CFLAGS=-march=x86-64 -mtune=generic -O2 -pipe
 -fno-plt' CPPFLAGS=-D_FORTIFY_SOURCE=2
 LDFLAGS=-Wl,-O1,--sort-common,--as-needed,-z,relro,-z,now'

Configured features:
XPM JPEG TIFF GIF PNG RSVG SOUND GPM DBUS GSETTINGS GLIB NOTIFY INOTIFY
ACL GNUTLS LIBXML2 FREETYPE HARFBUZZ M17N_FLT LIBOTF XFT ZLIB
TOOLKIT_SCROLL_BARS GTK3 X11 XDBE XIM MODULES THREADS LIBSYSTEMD JSON
PDUMPER LCMS2 GMP

Important settings:
  value of $LC_TIME: sr_RS.UTF-8
  value of $LANG: en_US.UTF-8
  locale-coding-system: utf-8-unix

Major mode: Lisp Interaction

Minor modes in effect:
  tooltip-mode: t
  global-eldoc-mode: t
  eldoc-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  line-number-mode: t
  visual-line-mode: t
  transient-mark-mode: t

Load-path shadows:
None found.

Features:
(help-mode pp shadow sort mail-extr emacsbug message rmc puny dired
dired-loaddefs format-spec rfc822 mml easymenu mml-sec password-cache
epa derived epg epg-config gnus-util rmail rmail-loaddefs
text-property-search time-date subr-x seq byte-opt gv bytecomp
byte-compile cconv mm-decode mm-bodies mm-encode mail-parse rfc2231
mailabbrev gmm-utils mailheader cl-loaddefs cl-lib sendmail rfc2047
rfc2045 ietf-drums mm-util mail-prsvr mail-utils tooltip eldoc electric
uniquify ediff-hook vc-hooks lisp-float-type mwheel term/x-win x-win
term/common-win x-dnd tool-bar dnd fontset image regexp-opt fringe
tabulated-list replace newcomment text-mode elisp-mode lisp-mode
prog-mode register page tab-bar menu-bar rfn-eshadow isearch timer
select scroll-bar mouse jit-lock font-lock syntax facemenu font-core
term/tty-colors frame minibuffer cl-generic cham georgian utf-8-lang
misc-lang vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms
cp51932 hebrew greek romanian slovak czech european ethiopic indian
cyrillic chinese composite charscript charprop case-table epa-hook
jka-cmpr-hook help simple abbrev obarray cl-preloaded nadvice loaddefs
button faces cus-face macroexp files text-properties overlay sha1 md5
base64 format env code-pages mule custom widget hashtable-print-readable
backquote threads dbusbind inotify lcms2 dynamic-setting
system-font-setting font-render-setting move-toolbar gtk x-toolkit x
multi-tty make-network-process emacs)

Memory information:
((conses 16 48012 9439)
 (symbols 48 6106 1)
 (strings 32 16061 1764)
 (string-bytes 1 523665)
 (vectors 16 11050)
 (vector-slots 8 140150 12926)
 (floats 8 22 32)
 (intervals 56 268 1)
 (buffers 1000 13))

> Are you sure you've rebuilt Emacs completely?
>
> In any case, I will need a detailed recipe that reproduces the
> problem, because I'm no longer able to reproduce it after the change.
>

[-- Attachment #2: Type: text/html, Size: 4775 bytes --]

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> Date: Tue, 6 Oct 2020 10:48:21 +0200
> Cc: alan@idiocy.org, 43363-done@debbugs.gnu.org
> 
> I'm not sure what do you mean by "rebuilt Emacs completely", I've downloaded
> https://git.savannah.gnu.org/cgit/emacs.git/snapshot/emacs-acc9b461538d65190cd88f87fd997f733f382ad9.tar.gz
> and used it to build Emacs.
> I've even tried to use it without cairo.

And you are sure you are invoking the src/emacs binary produced by
that build?

I'm sorry to ask these obvious questions: it's just that I cannot
understand how the fix could possibly NOT work for you.

> Also, I'm not sure what do you mean by "recipe", but the way to reproduce the error for me is the same like it
> was... and with this new build I get these details collected
> 
> In GNU Emacs 27.1 (build 3, x86_64-pc-linux-gnu, GTK+ Version 3.24.23)
>  of 2020-10-06 built on delpas

The version should be 27.1.50, not 27.1.  Could it be that you are
running the original 27.1 binary, not the one built in the src/
directory of the snapshot you unpacked?  Can you describe the steps
you used to build Emacs after downloading the snapshot tarball?

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Драгољуб Шишовић]

[-- Attachment #1: Type: text/plain, Size: 783 bytes --]

>
> And you are sure you are invoking the src/emacs binary produced by
> that build?
>
> I'm sorry to ask these obvious questions: it's just that I cannot
> understand how the fix could possibly NOT work for you.
>
> The version should be 27.1.50, not 27.1.  Could it be that you are
> running the original 27.1 binary, not the one built in the src/
> directory of the snapshot you unpacked?  Can you describe the steps
> you used to build Emacs after downloading the snapshot tarball?
>

Please, don't be sorry, I am new to this so I'm probably doing something
wrong...

I've uninstalled my current emacs with pacman -Rns
Then I downloaded the tarball, unpacked it, used the PKGBUILD from emacs
version 27.1, I ran makepkg, and then I've used "pacman -U emacs-27..." to
install it.

[-- Attachment #2: Type: text/html, Size: 1066 bytes --]

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> Date: Tue, 6 Oct 2020 11:25:41 +0200
> Cc: alan@idiocy.org, 43363-done@debbugs.gnu.org
> 
> I've uninstalled my current emacs with pacman -Rns
> Then I downloaded the tarball, unpacked it, used the PKGBUILD from emacs version 27.1, I ran makepkg,
> and then I've used "pacman -U emacs-27..." to install it. 

I'm not familiar with pacman enough to understand what this did.

In the directory tree where you unpacked the tarball, please look in
the src/ subdirectory -- is there a binary file called
'emacs-27.1.50.1' there?  If so, please run that binary and see if the
problem persists.

The there's no src/emacs-27.1.50.1 where you unpacked the tarball,
please show the full contents of the PKGBUILD and makepkg scripts you
used.

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Драгољуб Шишовић]

[-- Attachment #1: Type: text/plain, Size: 1198 bytes --]

I couldn't find src/emacs-27.1.50.1, only 27.1
makepkg script I've used is https://wiki.archlinux.org/index.php/Makepkg
And the PKGBUILD I've used is
https://raw.githubusercontent.com/archlinux/svntogit-packages/packages/emacs/trunk/PKGBUILD

уто, 6. окт 2020. у 11:29 Eli Zaretskii <eliz@gnu.org> је написао/ла:

> > From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> > Date: Tue, 6 Oct 2020 11:25:41 +0200
> > Cc: alan@idiocy.org, 43363-done@debbugs.gnu.org
> >
> > I've uninstalled my current emacs with pacman -Rns
> > Then I downloaded the tarball, unpacked it, used the PKGBUILD from emacs
> version 27.1, I ran makepkg,
> > and then I've used "pacman -U emacs-27..." to install it.
>
> I'm not familiar with pacman enough to understand what this did.
>
> In the directory tree where you unpacked the tarball, please look in
> the src/ subdirectory -- is there a binary file called
> 'emacs-27.1.50.1' there?  If so, please run that binary and see if the
> problem persists.
>
> The there's no src/emacs-27.1.50.1 where you unpacked the tarball,
> please show the full contents of the PKGBUILD and makepkg scripts you
> used.
>

[-- Attachment #2: Type: text/html, Size: 1940 bytes --]

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> Date: Tue, 6 Oct 2020 11:48:49 +0200
> Cc: alan@idiocy.org, 43363@debbugs.gnu.org
> 
> I couldn't find src/emacs-27.1.50.1, only 27.1

Is src/emacs-27.1 a file or a directory?  If it's a directory, what is
in it?

Thanks.

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Драгољуб Шишовић]

[-- Attachment #1: Type: text/plain, Size: 578 bytes --]

Sorry for the delayed answer.
It's a directory, I've uploaded a view of it's tree here
https://drive.google.com/file/d/1QlAMTYZrQBfjWy19qI879eCkCydqhgcj/view

уто, 6. окт 2020. у 12:00 Eli Zaretskii <eliz@gnu.org> је написао/ла:

> > From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> > Date: Tue, 6 Oct 2020 11:48:49 +0200
> > Cc: alan@idiocy.org, 43363@debbugs.gnu.org
> >
> > I couldn't find src/emacs-27.1.50.1, only 27.1
>
> Is src/emacs-27.1 a file or a directory?  If it's a directory, what is
> in it?
>
> Thanks.
>

[-- Attachment #2: Type: text/html, Size: 1194 bytes --]

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> Date: Tue, 6 Oct 2020 13:31:11 +0200
> Cc: Alan Third <alan@idiocy.org>, 43363@debbugs.gnu.org
> 
> It's a directory, I've uploaded a view of it's tree here
> https://drive.google.com/file/d/1QlAMTYZrQBfjWy19qI879eCkCydqhgcj/view

There's a file src/emacs-27.1.4 there.  If you run it like this:


  ./src/emacs-27.1/src/emacs-27.1.4 -Q

does it exhibit the problem with region highlighting as you reported
originally?  (The above command assumes that you type that at the
shell prompt with the top-level directory of the unpacked snapshot
tarball being your working directory.)

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Драгољуб Шишовић]

[-- Attachment #1: Type: text/plain, Size: 1030 bytes --]

Yes. The problem is still there.
I've tried to purge the emacs in full from my system, with all of its files
and dependencies and install it again from
https://git.savannah.gnu.org/cgit/emacs.git/snapshot/emacs-acc9b461538d65190cd88f87fd997f733f382ad9.tar.gz

However, nothing changed.

Suggestion:
Considering that
https://git.savannah.gnu.org/cgit/emacs.git/commit/?h=emacs-27&id=acc9b461538d65190cd88f87fd997f733f382ad9
fixed the bug for both you and Alan, I think I must be doing something
wrong here.
Also you've been too kind to help me, so I'd hate to take up more of your
time with something that probably isn't related to this bug, but with my
build process.
So I'd like to suggest that you close this bug and mark it as solved. I
will wait for the official update with this patch to reach the Arch
repository. That way my build process won't affect anything. And if the bug
still manifests after that, I'd like to be bold and reopen the bug, if
possible. Would that be ok?

Thank you so much for your patience and help.

[-- Attachment #2: Type: text/html, Size: 1457 bytes --]

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> Date: Tue, 6 Oct 2020 14:59:27 +0200
> Cc: Alan Third <alan@idiocy.org>, 43363@debbugs.gnu.org
> 
> Yes. The problem is still there.
> I've tried to purge the emacs in full from my system, with all of its files and dependencies and install it again
> from
> https://git.savannah.gnu.org/cgit/emacs.git/snapshot/emacs-acc9b461538d65190cd88f87fd997f733f382ad9.tar.gz
> 
> However, nothing changed.

Last question: does the file src/emacs-27.1/src/xdisp.c in the tree
where you unpacked the snapshot have this line on or around line
number 21811:

  const int orig_face_id = it->face_id;

> Suggestion:
> Considering that
> https://git.savannah.gnu.org/cgit/emacs.git/commit/?h=emacs-27&id=acc9b461538d65190cd88f87fd997f733f382ad9
> fixed the bug for both you and Alan, I think I must be doing something wrong here. 
> Also you've been too kind to help me, so I'd hate to take up more of your time with something that probably
> isn't related to this bug, but with my build process.
> So I'd like to suggest that you close this bug and mark it as solved. I will wait for the official update with this
> patch to reach the Arch repository. That way my build process won't affect anything. And if the bug still
> manifests after that, I'd like to be bold and reopen the bug, if possible. Would that be ok?

The bug is already closed, thanks.  Yes, if the bug is still present
in the official update, by all means please reopen the bug report.

> Thank you so much for your patience and help. 

Thank you for your efforts and perseverance.

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Драгољуб Шишовић]

[-- Attachment #1: Type: text/plain, Size: 416 bytes --]

> Last question: does the file src/emacs-27.1/src/xdisp.c in the tree
> where you unpacked the snapshot have this line on or around line
> number 21811:
>
>   const int orig_face_id = it->face_id;
>

YES! That was it.
I made a major error during my build process and nothing was patched.
When I correctly patched my emacs the bug was gone!!!
The bug is fixed!

Thank you very, very much for everything!
Best wishes.

[-- Attachment #2: Type: text/html, Size: 721 bytes --]

bug#43363: 27.1; Wrapped comment line that contains cyrillic text is displayed in different colors

[Eli Zaretskii]

> From: Драгољуб Шишовић <dragoljub.sisovic@gmail.com>
> Date: Tue, 6 Oct 2020 17:59:45 +0200
> Cc: Alan Third <alan@idiocy.org>, 43363@debbugs.gnu.org
> 
>  Last question: does the file src/emacs-27.1/src/xdisp.c in the tree
>  where you unpacked the snapshot have this line on or around line
>  number 21811:
> 
>    const int orig_face_id = it->face_id;
> 
> YES! That was it.
> I made a major error during my build process and nothing was patched.
> When I correctly patched my emacs the bug was gone!!!
> The bug is fixed!
> 
> Thank you very, very much for everything!

Great, thanks for telling us.