bug#60247: 28.2; incorrect highlighting in HTML+ mode

bug#60247: 28.2; incorrect highlighting in HTML+ mode

[Vincent Lefevre]

[-- Attachment #1: Type: text/plain, Size: 5311 bytes --]

On the attached HTML file (beginning of a HTML file from Wikipedia),
highlighting is incorrect.

1. Open file.html with "emacs -Q file.html".
2. Go to the end of the file.

In the paragraph starting with

<p>The first version of unums, formally known as Type I unum, was introduced in Gustafson's book <i>The End of Error</i> as a superset

everything from "'s book" is highlighted in a different color.

Removing some parts before this paragraph makes the highlighting correct.

In GNU Emacs 28.2 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.24.35, cairo version 1.16.0)
 of 2022-12-20, modified by Debian built on x86-csail-01
Windowing system distributor 'The X.Org Foundation', version 11.0.12101005
System Description: Debian GNU/Linux bookworm/sid

Configured using:
 'configure --build x86_64-linux-gnu --prefix=/usr
 --sharedstatedir=/var/lib --libexecdir=/usr/libexec
 --localstatedir=/var/lib --infodir=/usr/share/info
 --mandir=/usr/share/man --with-libsystemd --with-pop=yes
 --enable-locallisppath=/etc/emacs:/usr/local/share/emacs/28.2/site-lisp:/usr/local/share/emacs/site-lisp:/usr/share/emacs/28.2/site-lisp:/usr/share/emacs/site-lisp
 --with-sound=alsa --without-gconf --with-mailutils
 --with-native-compilation --build x86_64-linux-gnu --prefix=/usr
 --sharedstatedir=/var/lib --libexecdir=/usr/libexec
 --localstatedir=/var/lib --infodir=/usr/share/info
 --mandir=/usr/share/man --with-libsystemd --with-pop=yes
 --enable-locallisppath=/etc/emacs:/usr/local/share/emacs/28.2/site-lisp:/usr/local/share/emacs/site-lisp:/usr/share/emacs/28.2/site-lisp:/usr/share/emacs/site-lisp
 --with-sound=alsa --without-gconf --with-mailutils
 --with-native-compilation --with-cairo --with-x=yes
 --with-x-toolkit=gtk3 --with-toolkit-scroll-bars 'CFLAGS=-g -O2
 -ffile-prefix-map=/build/emacs-OltuXQ/emacs-28.2+1=. -fstack-protector-strong
 -Wformat -Werror=format-security -Wall' 'CPPFLAGS=-Wdate-time
 -D_FORTIFY_SOURCE=2' LDFLAGS=-Wl,-z,relro'

Configured features:
ACL CAIRO DBUS FREETYPE GIF GLIB GMP GNUTLS GPM GSETTINGS HARFBUZZ JPEG
JSON LCMS2 LIBOTF LIBSELINUX LIBSYSTEMD LIBXML2 M17N_FLT MODULES
NATIVE_COMP NOTIFY INOTIFY PDUMPER PNG RSVG SECCOMP SOUND THREADS TIFF
TOOLKIT_SCROLL_BARS X11 XDBE XIM XPM GTK3 ZLIB

Important settings:
  value of $LC_COLLATE: POSIX
  value of $LC_CTYPE: C.UTF-8
  value of $LC_TIME: en_DK.utf8
  value of $LANG: POSIX
  locale-coding-system: utf-8-unix

Major mode: HTML+

Minor modes in effect:
  tooltip-mode: t
  global-eldoc-mode: t
  show-paren-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  line-number-mode: t
  indent-tabs-mode: t
  transient-mark-mode: t

Load-path shadows:
None found.

Features:
(shadow sort mail-extr emacsbug message rmc dired dired-loaddefs rfc822
mml mml-sec epa derived epg rfc6068 epg-config mm-decode mm-bodies
mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader comp
comp-cstr warnings rx cl-extra help-mode sendmail vc-dispatcher vc-svn
mhtml-mode css-mode smie eww xdg url-queue thingatpt shr kinsoku svg xml
browse-url url url-proxy url-privacy url-expand url-methods url-history
url-cookie url-domsuf url-util url-parse url-vars mailcap puny mm-url
gnus nnheader gnus-util rmail rmail-loaddefs auth-source cl-seq eieio
eieio-core cl-macs eieio-loaddefs password-cache rfc2047 rfc2045
ietf-drums text-property-search time-date mail-utils wid-edit mm-util
mail-prsvr color js json subr-x map imenu cc-mode cc-fonts cc-guess
cc-menus cc-cmds cc-styles cc-align cc-engine cc-vars cc-defs sgml-mode
facemenu seq byte-opt gv bytecomp byte-compile cconv dom cl-loaddefs
cl-lib iso-transl tooltip eldoc paren electric uniquify ediff-hook
vc-hooks lisp-float-type elisp-mode mwheel term/x-win x-win
term/common-win x-dnd tool-bar dnd fontset image regexp-opt fringe
tabulated-list replace newcomment text-mode lisp-mode prog-mode register
page tab-bar menu-bar rfn-eshadow isearch easymenu timer select
scroll-bar mouse jit-lock font-lock syntax font-core term/tty-colors
frame minibuffer cl-generic cham georgian utf-8-lang misc-lang
vietnamese tibetan thai tai-viet lao korean japanese eucjp-ms cp51932
hebrew greek romanian slovak czech european ethiopic indian cyrillic
chinese composite emoji-zwj charscript charprop case-table epa-hook
jka-cmpr-hook help simple abbrev obarray cl-preloaded nadvice button
loaddefs faces cus-face macroexp files window text-properties overlay
sha1 md5 base64 format env code-pages mule custom widget
hashtable-print-readable backquote threads dbusbind inotify lcms2
dynamic-setting system-font-setting font-render-setting cairo
move-toolbar gtk x-toolkit x multi-tty make-network-process
native-compile emacs)

Memory information:
((conses 16 174174 7508)
 (symbols 48 13325 1)
 (strings 32 44000 4391)
 (string-bytes 1 1500729)
 (vectors 16 25673)
 (vector-slots 8 485132 25960)
 (floats 8 140 28)
 (intervals 56 710 0)
 (buffers 992 12))

-- 
Vincent Lefèvre <vincent@vinc17.net> - Web: <https://www.vinc17.net/>
100% accessible validated (X)HTML - Blog: <https://www.vinc17.net/blog/>
Work: CR INRIA - computer arithmetic / AriC project (LIP, ENS-Lyon)

[-- Attachment #2: file.html --]
[-- Type: text/html, Size: 14345 bytes --]

bug#60247: 28.2; incorrect highlighting in HTML+ mode

[Eli Zaretskii]

> Date: Thu, 22 Dec 2022 02:51:32 +0100
> From: Vincent Lefevre <vincent@vinc17.net>
> 
> 1. Open file.html with "emacs -Q file.html".
> 2. Go to the end of the file.
> 
> In the paragraph starting with
> 
> <p>The first version of unums, formally known as Type I unum, was introduced in Gustafson's book <i>The End of Error</i> as a superset
> 
> everything from "'s book" is highlighted in a different color.

HTML Mode evidently considers what follows the apostrophe to be a
string.  Replacing the literal apostrophe with &#39; fixes the
display.

bug#60247: 28.2; incorrect highlighting in HTML+ mode

[Vincent Lefevre]

On 2022-12-22 09:47:43 +0200, Eli Zaretskii wrote:
> > Date: Thu, 22 Dec 2022 02:51:32 +0100
> > From: Vincent Lefevre <vincent@vinc17.net>
> > 
> > 1. Open file.html with "emacs -Q file.html".
> > 2. Go to the end of the file.
> > 
> > In the paragraph starting with
> > 
> > <p>The first version of unums, formally known as Type I unum, was introduced in Gustafson's book <i>The End of Error</i> as a superset
> > 
> > everything from "'s book" is highlighted in a different color.
> 
> HTML Mode evidently considers what follows the apostrophe to be a
> string.  Replacing the literal apostrophe with &#39; fixes the
> display.

Perhaps, but HTML mode's behavior is surprisingly inconsistent:
on a case with some earlier text removed, this behavior no longer
occurs.

-- 
Vincent Lefèvre <vincent@vinc17.net> - Web: <https://www.vinc17.net/>
100% accessible validated (X)HTML - Blog: <https://www.vinc17.net/blog/>
Work: CR INRIA - computer arithmetic / AriC project (LIP, ENS-Lyon)

bug#60247: 28.2; incorrect highlighting in HTML+ mode

[Matthias Meulien]

[-- Attachment #1: Type: text/plain, Size: 937 bytes --]

Eli Zaretskii <eliz@gnu.org> writes:

>> Date: Thu, 22 Dec 2022 02:51:32 +0100
>> From: Vincent Lefevre <vincent@vinc17.net>
>> 
>> 1. Open file.html with "emacs -Q file.html".
>> 2. Go to the end of the file.
>> 
>> In the paragraph starting with
>> 
>> <p>The first version of unums, formally known as Type I unum, was introduced in Gustafson's book <i>The End of Error</i> as a superset
>> 
>> everything from "'s book" is highlighted in a different color.
>
> HTML Mode evidently considers what follows the apostrophe to be a
> string.  Replacing the literal apostrophe with &#39; fixes the
> display.

I confirm Vincent observation:  HTML Mode behavior with quotes is
inconsistent.

Bug still present with 30.0.50 build from commit b9a910a701a.

I reproduced with emacs -Q and the files test.html and test_ko.html
attached to this message.

Note that removing random space charaters in the style element sometime
fix the problem.



[-- Attachment #2: Capture d’écran du 2023-07-23 09-47-12.png --]
[-- Type: image/png, Size: 125618 bytes --]

[-- Attachment #3: test.html --]
[-- Type: text/html, Size: 1414 bytes --]

[-- Attachment #4: test_ko.html --]
[-- Type: text/html, Size: 1612 bytes --]

bug#60247: 28.2; incorrect highlighting in HTML+ mode

[Matthias Meulien]

Matthias Meulien <orontee@gmail.com> writes:

> Eli Zaretskii <eliz@gnu.org> writes:
>
>>> Date: Thu, 22 Dec 2022 02:51:32 +0100
>>> From: Vincent Lefevre <vincent@vinc17.net>
>>> 
>>> 1. Open file.html with "emacs -Q file.html".
>>> 2. Go to the end of the file.
>>> 
>>> In the paragraph starting with
>>> 
>>> <p>The first version of unums, formally known as Type I unum, was introduced in Gustafson's book <i>The End of Error</i> as a superset
>>> 
>>> everything from "'s book" is highlighted in a different color.
>>
>> HTML Mode evidently considers what follows the apostrophe to be a
>> string.  Replacing the literal apostrophe with &#39; fixes the
>> display.
>
> I confirm Vincent observation:  HTML Mode behavior with quotes is
> inconsistent.
>
> Bug still present with 30.0.50 build from commit b9a910a701a.
>
> I reproduced with emacs -Q and the files test.html and test_ko.html
> attached to this message.
>
> Note that removing random space charaters in the style element sometime
> fix the problem.
>
>
>
> Test HTML Mode
>
> This is expected. That's expected too
>
> Test HTML Mode
>
> This is expected. That's expected too

Note that fontification looks good with html-ts-mode.