* bug#40794: 26.3; HTML entities ☆ and ★ (inter alia) are not parsed by libxml-parse-html-region @ 2020-04-23 13:24 Tim Landscheidt 2020-07-29 5:26 ` Lars Ingebrigtsen 0 siblings, 1 reply; 5+ messages in thread From: Tim Landscheidt @ 2020-04-23 13:24 UTC (permalink / raw) To: 40794 (Prologue: This bug showed up in the "ALT" attribute of an "IMG" element of an HTML mail in Gnus. I am reasonably cer- tain that this stems from libxml-parse-html-region and should be fixed there, but there may be more prudent solu- tions.) With GNU Emacs 26.3 on Fedora: | ELISP> (with-temp-buffer | (insert "<!DOCTYPE html> | <html lang=\"en\"> | <head><title>Title</title></head> | <body> | <p>Hello world</p> | <p>ä</p> | <p>☆</p> | <p>★</p> | </body> | </html>") | (libxml-parse-html-region (point-min) (point-max))) | (html | ((lang . "en")) | (head nil | (title nil "Title")) | (body nil "\n " | (p nil "Hello world") | "\n " | (p nil "ä") | "\n " | (p nil "☆") | "\n " | (p nil "★") | "\n")) | ELISP> These should instead yield "ä" (228), "☆" (9734) and "★" (9733). lisp/leim/quail/sgml-input.el seems to contain the necessary data for ☆ and ★ that could probably be fed to libxml. ^ permalink raw reply [flat|nested] 5+ messages in thread
* bug#40794: 26.3; HTML entities ☆ and ★ (inter alia) are not parsed by libxml-parse-html-region 2020-04-23 13:24 bug#40794: 26.3; HTML entities ☆ and ★ (inter alia) are not parsed by libxml-parse-html-region Tim Landscheidt @ 2020-07-29 5:26 ` Lars Ingebrigtsen 2020-07-29 5:35 ` Lars Ingebrigtsen 0 siblings, 1 reply; 5+ messages in thread From: Lars Ingebrigtsen @ 2020-07-29 5:26 UTC (permalink / raw) To: Tim Landscheidt; +Cc: 40794 Tim Landscheidt <tim@tim-landscheidt.de> writes: > (Prologue: This bug showed up in the "ALT" attribute of an > "IMG" element of an HTML mail in Gnus. I am reasonably cer- > tain that this stems from libxml-parse-html-region and > should be fixed there, but there may be more prudent solu- > tions.) [...] > These should instead yield "ä" (228), "☆" (9734) and > "★" (9733). > > lisp/leim/quail/sgml-input.el seems to contain the necessary > data for ☆ and ★ that could probably be fed to > libxml. As far as I can tell, libxml2 doesn't take a list of entities as an input when parsing HTML? I may have missed something... Hm, a bit of googling shows http://xmlsoft.org/html/libxml-entities.html and there is apparently a way to tell libxml2 about further entities? But I think this all sounds more like a libxml2 than an Emacs bug, really? -- (domestic pets only, the antidote for overdose, milk.) bloggy blog: http://lars.ingebrigtsen.no ^ permalink raw reply [flat|nested] 5+ messages in thread
* bug#40794: 26.3; HTML entities ☆ and ★ (inter alia) are not parsed by libxml-parse-html-region 2020-07-29 5:26 ` Lars Ingebrigtsen @ 2020-07-29 5:35 ` Lars Ingebrigtsen 2020-09-09 13:22 ` Stefan Kangas 0 siblings, 1 reply; 5+ messages in thread From: Lars Ingebrigtsen @ 2020-07-29 5:35 UTC (permalink / raw) To: Tim Landscheidt; +Cc: 40794 I had a look at the libxml2 sources. The logic isn't really explained, but apparently they include all the <255-value entities, and then a selected number of the other entities (about 160 of them). I have no idea what the logic behind this is... perhaps they've just forgotten to add the new ones? Which makes me think that this is really a libxml2 bug, and you should report it there instead. Excerpt: /************************************************************************ * * * The list of HTML predefined entities * * * ************************************************************************/ static const htmlEntityDesc html40EntitiesTable[] = { /* * the 4 absolute ones, plus apostrophe. */ { 34, "quot", "quotation mark = APL quote, U+0022 ISOnum" }, { 38, "amp", "ampersand, U+0026 ISOnum" }, { 39, "apos", "single quote" }, { 60, "lt", "less-than sign, U+003C ISOnum" }, { 62, "gt", "greater-than sign, U+003E ISOnum" }, /* * A bunch still in the 128-255 range * Replacing them depend really on the charset used. */ { 160, "nbsp", "no-break space = non-breaking space, U+00A0 ISOnum" }, { 161, "iexcl","inverted exclamation mark, U+00A1 ISOnum" }, { 162, "cent", "cent sign, U+00A2 ISOnum" }, [...] { 376, "Yuml", "latin capital letter Y with diaeresis, U+0178 ISOlat2" }, /* * Anything below should really be kept as entities references */ { 402, "fnof", "latin small f with hook = function = florin, U+0192 ISOtech" }, { 710, "circ", "modifier letter circumflex accent, U+02C6 ISOpub" }, { 732, "tilde","small tilde, U+02DC ISOdia" }, { 913, "Alpha","greek capital letter alpha, U+0391" }, { 914, "Beta", "greek capital letter beta, U+0392" }, { 915, "Gamma","greek capital letter gamma, U+0393 ISOgrk3" }, { 916, "Delta","greek capital letter delta, U+0394 ISOgrk3" }, [...] { 9824, "spades","black spade suit, U+2660 ISOpub" }, { 9827, "clubs","black club suit = shamrock, U+2663 ISOpub" }, { 9829, "hearts","black heart suit = valentine, U+2665 ISOpub" }, { 9830, "diams","black diamond suit, U+2666 ISOpub" }, -- (domestic pets only, the antidote for overdose, milk.) bloggy blog: http://lars.ingebrigtsen.no ^ permalink raw reply [flat|nested] 5+ messages in thread
* bug#40794: 26.3; HTML entities ☆ and ★ (inter alia) are not parsed by libxml-parse-html-region 2020-07-29 5:35 ` Lars Ingebrigtsen @ 2020-09-09 13:22 ` Stefan Kangas 2020-11-25 10:03 ` Stefan Kangas 0 siblings, 1 reply; 5+ messages in thread From: Stefan Kangas @ 2020-09-09 13:22 UTC (permalink / raw) To: Lars Ingebrigtsen; +Cc: 40794, Tim Landscheidt Lars Ingebrigtsen <larsi@gnus.org> writes: > I had a look at the libxml2 sources. The logic isn't really explained, > but apparently they include all the <255-value entities, and then a > selected number of the other entities (about 160 of them). > > I have no idea what the logic behind this is... perhaps they've just > forgotten to add the new ones? Which makes me think that this is really > a libxml2 bug, and you should report it there instead. Agreed. Tim, could you please report this to the libxml2 developers? ^ permalink raw reply [flat|nested] 5+ messages in thread
* bug#40794: 26.3; HTML entities ☆ and ★ (inter alia) are not parsed by libxml-parse-html-region 2020-09-09 13:22 ` Stefan Kangas @ 2020-11-25 10:03 ` Stefan Kangas 0 siblings, 0 replies; 5+ messages in thread From: Stefan Kangas @ 2020-11-25 10:03 UTC (permalink / raw) To: Lars Ingebrigtsen; +Cc: 40794, Tim Landscheidt tags 40794 notabug close 40794 thanks Stefan Kangas <stefan@marxist.se> writes: > Lars Ingebrigtsen <larsi@gnus.org> writes: > >> I had a look at the libxml2 sources. The logic isn't really explained, >> but apparently they include all the <255-value entities, and then a >> selected number of the other entities (about 160 of them). >> >> I have no idea what the logic behind this is... perhaps they've just >> forgotten to add the new ones? Which makes me think that this is really >> a libxml2 bug, and you should report it there instead. > > Agreed. Tim, could you please report this to the libxml2 developers? That was 10 weeks ago, and we seem to agree that this is not a bug in Emacs. I'm therefore closing this bug report. Please report this issue to the libxml2 developers if it is still an issue. ^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2020-11-25 10:03 UTC | newest] Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2020-04-23 13:24 bug#40794: 26.3; HTML entities ☆ and ★ (inter alia) are not parsed by libxml-parse-html-region Tim Landscheidt 2020-07-29 5:26 ` Lars Ingebrigtsen 2020-07-29 5:35 ` Lars Ingebrigtsen 2020-09-09 13:22 ` Stefan Kangas 2020-11-25 10:03 ` Stefan Kangas
Code repositories for project(s) associated with this public inbox https://git.savannah.gnu.org/cgit/emacs.git This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).