From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: "Greg A. Woods" Newsgroups: gmane.emacs.bugs Subject: bug#53924: 26.1; fontification sometimes fails for some characters despite available glyphs Date: Wed, 16 Feb 2022 13:55:01 -0800 Organization: Robo-Hacker Message-ID: References: <838ruitqu9.fsf@gnu.org> <834k55ub5u.fsf@gnu.org> <83k0dzq8y0.fsf@gnu.org> <83zgms2oso.fsf@gnu.org> <83k0dv32kn.fsf@gnu.org> Reply-To: "Greg A. Woods" , GNU Emacs Bug Reports <53924@debbugs.gnu.org> Mime-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue") Content-Type: multipart/signed; boundary="pgp-sign-Multipart_Wed_Feb_16_13:54:44_2022-1"; micalg=pgp-sha1; protocol="application/pgp-signature" Content-Transfer-Encoding: 7bit Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="28772"; mail-complaints-to="usenet@ciao.gmane.io" User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI-EPG/1.14.7 (Harue) FLIM-LB/1.14.9 (=?UTF-8?Q?Goj=C5=8D?=) APEL-LB/10.8 EasyPG/1.0.0 Emacs/26.1 (x86_64--netbsd) MULE/6.0 (HANACHIRUSATO) Cc: GNU Emacs Bug Reports <53924@debbugs.gnu.org> To: Eli Zaretskii Original-X-From: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Wed Feb 16 22:56:15 2022 Return-path: Envelope-to: geb-bug-gnu-emacs@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1nKSHW-0007Ho-EW for geb-bug-gnu-emacs@m.gmane-mx.org; Wed, 16 Feb 2022 22:56:14 +0100 Original-Received: from localhost ([::1]:34844 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1nKSHU-0005Wn-UX for geb-bug-gnu-emacs@m.gmane-mx.org; Wed, 16 Feb 2022 16:56:12 -0500 Original-Received: from eggs.gnu.org ([209.51.188.92]:55980) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1nKSHK-0005Vq-Cx for bug-gnu-emacs@gnu.org; Wed, 16 Feb 2022 16:56:02 -0500 Original-Received: from debbugs.gnu.org ([209.51.188.43]:55723) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1nKSHK-000377-3X for bug-gnu-emacs@gnu.org; Wed, 16 Feb 2022 16:56:02 -0500 Original-Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1nKSHK-0006zJ-3R for bug-gnu-emacs@gnu.org; Wed, 16 Feb 2022 16:56:02 -0500 X-Loop: help-debbugs@gnu.org Resent-From: "Greg A. Woods" Original-Sender: "Debbugs-submit" Resent-CC: bug-gnu-emacs@gnu.org Resent-Date: Wed, 16 Feb 2022 21:56:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 53924 X-GNU-PR-Package: emacs Original-Received: via spool by 53924-submit@debbugs.gnu.org id=B53924.164504851226791 (code B ref 53924); Wed, 16 Feb 2022 21:56:02 +0000 Original-Received: (at 53924) by debbugs.gnu.org; 16 Feb 2022 21:55:12 +0000 Original-Received: from localhost ([127.0.0.1]:49614 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nKSGR-0006xo-IU for submit@debbugs.gnu.org; Wed, 16 Feb 2022 16:55:11 -0500 Original-Received: from [198.96.117.51] (port=56405 helo=central.weird.com) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1nKSGP-0006xg-9a for 53924@debbugs.gnu.org; Wed, 16 Feb 2022 16:55:07 -0500 Original-Received: from (invalid client hostname: bind: DNS error: DNS lookup for A for 'more.local': Unknown host)more.local ((no PTR matching greeting name)d207-6-82-137.bchsia.telus.net[207.6.82.137] port=63100) by central.weird.com([198.96.117.51] port=587) via TCP with esmtp (6642 bytes) (sender: ) (ident using UNIX) id for <53924@debbugs.gnu.org>; Wed, 16 Feb 2022 16:55:04 -0500 (EST) (Smail-3.2.0.122-Pre 2005-Nov-17 #1 built 2022-Feb-11) Original-Received: from more.local ([10.0.1.129] port=63101) by more.local([10.0.1.129] port=25) via TCP with esmtp (6157 bytes) (sender: ) id for <53924@debbugs.gnu.org>; Wed, 16 Feb 2022 13:55:01 -0800 (PST) (Smail-3.2.0.122-Pre 2005-Nov-17 #1 built 2022-Feb-11) In-Reply-To: <83k0dv32kn.fsf@gnu.org> X-Face: ; j3Eth2XV8h1Yfu*uL{<:dQ$#E[DB0gemGZJ"J#4fH*][ lz; @-iwMv_u\6uIEKR0KY"=MzoQH#CrqBN`nG_5B@rrM8,f~Gr&h5a\= List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-gnu-emacs-bounces+geb-bug-gnu-emacs=m.gmane-mx.org@gnu.org Original-Sender: "bug-gnu-emacs" Xref: news.gmane.io gmane.emacs.bugs:227061 Archived-At: --pgp-sign-Multipart_Wed_Feb_16_13:54:44_2022-1 Content-Type: text/plain; charset=US-ASCII At Wed, 16 Feb 2022 05:36:24 +0200, Eli Zaretskii wrote: Subject: Re: bug#53924: 26.1; fontification sometimes fails for some characters despite available glyphs > > > Date: Tue, 15 Feb 2022 18:32:23 -0800 > > From: "Greg A. Woods" > > CC: GNU Emacs Bug Reports <53924@debbugs.gnu.org> > > > > Hopefully this message encodes properly, it should be text/plain, in > > the ISO10646-1 charset, with BASE64 encoding. > > > > Run "emacs -q" in the debugger, switch to the *scratch* buffer and > > insert the forms below, then: > > > > M-x eval-buffer > > > > Switch to the new *Font Families* buffer and scroll slowly through it. > > Depending on how many fonts you have installed, and how, and what kind > > of resources your system(s) have, this could take quite a long time. > > > > If that doesn't trigger a crash try going back to the beginning, > > increase the text scale with C-u C-x C-+ and scroll through again. > > > > This seems to reliably cause the crash for me, at least with the Git > > master version I have built using the lucid toolkit.. > > Like I said before: please try to figure out which font causes the > crashes, and post a recipe with that font alone. Otherwise, trying to > reproduce this is a huge waste of time, because the results depend > critically on the fonts actually installed on the system. Sorry, I really can't be bothered to waste more of my own time on this aspect of the problem until I know that you, or someone else, has at least tried the very simple test I've provided. It is really very simple, and it really would be useful if someone other than myself, in my limited test environment, can try it out to see what happens. I've even already identified suspect fonts (e.g. in comments in the code I supplied), and if you don't have them google will almost instantly tell you where you can find them to try for yourself. Any crash is very bad of course, but, the main issue central to this bug report remains, which is the question of why Emacs chooses to use the frame's default font for ASCII characters when displaying some fonts but not others (even simultaneously with both fonts rendered in the same frame), even when all fonts appear (via other tools) to have all necessary glyphs for all these same ASCII characters. The algorithms for this choice do not seem to be very well documented outside of the code itself, and the code is extremely convoluted and non-modular. If there's something "odd" or otherwise wrong/different with the fonts that don't display properly, that's fine, I just want to know exactly what the problem is. However without knowing even what could be wrong it's impossible to identify and perhaps fix or otherwise change these differences using other tools. My only other available test environment is native macOS with Emacs using the "nextstep" toolkit. There it seems Emacs has very a different and quite opposite "opinion" about ASCII vs. other Unicode characters (than under X11) -- the macOS native version is happy to show empty boxes for ASCII characters if the font has none, but it always cobbles together other Unicode glyphs, e.g. in my sample text, from a variety of other fonts if the requested font has no glyphs for them. I have not seen any crashes in the native macOS environment either. Anyway this X11 font display issue seems to be central to Emacs' ability to accurately display things like web pages and other formatted documents in a more WYSIWYG manner. It also doesn't make a very good demo if Emacs can't even show samples of all available fonts in a given environment. The crash, which for example might be triggered by an attempt to use one of the more problematic fonts in displaying a formatted web page or document, is still secondary to my main issue. -- Greg A. Woods Kelowna, BC +1 250 762-7675 RoboHack Planix, Inc. Avoncote Farms --pgp-sign-Multipart_Wed_Feb_16_13:54:44_2022-1 Content-Type: application/pgp-signature Content-Transfer-Encoding: 7bit Content-Description: OpenPGP Digital Signature -----BEGIN PGP SIGNATURE----- iF0EABECAB0WIQTWEnAIIlcZX4oAawJie18UwlnHhQUCYg1yqAAKCRBie18UwlnH hf+RAKCxluSLYMQiKGaE0LwSEYPhAoLwLwCfSnvNcbzFpFGii0fo7jcK/gVTHUY= =ZVUU -----END PGP SIGNATURE----- --pgp-sign-Multipart_Wed_Feb_16_13:54:44_2022-1--