GNU bug report logs - #53924
26.1; fontification sometimes fails for some characters despite available glyphs

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: emacs; Reported by: "Greg A. Woods" <woods@HIDDEN>; dated Thu, 10 Feb 2022 19:11:01 UTC; Maintainer for emacs is bug-gnu-emacs@HIDDEN.

Message received at 53924 <at> debbugs.gnu.org:

Received: (at 53924) by debbugs.gnu.org; 13 Feb 2022 06:06:17 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun Feb 13 01:06:17 2022
Received: from localhost ([127.0.0.1]:36148 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1nJ81Z-0005NH-4A
	for submit <at> debbugs.gnu.org; Sun, 13 Feb 2022 01:06:17 -0500
Received: from [198.96.117.51] (port=63849 helo=central.weird.com)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <woods@HIDDEN>) id 1nJ81W-0005N8-M6
 for 53924 <at> debbugs.gnu.org; Sun, 13 Feb 2022 01:06:15 -0500
Received: from (invalid client hostname: bind: DNS error: DNS lookup for A for
 'more.local': Unknown host)more.local
 ((no PTR matching greeting name (Invalid rDNS PTR target
 'd207-6-82-137.bchsia.telus.net': bind: DNS error: DNS lookup for A for
 'd207-6-82-137.bchsia.telus.net': Unknown
 host))d207-6-82-137.bchsia.telus.net[207.6.82.137] port=57703)
 by central.weird.com([198.96.117.51] port=587)
 via TCP with esmtp (12407 bytes) (sender: <woods@HIDDEN>)
 (ident <nobody> using UNIX) id <m1nJ81W-00rPJh0@HIDDEN>
 for <53924 <at> debbugs.gnu.org>; Sun, 13 Feb 2022 01:06:14 -0500 (EST)
 (Smail-3.2.0.122-Pre 2005-Nov-17 #1 built 2022-Feb-11)
Received: from more.local ([10.0.1.129] port=57704)
 by more.local([10.0.1.129] port=25) via TCP with esmtp (11776 bytes)
 (sender: <woods@HIDDEN>) id <m1nJ81T-0039Xw0@HIDDEN>
 for <53924 <at> debbugs.gnu.org>; Sat, 12 Feb 2022 22:06:11 -0800 (PST)
 (Smail-3.2.0.122-Pre 2005-Nov-17 #1 built 2021-Nov-17)
Message-Id: <m1nJ81T-0039Xw0@HIDDEN>
Date: Sat, 12 Feb 2022 22:06:09 -0800
From: "Greg A. Woods" <woods@HIDDEN>
To: GNU Emacs Bug Reports <53924 <at> debbugs.gnu.org>
Subject: Re: bug#53924: 26.1;
 fontification sometimes fails for some characters despite available
 glyphs
In-Reply-To: <834k55ub5u.fsf@HIDDEN>
References: <m1nIEhv-0039XwC@HIDDEN> <838ruitqu9.fsf@HIDDEN>
 <m1nIIwv-0039XwC@HIDDEN> <834k55ub5u.fsf@HIDDEN>
User-Agent: Wanderlust/2.15.9 (Almost Unreal) SEMI-EPG/1.14.7 (Harue)
 FLIM-LB/1.14.9 (=?ISO-8859-4?Q?Goj=F2?=) APEL-LB/10.8 EasyPG/1.0.0
 Emacs/26.1 (x86_64--netbsd) MULE/6.0 (HANACHIRUSATO)
X-Face: ; j3Eth2XV8h1Yfu<eXd9JL+"t;
 iT8?{X]Fjm`Qb]>*uL{<:dQ$#E[DB0gemGZJ"J#4fH*][
 lz; @-iwMv_u\6uIEKR0KY"=MzoQH#CrqBN`nG_5B@rrM8,f~Gr&h5a\=<t0loVf0$}bP=]i3OMh"n_
 _@m4/, ~2`V=(-9LyW.)'`@E_fE^<4y7)BIe`A''/j-Y#gDNZERh%CCij'q-NA4F<|yjznEhd7=l^xH
 2.qD3o0IanGHERTW+z$G
Precedence: first-class
Organization: Robo-Hacker
MIME-Version: 1.0 (generated by SEMI-EPG 1.14.7 - "Harue")
Content-Type: multipart/signed;
 boundary="pgp-sign-Multipart_Sat_Feb_12_22:05:21_2022-1"; micalg=pgp-sha1;
 protocol="application/pgp-signature"
Content-Transfer-Encoding: 7bit
X-Spam-Score: 1.5 (+)
X-Spam-Report: Spam detection software, running on the system "debbugs.gnu.org",
 has NOT identified this incoming email as spam.  The original
 message has been attached to this so you can view it or label
 similar future email.  If you have any questions, see
 the administrator of that system for details.
 Content preview:  New code, ancient bug,
 and a possibly related crash..... First
 the ancient typo/bug: fontset.el contains an errant definition for
 xlfd-regexp-spacing-subnum
 (with the value '8'). git-blame suggests this typo has lurked for 20 years!
 Content analysis details:   (1.5 points, 10.0 required)
 pts rule name              description
 ---- ---------------------- --------------------------------------------------
 0.2 HEADER_FROM_DIFFERENT_DOMAINS From and EnvelopeFrom 2nd level
 mail domains are different
 0.0 SPF_HELO_NONE          SPF: HELO does not publish an SPF Record
 0.0 SPF_NONE               SPF: sender does not publish an SPF Record
 1.3 RDNS_NONE Delivered to internal network by a host with no rDNS
 -0.0 T_SCC_BODY_TEXT_LINE   No description available.
X-Debbugs-Envelope-To: 53924
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Reply-To: "Greg A. Woods" <woods@HIDDEN>,
 GNU Emacs Bug Reports <53924 <at> debbugs.gnu.org>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 0.5 (/)

--pgp-sign-Multipart_Sat_Feb_12_22:05:21_2022-1
Content-Type: text/plain; charset=US-ASCII

New code, ancient bug, and a possibly related crash.....

First the ancient typo/bug:

fontset.el contains an errant definition for xlfd-regexp-spacing-subnum
(with the value '8').  git-blame suggests this typo has lurked for 20
years!

It should of course be '9':

    (defconst xlfd-regexp-spacing-subnum 9) ; fix a 20-year-old typo!


Second, an update of my `show-all-font-families', now with working
support to optionally show just the mono-spaced fonts, but be warned it
can cause crashes:

(defvar sample-text-history nil
  "History list for commands that read sample text.")
(require 'faces)
(add-to-history 'sample-text-history list-faces-sample-text)

(defvar ascii-sample-text
  ;; this default text is just ASCII
  ;; xxx should it be iso8859-1, but how to do that?
  ;; `encode-coding-string' ?
  "ABCDEFGHIJKLMNOPQRSTUVWXYZ 0123456789
abcdefghijklmnopqrstuvwxyz
`~!@#$%^&*()_+-={}|[]\\:\"\;'<>?,./"
  "all the ASCII printable characters for sample text.")

(defun show-all-font-families (&optional sample-text mono-only)
  "Show SAMPLE-TEXT (by default `list-faces-sample-text') in
'roman', 'bold', 'italic', and 'bold italic' for each font family
known to `font-family-list'.

If MONO-ONLY, include ':spacing m' in the `font-spec' parameters.
Interactively, a negative prefix does the same.

Note you can seem some strange results for fonts that don't have
each of the requested weight and slant forms.  Sometimes
proportional glyphs will even be substituted for mono-spaced
glyphs!  Sometimes a glyph from a different font (the default
font?) will be substituted even when the requested font is
available with all the requested attributes, e.g. 'office code
pro'.  (Perhaps because it is _only_ avaliable with the requested
attributes, but no others?)

Also some proportional fonts will show up despite only
mono-spaced fonts being selected.  Perhaps spacing is ignored
when requesting a font?  Note even `x-list-fonts' warns that:

    Fonts Emacs can't use may or may not be excluded...

N.B. WARNING:  This code may try to display fonts that cannot be
opened and as a result will crash Emacs!  Worse yet it can get
stuck rendering fonts and if killed cause the X11 server to go
into a CPU-bound loop that may take hours to resolve!  Kill it
sooner than later!  This is particularly true for Emacs-26.1 when
the MONO-ONLY parameter is non-nil.  See also the exclusion of
the 'droid' fonts.

Derived from an example on the EmacsWiki."
  (interactive
   (list
    ;; optional `sample-text':
    (if current-prefix-arg
	(read-string
	 "Sample text:"
	 ascii-sample-text
	 'sample-text-history))
    ;; optional `mono-only':
    (cond
     ((eq current-prefix-arg '-)
      t)
     ((and (numberp current-prefix-arg)
           (< current-prefix-arg 0))
      t)
     ((and (listp current-prefix-arg)
           (numberp (car current-prefix-arg))
           (< (car current-prefix-arg) 0))
      t)
     (t nil))))
  (let ((str (if sample-text
		 sample-text
	       list-faces-sample-text))
	(font-families (cl-remove-duplicates
			(sort (font-family-list)
			      (lambda(x y) (string> (upcase x) (upcase y))))
			:test 'cl-equalp)))
    (with-help-window "*Font Families*"
      (with-current-buffer standard-output
	(dolist (ff font-families)
	  (let* ((fs (font-spec :family ff
				:weight 'medium :slant 'r
				;; xxx :spacing is confusing
				;; see below for additional test to confirm!
				(if mono-only :spacing) (if mono-only 'm)
				:registry 'iso10646-1))
		 (fl (list-fonts fs))
		 (fe (car fl))			; usually the cdr is non-scalable?
		 (xlfd (if fe
			   (font-xlfd-name fe)
			 (font-xlfd-name fs)))	; xxx font may not be useable
		 (fn (if (eq window-system 'x)
			 (condition-case nil
			     (x-resolve-font-name xlfd)
			   (error (message "Invalid font family: %s" ff)
				  nil))
		       nil))
		 (xlfd-fields (if fn
				  (x-decompose-font-name fn) ; xxx not really an X11 function
				nil))
		 )
	    ;; XXX the "droid*" fonts are broken???
	    (if (and (not (string-match "droid" ff))
		     (not (string-equal "nil" ff)) ; xxx never a useful font
		     (not (string-match "italic" ff)) ; xxx rarely in all other styles
		     (not (string-match "bold" ff)) ; xxx rarely in all other styles
		     (not (string-match ".pcf" ff)) ; xxx usually bitmap cursors
		     ;;
		     ;; xxx some fonts, e.g. "inconsolata" (which xfontsel says
		     ;; is both 'm' and 'p'), will return the "wrong" spacing in
		     ;; the XLFD if the request has a wild-card (i.e. :spacing
		     ;; unspecified), but then it can't be found with
		     ;; `font-info' with the explicit ":spacing 'p".
		     ;;
		     ;; XXX this test is needed though as it might sometimes
		     ;; prevent crashes in the case where this spacing confusion
		     ;; happens.
		     ;;
		     (condition-case nil
			 (if (font-info xlfd) ; xxx can this also return nil?
			     t
			   (message "Can't get font info for: %s" xlfd)
			   nil)
		       (error (message "Bad font: %s" xlfd)
			      nil))
		     (if mono-only
			 (if xlfd-fields
			     ;; because `x-resolve-font-name' sometimes ignores
			     ;; `:spacing' we must confirm the font matches
			     ;; xxx `xlfd-regexp-spacing-subnum' is WRONG, for 20 years!
			     (if (string-equal (aref xlfd-fields 9) "m")
				 t
			       (message "Font not actually monospaced: %s" xlfd)
			       nil)
			   ;; xxx try `font-get' on `fe', but that doesn't seem to
			   ;; work properly for getting `:spacing'!?!?!?!?
			   (if (eq window-system 'x)
			       (message "Can't resolve X font for: %s" xlfd)))
		       t))
		;; xxx XXX N.B.:  without escaping the semicolons emacs can't
		;; parse these expressions backwards!!!
		(insert "\; " ff ":" xlfd "\n\;\n"
			"\;\t" ff " (plain):\n\;\n"
			(propertize str 'font-lock-face
				    `(:family ,ff :weight medium :slant r))
			"\n\;\n\;\t" ff " [bold]:\n\;\n"
			(propertize str 'font-lock-face
				    `(:family ,ff :weight bold :slant r))
			"\n\;\n\;\t " ff " [italic]:\n\;\n"
			(propertize str 'font-lock-face
				    `(:family ,ff :weight medium :slant italic))
			"\n\;\n\;\t " ff " [bold italic]:\n\;\n"
			(propertize str 'font-lock-face
				    `(:family ,ff :weight bold :slant italic))
			"\n\;\n\n")
	      (message "Not showing font-family: %s" ff)))
	  (goto-char (point-min))
	  (setq case-fold-search t)
	  (if (fboundp 'form-feed-mode)
	      (form-feed-mode nil)))))))



Finally a crash (working on reproducing it with GDB in the source tree,
but my gdb is having trouble with the emacs .gdbinit):

Reading symbols from /usr/pkg/bin/emacs-26.1...
[New process 12954]
[New process 1873]
Core was generated by `emacs'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x00007cdaa53676aa in _lwp_kill () from /usr/lib/libc.so.12
[Current thread is 1 (process 12954)]
(gdb) bt
#0  0x00007cdaa53676aa in _lwp_kill () from /usr/lib/libc.so.12
#1  0x00000000004dc6ac in terminate_due_to_signal (sig=sig@entry=11,
    backtrace_limit=backtrace_limit@entry=40) at emacs.c:394
#2  0x00000000004f2d13 in handle_fatal_signal (sig=sig@entry=11) at sysdep.c:1769
#3  0x00000000004f2f53 in deliver_thread_signal (sig=sig@entry=11,
    handler=0x4f2d05 <handle_fatal_signal>) at sysdep.c:1743
#4  0x00000000004f2fa6 in deliver_fatal_thread_signal (sig=11) at sysdep.c:1781
#5  handle_sigsegv (sig=11, siginfo=<optimized out>, arg=<optimized out>)
    at sysdep.c:1866
#6  <signal handler called>
#7  0x00000000005ad68d in fontset_find_font (fontset=fontset@entry=364, c=c@entry=180,
    face=face@entry=0x7cdaad2db4c0, charset_id=charset_id@entry=-1,
    fallback=fallback@entry=false) at fontset.c:550
#8  0x00000000005adfd3 in fontset_font (fontset=fontset@entry=364, c=c@entry=180,
    face=face@entry=0x7cdaad2db4c0, id=-1) at fontset.c:760
#9  0x00000000005ae365 in face_for_char (f=0x7cdaafbf2c30,
    face=face@entry=0x7cdaad2db4c0, c=180, pos=<optimized out>, object=<optimized out>)
    at fontset.c:990
#10 0x000000000043e186 in FACE_FOR_CHAR (object=<optimized out>, pos=<optimized out>,
    character=<optimized out>, face=0x7cdaad2db4c0, f=<optimized out>)
    at dispextern.h:1818
#11 get_next_display_element (it=it@entry=0x7f7fffe82f90) at xdisp.c:7303
#12 0x000000000044790b in display_line (it=it@entry=0x7f7fffe82f90,
    cursor_vpos=cursor_vpos@entry=0) at xdisp.c:21409
#13 0x000000000044ab97 in try_window (window=window@entry=137278716771333, pos=...,
    flags=flags@entry=0) at xdisp.c:17627
#14 0x000000000045e783 in redisplay_window (window=137278716771333,
    just_this_one_p=just_this_one_p@entry=false) at xdisp.c:16811
#15 0x0000000000461d78 in redisplay_window_0 (window=window@entry=137278716771333)
    at xdisp.c:14831
#16 0x0000000000547c1f in internal_condition_case_1 (
    bfun=bfun@entry=0x461d4f <redisplay_window_0>, arg=137278716771333,
    handlers=<optimized out>, hfun=hfun@entry=0x42929e <redisplay_window_error>)
    at eval.c:1356
#17 0x000000000042d9ae in redisplay_windows (window=137278716771333) at xdisp.c:14811
#18 0x000000000044f61d in redisplay_internal () at xdisp.c:14300
#19 0x000000000045133e in redisplay () at xdisp.c:13518
#20 0x00000000004e58eb in read_char (commandflag=commandflag@entry=1,
    map=map@entry=137278680449907, prev_event=0,
    used_mouse_menu=used_mouse_menu@entry=0x7f7fffe883cb, end_time=end_time@entry=0x0)
    at keyboard.c:2480
#21 0x00000000004e8b6c in read_key_sequence (keybuf=keybuf@entry=0x7f7fffe884b0,
    prompt=prompt@entry=0, dont_downcase_last=dont_downcase_last@entry=false,
    can_return_switch_frame=can_return_switch_frame@entry=true,
--Type <RET> for more, q to quit, c to continue without paging--q
Quit
(gdb)

--
					Greg A. Woods <gwoods@HIDDEN>

Kelowna, BC     +1 250 762-7675           RoboHack <woods@HIDDEN>
Planix, Inc. <woods@HIDDEN>     Avoncote Farms <woods@HIDDEN>

--pgp-sign-Multipart_Sat_Feb_12_22:05:21_2022-1
Content-Type: application/pgp-signature
Content-Transfer-Encoding: 7bit
Content-Description: OpenPGP Digital Signature

-----BEGIN PGP SIGNATURE-----

iF0EABECAB0WIQTWEnAIIlcZX4oAawJie18UwlnHhQUCYgifpAAKCRBie18UwlnH
hQ0RAKC24lLiuznoDJeHoWILNRcrnPe+wgCfU0Uz3zPU7+HkLnsjh0LmLw5Xblk=
=UxoV
-----END PGP SIGNATURE-----

--pgp-sign-Multipart_Sat_Feb_12_22:05:21_2022-1--

Acknowledgement sent to "Greg A. Woods" <woods@HIDDEN>, GNU Emacs Bug Reports>:
Extra info received and forwarded to list. Copy sent to bug-gnu-emacs@HIDDEN. Full text available.