GNU logs - #32487, boring messages

Message sent to bug-gnu-emacs@HIDDEN:

Subject: bug#32487: 26.1.50; keyboard-quit while main thread blocked crashes Emacs
Resent-From: Gemini Lasswell <gazally@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Mon, 20 Aug 2018 23:00:01 +0000
Resent-Message-ID: <handler.32487.B.153480594324153 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: 32487 <at> debbugs.gnu.org
From: Gemini Lasswell <gazally@HIDDEN>
Date: Mon, 20 Aug 2018 15:57:08 -0700
Message-ID: <876004r6ij.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

In both emacs-26 and master, it's possible to hang or crash Emacs with
Lisp code which uses threads and is buggy in ways which cause the main
thread to be blocked, combined with keyboard-quit.

To reproduce, copy the code listed below into a buffer and evaluate it
(with emacs -Q if you wish).  Then choose one of:

M-x my-hang-1 RET
M-x my-hang-2 RET
M-x my-hang-3 RET

Result: Emacs will stop responding to keyboard input.  Repeated use of
C-g will do nothing when running under X11 and will cause Emacs to crash
when running in a terminal.


(defvar my-mutex-1 (make-mutex "mutex-1"))

(defun my-wait-on-locked-mutex ()
  (with-mutex my-mutex-1
    (message "mutex-1 wasn't locked")))

(defun my-hang-1 ()
  (interactive)
  (with-mutex my-mutex-1
    (let ((thread (make-thread #'my-wait-on-locked-mutex)))
      (thread-join thread))))

(defvar my-mutex-2 (make-mutex "mutex-2"))
(defvar my-var-2 nil)

(defun my-inf-loop ()
  (mutex-lock my-mutex-2)
  (while t
    (setq my-var-2 t)
    (thread-yield)))

(defun my-hang-2 ()
  (interactive)
  (setq my-var-2 nil)
  (let ((thread (make-thread #'my-inf-loop)))
    (while (not my-var-2)
      (thread-yield))
    (with-mutex my-mutex-2
      (message "mutex-2 wasn't locked"))))

(defvar my-cond-mutex (make-mutex "cond-mutex"))
(defvar my-cond-var (make-condition-variable my-cond-mutex))
(defvar my-var-3 nil)

(defun my-fail-to-notify ()
  (with-mutex my-cond-mutex
    (setq my-var-3 t)))

(defun my-hang-3 ()
  (interactive)
  (setq my-var-3 nil)
  (let ((thread (make-thread #'my-fail-to-notify)))
    (with-mutex my-cond-mutex
      (while (not my-var-3)
	(condition-wait my-cond-var)))))

In GNU Emacs 26.1.50 (build 1, x86_64-pc-linux-gnu, GTK+ Version 3.22.28)
 of 2018-08-05 built on localhost
Windowing system distributor 'The X.Org Foundation', version 11.0.11906000
Recent messages:
For information about GNU Emacs and the GNU system, type C-h C-a.

Configured using:
 'configure
 --prefix=/nix/store/4pwyx7ixl5fbdj75kmbsnzcrbsvkvg09-emacs-26.1.50
 --with-modules --with-x-toolkit=gtk3 --with-xft'

Configured features:
XPM JPEG TIFF GIF PNG RSVG IMAGEMAGICK SOUND DBUS GSETTINGS NOTIFY
LIBSELINUX GNUTLS LIBXML2 FREETYPE XFT ZLIB TOOLKIT_SCROLL_BARS GTK3 X11
MODULES THREADS LCMS2

Important settings:
  value of $EMACSLOADPATH: /nix/store/7xj2afwwci2r69g5ghhf7qlinlpxw858-emacs-packages-deps/share/emacs/site-lisp:
  value of $LANG: en_US.UTF-8
  locale-coding-system: utf-8-unix

Major mode: Lisp Interaction

Minor modes in effect:
  tooltip-mode: t
  global-eldoc-mode: t
  eldoc-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t
  line-number-mode: t
  transient-mark-mode: t

Load-path shadows:
/nix/store/7xj2afwwci2r69g5ghhf7qlinlpxw858-emacs-packages-deps/share/emacs/site-lisp/elpa/magit-2.11.0/magit-popup hides /nix/store/7xj2afwwci2r69g5ghhf7qlinlpxw858-emacs-packages-deps/share/emacs/site-lisp/elpa/magit-popup-2.12.2/magit-popup
/nix/store/7xj2afwwci2r69g5ghhf7qlinlpxw858-emacs-packages-deps/share/emacs/site-lisp/elpa/soap-client-3.1.3/soap-inspect hides /nix/store/4pwyx7ixl5fbdj75kmbsnzcrbsvkvg09-emacs-26.1.50/share/emacs/26.1.50/lisp/net/soap-inspect
/nix/store/7xj2afwwci2r69g5ghhf7qlinlpxw858-emacs-packages-deps/share/emacs/site-lisp/elpa/soap-client-3.1.3/soap-client hides /nix/store/4pwyx7ixl5fbdj75kmbsnzcrbsvkvg09-emacs-26.1.50/share/emacs/26.1.50/lisp/net/soap-client
/nix/store/7xj2afwwci2r69g5ghhf7qlinlpxw858-emacs-packages-deps/share/emacs/site-lisp/elpa/seq-2.20/seq hides /nix/store/4pwyx7ixl5fbdj75kmbsnzcrbsvkvg09-emacs-26.1.50/share/emacs/26.1.50/lisp/emacs-lisp/seq
/nix/store/7xj2afwwci2r69g5ghhf7qlinlpxw858-emacs-packages-deps/share/emacs/site-lisp/elpa/let-alist-1.0.5/let-alist hides /nix/store/4pwyx7ixl5fbdj75kmbsnzcrbsvkvg09-emacs-26.1.50/share/emacs/26.1.50/lisp/emacs-lisp/let-alist

Features:
(shadow sort mail-extr emacsbug message rmc puny seq seq-25 byte-opt gv
bytecomp byte-compile cconv cl-loaddefs cl-lib dired dired-loaddefs
format-spec rfc822 mml easymenu mml-sec password-cache epa derived epg
epg-config gnus-util rmail rmail-loaddefs mm-decode mm-bodies mm-encode
mail-parse rfc2231 mailabbrev gmm-utils mailheader sendmail rfc2047
rfc2045 ietf-drums mm-util mail-prsvr mail-utils elec-pair time-date
mule-util tooltip eldoc electric uniquify ediff-hook vc-hooks
lisp-float-type mwheel term/x-win x-win term/common-win x-dnd tool-bar
dnd fontset image regexp-opt fringe tabulated-list replace newcomment
text-mode elisp-mode lisp-mode prog-mode register page menu-bar
rfn-eshadow isearch timer select scroll-bar mouse jit-lock font-lock
syntax facemenu font-core term/tty-colors frame cl-generic cham georgian
utf-8-lang misc-lang vietnamese tibetan thai tai-viet lao korean
japanese eucjp-ms cp51932 hebrew greek romanian slovak czech european
ethiopic indian cyrillic chinese composite charscript charprop
case-table epa-hook jka-cmpr-hook help simple abbrev obarray minibuffer
cl-preloaded nadvice loaddefs button faces cus-face macroexp files
text-properties overlay sha1 md5 base64 format env code-pages mule
custom widget hashtable-print-readable backquote threads dbusbind
inotify lcms2 dynamic-setting system-font-setting font-render-setting
move-toolbar gtk x-toolkit x multi-tty make-network-process emacs)

Memory information:
((conses 16 95020 4549)
 (symbols 48 20383 1)
 (miscs 40 44 118)
 (strings 32 28447 1654)
 (string-bytes 1 773489)
 (vectors 16 14062)
 (vector-slots 8 502938 6272)
 (floats 8 49 68)
 (intervals 56 216 0)
 (buffers 992 11))

Message sent:

Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.505 (Entity 5.505)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Gemini Lasswell <gazally@HIDDEN>
Subject: bug#32487: Acknowledgement (26.1.50; keyboard-quit while main
 thread blocked crashes Emacs)
Message-ID: <handler.32487.B.153480594324153.ack <at> debbugs.gnu.org>
References: <876004r6ij.fsf@HIDDEN>
X-Gnu-PR-Message: ack 32487
X-Gnu-PR-Package: emacs
Reply-To: 32487 <at> debbugs.gnu.org
Date: Mon, 20 Aug 2018 23:00:02 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 bug-gnu-emacs@HIDDEN

If you wish to submit further information on this problem, please
send it to 32487 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
32487: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D32487
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems

Message sent to bug-gnu-emacs@HIDDEN:

Subject: bug#32487: 26.1.50; keyboard-quit while main thread blocked crashes Emacs
Resent-From: Eli Zaretskii <eliz@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Tue, 21 Aug 2018 15:23:02 +0000
Resent-Message-ID: <handler.32487.B32487.153486495629642 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Gemini Lasswell <gazally@HIDDEN>
Cc: 32487 <at> debbugs.gnu.org
Date: Tue, 21 Aug 2018 18:22:19 +0300
Message-Id: <83o9dvd9sk.fsf@HIDDEN>
From: Eli Zaretskii <eliz@HIDDEN>
In-reply-to: <876004r6ij.fsf@HIDDEN> (message from Gemini Lasswell on Mon, 
 20 Aug 2018 15:57:08 -0700)
References: <876004r6ij.fsf@HIDDEN>
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

> From: Gemini Lasswell <gazally@HIDDEN>
> Date: Mon, 20 Aug 2018 15:57:08 -0700
> 
> In both emacs-26 and master, it's possible to hang or crash Emacs with
> Lisp code which uses threads and is buggy in ways which cause the main
> thread to be blocked, combined with keyboard-quit.

That's ample punishment for a buggy program, don't you think?

> To reproduce, copy the code listed below into a buffer and evaluate it
> (with emacs -Q if you wish).  Then choose one of:
> 
> M-x my-hang-1 RET
> M-x my-hang-2 RET
> M-x my-hang-3 RET
> 
> Result: Emacs will stop responding to keyboard input.  Repeated use of
> C-g will do nothing when running under X11 and will cause Emacs to crash
> when running in a terminal.

Doing nothing is fine when a program is buggy.

On a TTY, the 1st and the 3rd example are not crashes: they are the
"emergency escape" feature of Emacs.  You can read about it in the
manual.  It is triggered when more than one C-g is pressed without
Emacs being able to process the first one.  Due to the way we process
input nowadays, you cannot see this in action except on a Unix TTY,
where C-g triggers a SIGINT.

The 2nd example seems to be caused by a non-main thread entering
redisplay (I think).  Or something like that.

Message sent to bug-gnu-emacs@HIDDEN:

Subject: bug#32487: 26.1.50; keyboard-quit while main thread blocked crashes Emacs
Resent-From: Gemini Lasswell <gazally@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Wed, 22 Aug 2018 14:41:02 +0000
Resent-Message-ID: <handler.32487.B32487.153494884713779 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Eli Zaretskii <eliz@HIDDEN>
Cc: 32487 <at> debbugs.gnu.org
From: Gemini Lasswell <gazally@HIDDEN>
References: <876004r6ij.fsf@HIDDEN> <83o9dvd9sk.fsf@HIDDEN>
Date: Wed, 22 Aug 2018 07:39:35 -0700
In-Reply-To: <83o9dvd9sk.fsf@HIDDEN> (Eli Zaretskii's message of "Tue, 21 Aug
 2018 18:22:19 +0300")
Message-ID: <87r2iqpis8.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1.50 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

Eli Zaretskii <eliz@HIDDEN> writes:

> That's ample punishment for a buggy program, don't you think?

I thought so too at first, when I first came across this.  But the
reality is that new bugs get added to Emacs all the time, despite our
best efforts, and the fact that C-g can't interrupt the thread
primitives raises the risk of new bugs being severe bugs.

If a user encounters a hanging bug in non-threaded Lisp, it's very
likely that she can recover from it with C-g, and continue using Emacs.
But if the user encounters a hanging bug in threaded Lisp, she will lose
her Emacs session.

Emacs is also a development environment, and it's a much less friendly
place to develop programs when it's easy for buggy programs to crash the
development environment.  Obviously it's not hard to write Lisp that
makes Emacs unresponsive or unusable, if you're trying to do that.  But
in the act of trying to write useful Lisp, it's been rare in my
experience.  With the thread primitives it's much easier to do
unintentionally.

Most of the time when I write buggy Lisp that stops responding, I can
find out what the problem is by stopping it with C-g, using
toggle-debug-on-quit, restarting my problematic code, C-g again.  This
doesn't work if the main thread is stuck in a thread primitive.

Message sent to bug-gnu-emacs@HIDDEN:

X-Loop: help-debbugs@HIDDEN
Subject: bug#32487: 26.1.50; keyboard-quit while main thread blocked crashes Emacs
Resent-From: Eli Zaretskii <eliz@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Wed, 22 Aug 2018 15:08:02 +0000
Resent-Message-ID: <handler.32487.B32487.153495043316328 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 32487
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Gemini Lasswell <gazally@HIDDEN>
Cc: 32487 <at> debbugs.gnu.org
Received: via spool by 32487-submit <at> debbugs.gnu.org id=B32487.153495043316328
          (code B ref 32487); Wed, 22 Aug 2018 15:08:02 +0000
Received: (at 32487) by debbugs.gnu.org; 22 Aug 2018 15:07:13 +0000
Received: from localhost ([127.0.0.1]:57894 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1fsUj3-0004FI-Jv
	for submit <at> debbugs.gnu.org; Wed, 22 Aug 2018 11:07:13 -0400
Received: from eggs.gnu.org ([208.118.235.92]:44596)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <eliz@HIDDEN>) id 1fsUj1-0004F4-Nd
 for 32487 <at> debbugs.gnu.org; Wed, 22 Aug 2018 11:07:11 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <eliz@HIDDEN>) id 1fsUis-0002jl-3y
 for 32487 <at> debbugs.gnu.org; Wed, 22 Aug 2018 11:07:06 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=disabled
 version=3.3.2
Received: from fencepost.gnu.org ([2001:4830:134:3::e]:34882)
 by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <eliz@HIDDEN>)
 id 1fsUir-0002jb-LT; Wed, 22 Aug 2018 11:07:01 -0400
Received: from [176.228.60.248] (port=1570 helo=home-c4e4a596f7)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <eliz@HIDDEN>)
 id 1fsUir-0006aB-8Y; Wed, 22 Aug 2018 11:07:01 -0400
Date: Wed, 22 Aug 2018 18:06:58 +0300
Message-Id: <83y3cybfu5.fsf@HIDDEN>
From: Eli Zaretskii <eliz@HIDDEN>
In-reply-to: <87r2iqpis8.fsf@HIDDEN> (message from Gemini Lasswell on Wed, 
 22 Aug 2018 07:39:35 -0700)
References: <876004r6ij.fsf@HIDDEN> <83o9dvd9sk.fsf@HIDDEN>
 <87r2iqpis8.fsf@HIDDEN>
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Received-From: 2001:4830:134:3::e
X-Spam-Score: -5.0 (-----)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -6.0 (------)

> From: Gemini Lasswell <gazally@HIDDEN>
> Cc: 32487 <at> debbugs.gnu.org
> Date: Wed, 22 Aug 2018 07:39:35 -0700
> 
> Most of the time when I write buggy Lisp that stops responding, I can
> find out what the problem is by stopping it with C-g, using
> toggle-debug-on-quit, restarting my problematic code, C-g again.  This
> doesn't work if the main thread is stuck in a thread primitive.

It also doesn't always work if you are stuck in a system API.

Last modified: Mon, 25 Nov 2019 12:00:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.