GNU bug report logs - #46573
28.0.50; Error when edebugging setting unbound place

Previous Next

Package: emacs;

Reported by: Michael Heerdegen <michael_heerdegen <at> web.de>

Date: Tue, 16 Feb 2021 22:34:02 UTC

Severity: normal

Found in version 28.0.50

Done: Stefan Monnier <monnier <at> iro.umontreal.ca>

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 46573 in the body.
You can then email your comments to 46573 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Tue, 16 Feb 2021 22:34:02 GMT) Full text and rfc822 format available.

Acknowledgement sent to Michael Heerdegen <michael_heerdegen <at> web.de>:
New bug report received and forwarded. Copy sent to bug-gnu-emacs <at> gnu.org. (Tue, 16 Feb 2021 22:34:02 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Michael Heerdegen <michael_heerdegen <at> web.de>
To: bug-gnu-emacs <at> gnu.org
Cc: Lars Ingebrigtsen <larsi <at> gnus.org>,
 Stefan Monnier <monnier <at> iro.umontreal.ca>
Subject: 28.0.50; Error when edebugging setting unbound place
Date: Tue, 16 Feb 2021 23:32:58 +0100
Hello,

when edebugging something like

  (setf PLACE VALUE)

Edebug stops after PLACE and displays its "binding".  While that would
make some sense for e.g. `cl-callf', in the above situation the behavior
is confusing because when the code is run the binding of PLACE is never
referenced, so this suggests that the code uses the binding of PLACE in
some way which is not the case.

But when PLACE is even unbound (e.g. and unbound variable, or an unbound
eieio-object slot [a totally legitimate case!]), Edebug kicks me out of
the session and raises an error.  Edebug can't be used for such code.
That needs fixing.

TIA,

Michael.






Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Tue, 16 Feb 2021 22:52:01 GMT) Full text and rfc822 format available.

Message #8 received at 46573 <at> debbugs.gnu.org (full text, mbox):

From: Lars Ingebrigtsen <larsi <at> gnus.org>
To: Michael Heerdegen <michael_heerdegen <at> web.de>
Cc: Stefan Monnier <monnier <at> iro.umontreal.ca>, 46573 <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Tue, 16 Feb 2021 23:51:28 +0100
Michael Heerdegen <michael_heerdegen <at> web.de> writes:

> when edebugging something like
>
>   (setf PLACE VALUE)
>
> Edebug stops after PLACE and displays its "binding". 

This is due to this definition:

;; Autoload this `put' since a user might use C-u C-M-x on an expression
;; containing a non-trivial `push' even before gv.el was loaded.
;;;###autoload
(put 'gv-place 'edebug-form-spec '(form)) ;So-called "indirect spec".

That's certainly not correct for the simplest forms like

(setf foo 'bar)

And it's not really correct for things like

(setf (gethash 1 table) 'bar)

either, is it?  (Although it is amusing to see the results of
(gethash 1 table), it's not really helpful.)

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Tue, 16 Feb 2021 23:05:02 GMT) Full text and rfc822 format available.

Message #11 received at 46573 <at> debbugs.gnu.org (full text, mbox):

From: Stefan Monnier <monnier <at> iro.umontreal.ca>
To: Lars Ingebrigtsen <larsi <at> gnus.org>
Cc: Michael Heerdegen <michael_heerdegen <at> web.de>, 46573 <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Tue, 16 Feb 2021 18:04:41 -0500
>> when edebugging something like
>>
>>   (setf PLACE VALUE)
>>
>> Edebug stops after PLACE and displays its "binding". 

Hmm... looks like we have a bug.

> This is due to this definition:
>
> ;; Autoload this `put' since a user might use C-u C-M-x on an expression
> ;; containing a non-trivial `push' even before gv.el was loaded.
> ;;;###autoload
> (put 'gv-place 'edebug-form-spec '(form)) ;So-called "indirect spec".
>
> That's certainly not correct for the simplest forms like

This has been there since the introduction of `gv`, so I think it
*is* correct.  The problem is elsewhere (likely introduced by some of
my recent changes to Edebug).


        Stefan





Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Tue, 16 Feb 2021 23:10:01 GMT) Full text and rfc822 format available.

Message #14 received at 46573 <at> debbugs.gnu.org (full text, mbox):

From: Lars Ingebrigtsen <larsi <at> gnus.org>
To: Stefan Monnier <monnier <at> iro.umontreal.ca>
Cc: Michael Heerdegen <michael_heerdegen <at> web.de>, 46573 <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Wed, 17 Feb 2021 00:09:17 +0100
Stefan Monnier <monnier <at> iro.umontreal.ca> writes:

>> (put 'gv-place 'edebug-form-spec '(form)) ;So-called "indirect spec".
>>
>> That's certainly not correct for the simplest forms like
>
> This has been there since the introduction of `gv`, so I think it
> *is* correct.  The problem is elsewhere (likely introduced by some of
> my recent changes to Edebug).

Darn!  I thought I had finally learned how to read edebug specs.  :-/  I
though `form' meant that it's going to be instrumented?  Hm...  but it's
`(form)' which means, er, uhm.

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Tue, 16 Feb 2021 23:20:02 GMT) Full text and rfc822 format available.

Message #17 received at 46573 <at> debbugs.gnu.org (full text, mbox):

From: Lars Ingebrigtsen <larsi <at> gnus.org>
To: Stefan Monnier <monnier <at> iro.umontreal.ca>
Cc: Michael Heerdegen <michael_heerdegen <at> web.de>, 46573 <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Wed, 17 Feb 2021 00:19:10 +0100
Lars Ingebrigtsen <larsi <at> gnus.org> writes:

> Darn!  I thought I had finally learned how to read edebug specs.  :-/  I
> though `form' meant that it's going to be instrumented?  Hm...  but it's
> `(form)' which means, er, uhm.

Oh, it still means `form':

If the symbol has an Edebug specification, this @dfn{indirect
specification} should be either a list specification that is used in
place of the symbol

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Tue, 16 Feb 2021 23:22:01 GMT) Full text and rfc822 format available.

Message #20 received at 46573 <at> debbugs.gnu.org (full text, mbox):

From: Lars Ingebrigtsen <larsi <at> gnus.org>
To: Stefan Monnier <monnier <at> iro.umontreal.ca>
Cc: Michael Heerdegen <michael_heerdegen <at> web.de>, 46573 <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Wed, 17 Feb 2021 00:21:17 +0100
I checked older Emacs versions -- (setf foo 'bar) works in Emacs 26.1,
but not in Emacs 27.1.  So I suspect it's not the recent changes that
broke this?

-- 
(domestic pets only, the antidote for overdose, milk.)
   bloggy blog: http://lars.ingebrigtsen.no





Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Wed, 17 Feb 2021 00:01:02 GMT) Full text and rfc822 format available.

Message #23 received at 46573 <at> debbugs.gnu.org (full text, mbox):

From: Stefan Monnier <monnier <at> iro.umontreal.ca>
To: Lars Ingebrigtsen <larsi <at> gnus.org>
Cc: Michael Heerdegen <michael_heerdegen <at> web.de>,
 Gemini Lasswell <gazally <at> runbox.com>, 46573 <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Tue, 16 Feb 2021 19:00:45 -0500
>>> (put 'gv-place 'edebug-form-spec '(form)) ;So-called "indirect spec".
>>>
>>> That's certainly not correct for the simplest forms like
>>
>> This has been there since the introduction of `gv`, so I think it
>> *is* correct.  The problem is elsewhere (likely introduced by some of
>> my recent changes to Edebug).
>
> Darn!  I thought I had finally learned how to read edebug specs.  :-/  I
> though `form' meant that it's going to be instrumented?  Hm...  but it's
> `(form)' which means, er, uhm.

Yes, it means Edebug rewrites (setf x 5) to something like:

    (edebug-after (edebug-before 1) 3 (setf (edebug-after 0 2 x) 5))

Whose behavior then depends on the definition of (edebug-after N1 N2 EXP)
as a "place", which is here:

    (put 'edebug-after 'gv-expander
         (lambda (do before index place)
           (gv-letplace (getter setter) place
             (funcall do `(edebug-after ,before ,index ,getter)
                      (lambda (store)
                        `(progn (edebug-after ,before ,index ,getter)
                                ,(funcall setter store)))))))

and indeed, there's the bug, introduced by Gemini's commit
d79cf638f278e50c22feb53d6ba556f5ce9d7853 which does (among various other
things):

    [...]
    * lisp/emacs-lisp/gv.el: Modify edebug-after's gv-expander to
    instrument in the setter as well as the getter.
    [...]

    diff --git a/lisp/emacs-lisp/gv.el b/lisp/emacs-lisp/gv.el
    --- a/lisp/emacs-lisp/gv.el
    +++ b/lisp/emacs-lisp/gv.el
    @@ -302,5 +302,7 @@
     (put 'edebug-after 'gv-expander
          (lambda (do before index place)
            (gv-letplace (getter setter) place
              (funcall do `(edebug-after ,before ,index ,getter)
    -                  setter))))
    +                  (lambda (store)
    +                    `(progn (edebug-after ,before ,index ,getter)
    +                            ,(funcall setter store)))))))

Gemini, how important is it to instrument the setter?  It is definitely
undesirable for Edebug, which you end up seeing the result of
computations which don't take place at all during
un-instrumented execution.  How 'bout using something like

    `(edebug-after ,before ,index ,(funcall setter store))

instead?


        Stefan





Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Wed, 17 Feb 2021 15:30:02 GMT) Full text and rfc822 format available.

Message #26 received at 46573 <at> debbugs.gnu.org (full text, mbox):

From: Eli Zaretskii <eliz <at> gnu.org>
To: Lars Ingebrigtsen <larsi <at> gnus.org>
Cc: michael_heerdegen <at> web.de, monnier <at> iro.umontreal.ca, 46573 <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Wed, 17 Feb 2021 17:29:35 +0200
> From: Lars Ingebrigtsen <larsi <at> gnus.org>
> Date: Wed, 17 Feb 2021 00:21:17 +0100
> Cc: Michael Heerdegen <michael_heerdegen <at> web.de>, 46573 <at> debbugs.gnu.org
> 
> I checked older Emacs versions -- (setf foo 'bar) works in Emacs 26.1,
> but not in Emacs 27.1.

Then we should try fixing it in Emacs 27.2, if that's possible without
risky changes.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Wed, 24 Feb 2021 01:00:02 GMT) Full text and rfc822 format available.

Message #29 received at 46573 <at> debbugs.gnu.org (full text, mbox):

From: Gemini Lasswell <gazally <at> runbox.com>
To: Stefan Monnier <monnier <at> iro.umontreal.ca>
Cc: Michael Heerdegen <michael_heerdegen <at> web.de>,
 Lars Ingebrigtsen <larsi <at> gnus.org>, 46573 <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Tue, 23 Feb 2021 16:59:12 -0800
Stefan Monnier writes:

> Gemini, how important is it to instrument the setter?  It is definitely
> undesirable for Edebug, which you end up seeing the result of
> computations which don't take place at all during
> un-instrumented execution.  How 'bout using something like
>
>     `(edebug-after ,before ,index ,(funcall setter store))
>
> instead?

Hi Stefan,

Sorry to be slow responding to this.  I don't think I would have added
this complication without a good reason, but it's not apparent to me now
what that reason was.  I hope to find time to look at it more this
weekend.

Best,

Gemini






Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Mon, 01 Mar 2021 21:18:02 GMT) Full text and rfc822 format available.

Message #32 received at 46573 <at> debbugs.gnu.org (full text, mbox):

From: Stefan Monnier <monnier <at> iro.umontreal.ca>
To: Eli Zaretskii <eliz <at> gnu.org>, Lars Ingebrigtsen <larsi <at> gnus.org>
Cc: michael_heerdegen <at> web.de, Gemini Lasswell <gazally <at> runbox.com>,
 46573 <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Mon, 01 Mar 2021 16:17:40 -0500
>> I checked older Emacs versions -- (setf foo 'bar) works in Emacs 26.1,
>> but not in Emacs 27.1.
> Then we should try fixing it in Emacs 27.2, if that's possible without
> risky changes.

I plan to install the patch below into `master` to fix this problem, but
I believe this change is sufficiently safe for the `emacs-27` branch, so
you agree I'll install it into `emacs-27` instead.

For code like

    (setf (car x) (cdr x))

The instrumented in Emacs-27.1 looked like:

    (let* ((v (edebug-after 0 2 x)))
      (progn
        (edebug-after (edebug-before 1) 3 (car v))
        (setcar v (edebug-after (edebug-before 4) 6
                                (cdr (edebug-after 0 5 x))))))

with the new code it will look like:

    (let* ((v (edebug-after 0 2 x)))
      (edebug-after
       (edebug-before 1) 3
       (setcar v (edebug-after (edebug-before 4) 6
                               (cdr (edebug-after 0 5 x))))))

For reference in Emacs-26, it looked like:

    (let* ((v (edebug-after 0 2 x)))
      (setcar v (edebug-after (edebug-before 4) 6
                              (cdr (edebug-after 0 5 x)))))

IIUC Gemini is too busy with real life to look at this now, but my
understanding of the motivation for his change was that the Emacs-26
code left instrumentation points 1 and 3 above completely unused (they
are generated by Edebug and then thrown away by macro expansion), giving
the mistaken impression (to the code-coverage checker) that these
execution paths are not exercised.  The new form should preserve the
benefit of Gemini's change in this respect while improving the behavior
during Edebug.


        Stefan


* lisp/emacs-lisp/gv.el (edebug-after): Don't run getter in the setter

This fixes bug#46573 which was introduced by commit
d79cf638f278e50c22feb53d6ba556f5ce9d7853.
The new code is a middle ground, which makes sure the instrumentation
point is used (so the coverage checker won't have ghost unreachable
instrumentation points) yet without artificially running the getter
when we only need to run the setter.


diff --git a/lisp/emacs-lisp/gv.el b/lisp/emacs-lisp/gv.el
index 3d8054950c..ce48e578e0 100644
--- a/lisp/emacs-lisp/gv.el
+++ b/lisp/emacs-lisp/gv.el
@@ -324,8 +324,7 @@ 'gv-place
        (gv-letplace (getter setter) place
          (funcall do `(edebug-after ,before ,index ,getter)
                   (lambda (store)
-                    `(progn (edebug-after ,before ,index ,getter)
-                            ,(funcall setter store)))))))
+                    `(edebug-after ,before ,index ,(funcall setter store)))))))
 
 ;;; The common generalized variables.
 





Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Tue, 02 Mar 2021 05:59:01 GMT) Full text and rfc822 format available.

Message #35 received at 46573 <at> debbugs.gnu.org (full text, mbox):

From: Eli Zaretskii <eliz <at> gnu.org>
To: Stefan Monnier <monnier <at> iro.umontreal.ca>
Cc: michael_heerdegen <at> web.de, gazally <at> runbox.com, larsi <at> gnus.org,
 46573 <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Tue, 02 Mar 2021 07:58:42 +0200
> From: Stefan Monnier <monnier <at> iro.umontreal.ca>
> Cc: Gemini Lasswell <gazally <at> runbox.com>, michael_heerdegen <at> web.de,
>   46573 <at> debbugs.gnu.org
> Date: Mon, 01 Mar 2021 16:17:40 -0500
> 
> >> I checked older Emacs versions -- (setf foo 'bar) works in Emacs 26.1,
> >> but not in Emacs 27.1.
> > Then we should try fixing it in Emacs 27.2, if that's possible without
> > risky changes.
> 
> I plan to install the patch below into `master` to fix this problem, but
> I believe this change is sufficiently safe for the `emacs-27` branch, so
> you agree I'll install it into `emacs-27` instead.

I'm okay with installing this on the emacs-27 branch, but please wait
for a day to let others comment.

Thanks.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Wed, 03 Mar 2021 23:15:02 GMT) Full text and rfc822 format available.

Message #38 received at 46573 <at> debbugs.gnu.org (full text, mbox):

From: Michael Heerdegen <michael_heerdegen <at> web.de>
To: Stefan Monnier <monnier <at> iro.umontreal.ca>
Cc: Gemini Lasswell <gazally <at> runbox.com>, Eli Zaretskii <eliz <at> gnu.org>,
 Lars Ingebrigtsen <larsi <at> gnus.org>, 46573 <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Thu, 04 Mar 2021 00:13:36 +0100
Stefan Monnier <monnier <at> iro.umontreal.ca> writes:

> >> I checked older Emacs versions -- (setf foo 'bar) works in Emacs 26.1,
> >> but not in Emacs 27.1.
> > Then we should try fixing it in Emacs 27.2, if that's possible without
> > risky changes.
>
> I plan to install the patch below into `master` to fix this problem, but
> I believe this change is sufficiently safe for the `emacs-27` branch, so
> you agree I'll install it into `emacs-27` instead.

I tried your patch (thanks for working on it) now.  The error is gone,
but in my example

  (setf y 3)

when I step with edebug the thing still stops after the "y" to say the
value is "3", not after the number "3" - that position is omitted.  Is
this intentional?

Thanks,

Michael.




Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Wed, 03 Mar 2021 23:27:01 GMT) Full text and rfc822 format available.

Message #41 received at 46573 <at> debbugs.gnu.org (full text, mbox):

From: Stefan Monnier <monnier <at> iro.umontreal.ca>
To: Michael Heerdegen <michael_heerdegen <at> web.de>
Cc: Gemini Lasswell <gazally <at> runbox.com>, Eli Zaretskii <eliz <at> gnu.org>,
 Lars Ingebrigtsen <larsi <at> gnus.org>, 46573 <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Wed, 03 Mar 2021 18:26:12 -0500
>> >> I checked older Emacs versions -- (setf foo 'bar) works in Emacs 26.1,
>> >> but not in Emacs 27.1.
>> > Then we should try fixing it in Emacs 27.2, if that's possible without
>> > risky changes.
>>
>> I plan to install the patch below into `master` to fix this problem, but
>> I believe this change is sufficiently safe for the `emacs-27` branch, so
>> you agree I'll install it into `emacs-27` instead.
>
> I tried your patch (thanks for working on it) now.  The error is gone,
> but in my example
>
>   (setf y 3)
>
> when I step with edebug the thing still stops after the "y" to say the
> value is "3", not after the number "3" - that position is omitted.  Is
> this intentional?

Intentional, maybe not, but expected yes: the instrumentation adds
a "before" step right before the "GV assignment" itself and an "after"
step right after it.

Maybe we should add a special case for when `setf` is used for
a simple variable such that the variable is not instrumented at all,
just as is the case for `setq`?


        Stefan





Information forwarded to bug-gnu-emacs <at> gnu.org:
bug#46573; Package emacs. (Wed, 03 Mar 2021 23:48:01 GMT) Full text and rfc822 format available.

Message #44 received at 46573 <at> debbugs.gnu.org (full text, mbox):

From: Michael Heerdegen <michael_heerdegen <at> web.de>
To: Stefan Monnier <monnier <at> iro.umontreal.ca>
Cc: Gemini Lasswell <gazally <at> runbox.com>, Eli Zaretskii <eliz <at> gnu.org>,
 Lars Ingebrigtsen <larsi <at> gnus.org>, 46573 <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Thu, 04 Mar 2021 00:47:08 +0100
Stefan Monnier <monnier <at> iro.umontreal.ca> writes:

> Maybe we should add a special case for when `setf` is used for
> a simple variable such that the variable is not instrumented at all,
> just as is the case for `setq`?

I don't know.  Maybe not.

When the value expression is a list, i.e. not something self-evaluating
like an number, the behavior doesn't seem so strange anymore to me, it
makes sense.  And my gut feeling is that it would be more confusing to
handle different place expressions differently than setq and setf.

So the fix is ok from my side.  Thanks for the clarification.

Regards,

Michael.




Reply sent to Stefan Monnier <monnier <at> iro.umontreal.ca>:
You have taken responsibility. (Fri, 05 Mar 2021 17:41:01 GMT) Full text and rfc822 format available.

Notification sent to Michael Heerdegen <michael_heerdegen <at> web.de>:
bug acknowledged by developer. (Fri, 05 Mar 2021 17:41:02 GMT) Full text and rfc822 format available.

Message #49 received at 46573-done <at> debbugs.gnu.org (full text, mbox):

From: Stefan Monnier <monnier <at> iro.umontreal.ca>
To: Eli Zaretskii <eliz <at> gnu.org>
Cc: michael_heerdegen <at> web.de, gazally <at> runbox.com, larsi <at> gnus.org,
 46573-done <at> debbugs.gnu.org
Subject: Re: bug#46573: 28.0.50; Error when edebugging setting unbound place
Date: Fri, 05 Mar 2021 12:39:51 -0500
> I'm okay with installing this on the emacs-27 branch, but please wait
> for a day to let others comment.

Pushed,


        Stefan





bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> debbugs.gnu.org. (Sat, 03 Apr 2021 11:24:10 GMT) Full text and rfc822 format available.

This bug report was last modified 3 years and 23 days ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.