GNU logs - #62471, boring messages

Message sent to bug-gnu-emacs@HIDDEN:

Subject: bug#62471: 29.0.60; `erts-run-test' results inconsistent with batch mode
Resent-From: Troy Brown <brownts@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Sun, 26 Mar 2023 22:29:02 +0000
Resent-Message-ID: <handler.62471.B.16798697263860 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: 62471 <at> debbugs.gnu.org
MIME-Version: 1.0
From: Troy Brown <brownts@HIDDEN>
Date: Sun, 26 Mar 2023 18:28:27 -0400
Message-ID: <CABvCZ41xUozoZGWAW88HMD0HFfBWW=0DG2H=CVqaVNAaScB0Bw@HIDDEN>
Content-Type: text/plain; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=209.85.208.42;
 envelope-from=troy.s.brown@HIDDEN; helo=mail-ed1-f42.google.com
X-Spam_score_int: -13
X-Spam_score: -1.4
X-Spam_bar: -
X-Spam_report: (-1.4 / 5.0 requ) BAYES_00=-1.9, FREEMAIL_FORGED_FROMDOMAIN=0.25,
 FREEMAIL_FROM=0.001, HEADER_FROM_DIFFERENT_DOMAINS=0.25,
 RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001,
 SPF_PASS=-0.001 autolearn=no autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.1 (-)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.1 (--)

Interactively running `erts-run-test' provides different (i.e.,
incorrect) results as when the test is run in batch mode.  I noticed
this happens when a new "code" block is introduced.  In the following
situation, there are two ERTS tests, each one supplies its own "code"
block associated with the test case.  When I interactively attempt to
execute the second test case (i.e., C-c C-c from within `erts-mode'),
the test fails and the expected results match the output from the first
case.

I used the following two test files.  `hi-test.el' is used to run the
test in batch mode (emacs -batch -l ert -l hi-test.el -f
ert-run-tests-batch-and-exit).  This just runs the ERTS test cases.
The second file (located relatively from `hi-test.el' in
resources/hi.erts) contains the two test cases.

hi-test.el:

(require 'ert)
(require 'ert-x)

(ert-deftest hi-test-run ()
  (ert-test-erts-file (ert-resource-file "hi.erts")))


resources/hi.erts:

Code:
  (lambda ()
    (fundamental-mode)
    (goto-char (point-max))
    (insert "there\n"))

Name: Hi there

=3D-=3D
Hi
=3D-=3D
Hi
there
=3D-=3D-=3D

Code:
  (lambda ()
    (fundamental-mode)
    (goto-char (point-max))
    (insert "you\n"))

Name: Hi you

=3D-=3D
Hi
=3D-=3D
Hi
you
=3D-=3D-=3D

Running in batch mode, I get the following result:

Running 1 tests (2023-03-26 18:10:33-0400, selector =E2=80=98t=E2=80=99)
   passed  1/1  hi-test-run (0.000384 sec)

Ran 1 tests, 1 results as expected, 0 unexpected (2023-03-26
18:10:33-0400, 0.000493 sec)

Running interactively in the `erts-mode' buffer, I get the following
result:

Test failure; result:
Hi
there

Message sent:

Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.505 (Entity 5.505)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Troy Brown <brownts@HIDDEN>
Subject: bug#62471: Acknowledgement (29.0.60; `erts-run-test' results
 inconsistent with batch mode)
Message-ID: <handler.62471.B.16798697263860.ack <at> debbugs.gnu.org>
References: <CABvCZ41xUozoZGWAW88HMD0HFfBWW=0DG2H=CVqaVNAaScB0Bw@HIDDEN>
X-Gnu-PR-Message: ack 62471
X-Gnu-PR-Package: emacs
Reply-To: 62471 <at> debbugs.gnu.org
Date: Sun, 26 Mar 2023 22:29:02 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 bug-gnu-emacs@HIDDEN

If you wish to submit further information on this problem, please
send it to 62471 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
62471: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D62471
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems

Last modified: Sun, 26 Mar 2023 22:30:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.