GNU logs - #75358, boring messages


Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector
Resent-From: Pip Cet <pipcet@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Sat, 04 Jan 2025 16:38:02 +0000
Resent-Message-ID: <handler.75358.B.17360086374101 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: report 75358
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: 75358 <at> debbugs.gnu.org
X-Debbugs-Original-To: bug-gnu-emacs@HIDDEN
Received: via spool by submit <at> debbugs.gnu.org id=B.17360086374101
          (code B ref -1); Sat, 04 Jan 2025 16:38:02 +0000
Received: (at submit) by debbugs.gnu.org; 4 Jan 2025 16:37:17 +0000
Received: from localhost ([127.0.0.1]:56884 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tU79J-000145-BP
	for submit <at> debbugs.gnu.org; Sat, 04 Jan 2025 11:37:17 -0500
Received: from lists.gnu.org ([2001:470:142::17]:48104)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <pipcet@HIDDEN>)
 id 1tU79I-00013r-8y
 for submit <at> debbugs.gnu.org; Sat, 04 Jan 2025 11:37:16 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <pipcet@HIDDEN>)
 id 1tU79C-0007Ae-GC
 for bug-gnu-emacs@HIDDEN; Sat, 04 Jan 2025 11:37:10 -0500
Received: from mail-4316.protonmail.ch ([185.70.43.16])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <pipcet@HIDDEN>)
 id 1tU79A-0005Qy-PG
 for bug-gnu-emacs@HIDDEN; Sat, 04 Jan 2025 11:37:10 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com;
 s=protonmail3; t=1736008627; x=1736267827;
 bh=rJZiDrP9gDVyDuZEi/CHMZn264d3LYLlkJ4rjAG4lH4=;
 h=Date:To:From:Subject:Message-ID:Feedback-ID:From:To:Cc:Date:
 Subject:Reply-To:Feedback-ID:Message-ID:BIMI-Selector:
 List-Unsubscribe:List-Unsubscribe-Post;
 b=wVy9VqrtG5Froe3rkA6G4WYs+RKTHiGVkhGRrJnpZfEIThB5msg8X5+xXHLqe4wqx
 4Gj2GwyHnT2VbGb9EZonNSIuiH8RvmUwl/gFZiblo0m2ChxxYqVshLU0Merkh/Y0a/
 2oJabxkLVfvb3CSl5jiLBLrZRVd26XjJH2r3PNjQnyjawZC06tFfn4ViJQPAFQ2Ri5
 Gn+mvhxGohift1hT63APG2TQYT9krNP40Fe36iZ0vx6MGsIPyAWQf+nVaQdFyQkJqD
 P4xEilN3Y2cPRCzeaeAFsbl22p2PtF5Ew3CKpRcPywuwfd+tYAhSIS0fxSU7rBPPtK
 An6kui5ajyqIw==
Date: Sat, 04 Jan 2025 16:37:03 +0000
From: Pip Cet <pipcet@HIDDEN>
Message-ID: <87cyh2fsep.fsf@HIDDEN>
Feedback-ID: 112775352:user:proton
X-Pm-Message-ID: 61437615580d5d247ab3fa80711b192ce4f12e12
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=185.70.43.16; envelope-from=pipcet@HIDDEN;
 helo=mail-4316.protonmail.ch
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001,
 RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001,
 RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001,
 SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: 1.0 (+)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)

On scratch/elisp-benchmarks, the following emacs -Q invocation:

./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(p=
rogn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run "b=
ubble"))'

is equivalent to

./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(p=
rogn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run))'

but

./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(p=
rogn (elisp-benchmarks-run "bubble") (delete-other-windows) (elisp-benchmar=
ks-run))'

is not.

(The (delete-other-windows) is necessary because of other issues).

The expected behavior is for the SELECTOR to determine the tests to be
executed, as described in the documentation; in reality, it merely
determines which tests are compiled, then all symbols matching the
regexp produced below are executed.

In the first example, the second SELECTOR argument has no effect,
because the tests to be run are determined as:

=09           (mapatoms (lambda (s)
=09                      (let ((name (symbol-name s)))
=09                        (when (and (fboundp s)
=09                                   (string-match
=09                                    "\\`elb-\\(.*\\)-entry\\'" name))
=09                          (push (match-string 1 name) names)))))

without respecting the SELECTOR argument in any fashion: any elisp
function that happens to match the symbol format is run.

"Fixing" this by applying the selector as a regular expression to the
"name" value seems simple enough, as a stop-gap.  But: IMHO, reserving
chunks of the symbol namespace for special uses is unsatisfactory and
should be avoided.  This is true in both interactive and
non-interactive emacs runs.  Running benchmarks in a live Emacs
session can be useful; running functions based on their symbol name
alone is dangerous.

Of course, the selector is currently applied to file names, not test
names, so we'd have to decide what (elisp-benchmarks-run "font-lock"),
for example, is supposed to do.

IMHO, the proper fix is to use a working test registration mechanism,
ideally ERT.





Message sent:


Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.505 (Entity 5.505)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Pip Cet <pipcet@HIDDEN>
Subject: bug#75358: Acknowledgement ([scratch/elisp-benchmarks] repeated
 runs don't apply selector)
Message-ID: <handler.75358.B.17360086374101.ack <at> debbugs.gnu.org>
References: <87cyh2fsep.fsf@HIDDEN>
X-Gnu-PR-Message: ack 75358
X-Gnu-PR-Package: emacs
Reply-To: 75358 <at> debbugs.gnu.org
Date: Sat, 04 Jan 2025 16:38:02 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 bug-gnu-emacs@HIDDEN

If you wish to submit further information on this problem, please
send it to 75358 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
75358: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D75358
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems


Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector
Resent-From: Andrea Corallo <acorallo@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Mon, 06 Jan 2025 10:18:02 +0000
Resent-Message-ID: <handler.75358.B.173615863810232 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 75358
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: 75358 <at> debbugs.gnu.org
Cc: pipcet@HIDDEN, monnier@HIDDEN
X-Debbugs-Original-To: Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>
X-Debbugs-Original-Cc: Pip Cet <pipcet@HIDDEN>, 75358 <at> debbugs.gnu.org, Stefan Monnier <monnier@HIDDEN>
Received: via spool by submit <at> debbugs.gnu.org id=B.173615863810232
          (code B ref -1); Mon, 06 Jan 2025 10:18:02 +0000
Received: (at submit) by debbugs.gnu.org; 6 Jan 2025 10:17:18 +0000
Received: from localhost ([127.0.0.1]:36765 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tUkAc-0002eo-Mx
	for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:18 -0500
Received: from lists.gnu.org ([2001:470:142::17]:36932)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUkAZ-0002eU-On
 for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:12 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUkAU-0006Sw-6O
 for bug-gnu-emacs@HIDDEN; Mon, 06 Jan 2025 05:17:06 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>)
 id 1tUkAT-0007M3-JK; Mon, 06 Jan 2025 05:17:05 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To:
 From; bh=Qa6RFQf/IrkmlFvxY9S3OMVy5DTu7YgJ7FsMfgCc0po=; b=WLBV33PiUHHNeWTcbfe4
 y+DJvyD2s9F+8v/pyPSK1ANi+wKL/e5fFEbIocJPmgbjwfPVZK3OVkUQOhgBvFIr5isjlae5AwBcb
 WdMzUMk6ac2rbe6GFu3dHIvGsCJCJQDpsC42C4W+SliPZaYNAtkzSFfj9JfrKHEfAhBJI/0uVeSRv
 jv1JfNASVa5XVrud58TizqXxJQwBxmRFFpejPq93GrJgjp1VcrxsYMs/OhRm2B4qm/uTnWYvSTiuY
 bfkhhkprar1x9Q6gck72654KyFz2c6KM8M3YOhBEXe67Ti2CIYePyvoS1xwmwcW6pbi+K0BTMkhwv
 wWOM0ku9akPucA==;
Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1)
 (envelope-from <acorallo@HIDDEN>)
 id 1tUkAS-0002QZ-3O; Mon, 06 Jan 2025 05:17:04 -0500
From: Andrea Corallo <acorallo@HIDDEN>
In-Reply-To: <87cyh2fsep.fsf@HIDDEN> (Pip Cet via's message of "Sat,
 04 Jan 2025 16:37:03 +0000")
References: <87cyh2fsep.fsf@HIDDEN>
Date: Mon, 06 Jan 2025 05:17:04 -0500
Message-ID: <yp1ikqs5jrz.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -0.0 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text
editors" <bug-gnu-emacs@HIDDEN> writes:

> On scratch/elisp-benchmarks, the following emacs -Q invocation:
>
> ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run "bubble"))'
>
> is equivalent to
>
> ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run))'
>
> but
>
> ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run "bubble") (delete-other-windows) (elisp-benchmarks-run))'
>
> is not.
>
> (The (delete-other-windows) is necessary because of other issues).
>
> The expected behavior is for the SELECTOR to determine the tests to be
> executed, as described in the documentation; in reality, it merely
> determines which tests are compiled, then all symbols matching the
> regexp produced below are executed.
>
> In the first example, the second SELECTOR argument has no effect,
> because the tests to be run are determined as:
>
> 	           (mapatoms (lambda (s)
> 	                      (let ((name (symbol-name s)))
> 	                        (when (and (fboundp s)
> 	                                   (string-match
> 	                                    "\\`elb-\\(.*\\)-entry\\'" name))
> 	                          (push (match-string 1 name) names)))))
>
> without respecting the SELECTOR argument in any fashion: any elisp
> function that happens to match the symbol format is run.
>
> "Fixing" this by applying the selector as a regular expression to the
> "name" value seems simple enough, as a stop-gap.

Yep, as mentioned elisp-benachmarks was made (in order to give
meaningful results) to run from a known state, running two times will
not give meaningful results.  Anyway applying the selector to the runner
as well seems a satisfactory fix to me.

> But: IMHO, reserving
> chunks of the symbol namespace for special uses is unsatisfactory and
> should be avoided.  This is true in both interactive and
> non-interactive emacs runs.  Running benchmarks in a live Emacs
> session can be useful; running functions based on their symbol name
> alone is dangerous.
>
> Of course, the selector is currently applied to file names, not test
> names, so we'd have to decide what (elisp-benchmarks-run "font-lock"),
> for example, is supposed to do.

We can also decide to apply it only to test names to disambiguate if we
prefer.




Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector
Resent-From: Andrea Corallo <acorallo@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Mon, 06 Jan 2025 10:18:03 +0000
Resent-Message-ID: <handler.75358.B75358.173615863910238 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 75358
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: 75358 <at> debbugs.gnu.org
Cc: pipcet@HIDDEN, monnier@HIDDEN
X-Debbugs-Original-To: Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>
X-Debbugs-Original-Cc: Pip Cet <pipcet@HIDDEN>, 75358 <at> debbugs.gnu.org, Stefan Monnier <monnier@HIDDEN>
Received: via spool by 75358-submit <at> debbugs.gnu.org id=B75358.173615863910238
          (code B ref 75358); Mon, 06 Jan 2025 10:18:03 +0000
Received: (at 75358) by debbugs.gnu.org; 6 Jan 2025 10:17:19 +0000
Received: from localhost ([127.0.0.1]:36767 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tUkAg-0002ez-L3
	for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:19 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10]:37302)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUkAZ-0002eS-7D
 for 75358 <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:13 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>)
 id 1tUkAT-0007M3-JK; Mon, 06 Jan 2025 05:17:05 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To:
 From; bh=Qa6RFQf/IrkmlFvxY9S3OMVy5DTu7YgJ7FsMfgCc0po=; b=WLBV33PiUHHNeWTcbfe4
 y+DJvyD2s9F+8v/pyPSK1ANi+wKL/e5fFEbIocJPmgbjwfPVZK3OVkUQOhgBvFIr5isjlae5AwBcb
 WdMzUMk6ac2rbe6GFu3dHIvGsCJCJQDpsC42C4W+SliPZaYNAtkzSFfj9JfrKHEfAhBJI/0uVeSRv
 jv1JfNASVa5XVrud58TizqXxJQwBxmRFFpejPq93GrJgjp1VcrxsYMs/OhRm2B4qm/uTnWYvSTiuY
 bfkhhkprar1x9Q6gck72654KyFz2c6KM8M3YOhBEXe67Ti2CIYePyvoS1xwmwcW6pbi+K0BTMkhwv
 wWOM0ku9akPucA==;
Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1)
 (envelope-from <acorallo@HIDDEN>)
 id 1tUkAS-0002QZ-3O; Mon, 06 Jan 2025 05:17:04 -0500
From: Andrea Corallo <acorallo@HIDDEN>
In-Reply-To: <87cyh2fsep.fsf@HIDDEN> (Pip Cet via's message of "Sat,
 04 Jan 2025 16:37:03 +0000")
References: <87cyh2fsep.fsf@HIDDEN>
Date: Mon, 06 Jan 2025 05:17:04 -0500
Message-ID: <yp1ikqs5jrz.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -2.3 (--)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text
editors" <bug-gnu-emacs@HIDDEN> writes:

> On scratch/elisp-benchmarks, the following emacs -Q invocation:
>
> ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run "bubble"))'
>
> is equivalent to
>
> ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run))'
>
> but
>
> ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run "bubble") (delete-other-windows) (elisp-benchmarks-run))'
>
> is not.
>
> (The (delete-other-windows) is necessary because of other issues).
>
> The expected behavior is for the SELECTOR to determine the tests to be
> executed, as described in the documentation; in reality, it merely
> determines which tests are compiled, then all symbols matching the
> regexp produced below are executed.
>
> In the first example, the second SELECTOR argument has no effect,
> because the tests to be run are determined as:
>
> 	           (mapatoms (lambda (s)
> 	                      (let ((name (symbol-name s)))
> 	                        (when (and (fboundp s)
> 	                                   (string-match
> 	                                    "\\`elb-\\(.*\\)-entry\\'" name))
> 	                          (push (match-string 1 name) names)))))
>
> without respecting the SELECTOR argument in any fashion: any elisp
> function that happens to match the symbol format is run.
>
> "Fixing" this by applying the selector as a regular expression to the
> "name" value seems simple enough, as a stop-gap.

Yep, as mentioned elisp-benachmarks was made (in order to give
meaningful results) to run from a known state, running two times will
not give meaningful results.  Anyway applying the selector to the runner
as well seems a satisfactory fix to me.

> But: IMHO, reserving
> chunks of the symbol namespace for special uses is unsatisfactory and
> should be avoided.  This is true in both interactive and
> non-interactive emacs runs.  Running benchmarks in a live Emacs
> session can be useful; running functions based on their symbol name
> alone is dangerous.
>
> Of course, the selector is currently applied to file names, not test
> names, so we'd have to decide what (elisp-benchmarks-run "font-lock"),
> for example, is supposed to do.

We can also decide to apply it only to test names to disambiguate if we
prefer.




Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector
Resent-From: Stefan Monnier <monnier@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Mon, 06 Jan 2025 14:40:02 +0000
Resent-Message-ID: <handler.75358.B.173617436030154 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 75358
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Andrea Corallo <acorallo@HIDDEN>
Cc: 75358 <at> debbugs.gnu.org, pipcet@HIDDEN
X-Debbugs-Original-Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org, Pip Cet <pipcet@HIDDEN>
Received: via spool by submit <at> debbugs.gnu.org id=B.173617436030154
          (code B ref -1); Mon, 06 Jan 2025 14:40:02 +0000
Received: (at submit) by debbugs.gnu.org; 6 Jan 2025 14:39:20 +0000
Received: from localhost ([127.0.0.1]:37480 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tUoGF-0007qI-Ko
	for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:20 -0500
Received: from lists.gnu.org ([2001:470:142::17]:40806)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <monnier@HIDDEN>)
 id 1tUoGB-0007pp-Ub
 for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:16 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <monnier@HIDDEN>)
 id 1tUoG6-0002vf-GQ
 for bug-gnu-emacs@HIDDEN; Mon, 06 Jan 2025 09:39:10 -0500
Received: from mailscanner.iro.umontreal.ca ([132.204.25.50])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <monnier@HIDDEN>)
 id 1tUoG4-00051B-Qo; Mon, 06 Jan 2025 09:39:10 -0500
Received: from pmg1.iro.umontreal.ca (localhost.localdomain [127.0.0.1])
 by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id 91EE8100043;
 Mon,  6 Jan 2025 09:39:07 -0500 (EST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca;
 s=mail; t=1736174346;
 bh=TveHrl3QtuMWXQIRMor7BcLieMQyOP2VK43zG0Zkwbs=;
 h=From:To:Cc:Subject:In-Reply-To:References:Date:From;
 b=B652UHfKbeO4iiUXhpZNqRO+4az5uQgdDWXoZxe+LuGelaUpcfSNJlr9Wp3rn73N3
 Lvz46HZdL0pdxZVa00OIvNVcYJrCzE9h0woHFSgXuMQhmsXklPHCjQ/7Sg5PNpKY0s
 NKUE6o6BWCbMepmjecsgG+j5gkCNqNWqQ4J20YKY4we5nwRu68vrSI0RLiP7IRfSHM
 BjWfFvJ67jLuU0NTjDjIDFQaN7ikgxgDHODBdHSN+ItnC+PyiSJrJVEfTdcdIEyQd5
 xTm63T6Ta0fbAN/m05uelSPzlcqNF/QE+FlRA/5VXEZoQ/7NKrrurmNvwUSMDESRsY
 o3kICo57/03pg==
Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1])
 by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id CA540100035;
 Mon,  6 Jan 2025 09:39:06 -0500 (EST)
Received: from pastel (69-165-162-104.dsl.teksavvy.com [69.165.162.104])
 by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 9A3D212022A;
 Mon,  6 Jan 2025 09:39:06 -0500 (EST)
From: Stefan Monnier <monnier@HIDDEN>
In-Reply-To: <yp1ikqs5jrz.fsf@HIDDEN> (Andrea Corallo's message of
 "Mon, 06 Jan 2025 05:17:04 -0500")
Message-ID: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN>
References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN>
Date: Mon, 06 Jan 2025 09:39:06 -0500
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-SPAM-INFO: Spam detection results:  0
 ALL_TRUSTED                -1 Passed through trusted hosts only via SMTP
 BAYES_00                 -1.9 Bayes spam probability is 0 to 1%
 DKIM_SIGNED               0.1 Message has a DKIM or DK signature,
 not necessarily valid
 DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature
 DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's
 domain
 DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from
 domain
X-SPAM-LEVEL: 
Received-SPF: pass client-ip=132.204.25.50;
 envelope-from=monnier@HIDDEN; helo=mailscanner.iro.umontreal.ca
X-Spam_score_int: -42
X-Spam_score: -4.3
X-Spam_bar: ----
X-Spam_report: (-4.3 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_MED=-2.3,
 RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001,
 SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: 0.0 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

>> The expected behavior is for the SELECTOR to determine the tests to be
>> executed, as described in the documentation; in reality, it merely
>> determines which tests are compiled, then all symbols matching the
>> regexp produced below are executed.

Originally, there was only one benchmark per file, so SELECTOR
selects the files.  Maybe we should simply always load all the files and
then use SELECTOR to select the `elb-*-entry` functions?


        Stefan





Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector
Resent-From: Stefan Monnier <monnier@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Mon, 06 Jan 2025 14:40:03 +0000
Resent-Message-ID: <handler.75358.B75358.173617435530138 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 75358
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Andrea Corallo <acorallo@HIDDEN>
Cc: 75358 <at> debbugs.gnu.org, pipcet@HIDDEN
X-Debbugs-Original-Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org, Pip Cet <pipcet@HIDDEN>
Received: via spool by 75358-submit <at> debbugs.gnu.org id=B75358.173617435530138
          (code B ref 75358); Mon, 06 Jan 2025 14:40:03 +0000
Received: (at 75358) by debbugs.gnu.org; 6 Jan 2025 14:39:15 +0000
Received: from localhost ([127.0.0.1]:37476 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tUoGB-0007q2-Ao
	for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:15 -0500
Received: from mailscanner.iro.umontreal.ca ([132.204.25.50]:50096)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <monnier@HIDDEN>)
 id 1tUoG9-0007pl-8p
 for 75358 <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:13 -0500
Received: from pmg1.iro.umontreal.ca (localhost.localdomain [127.0.0.1])
 by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id 91EE8100043;
 Mon,  6 Jan 2025 09:39:07 -0500 (EST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca;
 s=mail; t=1736174346;
 bh=TveHrl3QtuMWXQIRMor7BcLieMQyOP2VK43zG0Zkwbs=;
 h=From:To:Cc:Subject:In-Reply-To:References:Date:From;
 b=B652UHfKbeO4iiUXhpZNqRO+4az5uQgdDWXoZxe+LuGelaUpcfSNJlr9Wp3rn73N3
 Lvz46HZdL0pdxZVa00OIvNVcYJrCzE9h0woHFSgXuMQhmsXklPHCjQ/7Sg5PNpKY0s
 NKUE6o6BWCbMepmjecsgG+j5gkCNqNWqQ4J20YKY4we5nwRu68vrSI0RLiP7IRfSHM
 BjWfFvJ67jLuU0NTjDjIDFQaN7ikgxgDHODBdHSN+ItnC+PyiSJrJVEfTdcdIEyQd5
 xTm63T6Ta0fbAN/m05uelSPzlcqNF/QE+FlRA/5VXEZoQ/7NKrrurmNvwUSMDESRsY
 o3kICo57/03pg==
Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1])
 by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id CA540100035;
 Mon,  6 Jan 2025 09:39:06 -0500 (EST)
Received: from pastel (69-165-162-104.dsl.teksavvy.com [69.165.162.104])
 by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 9A3D212022A;
 Mon,  6 Jan 2025 09:39:06 -0500 (EST)
From: Stefan Monnier <monnier@HIDDEN>
In-Reply-To: <yp1ikqs5jrz.fsf@HIDDEN> (Andrea Corallo's message of
 "Mon, 06 Jan 2025 05:17:04 -0500")
Message-ID: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN>
References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN>
Date: Mon, 06 Jan 2025 09:39:06 -0500
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-SPAM-INFO: Spam detection results:  0
 ALL_TRUSTED                -1 Passed through trusted hosts only via SMTP
 BAYES_00                 -1.9 Bayes spam probability is 0 to 1%
 DKIM_SIGNED               0.1 Message has a DKIM or DK signature,
 not necessarily valid
 DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature
 DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's
 domain
 DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from
 domain
X-SPAM-LEVEL: 
X-Spam-Score: -2.3 (--)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

>> The expected behavior is for the SELECTOR to determine the tests to be
>> executed, as described in the documentation; in reality, it merely
>> determines which tests are compiled, then all symbols matching the
>> regexp produced below are executed.

Originally, there was only one benchmark per file, so SELECTOR
selects the files.  Maybe we should simply always load all the files and
then use SELECTOR to select the `elb-*-entry` functions?


        Stefan





Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector
Resent-From: Andrea Corallo <acorallo@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Mon, 06 Jan 2025 20:36:02 +0000
Resent-Message-ID: <handler.75358.B.17361957286166 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 75358
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Stefan Monnier <monnier@HIDDEN>
Cc: 75358 <at> debbugs.gnu.org, pipcet@HIDDEN
X-Debbugs-Original-Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org, Pip Cet <pipcet@HIDDEN>
Received: via spool by submit <at> debbugs.gnu.org id=B.17361957286166
          (code B ref -1); Mon, 06 Jan 2025 20:36:02 +0000
Received: (at submit) by debbugs.gnu.org; 6 Jan 2025 20:35:28 +0000
Received: from localhost ([127.0.0.1]:40346 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tUtou-0001bL-0t
	for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:28 -0500
Received: from lists.gnu.org ([2001:470:142::17]:39596)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUtos-0001ao-Fj
 for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:26 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUtom-0007ZZ-KG
 for bug-gnu-emacs@HIDDEN; Mon, 06 Jan 2025 15:35:20 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>)
 id 1tUtol-0006qe-8p; Mon, 06 Jan 2025 15:35:19 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To:
 From; bh=oNHXMFFw0lbUpjQ91MnT6Zu1wXAOfLj8Jqm0bSqHML0=; b=iGv6Nj2g9ZQv1ahSX/Ie
 Jp+M7G6j1sTcs/NQCDzhsUlKW9P5Jufo6hugVBAsA9gEzCChWEGt4lhZqNddDbDiUBky9i1ocwkeh
 ppRUb7ezHOwfWETopj7/IiZLKhnTWWzFY7cu13qrhtBsvJHtJ1Lj9lwtryKrBFn24U+zszvy6//JJ
 ti1aHP2sDFuPy+vnv/bpvY+CBKGCsMi7LmtKUNjV8KRmqox9ozCMwl26oTEGbliWhrO0XSZ0Sn5Qu
 b3r//iaVWY4+yzL4VAaE5Ljk0ENLohVMK3tUW/m/ddHA8npxPOUkQYEWxIhiI1sOK1WXbAkcL4oI8
 ZBnwcn6+QUPV9A==;
Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1)
 (envelope-from <acorallo@HIDDEN>)
 id 1tUtok-0005wz-2m; Mon, 06 Jan 2025 15:35:18 -0500
From: Andrea Corallo <acorallo@HIDDEN>
In-Reply-To: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> (Stefan Monnier's message
 of "Mon, 06 Jan 2025 09:39:06 -0500")
References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN>
 <jwv7c78ovom.fsf-monnier+emacs@HIDDEN>
Date: Mon, 06 Jan 2025 15:35:17 -0500
Message-ID: <yp1r05f4r5m.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -0.0 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Stefan Monnier <monnier@HIDDEN> writes:

>>> The expected behavior is for the SELECTOR to determine the tests to be
>>> executed, as described in the documentation; in reality, it merely
>>> determines which tests are compiled, then all symbols matching the
>>> regexp produced below are executed.
>
> Originally, there was only one benchmark per file, so SELECTOR
> selects the files.  Maybe we should simply always load all the files and
> then use SELECTOR to select the `elb-*-entry` functions?

+1




Message sent to bug-gnu-emacs@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector
Resent-From: Andrea Corallo <acorallo@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-gnu-emacs@HIDDEN
Resent-Date: Mon, 06 Jan 2025 20:36:02 +0000
Resent-Message-ID: <handler.75358.B75358.17361957286157 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 75358
X-GNU-PR-Package: emacs
X-GNU-PR-Keywords: 
To: Stefan Monnier <monnier@HIDDEN>
Cc: 75358 <at> debbugs.gnu.org, pipcet@HIDDEN
X-Debbugs-Original-Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org, Pip Cet <pipcet@HIDDEN>
Received: via spool by 75358-submit <at> debbugs.gnu.org id=B75358.17361957286157
          (code B ref 75358); Mon, 06 Jan 2025 20:36:02 +0000
Received: (at 75358) by debbugs.gnu.org; 6 Jan 2025 20:35:28 +0000
Received: from localhost ([127.0.0.1]:40344 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tUtot-0001bF-JA
	for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:27 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10]:51772)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUtor-0001am-Kn
 for 75358 <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:26 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>)
 id 1tUtol-0006qe-8p; Mon, 06 Jan 2025 15:35:19 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To:
 From; bh=oNHXMFFw0lbUpjQ91MnT6Zu1wXAOfLj8Jqm0bSqHML0=; b=iGv6Nj2g9ZQv1ahSX/Ie
 Jp+M7G6j1sTcs/NQCDzhsUlKW9P5Jufo6hugVBAsA9gEzCChWEGt4lhZqNddDbDiUBky9i1ocwkeh
 ppRUb7ezHOwfWETopj7/IiZLKhnTWWzFY7cu13qrhtBsvJHtJ1Lj9lwtryKrBFn24U+zszvy6//JJ
 ti1aHP2sDFuPy+vnv/bpvY+CBKGCsMi7LmtKUNjV8KRmqox9ozCMwl26oTEGbliWhrO0XSZ0Sn5Qu
 b3r//iaVWY4+yzL4VAaE5Ljk0ENLohVMK3tUW/m/ddHA8npxPOUkQYEWxIhiI1sOK1WXbAkcL4oI8
 ZBnwcn6+QUPV9A==;
Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1)
 (envelope-from <acorallo@HIDDEN>)
 id 1tUtok-0005wz-2m; Mon, 06 Jan 2025 15:35:18 -0500
From: Andrea Corallo <acorallo@HIDDEN>
In-Reply-To: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> (Stefan Monnier's message
 of "Mon, 06 Jan 2025 09:39:06 -0500")
References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN>
 <jwv7c78ovom.fsf-monnier+emacs@HIDDEN>
Date: Mon, 06 Jan 2025 15:35:17 -0500
Message-ID: <yp1r05f4r5m.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -2.3 (--)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Stefan Monnier <monnier@HIDDEN> writes:

>>> The expected behavior is for the SELECTOR to determine the tests to be
>>> executed, as described in the documentation; in reality, it merely
>>> determines which tests are compiled, then all symbols matching the
>>> regexp produced below are executed.
>
> Originally, there was only one benchmark per file, so SELECTOR
> selects the files.  Maybe we should simply always load all the files and
> then use SELECTOR to select the `elb-*-entry` functions?

+1




Message received at control <at> debbugs.gnu.org:


Received: (at control) by debbugs.gnu.org; 2 Mar 2025 04:11:56 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Mar 01 23:11:56 2025
Received: from localhost ([127.0.0.1]:49620 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1toagF-0004bc-Rf
	for submit <at> debbugs.gnu.org; Sat, 01 Mar 2025 23:11:56 -0500
Received: from mail-ej1-x62b.google.com ([2a00:1450:4864:20::62b]:57690)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)
 (Exim 4.84_2) (envelope-from <stefankangas@HIDDEN>)
 id 1toagD-0004bA-E1
 for control <at> debbugs.gnu.org; Sat, 01 Mar 2025 23:11:53 -0500
Received: by mail-ej1-x62b.google.com with SMTP id
 a640c23a62f3a-abf5358984bso129742866b.3
 for <control <at> debbugs.gnu.org>; Sat, 01 Mar 2025 20:11:53 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=gmail.com; s=20230601; t=1740888707; x=1741493507; darn=debbugs.gnu.org;
 h=to:subject:message-id:date:mime-version:from:from:to:cc:subject
 :date:message-id:reply-to;
 bh=VZnBu/ivHIv0DRkvW6oub4m86YEvTe6FPdzmB7NKsec=;
 b=KbhBlX5mshyhWYa39LbJ2AK25cwbDn0RZCqT2lt3A1U9WRBzBODM2ErqJbVhxntptr
 +5RMyIoBNUDmuw4v/Cigs2ttagDYZsa9Qr39SNET/q3IxaDKgEGXAgvL+R5nFiuoHUa9
 UkZfMv5ms/6zEy07CyDxzFOItpgmsMyR6NcpwfCXM5Gd39ZjaiSLN4jMHz5viKbQZcuK
 yS9xFSjvT0lyR2xPXJQtpDNmZJ0XZQ3Qcnlwd03jL6bqGlS6Tabshq/6eXIknvACExVm
 M3a69WUtuSLqrjlfB7lRCa+Gi8ok+AdVtxww5v9yn5nztZ+1jekI1IugUwR4VidI3W+u
 2zOA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20230601; t=1740888707; x=1741493507;
 h=to:subject:message-id:date:mime-version:from:x-gm-message-state
 :from:to:cc:subject:date:message-id:reply-to;
 bh=VZnBu/ivHIv0DRkvW6oub4m86YEvTe6FPdzmB7NKsec=;
 b=NKjnBiinPiwjqpOR+GgnYnWz29lSNmWTU/A9taGsOjkkiko7CJonBPzXJQVmZFq1O6
 ki1yPy3uLepwqcB0nigBiEQQCcw7OTEOQ1BAetqhBCsfc4hfJ2GmqfTwmtf2GC/CT3Xf
 jhH7nUwBPyjP60WwbpOh0HkceteS31ROUjaHWKn2SWJ4+nz12PkVVJONwvF7U3TkuSlg
 c5f8l9aSZSNdatowHqH31UIe2tJFyqW8+7jq7/HuZBxHyrS8aerX1HuYQ4a95+HV2CMe
 8BN9GrJkwcHYCl5/rSJnhQFM1Hrsv2vMhfYbczpXUXw2eZokPT2Sr/7FFmqp4V8/3tqB
 ys5w==
X-Gm-Message-State: AOJu0YziJBw3V8MVHfEhG1sWbvYpNudPD7O6ucenSQDYo/A4ju6V2hUE
 LDcnTS0Mq9BHGbhhpguIehgwuCHKSbLaOvtFYl4kVlXivBtxg0XMnf+H8wQbHrbNirxbUNLvp4z
 NSMcO4ZioXPDGDhyt8mwiuXsUiVzxZAaM/HU=
X-Gm-Gg: ASbGncvVZQO12nsHPxXSjR5OdUoLYu54FpM4ZpXaJvXM5aJHQUZdrPe/NvtsvsSCyrH
 1HtVoiUP7IY35Oc8cefsKdQ4QJ3xj+00f4sd2UsotqhIPfnxgCfy1WMWr+W6yLVL7TmQ5z1nu+H
 h0391hOuDbudVqaAlHO3vu/w8phQ==
X-Google-Smtp-Source: AGHT+IEL9LUVq+txN8iMeXBJPPh+yFnHbrwHlAQ7VbOmWlN1vab3H9wWcaKxFPUNY6B3F9FpJ7BpWx9fwnQgqNJClHQ=
X-Received: by 2002:a17:906:6a13:b0:abf:1984:181a with SMTP id
 a640c23a62f3a-abf265fc290mr1174213366b.52.1740888707176; Sat, 01 Mar 2025
 20:11:47 -0800 (PST)
Received: from 753933720722 named unknown by gmailapi.google.com with
 HTTPREST; Sat, 1 Mar 2025 20:11:46 -0800
From: Stefan Kangas <stefankangas@HIDDEN>
MIME-Version: 1.0
Date: Sat, 1 Mar 2025 20:11:46 -0800
X-Gm-Features: AQ5f1JoRgcSi87ZtKaUHoOG7uueXWEvCIO1KgiaS1WJt8FVdznx2xrJQ_gsd_JQ
Message-ID: <CADwFkmkwOU5QpXFM_2i3sEMknr7db=nm+uGN=AXVEPEvLezQOA@HIDDEN>
Subject: control message for bug #75358
To: control <at> debbugs.gnu.org
Content-Type: text/plain; charset="UTF-8"
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: control
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

severity 75358 wishlist
quit





Last modified: Sun, 2 Mar 2025 04:15:03 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.