X-Loop: help-debbugs@HIDDEN Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector Resent-From: Pip Cet <pipcet@HIDDEN> Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> Resent-CC: bug-gnu-emacs@HIDDEN Resent-Date: Sat, 04 Jan 2025 16:38:02 +0000 Resent-Message-ID: <handler.75358.B.17360086374101 <at> debbugs.gnu.org> Resent-Sender: help-debbugs@HIDDEN X-GNU-PR-Message: report 75358 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: 75358 <at> debbugs.gnu.org X-Debbugs-Original-To: bug-gnu-emacs@HIDDEN Received: via spool by submit <at> debbugs.gnu.org id=B.17360086374101 (code B ref -1); Sat, 04 Jan 2025 16:38:02 +0000 Received: (at submit) by debbugs.gnu.org; 4 Jan 2025 16:37:17 +0000 Received: from localhost ([127.0.0.1]:56884 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tU79J-000145-BP for submit <at> debbugs.gnu.org; Sat, 04 Jan 2025 11:37:17 -0500 Received: from lists.gnu.org ([2001:470:142::17]:48104) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <pipcet@HIDDEN>) id 1tU79I-00013r-8y for submit <at> debbugs.gnu.org; Sat, 04 Jan 2025 11:37:16 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <pipcet@HIDDEN>) id 1tU79C-0007Ae-GC for bug-gnu-emacs@HIDDEN; Sat, 04 Jan 2025 11:37:10 -0500 Received: from mail-4316.protonmail.ch ([185.70.43.16]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <pipcet@HIDDEN>) id 1tU79A-0005Qy-PG for bug-gnu-emacs@HIDDEN; Sat, 04 Jan 2025 11:37:10 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail3; t=1736008627; x=1736267827; bh=rJZiDrP9gDVyDuZEi/CHMZn264d3LYLlkJ4rjAG4lH4=; h=Date:To:From:Subject:Message-ID:Feedback-ID:From:To:Cc:Date: Subject:Reply-To:Feedback-ID:Message-ID:BIMI-Selector: List-Unsubscribe:List-Unsubscribe-Post; b=wVy9VqrtG5Froe3rkA6G4WYs+RKTHiGVkhGRrJnpZfEIThB5msg8X5+xXHLqe4wqx 4Gj2GwyHnT2VbGb9EZonNSIuiH8RvmUwl/gFZiblo0m2ChxxYqVshLU0Merkh/Y0a/ 2oJabxkLVfvb3CSl5jiLBLrZRVd26XjJH2r3PNjQnyjawZC06tFfn4ViJQPAFQ2Ri5 Gn+mvhxGohift1hT63APG2TQYT9krNP40Fe36iZ0vx6MGsIPyAWQf+nVaQdFyQkJqD P4xEilN3Y2cPRCzeaeAFsbl22p2PtF5Ew3CKpRcPywuwfd+tYAhSIS0fxSU7rBPPtK An6kui5ajyqIw== Date: Sat, 04 Jan 2025 16:37:03 +0000 From: Pip Cet <pipcet@HIDDEN> Message-ID: <87cyh2fsep.fsf@HIDDEN> Feedback-ID: 112775352:user:proton X-Pm-Message-ID: 61437615580d5d247ab3fa80711b192ce4f12e12 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=185.70.43.16; envelope-from=pipcet@HIDDEN; helo=mail-4316.protonmail.ch X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 1.0 (+) X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -0.0 (/) On scratch/elisp-benchmarks, the following emacs -Q invocation: ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(p= rogn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run "b= ubble"))' is equivalent to ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(p= rogn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run))' but ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(p= rogn (elisp-benchmarks-run "bubble") (delete-other-windows) (elisp-benchmar= ks-run))' is not. (The (delete-other-windows) is necessary because of other issues). The expected behavior is for the SELECTOR to determine the tests to be executed, as described in the documentation; in reality, it merely determines which tests are compiled, then all symbols matching the regexp produced below are executed. In the first example, the second SELECTOR argument has no effect, because the tests to be run are determined as: =09 (mapatoms (lambda (s) =09 (let ((name (symbol-name s))) =09 (when (and (fboundp s) =09 (string-match =09 "\\`elb-\\(.*\\)-entry\\'" name)) =09 (push (match-string 1 name) names))))) without respecting the SELECTOR argument in any fashion: any elisp function that happens to match the symbol format is run. "Fixing" this by applying the selector as a regular expression to the "name" value seems simple enough, as a stop-gap. But: IMHO, reserving chunks of the symbol namespace for special uses is unsatisfactory and should be avoided. This is true in both interactive and non-interactive emacs runs. Running benchmarks in a live Emacs session can be useful; running functions based on their symbol name alone is dangerous. Of course, the selector is currently applied to file names, not test names, so we'd have to decide what (elisp-benchmarks-run "font-lock"), for example, is supposed to do. IMHO, the proper fix is to use a working test registration mechanism, ideally ERT.
Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.505 (Entity 5.505) Content-Type: text/plain; charset=utf-8 X-Loop: help-debbugs@HIDDEN From: help-debbugs@HIDDEN (GNU bug Tracking System) To: Pip Cet <pipcet@HIDDEN> Subject: bug#75358: Acknowledgement ([scratch/elisp-benchmarks] repeated runs don't apply selector) Message-ID: <handler.75358.B.17360086374101.ack <at> debbugs.gnu.org> References: <87cyh2fsep.fsf@HIDDEN> X-Gnu-PR-Message: ack 75358 X-Gnu-PR-Package: emacs Reply-To: 75358 <at> debbugs.gnu.org Date: Sat, 04 Jan 2025 16:38:02 +0000 Thank you for filing a new bug report with debbugs.gnu.org. This is an automatically generated reply to let you know your message has been received. Your message is being forwarded to the package maintainers and other interested parties for their attention; they will reply in due course. Your message has been sent to the package maintainer(s): bug-gnu-emacs@HIDDEN If you wish to submit further information on this problem, please send it to 75358 <at> debbugs.gnu.org. Please do not send mail to help-debbugs@HIDDEN unless you wish to report a problem with the Bug-tracking system. --=20 75358: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D75358 GNU Bug Tracking System Contact help-debbugs@HIDDEN with problems
X-Loop: help-debbugs@HIDDEN Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector Resent-From: Andrea Corallo <acorallo@HIDDEN> Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> Resent-CC: bug-gnu-emacs@HIDDEN Resent-Date: Mon, 06 Jan 2025 10:18:02 +0000 Resent-Message-ID: <handler.75358.B.173615863810232 <at> debbugs.gnu.org> Resent-Sender: help-debbugs@HIDDEN X-GNU-PR-Message: followup 75358 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: 75358 <at> debbugs.gnu.org Cc: pipcet@HIDDEN, monnier@HIDDEN X-Debbugs-Original-To: Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN> X-Debbugs-Original-Cc: Pip Cet <pipcet@HIDDEN>, 75358 <at> debbugs.gnu.org, Stefan Monnier <monnier@HIDDEN> Received: via spool by submit <at> debbugs.gnu.org id=B.173615863810232 (code B ref -1); Mon, 06 Jan 2025 10:18:02 +0000 Received: (at submit) by debbugs.gnu.org; 6 Jan 2025 10:17:18 +0000 Received: from localhost ([127.0.0.1]:36765 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tUkAc-0002eo-Mx for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:18 -0500 Received: from lists.gnu.org ([2001:470:142::17]:36932) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUkAZ-0002eU-On for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:12 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUkAU-0006Sw-6O for bug-gnu-emacs@HIDDEN; Mon, 06 Jan 2025 05:17:06 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUkAT-0007M3-JK; Mon, 06 Jan 2025 05:17:05 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=Qa6RFQf/IrkmlFvxY9S3OMVy5DTu7YgJ7FsMfgCc0po=; b=WLBV33PiUHHNeWTcbfe4 y+DJvyD2s9F+8v/pyPSK1ANi+wKL/e5fFEbIocJPmgbjwfPVZK3OVkUQOhgBvFIr5isjlae5AwBcb WdMzUMk6ac2rbe6GFu3dHIvGsCJCJQDpsC42C4W+SliPZaYNAtkzSFfj9JfrKHEfAhBJI/0uVeSRv jv1JfNASVa5XVrud58TizqXxJQwBxmRFFpejPq93GrJgjp1VcrxsYMs/OhRm2B4qm/uTnWYvSTiuY bfkhhkprar1x9Q6gck72654KyFz2c6KM8M3YOhBEXe67Ti2CIYePyvoS1xwmwcW6pbi+K0BTMkhwv wWOM0ku9akPucA==; Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUkAS-0002QZ-3O; Mon, 06 Jan 2025 05:17:04 -0500 From: Andrea Corallo <acorallo@HIDDEN> In-Reply-To: <87cyh2fsep.fsf@HIDDEN> (Pip Cet via's message of "Sat, 04 Jan 2025 16:37:03 +0000") References: <87cyh2fsep.fsf@HIDDEN> Date: Mon, 06 Jan 2025 05:17:04 -0500 Message-ID: <yp1ikqs5jrz.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -0.0 (/) X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN> writes: > On scratch/elisp-benchmarks, the following emacs -Q invocation: > > ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run "bubble"))' > > is equivalent to > > ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run))' > > but > > ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run "bubble") (delete-other-windows) (elisp-benchmarks-run))' > > is not. > > (The (delete-other-windows) is necessary because of other issues). > > The expected behavior is for the SELECTOR to determine the tests to be > executed, as described in the documentation; in reality, it merely > determines which tests are compiled, then all symbols matching the > regexp produced below are executed. > > In the first example, the second SELECTOR argument has no effect, > because the tests to be run are determined as: > > (mapatoms (lambda (s) > (let ((name (symbol-name s))) > (when (and (fboundp s) > (string-match > "\\`elb-\\(.*\\)-entry\\'" name)) > (push (match-string 1 name) names))))) > > without respecting the SELECTOR argument in any fashion: any elisp > function that happens to match the symbol format is run. > > "Fixing" this by applying the selector as a regular expression to the > "name" value seems simple enough, as a stop-gap. Yep, as mentioned elisp-benachmarks was made (in order to give meaningful results) to run from a known state, running two times will not give meaningful results. Anyway applying the selector to the runner as well seems a satisfactory fix to me. > But: IMHO, reserving > chunks of the symbol namespace for special uses is unsatisfactory and > should be avoided. This is true in both interactive and > non-interactive emacs runs. Running benchmarks in a live Emacs > session can be useful; running functions based on their symbol name > alone is dangerous. > > Of course, the selector is currently applied to file names, not test > names, so we'd have to decide what (elisp-benchmarks-run "font-lock"), > for example, is supposed to do. We can also decide to apply it only to test names to disambiguate if we prefer.
X-Loop: help-debbugs@HIDDEN Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector Resent-From: Andrea Corallo <acorallo@HIDDEN> Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> Resent-CC: bug-gnu-emacs@HIDDEN Resent-Date: Mon, 06 Jan 2025 10:18:03 +0000 Resent-Message-ID: <handler.75358.B75358.173615863910238 <at> debbugs.gnu.org> Resent-Sender: help-debbugs@HIDDEN X-GNU-PR-Message: followup 75358 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: 75358 <at> debbugs.gnu.org Cc: pipcet@HIDDEN, monnier@HIDDEN X-Debbugs-Original-To: Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN> X-Debbugs-Original-Cc: Pip Cet <pipcet@HIDDEN>, 75358 <at> debbugs.gnu.org, Stefan Monnier <monnier@HIDDEN> Received: via spool by 75358-submit <at> debbugs.gnu.org id=B75358.173615863910238 (code B ref 75358); Mon, 06 Jan 2025 10:18:03 +0000 Received: (at 75358) by debbugs.gnu.org; 6 Jan 2025 10:17:19 +0000 Received: from localhost ([127.0.0.1]:36767 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tUkAg-0002ez-L3 for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:19 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:37302) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUkAZ-0002eS-7D for 75358 <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:13 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUkAT-0007M3-JK; Mon, 06 Jan 2025 05:17:05 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=Qa6RFQf/IrkmlFvxY9S3OMVy5DTu7YgJ7FsMfgCc0po=; b=WLBV33PiUHHNeWTcbfe4 y+DJvyD2s9F+8v/pyPSK1ANi+wKL/e5fFEbIocJPmgbjwfPVZK3OVkUQOhgBvFIr5isjlae5AwBcb WdMzUMk6ac2rbe6GFu3dHIvGsCJCJQDpsC42C4W+SliPZaYNAtkzSFfj9JfrKHEfAhBJI/0uVeSRv jv1JfNASVa5XVrud58TizqXxJQwBxmRFFpejPq93GrJgjp1VcrxsYMs/OhRm2B4qm/uTnWYvSTiuY bfkhhkprar1x9Q6gck72654KyFz2c6KM8M3YOhBEXe67Ti2CIYePyvoS1xwmwcW6pbi+K0BTMkhwv wWOM0ku9akPucA==; Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUkAS-0002QZ-3O; Mon, 06 Jan 2025 05:17:04 -0500 From: Andrea Corallo <acorallo@HIDDEN> In-Reply-To: <87cyh2fsep.fsf@HIDDEN> (Pip Cet via's message of "Sat, 04 Jan 2025 16:37:03 +0000") References: <87cyh2fsep.fsf@HIDDEN> Date: Mon, 06 Jan 2025 05:17:04 -0500 Message-ID: <yp1ikqs5jrz.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN> writes: > On scratch/elisp-benchmarks, the following emacs -Q invocation: > > ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run "bubble"))' > > is equivalent to > > ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run))' > > but > > ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run "bubble") (delete-other-windows) (elisp-benchmarks-run))' > > is not. > > (The (delete-other-windows) is necessary because of other issues). > > The expected behavior is for the SELECTOR to determine the tests to be > executed, as described in the documentation; in reality, it merely > determines which tests are compiled, then all symbols matching the > regexp produced below are executed. > > In the first example, the second SELECTOR argument has no effect, > because the tests to be run are determined as: > > (mapatoms (lambda (s) > (let ((name (symbol-name s))) > (when (and (fboundp s) > (string-match > "\\`elb-\\(.*\\)-entry\\'" name)) > (push (match-string 1 name) names))))) > > without respecting the SELECTOR argument in any fashion: any elisp > function that happens to match the symbol format is run. > > "Fixing" this by applying the selector as a regular expression to the > "name" value seems simple enough, as a stop-gap. Yep, as mentioned elisp-benachmarks was made (in order to give meaningful results) to run from a known state, running two times will not give meaningful results. Anyway applying the selector to the runner as well seems a satisfactory fix to me. > But: IMHO, reserving > chunks of the symbol namespace for special uses is unsatisfactory and > should be avoided. This is true in both interactive and > non-interactive emacs runs. Running benchmarks in a live Emacs > session can be useful; running functions based on their symbol name > alone is dangerous. > > Of course, the selector is currently applied to file names, not test > names, so we'd have to decide what (elisp-benchmarks-run "font-lock"), > for example, is supposed to do. We can also decide to apply it only to test names to disambiguate if we prefer.
X-Loop: help-debbugs@HIDDEN Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector Resent-From: Stefan Monnier <monnier@HIDDEN> Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> Resent-CC: bug-gnu-emacs@HIDDEN Resent-Date: Mon, 06 Jan 2025 14:40:02 +0000 Resent-Message-ID: <handler.75358.B.173617436030154 <at> debbugs.gnu.org> Resent-Sender: help-debbugs@HIDDEN X-GNU-PR-Message: followup 75358 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Andrea Corallo <acorallo@HIDDEN> Cc: 75358 <at> debbugs.gnu.org, pipcet@HIDDEN X-Debbugs-Original-Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org, Pip Cet <pipcet@HIDDEN> Received: via spool by submit <at> debbugs.gnu.org id=B.173617436030154 (code B ref -1); Mon, 06 Jan 2025 14:40:02 +0000 Received: (at submit) by debbugs.gnu.org; 6 Jan 2025 14:39:20 +0000 Received: from localhost ([127.0.0.1]:37480 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tUoGF-0007qI-Ko for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:20 -0500 Received: from lists.gnu.org ([2001:470:142::17]:40806) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <monnier@HIDDEN>) id 1tUoGB-0007pp-Ub for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:16 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <monnier@HIDDEN>) id 1tUoG6-0002vf-GQ for bug-gnu-emacs@HIDDEN; Mon, 06 Jan 2025 09:39:10 -0500 Received: from mailscanner.iro.umontreal.ca ([132.204.25.50]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <monnier@HIDDEN>) id 1tUoG4-00051B-Qo; Mon, 06 Jan 2025 09:39:10 -0500 Received: from pmg1.iro.umontreal.ca (localhost.localdomain [127.0.0.1]) by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id 91EE8100043; Mon, 6 Jan 2025 09:39:07 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca; s=mail; t=1736174346; bh=TveHrl3QtuMWXQIRMor7BcLieMQyOP2VK43zG0Zkwbs=; h=From:To:Cc:Subject:In-Reply-To:References:Date:From; b=B652UHfKbeO4iiUXhpZNqRO+4az5uQgdDWXoZxe+LuGelaUpcfSNJlr9Wp3rn73N3 Lvz46HZdL0pdxZVa00OIvNVcYJrCzE9h0woHFSgXuMQhmsXklPHCjQ/7Sg5PNpKY0s NKUE6o6BWCbMepmjecsgG+j5gkCNqNWqQ4J20YKY4we5nwRu68vrSI0RLiP7IRfSHM BjWfFvJ67jLuU0NTjDjIDFQaN7ikgxgDHODBdHSN+ItnC+PyiSJrJVEfTdcdIEyQd5 xTm63T6Ta0fbAN/m05uelSPzlcqNF/QE+FlRA/5VXEZoQ/7NKrrurmNvwUSMDESRsY o3kICo57/03pg== Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1]) by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id CA540100035; Mon, 6 Jan 2025 09:39:06 -0500 (EST) Received: from pastel (69-165-162-104.dsl.teksavvy.com [69.165.162.104]) by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 9A3D212022A; Mon, 6 Jan 2025 09:39:06 -0500 (EST) From: Stefan Monnier <monnier@HIDDEN> In-Reply-To: <yp1ikqs5jrz.fsf@HIDDEN> (Andrea Corallo's message of "Mon, 06 Jan 2025 05:17:04 -0500") Message-ID: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN> Date: Mon, 06 Jan 2025 09:39:06 -0500 User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-SPAM-INFO: Spam detection results: 0 ALL_TRUSTED -1 Passed through trusted hosts only via SMTP BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain X-SPAM-LEVEL: Received-SPF: pass client-ip=132.204.25.50; envelope-from=monnier@HIDDEN; helo=mailscanner.iro.umontreal.ca X-Spam_score_int: -42 X-Spam_score: -4.3 X-Spam_bar: ---- X-Spam_report: (-4.3 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 0.0 (/) X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) >> The expected behavior is for the SELECTOR to determine the tests to be >> executed, as described in the documentation; in reality, it merely >> determines which tests are compiled, then all symbols matching the >> regexp produced below are executed. Originally, there was only one benchmark per file, so SELECTOR selects the files. Maybe we should simply always load all the files and then use SELECTOR to select the `elb-*-entry` functions? Stefan
X-Loop: help-debbugs@HIDDEN Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector Resent-From: Stefan Monnier <monnier@HIDDEN> Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> Resent-CC: bug-gnu-emacs@HIDDEN Resent-Date: Mon, 06 Jan 2025 14:40:03 +0000 Resent-Message-ID: <handler.75358.B75358.173617435530138 <at> debbugs.gnu.org> Resent-Sender: help-debbugs@HIDDEN X-GNU-PR-Message: followup 75358 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Andrea Corallo <acorallo@HIDDEN> Cc: 75358 <at> debbugs.gnu.org, pipcet@HIDDEN X-Debbugs-Original-Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org, Pip Cet <pipcet@HIDDEN> Received: via spool by 75358-submit <at> debbugs.gnu.org id=B75358.173617435530138 (code B ref 75358); Mon, 06 Jan 2025 14:40:03 +0000 Received: (at 75358) by debbugs.gnu.org; 6 Jan 2025 14:39:15 +0000 Received: from localhost ([127.0.0.1]:37476 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tUoGB-0007q2-Ao for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:15 -0500 Received: from mailscanner.iro.umontreal.ca ([132.204.25.50]:50096) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <monnier@HIDDEN>) id 1tUoG9-0007pl-8p for 75358 <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:13 -0500 Received: from pmg1.iro.umontreal.ca (localhost.localdomain [127.0.0.1]) by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id 91EE8100043; Mon, 6 Jan 2025 09:39:07 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca; s=mail; t=1736174346; bh=TveHrl3QtuMWXQIRMor7BcLieMQyOP2VK43zG0Zkwbs=; h=From:To:Cc:Subject:In-Reply-To:References:Date:From; b=B652UHfKbeO4iiUXhpZNqRO+4az5uQgdDWXoZxe+LuGelaUpcfSNJlr9Wp3rn73N3 Lvz46HZdL0pdxZVa00OIvNVcYJrCzE9h0woHFSgXuMQhmsXklPHCjQ/7Sg5PNpKY0s NKUE6o6BWCbMepmjecsgG+j5gkCNqNWqQ4J20YKY4we5nwRu68vrSI0RLiP7IRfSHM BjWfFvJ67jLuU0NTjDjIDFQaN7ikgxgDHODBdHSN+ItnC+PyiSJrJVEfTdcdIEyQd5 xTm63T6Ta0fbAN/m05uelSPzlcqNF/QE+FlRA/5VXEZoQ/7NKrrurmNvwUSMDESRsY o3kICo57/03pg== Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1]) by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id CA540100035; Mon, 6 Jan 2025 09:39:06 -0500 (EST) Received: from pastel (69-165-162-104.dsl.teksavvy.com [69.165.162.104]) by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 9A3D212022A; Mon, 6 Jan 2025 09:39:06 -0500 (EST) From: Stefan Monnier <monnier@HIDDEN> In-Reply-To: <yp1ikqs5jrz.fsf@HIDDEN> (Andrea Corallo's message of "Mon, 06 Jan 2025 05:17:04 -0500") Message-ID: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN> Date: Mon, 06 Jan 2025 09:39:06 -0500 User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-SPAM-INFO: Spam detection results: 0 ALL_TRUSTED -1 Passed through trusted hosts only via SMTP BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain X-SPAM-LEVEL: X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) >> The expected behavior is for the SELECTOR to determine the tests to be >> executed, as described in the documentation; in reality, it merely >> determines which tests are compiled, then all symbols matching the >> regexp produced below are executed. Originally, there was only one benchmark per file, so SELECTOR selects the files. Maybe we should simply always load all the files and then use SELECTOR to select the `elb-*-entry` functions? Stefan
X-Loop: help-debbugs@HIDDEN Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector Resent-From: Andrea Corallo <acorallo@HIDDEN> Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> Resent-CC: bug-gnu-emacs@HIDDEN Resent-Date: Mon, 06 Jan 2025 20:36:02 +0000 Resent-Message-ID: <handler.75358.B.17361957286166 <at> debbugs.gnu.org> Resent-Sender: help-debbugs@HIDDEN X-GNU-PR-Message: followup 75358 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Stefan Monnier <monnier@HIDDEN> Cc: 75358 <at> debbugs.gnu.org, pipcet@HIDDEN X-Debbugs-Original-Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org, Pip Cet <pipcet@HIDDEN> Received: via spool by submit <at> debbugs.gnu.org id=B.17361957286166 (code B ref -1); Mon, 06 Jan 2025 20:36:02 +0000 Received: (at submit) by debbugs.gnu.org; 6 Jan 2025 20:35:28 +0000 Received: from localhost ([127.0.0.1]:40346 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tUtou-0001bL-0t for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:28 -0500 Received: from lists.gnu.org ([2001:470:142::17]:39596) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUtos-0001ao-Fj for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:26 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUtom-0007ZZ-KG for bug-gnu-emacs@HIDDEN; Mon, 06 Jan 2025 15:35:20 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUtol-0006qe-8p; Mon, 06 Jan 2025 15:35:19 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=oNHXMFFw0lbUpjQ91MnT6Zu1wXAOfLj8Jqm0bSqHML0=; b=iGv6Nj2g9ZQv1ahSX/Ie Jp+M7G6j1sTcs/NQCDzhsUlKW9P5Jufo6hugVBAsA9gEzCChWEGt4lhZqNddDbDiUBky9i1ocwkeh ppRUb7ezHOwfWETopj7/IiZLKhnTWWzFY7cu13qrhtBsvJHtJ1Lj9lwtryKrBFn24U+zszvy6//JJ ti1aHP2sDFuPy+vnv/bpvY+CBKGCsMi7LmtKUNjV8KRmqox9ozCMwl26oTEGbliWhrO0XSZ0Sn5Qu b3r//iaVWY4+yzL4VAaE5Ljk0ENLohVMK3tUW/m/ddHA8npxPOUkQYEWxIhiI1sOK1WXbAkcL4oI8 ZBnwcn6+QUPV9A==; Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUtok-0005wz-2m; Mon, 06 Jan 2025 15:35:18 -0500 From: Andrea Corallo <acorallo@HIDDEN> In-Reply-To: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> (Stefan Monnier's message of "Mon, 06 Jan 2025 09:39:06 -0500") References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN> <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> Date: Mon, 06 Jan 2025 15:35:17 -0500 Message-ID: <yp1r05f4r5m.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -0.0 (/) X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Stefan Monnier <monnier@HIDDEN> writes: >>> The expected behavior is for the SELECTOR to determine the tests to be >>> executed, as described in the documentation; in reality, it merely >>> determines which tests are compiled, then all symbols matching the >>> regexp produced below are executed. > > Originally, there was only one benchmark per file, so SELECTOR > selects the files. Maybe we should simply always load all the files and > then use SELECTOR to select the `elb-*-entry` functions? +1
X-Loop: help-debbugs@HIDDEN Subject: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector Resent-From: Andrea Corallo <acorallo@HIDDEN> Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> Resent-CC: bug-gnu-emacs@HIDDEN Resent-Date: Mon, 06 Jan 2025 20:36:02 +0000 Resent-Message-ID: <handler.75358.B75358.17361957286157 <at> debbugs.gnu.org> Resent-Sender: help-debbugs@HIDDEN X-GNU-PR-Message: followup 75358 X-GNU-PR-Package: emacs X-GNU-PR-Keywords: To: Stefan Monnier <monnier@HIDDEN> Cc: 75358 <at> debbugs.gnu.org, pipcet@HIDDEN X-Debbugs-Original-Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org, Pip Cet <pipcet@HIDDEN> Received: via spool by 75358-submit <at> debbugs.gnu.org id=B75358.17361957286157 (code B ref 75358); Mon, 06 Jan 2025 20:36:02 +0000 Received: (at 75358) by debbugs.gnu.org; 6 Jan 2025 20:35:28 +0000 Received: from localhost ([127.0.0.1]:40344 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tUtot-0001bF-JA for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:27 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:51772) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUtor-0001am-Kn for 75358 <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:26 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUtol-0006qe-8p; Mon, 06 Jan 2025 15:35:19 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=oNHXMFFw0lbUpjQ91MnT6Zu1wXAOfLj8Jqm0bSqHML0=; b=iGv6Nj2g9ZQv1ahSX/Ie Jp+M7G6j1sTcs/NQCDzhsUlKW9P5Jufo6hugVBAsA9gEzCChWEGt4lhZqNddDbDiUBky9i1ocwkeh ppRUb7ezHOwfWETopj7/IiZLKhnTWWzFY7cu13qrhtBsvJHtJ1Lj9lwtryKrBFn24U+zszvy6//JJ ti1aHP2sDFuPy+vnv/bpvY+CBKGCsMi7LmtKUNjV8KRmqox9ozCMwl26oTEGbliWhrO0XSZ0Sn5Qu b3r//iaVWY4+yzL4VAaE5Ljk0ENLohVMK3tUW/m/ddHA8npxPOUkQYEWxIhiI1sOK1WXbAkcL4oI8 ZBnwcn6+QUPV9A==; Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUtok-0005wz-2m; Mon, 06 Jan 2025 15:35:18 -0500 From: Andrea Corallo <acorallo@HIDDEN> In-Reply-To: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> (Stefan Monnier's message of "Mon, 06 Jan 2025 09:39:06 -0500") References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN> <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> Date: Mon, 06 Jan 2025 15:35:17 -0500 Message-ID: <yp1r05f4r5m.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Stefan Monnier <monnier@HIDDEN> writes: >>> The expected behavior is for the SELECTOR to determine the tests to be >>> executed, as described in the documentation; in reality, it merely >>> determines which tests are compiled, then all symbols matching the >>> regexp produced below are executed. > > Originally, there was only one benchmark per file, so SELECTOR > selects the files. Maybe we should simply always load all the files and > then use SELECTOR to select the `elb-*-entry` functions? +1
Received: (at control) by debbugs.gnu.org; 2 Mar 2025 04:11:56 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Sat Mar 01 23:11:56 2025 Received: from localhost ([127.0.0.1]:49620 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1toagF-0004bc-Rf for submit <at> debbugs.gnu.org; Sat, 01 Mar 2025 23:11:56 -0500 Received: from mail-ej1-x62b.google.com ([2a00:1450:4864:20::62b]:57690) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.84_2) (envelope-from <stefankangas@HIDDEN>) id 1toagD-0004bA-E1 for control <at> debbugs.gnu.org; Sat, 01 Mar 2025 23:11:53 -0500 Received: by mail-ej1-x62b.google.com with SMTP id a640c23a62f3a-abf5358984bso129742866b.3 for <control <at> debbugs.gnu.org>; Sat, 01 Mar 2025 20:11:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1740888707; x=1741493507; darn=debbugs.gnu.org; h=to:subject:message-id:date:mime-version:from:from:to:cc:subject :date:message-id:reply-to; bh=VZnBu/ivHIv0DRkvW6oub4m86YEvTe6FPdzmB7NKsec=; b=KbhBlX5mshyhWYa39LbJ2AK25cwbDn0RZCqT2lt3A1U9WRBzBODM2ErqJbVhxntptr +5RMyIoBNUDmuw4v/Cigs2ttagDYZsa9Qr39SNET/q3IxaDKgEGXAgvL+R5nFiuoHUa9 UkZfMv5ms/6zEy07CyDxzFOItpgmsMyR6NcpwfCXM5Gd39ZjaiSLN4jMHz5viKbQZcuK yS9xFSjvT0lyR2xPXJQtpDNmZJ0XZQ3Qcnlwd03jL6bqGlS6Tabshq/6eXIknvACExVm M3a69WUtuSLqrjlfB7lRCa+Gi8ok+AdVtxww5v9yn5nztZ+1jekI1IugUwR4VidI3W+u 2zOA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1740888707; x=1741493507; h=to:subject:message-id:date:mime-version:from:x-gm-message-state :from:to:cc:subject:date:message-id:reply-to; bh=VZnBu/ivHIv0DRkvW6oub4m86YEvTe6FPdzmB7NKsec=; b=NKjnBiinPiwjqpOR+GgnYnWz29lSNmWTU/A9taGsOjkkiko7CJonBPzXJQVmZFq1O6 ki1yPy3uLepwqcB0nigBiEQQCcw7OTEOQ1BAetqhBCsfc4hfJ2GmqfTwmtf2GC/CT3Xf jhH7nUwBPyjP60WwbpOh0HkceteS31ROUjaHWKn2SWJ4+nz12PkVVJONwvF7U3TkuSlg c5f8l9aSZSNdatowHqH31UIe2tJFyqW8+7jq7/HuZBxHyrS8aerX1HuYQ4a95+HV2CMe 8BN9GrJkwcHYCl5/rSJnhQFM1Hrsv2vMhfYbczpXUXw2eZokPT2Sr/7FFmqp4V8/3tqB ys5w== X-Gm-Message-State: AOJu0YziJBw3V8MVHfEhG1sWbvYpNudPD7O6ucenSQDYo/A4ju6V2hUE LDcnTS0Mq9BHGbhhpguIehgwuCHKSbLaOvtFYl4kVlXivBtxg0XMnf+H8wQbHrbNirxbUNLvp4z NSMcO4ZioXPDGDhyt8mwiuXsUiVzxZAaM/HU= X-Gm-Gg: ASbGncvVZQO12nsHPxXSjR5OdUoLYu54FpM4ZpXaJvXM5aJHQUZdrPe/NvtsvsSCyrH 1HtVoiUP7IY35Oc8cefsKdQ4QJ3xj+00f4sd2UsotqhIPfnxgCfy1WMWr+W6yLVL7TmQ5z1nu+H h0391hOuDbudVqaAlHO3vu/w8phQ== X-Google-Smtp-Source: AGHT+IEL9LUVq+txN8iMeXBJPPh+yFnHbrwHlAQ7VbOmWlN1vab3H9wWcaKxFPUNY6B3F9FpJ7BpWx9fwnQgqNJClHQ= X-Received: by 2002:a17:906:6a13:b0:abf:1984:181a with SMTP id a640c23a62f3a-abf265fc290mr1174213366b.52.1740888707176; Sat, 01 Mar 2025 20:11:47 -0800 (PST) Received: from 753933720722 named unknown by gmailapi.google.com with HTTPREST; Sat, 1 Mar 2025 20:11:46 -0800 From: Stefan Kangas <stefankangas@HIDDEN> MIME-Version: 1.0 Date: Sat, 1 Mar 2025 20:11:46 -0800 X-Gm-Features: AQ5f1JoRgcSi87ZtKaUHoOG7uueXWEvCIO1KgiaS1WJt8FVdznx2xrJQ_gsd_JQ Message-ID: <CADwFkmkwOU5QpXFM_2i3sEMknr7db=nm+uGN=AXVEPEvLezQOA@HIDDEN> Subject: control message for bug #75358 To: control <at> debbugs.gnu.org Content-Type: text/plain; charset="UTF-8" X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: control X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) severity 75358 wishlist quit
GNU bug tracking system
Copyright (C) 1999 Darren O. Benham,
1997 nCipher Corporation Ltd,
1994-97 Ian Jackson.