GNU bug report logs - #75358
[scratch/elisp-benchmarks] repeated runs don't apply selector

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: emacs; Reported by: Pip Cet <pipcet@HIDDEN>; dated Sat, 4 Jan 2025 16:38:02 UTC; Maintainer for emacs is bug-gnu-emacs@HIDDEN.

Message received at 75358 <at> debbugs.gnu.org:


Received: (at 75358) by debbugs.gnu.org; 6 Jan 2025 20:35:28 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 06 15:35:27 2025
Received: from localhost ([127.0.0.1]:40344 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tUtot-0001bF-JA
	for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:27 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10]:51772)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUtor-0001am-Kn
 for 75358 <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:26 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>)
 id 1tUtol-0006qe-8p; Mon, 06 Jan 2025 15:35:19 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To:
 From; bh=oNHXMFFw0lbUpjQ91MnT6Zu1wXAOfLj8Jqm0bSqHML0=; b=iGv6Nj2g9ZQv1ahSX/Ie
 Jp+M7G6j1sTcs/NQCDzhsUlKW9P5Jufo6hugVBAsA9gEzCChWEGt4lhZqNddDbDiUBky9i1ocwkeh
 ppRUb7ezHOwfWETopj7/IiZLKhnTWWzFY7cu13qrhtBsvJHtJ1Lj9lwtryKrBFn24U+zszvy6//JJ
 ti1aHP2sDFuPy+vnv/bpvY+CBKGCsMi7LmtKUNjV8KRmqox9ozCMwl26oTEGbliWhrO0XSZ0Sn5Qu
 b3r//iaVWY4+yzL4VAaE5Ljk0ENLohVMK3tUW/m/ddHA8npxPOUkQYEWxIhiI1sOK1WXbAkcL4oI8
 ZBnwcn6+QUPV9A==;
Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1)
 (envelope-from <acorallo@HIDDEN>)
 id 1tUtok-0005wz-2m; Mon, 06 Jan 2025 15:35:18 -0500
From: Andrea Corallo <acorallo@HIDDEN>
To: Stefan Monnier <monnier@HIDDEN>
Subject: Re: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply
 selector
In-Reply-To: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> (Stefan Monnier's message
 of "Mon, 06 Jan 2025 09:39:06 -0500")
References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN>
 <jwv7c78ovom.fsf-monnier+emacs@HIDDEN>
Date: Mon, 06 Jan 2025 15:35:17 -0500
Message-ID: <yp1r05f4r5m.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 75358
Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text
 editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org,
 Pip Cet <pipcet@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Stefan Monnier <monnier@HIDDEN> writes:

>>> The expected behavior is for the SELECTOR to determine the tests to be
>>> executed, as described in the documentation; in reality, it merely
>>> determines which tests are compiled, then all symbols matching the
>>> regexp produced below are executed.
>
> Originally, there was only one benchmark per file, so SELECTOR
> selects the files.  Maybe we should simply always load all the files and
> then use SELECTOR to select the `elb-*-entry` functions?

+1




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#75358; Package emacs. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 6 Jan 2025 20:35:28 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 06 15:35:28 2025
Received: from localhost ([127.0.0.1]:40346 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tUtou-0001bL-0t
	for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:28 -0500
Received: from lists.gnu.org ([2001:470:142::17]:39596)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUtos-0001ao-Fj
 for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:26 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUtom-0007ZZ-KG
 for bug-gnu-emacs@HIDDEN; Mon, 06 Jan 2025 15:35:20 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>)
 id 1tUtol-0006qe-8p; Mon, 06 Jan 2025 15:35:19 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To:
 From; bh=oNHXMFFw0lbUpjQ91MnT6Zu1wXAOfLj8Jqm0bSqHML0=; b=iGv6Nj2g9ZQv1ahSX/Ie
 Jp+M7G6j1sTcs/NQCDzhsUlKW9P5Jufo6hugVBAsA9gEzCChWEGt4lhZqNddDbDiUBky9i1ocwkeh
 ppRUb7ezHOwfWETopj7/IiZLKhnTWWzFY7cu13qrhtBsvJHtJ1Lj9lwtryKrBFn24U+zszvy6//JJ
 ti1aHP2sDFuPy+vnv/bpvY+CBKGCsMi7LmtKUNjV8KRmqox9ozCMwl26oTEGbliWhrO0XSZ0Sn5Qu
 b3r//iaVWY4+yzL4VAaE5Ljk0ENLohVMK3tUW/m/ddHA8npxPOUkQYEWxIhiI1sOK1WXbAkcL4oI8
 ZBnwcn6+QUPV9A==;
Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1)
 (envelope-from <acorallo@HIDDEN>)
 id 1tUtok-0005wz-2m; Mon, 06 Jan 2025 15:35:18 -0500
From: Andrea Corallo <acorallo@HIDDEN>
To: Stefan Monnier <monnier@HIDDEN>
Subject: Re: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply
 selector
In-Reply-To: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> (Stefan Monnier's message
 of "Mon, 06 Jan 2025 09:39:06 -0500")
References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN>
 <jwv7c78ovom.fsf-monnier+emacs@HIDDEN>
Date: Mon, 06 Jan 2025 15:35:17 -0500
Message-ID: <yp1r05f4r5m.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: submit
Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text
 editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org,
 Pip Cet <pipcet@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Stefan Monnier <monnier@HIDDEN> writes:

>>> The expected behavior is for the SELECTOR to determine the tests to be
>>> executed, as described in the documentation; in reality, it merely
>>> determines which tests are compiled, then all symbols matching the
>>> regexp produced below are executed.
>
> Originally, there was only one benchmark per file, so SELECTOR
> selects the files.  Maybe we should simply always load all the files and
> then use SELECTOR to select the `elb-*-entry` functions?

+1




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#75358; Package emacs. Full text available.

Message received at 75358 <at> debbugs.gnu.org:


Received: (at 75358) by debbugs.gnu.org; 6 Jan 2025 14:39:15 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 06 09:39:15 2025
Received: from localhost ([127.0.0.1]:37476 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tUoGB-0007q2-Ao
	for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:15 -0500
Received: from mailscanner.iro.umontreal.ca ([132.204.25.50]:50096)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <monnier@HIDDEN>)
 id 1tUoG9-0007pl-8p
 for 75358 <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:13 -0500
Received: from pmg1.iro.umontreal.ca (localhost.localdomain [127.0.0.1])
 by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id 91EE8100043;
 Mon,  6 Jan 2025 09:39:07 -0500 (EST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca;
 s=mail; t=1736174346;
 bh=TveHrl3QtuMWXQIRMor7BcLieMQyOP2VK43zG0Zkwbs=;
 h=From:To:Cc:Subject:In-Reply-To:References:Date:From;
 b=B652UHfKbeO4iiUXhpZNqRO+4az5uQgdDWXoZxe+LuGelaUpcfSNJlr9Wp3rn73N3
 Lvz46HZdL0pdxZVa00OIvNVcYJrCzE9h0woHFSgXuMQhmsXklPHCjQ/7Sg5PNpKY0s
 NKUE6o6BWCbMepmjecsgG+j5gkCNqNWqQ4J20YKY4we5nwRu68vrSI0RLiP7IRfSHM
 BjWfFvJ67jLuU0NTjDjIDFQaN7ikgxgDHODBdHSN+ItnC+PyiSJrJVEfTdcdIEyQd5
 xTm63T6Ta0fbAN/m05uelSPzlcqNF/QE+FlRA/5VXEZoQ/7NKrrurmNvwUSMDESRsY
 o3kICo57/03pg==
Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1])
 by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id CA540100035;
 Mon,  6 Jan 2025 09:39:06 -0500 (EST)
Received: from pastel (69-165-162-104.dsl.teksavvy.com [69.165.162.104])
 by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 9A3D212022A;
 Mon,  6 Jan 2025 09:39:06 -0500 (EST)
From: Stefan Monnier <monnier@HIDDEN>
To: Andrea Corallo <acorallo@HIDDEN>
Subject: Re: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply
 selector
In-Reply-To: <yp1ikqs5jrz.fsf@HIDDEN> (Andrea Corallo's message of
 "Mon, 06 Jan 2025 05:17:04 -0500")
Message-ID: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN>
References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN>
Date: Mon, 06 Jan 2025 09:39:06 -0500
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-SPAM-INFO: Spam detection results:  0
 ALL_TRUSTED                -1 Passed through trusted hosts only via SMTP
 BAYES_00                 -1.9 Bayes spam probability is 0 to 1%
 DKIM_SIGNED               0.1 Message has a DKIM or DK signature,
 not necessarily valid
 DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature
 DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's
 domain
 DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from
 domain
X-SPAM-LEVEL: 
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 75358
Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text
 editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org,
 Pip Cet <pipcet@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

>> The expected behavior is for the SELECTOR to determine the tests to be
>> executed, as described in the documentation; in reality, it merely
>> determines which tests are compiled, then all symbols matching the
>> regexp produced below are executed.

Originally, there was only one benchmark per file, so SELECTOR
selects the files.  Maybe we should simply always load all the files and
then use SELECTOR to select the `elb-*-entry` functions?


        Stefan





Information forwarded to bug-gnu-emacs@HIDDEN:
bug#75358; Package emacs. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 6 Jan 2025 14:39:20 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 06 09:39:20 2025
Received: from localhost ([127.0.0.1]:37480 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tUoGF-0007qI-Ko
	for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:20 -0500
Received: from lists.gnu.org ([2001:470:142::17]:40806)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <monnier@HIDDEN>)
 id 1tUoGB-0007pp-Ub
 for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:16 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <monnier@HIDDEN>)
 id 1tUoG6-0002vf-GQ
 for bug-gnu-emacs@HIDDEN; Mon, 06 Jan 2025 09:39:10 -0500
Received: from mailscanner.iro.umontreal.ca ([132.204.25.50])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <monnier@HIDDEN>)
 id 1tUoG4-00051B-Qo; Mon, 06 Jan 2025 09:39:10 -0500
Received: from pmg1.iro.umontreal.ca (localhost.localdomain [127.0.0.1])
 by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id 91EE8100043;
 Mon,  6 Jan 2025 09:39:07 -0500 (EST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca;
 s=mail; t=1736174346;
 bh=TveHrl3QtuMWXQIRMor7BcLieMQyOP2VK43zG0Zkwbs=;
 h=From:To:Cc:Subject:In-Reply-To:References:Date:From;
 b=B652UHfKbeO4iiUXhpZNqRO+4az5uQgdDWXoZxe+LuGelaUpcfSNJlr9Wp3rn73N3
 Lvz46HZdL0pdxZVa00OIvNVcYJrCzE9h0woHFSgXuMQhmsXklPHCjQ/7Sg5PNpKY0s
 NKUE6o6BWCbMepmjecsgG+j5gkCNqNWqQ4J20YKY4we5nwRu68vrSI0RLiP7IRfSHM
 BjWfFvJ67jLuU0NTjDjIDFQaN7ikgxgDHODBdHSN+ItnC+PyiSJrJVEfTdcdIEyQd5
 xTm63T6Ta0fbAN/m05uelSPzlcqNF/QE+FlRA/5VXEZoQ/7NKrrurmNvwUSMDESRsY
 o3kICo57/03pg==
Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1])
 by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id CA540100035;
 Mon,  6 Jan 2025 09:39:06 -0500 (EST)
Received: from pastel (69-165-162-104.dsl.teksavvy.com [69.165.162.104])
 by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 9A3D212022A;
 Mon,  6 Jan 2025 09:39:06 -0500 (EST)
From: Stefan Monnier <monnier@HIDDEN>
To: Andrea Corallo <acorallo@HIDDEN>
Subject: Re: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply
 selector
In-Reply-To: <yp1ikqs5jrz.fsf@HIDDEN> (Andrea Corallo's message of
 "Mon, 06 Jan 2025 05:17:04 -0500")
Message-ID: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN>
References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN>
Date: Mon, 06 Jan 2025 09:39:06 -0500
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-SPAM-INFO: Spam detection results:  0
 ALL_TRUSTED                -1 Passed through trusted hosts only via SMTP
 BAYES_00                 -1.9 Bayes spam probability is 0 to 1%
 DKIM_SIGNED               0.1 Message has a DKIM or DK signature,
 not necessarily valid
 DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature
 DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's
 domain
 DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from
 domain
X-SPAM-LEVEL: 
Received-SPF: pass client-ip=132.204.25.50;
 envelope-from=monnier@HIDDEN; helo=mailscanner.iro.umontreal.ca
X-Spam_score_int: -42
X-Spam_score: -4.3
X-Spam_bar: ----
X-Spam_report: (-4.3 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_MED=-2.3,
 RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001,
 SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: submit
Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text
 editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org,
 Pip Cet <pipcet@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

>> The expected behavior is for the SELECTOR to determine the tests to be
>> executed, as described in the documentation; in reality, it merely
>> determines which tests are compiled, then all symbols matching the
>> regexp produced below are executed.

Originally, there was only one benchmark per file, so SELECTOR
selects the files.  Maybe we should simply always load all the files and
then use SELECTOR to select the `elb-*-entry` functions?


        Stefan





Information forwarded to bug-gnu-emacs@HIDDEN:
bug#75358; Package emacs. Full text available.

Message received at 75358 <at> debbugs.gnu.org:


Received: (at 75358) by debbugs.gnu.org; 6 Jan 2025 10:17:19 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 06 05:17:19 2025
Received: from localhost ([127.0.0.1]:36767 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tUkAg-0002ez-L3
	for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:19 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10]:37302)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUkAZ-0002eS-7D
 for 75358 <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:13 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>)
 id 1tUkAT-0007M3-JK; Mon, 06 Jan 2025 05:17:05 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To:
 From; bh=Qa6RFQf/IrkmlFvxY9S3OMVy5DTu7YgJ7FsMfgCc0po=; b=WLBV33PiUHHNeWTcbfe4
 y+DJvyD2s9F+8v/pyPSK1ANi+wKL/e5fFEbIocJPmgbjwfPVZK3OVkUQOhgBvFIr5isjlae5AwBcb
 WdMzUMk6ac2rbe6GFu3dHIvGsCJCJQDpsC42C4W+SliPZaYNAtkzSFfj9JfrKHEfAhBJI/0uVeSRv
 jv1JfNASVa5XVrud58TizqXxJQwBxmRFFpejPq93GrJgjp1VcrxsYMs/OhRm2B4qm/uTnWYvSTiuY
 bfkhhkprar1x9Q6gck72654KyFz2c6KM8M3YOhBEXe67Ti2CIYePyvoS1xwmwcW6pbi+K0BTMkhwv
 wWOM0ku9akPucA==;
Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1)
 (envelope-from <acorallo@HIDDEN>)
 id 1tUkAS-0002QZ-3O; Mon, 06 Jan 2025 05:17:04 -0500
From: Andrea Corallo <acorallo@HIDDEN>
To: Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text
 editors" <bug-gnu-emacs@HIDDEN>
Subject: Re: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply
 selector
In-Reply-To: <87cyh2fsep.fsf@HIDDEN> (Pip Cet via's message of "Sat,
 04 Jan 2025 16:37:03 +0000")
References: <87cyh2fsep.fsf@HIDDEN>
Date: Mon, 06 Jan 2025 05:17:04 -0500
Message-ID: <yp1ikqs5jrz.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 75358
Cc: Pip Cet <pipcet@HIDDEN>, 75358 <at> debbugs.gnu.org,
 Stefan Monnier <monnier@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text
editors" <bug-gnu-emacs@HIDDEN> writes:

> On scratch/elisp-benchmarks, the following emacs -Q invocation:
>
> ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run "bubble"))'
>
> is equivalent to
>
> ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run))'
>
> but
>
> ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run "bubble") (delete-other-windows) (elisp-benchmarks-run))'
>
> is not.
>
> (The (delete-other-windows) is necessary because of other issues).
>
> The expected behavior is for the SELECTOR to determine the tests to be
> executed, as described in the documentation; in reality, it merely
> determines which tests are compiled, then all symbols matching the
> regexp produced below are executed.
>
> In the first example, the second SELECTOR argument has no effect,
> because the tests to be run are determined as:
>
> 	           (mapatoms (lambda (s)
> 	                      (let ((name (symbol-name s)))
> 	                        (when (and (fboundp s)
> 	                                   (string-match
> 	                                    "\\`elb-\\(.*\\)-entry\\'" name))
> 	                          (push (match-string 1 name) names)))))
>
> without respecting the SELECTOR argument in any fashion: any elisp
> function that happens to match the symbol format is run.
>
> "Fixing" this by applying the selector as a regular expression to the
> "name" value seems simple enough, as a stop-gap.

Yep, as mentioned elisp-benachmarks was made (in order to give
meaningful results) to run from a known state, running two times will
not give meaningful results.  Anyway applying the selector to the runner
as well seems a satisfactory fix to me.

> But: IMHO, reserving
> chunks of the symbol namespace for special uses is unsatisfactory and
> should be avoided.  This is true in both interactive and
> non-interactive emacs runs.  Running benchmarks in a live Emacs
> session can be useful; running functions based on their symbol name
> alone is dangerous.
>
> Of course, the selector is currently applied to file names, not test
> names, so we'd have to decide what (elisp-benchmarks-run "font-lock"),
> for example, is supposed to do.

We can also decide to apply it only to test names to disambiguate if we
prefer.




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#75358; Package emacs. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 6 Jan 2025 10:17:18 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 06 05:17:18 2025
Received: from localhost ([127.0.0.1]:36765 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tUkAc-0002eo-Mx
	for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:18 -0500
Received: from lists.gnu.org ([2001:470:142::17]:36932)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUkAZ-0002eU-On
 for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:12 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUkAU-0006Sw-6O
 for bug-gnu-emacs@HIDDEN; Mon, 06 Jan 2025 05:17:06 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>)
 id 1tUkAT-0007M3-JK; Mon, 06 Jan 2025 05:17:05 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To:
 From; bh=Qa6RFQf/IrkmlFvxY9S3OMVy5DTu7YgJ7FsMfgCc0po=; b=WLBV33PiUHHNeWTcbfe4
 y+DJvyD2s9F+8v/pyPSK1ANi+wKL/e5fFEbIocJPmgbjwfPVZK3OVkUQOhgBvFIr5isjlae5AwBcb
 WdMzUMk6ac2rbe6GFu3dHIvGsCJCJQDpsC42C4W+SliPZaYNAtkzSFfj9JfrKHEfAhBJI/0uVeSRv
 jv1JfNASVa5XVrud58TizqXxJQwBxmRFFpejPq93GrJgjp1VcrxsYMs/OhRm2B4qm/uTnWYvSTiuY
 bfkhhkprar1x9Q6gck72654KyFz2c6KM8M3YOhBEXe67Ti2CIYePyvoS1xwmwcW6pbi+K0BTMkhwv
 wWOM0ku9akPucA==;
Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1)
 (envelope-from <acorallo@HIDDEN>)
 id 1tUkAS-0002QZ-3O; Mon, 06 Jan 2025 05:17:04 -0500
From: Andrea Corallo <acorallo@HIDDEN>
To: Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text
 editors" <bug-gnu-emacs@HIDDEN>
Subject: Re: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply
 selector
In-Reply-To: <87cyh2fsep.fsf@HIDDEN> (Pip Cet via's message of "Sat,
 04 Jan 2025 16:37:03 +0000")
References: <87cyh2fsep.fsf@HIDDEN>
Date: Mon, 06 Jan 2025 05:17:04 -0500
Message-ID: <yp1ikqs5jrz.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: submit
Cc: Pip Cet <pipcet@HIDDEN>, 75358 <at> debbugs.gnu.org,
 Stefan Monnier <monnier@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text
editors" <bug-gnu-emacs@HIDDEN> writes:

> On scratch/elisp-benchmarks, the following emacs -Q invocation:
>
> ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run "bubble"))'
>
> is equivalent to
>
> ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run))'
>
> but
>
> ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run "bubble") (delete-other-windows) (elisp-benchmarks-run))'
>
> is not.
>
> (The (delete-other-windows) is necessary because of other issues).
>
> The expected behavior is for the SELECTOR to determine the tests to be
> executed, as described in the documentation; in reality, it merely
> determines which tests are compiled, then all symbols matching the
> regexp produced below are executed.
>
> In the first example, the second SELECTOR argument has no effect,
> because the tests to be run are determined as:
>
> 	           (mapatoms (lambda (s)
> 	                      (let ((name (symbol-name s)))
> 	                        (when (and (fboundp s)
> 	                                   (string-match
> 	                                    "\\`elb-\\(.*\\)-entry\\'" name))
> 	                          (push (match-string 1 name) names)))))
>
> without respecting the SELECTOR argument in any fashion: any elisp
> function that happens to match the symbol format is run.
>
> "Fixing" this by applying the selector as a regular expression to the
> "name" value seems simple enough, as a stop-gap.

Yep, as mentioned elisp-benachmarks was made (in order to give
meaningful results) to run from a known state, running two times will
not give meaningful results.  Anyway applying the selector to the runner
as well seems a satisfactory fix to me.

> But: IMHO, reserving
> chunks of the symbol namespace for special uses is unsatisfactory and
> should be avoided.  This is true in both interactive and
> non-interactive emacs runs.  Running benchmarks in a live Emacs
> session can be useful; running functions based on their symbol name
> alone is dangerous.
>
> Of course, the selector is currently applied to file names, not test
> names, so we'd have to decide what (elisp-benchmarks-run "font-lock"),
> for example, is supposed to do.

We can also decide to apply it only to test names to disambiguate if we
prefer.




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#75358; Package emacs. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 4 Jan 2025 16:37:17 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Jan 04 11:37:17 2025
Received: from localhost ([127.0.0.1]:56884 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1tU79J-000145-BP
	for submit <at> debbugs.gnu.org; Sat, 04 Jan 2025 11:37:17 -0500
Received: from lists.gnu.org ([2001:470:142::17]:48104)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <pipcet@HIDDEN>)
 id 1tU79I-00013r-8y
 for submit <at> debbugs.gnu.org; Sat, 04 Jan 2025 11:37:16 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <pipcet@HIDDEN>)
 id 1tU79C-0007Ae-GC
 for bug-gnu-emacs@HIDDEN; Sat, 04 Jan 2025 11:37:10 -0500
Received: from mail-4316.protonmail.ch ([185.70.43.16])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <pipcet@HIDDEN>)
 id 1tU79A-0005Qy-PG
 for bug-gnu-emacs@HIDDEN; Sat, 04 Jan 2025 11:37:10 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com;
 s=protonmail3; t=1736008627; x=1736267827;
 bh=rJZiDrP9gDVyDuZEi/CHMZn264d3LYLlkJ4rjAG4lH4=;
 h=Date:To:From:Subject:Message-ID:Feedback-ID:From:To:Cc:Date:
 Subject:Reply-To:Feedback-ID:Message-ID:BIMI-Selector:
 List-Unsubscribe:List-Unsubscribe-Post;
 b=wVy9VqrtG5Froe3rkA6G4WYs+RKTHiGVkhGRrJnpZfEIThB5msg8X5+xXHLqe4wqx
 4Gj2GwyHnT2VbGb9EZonNSIuiH8RvmUwl/gFZiblo0m2ChxxYqVshLU0Merkh/Y0a/
 2oJabxkLVfvb3CSl5jiLBLrZRVd26XjJH2r3PNjQnyjawZC06tFfn4ViJQPAFQ2Ri5
 Gn+mvhxGohift1hT63APG2TQYT9krNP40Fe36iZ0vx6MGsIPyAWQf+nVaQdFyQkJqD
 P4xEilN3Y2cPRCzeaeAFsbl22p2PtF5Ew3CKpRcPywuwfd+tYAhSIS0fxSU7rBPPtK
 An6kui5ajyqIw==
Date: Sat, 04 Jan 2025 16:37:03 +0000
To: bug-gnu-emacs@HIDDEN
From: Pip Cet <pipcet@HIDDEN>
Subject: [scratch/elisp-benchmarks] repeated runs don't apply selector
Message-ID: <87cyh2fsep.fsf@HIDDEN>
Feedback-ID: 112775352:user:proton
X-Pm-Message-ID: 61437615580d5d247ab3fa80711b192ce4f12e12
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=185.70.43.16; envelope-from=pipcet@HIDDEN;
 helo=mail-4316.protonmail.ch
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001,
 RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001,
 RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001,
 SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)

On scratch/elisp-benchmarks, the following emacs -Q invocation:

./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(p=
rogn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run "b=
ubble"))'

is equivalent to

./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(p=
rogn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run))'

but

./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(p=
rogn (elisp-benchmarks-run "bubble") (delete-other-windows) (elisp-benchmar=
ks-run))'

is not.

(The (delete-other-windows) is necessary because of other issues).

The expected behavior is for the SELECTOR to determine the tests to be
executed, as described in the documentation; in reality, it merely
determines which tests are compiled, then all symbols matching the
regexp produced below are executed.

In the first example, the second SELECTOR argument has no effect,
because the tests to be run are determined as:

=09           (mapatoms (lambda (s)
=09                      (let ((name (symbol-name s)))
=09                        (when (and (fboundp s)
=09                                   (string-match
=09                                    "\\`elb-\\(.*\\)-entry\\'" name))
=09                          (push (match-string 1 name) names)))))

without respecting the SELECTOR argument in any fashion: any elisp
function that happens to match the symbol format is run.

"Fixing" this by applying the selector as a regular expression to the
"name" value seems simple enough, as a stop-gap.  But: IMHO, reserving
chunks of the symbol namespace for special uses is unsatisfactory and
should be avoided.  This is true in both interactive and
non-interactive emacs runs.  Running benchmarks in a live Emacs
session can be useful; running functions based on their symbol name
alone is dangerous.

Of course, the selector is currently applied to file names, not test
names, so we'd have to decide what (elisp-benchmarks-run "font-lock"),
for example, is supposed to do.

IMHO, the proper fix is to use a working test registration mechanism,
ideally ERT.





Acknowledgement sent to Pip Cet <pipcet@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-gnu-emacs@HIDDEN. Full text available.
Report forwarded to bug-gnu-emacs@HIDDEN:
bug#75358; Package emacs. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Sun, 12 Jan 2025 05:45:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.