Received: (at 75358) by debbugs.gnu.org; 6 Jan 2025 20:35:28 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 06 15:35:27 2025 Received: from localhost ([127.0.0.1]:40344 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tUtot-0001bF-JA for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:27 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:51772) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUtor-0001am-Kn for 75358 <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:26 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUtol-0006qe-8p; Mon, 06 Jan 2025 15:35:19 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=oNHXMFFw0lbUpjQ91MnT6Zu1wXAOfLj8Jqm0bSqHML0=; b=iGv6Nj2g9ZQv1ahSX/Ie Jp+M7G6j1sTcs/NQCDzhsUlKW9P5Jufo6hugVBAsA9gEzCChWEGt4lhZqNddDbDiUBky9i1ocwkeh ppRUb7ezHOwfWETopj7/IiZLKhnTWWzFY7cu13qrhtBsvJHtJ1Lj9lwtryKrBFn24U+zszvy6//JJ ti1aHP2sDFuPy+vnv/bpvY+CBKGCsMi7LmtKUNjV8KRmqox9ozCMwl26oTEGbliWhrO0XSZ0Sn5Qu b3r//iaVWY4+yzL4VAaE5Ljk0ENLohVMK3tUW/m/ddHA8npxPOUkQYEWxIhiI1sOK1WXbAkcL4oI8 ZBnwcn6+QUPV9A==; Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUtok-0005wz-2m; Mon, 06 Jan 2025 15:35:18 -0500 From: Andrea Corallo <acorallo@HIDDEN> To: Stefan Monnier <monnier@HIDDEN> Subject: Re: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector In-Reply-To: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> (Stefan Monnier's message of "Mon, 06 Jan 2025 09:39:06 -0500") References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN> <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> Date: Mon, 06 Jan 2025 15:35:17 -0500 Message-ID: <yp1r05f4r5m.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 75358 Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org, Pip Cet <pipcet@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Stefan Monnier <monnier@HIDDEN> writes: >>> The expected behavior is for the SELECTOR to determine the tests to be >>> executed, as described in the documentation; in reality, it merely >>> determines which tests are compiled, then all symbols matching the >>> regexp produced below are executed. > > Originally, there was only one benchmark per file, so SELECTOR > selects the files. Maybe we should simply always load all the files and > then use SELECTOR to select the `elb-*-entry` functions? +1
bug-gnu-emacs@HIDDEN
:bug#75358
; Package emacs
.
Full text available.Received: (at submit) by debbugs.gnu.org; 6 Jan 2025 20:35:28 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 06 15:35:28 2025 Received: from localhost ([127.0.0.1]:40346 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tUtou-0001bL-0t for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:28 -0500 Received: from lists.gnu.org ([2001:470:142::17]:39596) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUtos-0001ao-Fj for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 15:35:26 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUtom-0007ZZ-KG for bug-gnu-emacs@HIDDEN; Mon, 06 Jan 2025 15:35:20 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUtol-0006qe-8p; Mon, 06 Jan 2025 15:35:19 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=oNHXMFFw0lbUpjQ91MnT6Zu1wXAOfLj8Jqm0bSqHML0=; b=iGv6Nj2g9ZQv1ahSX/Ie Jp+M7G6j1sTcs/NQCDzhsUlKW9P5Jufo6hugVBAsA9gEzCChWEGt4lhZqNddDbDiUBky9i1ocwkeh ppRUb7ezHOwfWETopj7/IiZLKhnTWWzFY7cu13qrhtBsvJHtJ1Lj9lwtryKrBFn24U+zszvy6//JJ ti1aHP2sDFuPy+vnv/bpvY+CBKGCsMi7LmtKUNjV8KRmqox9ozCMwl26oTEGbliWhrO0XSZ0Sn5Qu b3r//iaVWY4+yzL4VAaE5Ljk0ENLohVMK3tUW/m/ddHA8npxPOUkQYEWxIhiI1sOK1WXbAkcL4oI8 ZBnwcn6+QUPV9A==; Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUtok-0005wz-2m; Mon, 06 Jan 2025 15:35:18 -0500 From: Andrea Corallo <acorallo@HIDDEN> To: Stefan Monnier <monnier@HIDDEN> Subject: Re: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector In-Reply-To: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> (Stefan Monnier's message of "Mon, 06 Jan 2025 09:39:06 -0500") References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN> <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> Date: Mon, 06 Jan 2025 15:35:17 -0500 Message-ID: <yp1r05f4r5m.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: submit Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org, Pip Cet <pipcet@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Stefan Monnier <monnier@HIDDEN> writes: >>> The expected behavior is for the SELECTOR to determine the tests to be >>> executed, as described in the documentation; in reality, it merely >>> determines which tests are compiled, then all symbols matching the >>> regexp produced below are executed. > > Originally, there was only one benchmark per file, so SELECTOR > selects the files. Maybe we should simply always load all the files and > then use SELECTOR to select the `elb-*-entry` functions? +1
bug-gnu-emacs@HIDDEN
:bug#75358
; Package emacs
.
Full text available.Received: (at 75358) by debbugs.gnu.org; 6 Jan 2025 14:39:15 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 06 09:39:15 2025 Received: from localhost ([127.0.0.1]:37476 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tUoGB-0007q2-Ao for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:15 -0500 Received: from mailscanner.iro.umontreal.ca ([132.204.25.50]:50096) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <monnier@HIDDEN>) id 1tUoG9-0007pl-8p for 75358 <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:13 -0500 Received: from pmg1.iro.umontreal.ca (localhost.localdomain [127.0.0.1]) by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id 91EE8100043; Mon, 6 Jan 2025 09:39:07 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca; s=mail; t=1736174346; bh=TveHrl3QtuMWXQIRMor7BcLieMQyOP2VK43zG0Zkwbs=; h=From:To:Cc:Subject:In-Reply-To:References:Date:From; b=B652UHfKbeO4iiUXhpZNqRO+4az5uQgdDWXoZxe+LuGelaUpcfSNJlr9Wp3rn73N3 Lvz46HZdL0pdxZVa00OIvNVcYJrCzE9h0woHFSgXuMQhmsXklPHCjQ/7Sg5PNpKY0s NKUE6o6BWCbMepmjecsgG+j5gkCNqNWqQ4J20YKY4we5nwRu68vrSI0RLiP7IRfSHM BjWfFvJ67jLuU0NTjDjIDFQaN7ikgxgDHODBdHSN+ItnC+PyiSJrJVEfTdcdIEyQd5 xTm63T6Ta0fbAN/m05uelSPzlcqNF/QE+FlRA/5VXEZoQ/7NKrrurmNvwUSMDESRsY o3kICo57/03pg== Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1]) by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id CA540100035; Mon, 6 Jan 2025 09:39:06 -0500 (EST) Received: from pastel (69-165-162-104.dsl.teksavvy.com [69.165.162.104]) by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 9A3D212022A; Mon, 6 Jan 2025 09:39:06 -0500 (EST) From: Stefan Monnier <monnier@HIDDEN> To: Andrea Corallo <acorallo@HIDDEN> Subject: Re: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector In-Reply-To: <yp1ikqs5jrz.fsf@HIDDEN> (Andrea Corallo's message of "Mon, 06 Jan 2025 05:17:04 -0500") Message-ID: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN> Date: Mon, 06 Jan 2025 09:39:06 -0500 User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-SPAM-INFO: Spam detection results: 0 ALL_TRUSTED -1 Passed through trusted hosts only via SMTP BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain X-SPAM-LEVEL: X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 75358 Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org, Pip Cet <pipcet@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) >> The expected behavior is for the SELECTOR to determine the tests to be >> executed, as described in the documentation; in reality, it merely >> determines which tests are compiled, then all symbols matching the >> regexp produced below are executed. Originally, there was only one benchmark per file, so SELECTOR selects the files. Maybe we should simply always load all the files and then use SELECTOR to select the `elb-*-entry` functions? Stefan
bug-gnu-emacs@HIDDEN
:bug#75358
; Package emacs
.
Full text available.Received: (at submit) by debbugs.gnu.org; 6 Jan 2025 14:39:20 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 06 09:39:20 2025 Received: from localhost ([127.0.0.1]:37480 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tUoGF-0007qI-Ko for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:20 -0500 Received: from lists.gnu.org ([2001:470:142::17]:40806) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <monnier@HIDDEN>) id 1tUoGB-0007pp-Ub for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 09:39:16 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <monnier@HIDDEN>) id 1tUoG6-0002vf-GQ for bug-gnu-emacs@HIDDEN; Mon, 06 Jan 2025 09:39:10 -0500 Received: from mailscanner.iro.umontreal.ca ([132.204.25.50]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <monnier@HIDDEN>) id 1tUoG4-00051B-Qo; Mon, 06 Jan 2025 09:39:10 -0500 Received: from pmg1.iro.umontreal.ca (localhost.localdomain [127.0.0.1]) by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id 91EE8100043; Mon, 6 Jan 2025 09:39:07 -0500 (EST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=iro.umontreal.ca; s=mail; t=1736174346; bh=TveHrl3QtuMWXQIRMor7BcLieMQyOP2VK43zG0Zkwbs=; h=From:To:Cc:Subject:In-Reply-To:References:Date:From; b=B652UHfKbeO4iiUXhpZNqRO+4az5uQgdDWXoZxe+LuGelaUpcfSNJlr9Wp3rn73N3 Lvz46HZdL0pdxZVa00OIvNVcYJrCzE9h0woHFSgXuMQhmsXklPHCjQ/7Sg5PNpKY0s NKUE6o6BWCbMepmjecsgG+j5gkCNqNWqQ4J20YKY4we5nwRu68vrSI0RLiP7IRfSHM BjWfFvJ67jLuU0NTjDjIDFQaN7ikgxgDHODBdHSN+ItnC+PyiSJrJVEfTdcdIEyQd5 xTm63T6Ta0fbAN/m05uelSPzlcqNF/QE+FlRA/5VXEZoQ/7NKrrurmNvwUSMDESRsY o3kICo57/03pg== Received: from mail01.iro.umontreal.ca (unknown [172.31.2.1]) by pmg1.iro.umontreal.ca (Proxmox) with ESMTP id CA540100035; Mon, 6 Jan 2025 09:39:06 -0500 (EST) Received: from pastel (69-165-162-104.dsl.teksavvy.com [69.165.162.104]) by mail01.iro.umontreal.ca (Postfix) with ESMTPSA id 9A3D212022A; Mon, 6 Jan 2025 09:39:06 -0500 (EST) From: Stefan Monnier <monnier@HIDDEN> To: Andrea Corallo <acorallo@HIDDEN> Subject: Re: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector In-Reply-To: <yp1ikqs5jrz.fsf@HIDDEN> (Andrea Corallo's message of "Mon, 06 Jan 2025 05:17:04 -0500") Message-ID: <jwv7c78ovom.fsf-monnier+emacs@HIDDEN> References: <87cyh2fsep.fsf@HIDDEN> <yp1ikqs5jrz.fsf@HIDDEN> Date: Mon, 06 Jan 2025 09:39:06 -0500 User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-SPAM-INFO: Spam detection results: 0 ALL_TRUSTED -1 Passed through trusted hosts only via SMTP BAYES_00 -1.9 Bayes spam probability is 0 to 1% DKIM_SIGNED 0.1 Message has a DKIM or DK signature, not necessarily valid DKIM_VALID -0.1 Message has at least one valid DKIM or DK signature DKIM_VALID_AU -0.1 Message has a valid DKIM or DK signature from author's domain DKIM_VALID_EF -0.1 Message has a valid DKIM or DK signature from envelope-from domain X-SPAM-LEVEL: Received-SPF: pass client-ip=132.204.25.50; envelope-from=monnier@HIDDEN; helo=mailscanner.iro.umontreal.ca X-Spam_score_int: -42 X-Spam_score: -4.3 X-Spam_bar: ---- X-Spam_report: (-4.3 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 0.0 (/) X-Debbugs-Envelope-To: submit Cc: "Pip Cet via Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN>, 75358 <at> debbugs.gnu.org, Pip Cet <pipcet@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) >> The expected behavior is for the SELECTOR to determine the tests to be >> executed, as described in the documentation; in reality, it merely >> determines which tests are compiled, then all symbols matching the >> regexp produced below are executed. Originally, there was only one benchmark per file, so SELECTOR selects the files. Maybe we should simply always load all the files and then use SELECTOR to select the `elb-*-entry` functions? Stefan
bug-gnu-emacs@HIDDEN
:bug#75358
; Package emacs
.
Full text available.Received: (at 75358) by debbugs.gnu.org; 6 Jan 2025 10:17:19 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 06 05:17:19 2025 Received: from localhost ([127.0.0.1]:36767 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tUkAg-0002ez-L3 for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:19 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:37302) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUkAZ-0002eS-7D for 75358 <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:13 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUkAT-0007M3-JK; Mon, 06 Jan 2025 05:17:05 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=Qa6RFQf/IrkmlFvxY9S3OMVy5DTu7YgJ7FsMfgCc0po=; b=WLBV33PiUHHNeWTcbfe4 y+DJvyD2s9F+8v/pyPSK1ANi+wKL/e5fFEbIocJPmgbjwfPVZK3OVkUQOhgBvFIr5isjlae5AwBcb WdMzUMk6ac2rbe6GFu3dHIvGsCJCJQDpsC42C4W+SliPZaYNAtkzSFfj9JfrKHEfAhBJI/0uVeSRv jv1JfNASVa5XVrud58TizqXxJQwBxmRFFpejPq93GrJgjp1VcrxsYMs/OhRm2B4qm/uTnWYvSTiuY bfkhhkprar1x9Q6gck72654KyFz2c6KM8M3YOhBEXe67Ti2CIYePyvoS1xwmwcW6pbi+K0BTMkhwv wWOM0ku9akPucA==; Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUkAS-0002QZ-3O; Mon, 06 Jan 2025 05:17:04 -0500 From: Andrea Corallo <acorallo@HIDDEN> To: Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN> Subject: Re: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector In-Reply-To: <87cyh2fsep.fsf@HIDDEN> (Pip Cet via's message of "Sat, 04 Jan 2025 16:37:03 +0000") References: <87cyh2fsep.fsf@HIDDEN> Date: Mon, 06 Jan 2025 05:17:04 -0500 Message-ID: <yp1ikqs5jrz.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 75358 Cc: Pip Cet <pipcet@HIDDEN>, 75358 <at> debbugs.gnu.org, Stefan Monnier <monnier@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN> writes: > On scratch/elisp-benchmarks, the following emacs -Q invocation: > > ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run "bubble"))' > > is equivalent to > > ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run))' > > but > > ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run "bubble") (delete-other-windows) (elisp-benchmarks-run))' > > is not. > > (The (delete-other-windows) is necessary because of other issues). > > The expected behavior is for the SELECTOR to determine the tests to be > executed, as described in the documentation; in reality, it merely > determines which tests are compiled, then all symbols matching the > regexp produced below are executed. > > In the first example, the second SELECTOR argument has no effect, > because the tests to be run are determined as: > > (mapatoms (lambda (s) > (let ((name (symbol-name s))) > (when (and (fboundp s) > (string-match > "\\`elb-\\(.*\\)-entry\\'" name)) > (push (match-string 1 name) names))))) > > without respecting the SELECTOR argument in any fashion: any elisp > function that happens to match the symbol format is run. > > "Fixing" this by applying the selector as a regular expression to the > "name" value seems simple enough, as a stop-gap. Yep, as mentioned elisp-benachmarks was made (in order to give meaningful results) to run from a known state, running two times will not give meaningful results. Anyway applying the selector to the runner as well seems a satisfactory fix to me. > But: IMHO, reserving > chunks of the symbol namespace for special uses is unsatisfactory and > should be avoided. This is true in both interactive and > non-interactive emacs runs. Running benchmarks in a live Emacs > session can be useful; running functions based on their symbol name > alone is dangerous. > > Of course, the selector is currently applied to file names, not test > names, so we'd have to decide what (elisp-benchmarks-run "font-lock"), > for example, is supposed to do. We can also decide to apply it only to test names to disambiguate if we prefer.
bug-gnu-emacs@HIDDEN
:bug#75358
; Package emacs
.
Full text available.Received: (at submit) by debbugs.gnu.org; 6 Jan 2025 10:17:18 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 06 05:17:18 2025 Received: from localhost ([127.0.0.1]:36765 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tUkAc-0002eo-Mx for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:18 -0500 Received: from lists.gnu.org ([2001:470:142::17]:36932) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <acorallo@HIDDEN>) id 1tUkAZ-0002eU-On for submit <at> debbugs.gnu.org; Mon, 06 Jan 2025 05:17:12 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUkAU-0006Sw-6O for bug-gnu-emacs@HIDDEN; Mon, 06 Jan 2025 05:17:06 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUkAT-0007M3-JK; Mon, 06 Jan 2025 05:17:05 -0500 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org; s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To: From; bh=Qa6RFQf/IrkmlFvxY9S3OMVy5DTu7YgJ7FsMfgCc0po=; b=WLBV33PiUHHNeWTcbfe4 y+DJvyD2s9F+8v/pyPSK1ANi+wKL/e5fFEbIocJPmgbjwfPVZK3OVkUQOhgBvFIr5isjlae5AwBcb WdMzUMk6ac2rbe6GFu3dHIvGsCJCJQDpsC42C4W+SliPZaYNAtkzSFfj9JfrKHEfAhBJI/0uVeSRv jv1JfNASVa5XVrud58TizqXxJQwBxmRFFpejPq93GrJgjp1VcrxsYMs/OhRm2B4qm/uTnWYvSTiuY bfkhhkprar1x9Q6gck72654KyFz2c6KM8M3YOhBEXe67Ti2CIYePyvoS1xwmwcW6pbi+K0BTMkhwv wWOM0ku9akPucA==; Received: from acorallo by fencepost.gnu.org with local (Exim 4.90_1) (envelope-from <acorallo@HIDDEN>) id 1tUkAS-0002QZ-3O; Mon, 06 Jan 2025 05:17:04 -0500 From: Andrea Corallo <acorallo@HIDDEN> To: Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN> Subject: Re: bug#75358: [scratch/elisp-benchmarks] repeated runs don't apply selector In-Reply-To: <87cyh2fsep.fsf@HIDDEN> (Pip Cet via's message of "Sat, 04 Jan 2025 16:37:03 +0000") References: <87cyh2fsep.fsf@HIDDEN> Date: Mon, 06 Jan 2025 05:17:04 -0500 Message-ID: <yp1ikqs5jrz.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: submit Cc: Pip Cet <pipcet@HIDDEN>, 75358 <at> debbugs.gnu.org, Stefan Monnier <monnier@HIDDEN> X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Pip Cet via "Bug reports for GNU Emacs, the Swiss army knife of text editors" <bug-gnu-emacs@HIDDEN> writes: > On scratch/elisp-benchmarks, the following emacs -Q invocation: > > ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run "bubble"))' > > is equivalent to > > ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run))' > > but > > ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(progn (elisp-benchmarks-run "bubble") (delete-other-windows) (elisp-benchmarks-run))' > > is not. > > (The (delete-other-windows) is necessary because of other issues). > > The expected behavior is for the SELECTOR to determine the tests to be > executed, as described in the documentation; in reality, it merely > determines which tests are compiled, then all symbols matching the > regexp produced below are executed. > > In the first example, the second SELECTOR argument has no effect, > because the tests to be run are determined as: > > (mapatoms (lambda (s) > (let ((name (symbol-name s))) > (when (and (fboundp s) > (string-match > "\\`elb-\\(.*\\)-entry\\'" name)) > (push (match-string 1 name) names))))) > > without respecting the SELECTOR argument in any fashion: any elisp > function that happens to match the symbol format is run. > > "Fixing" this by applying the selector as a regular expression to the > "name" value seems simple enough, as a stop-gap. Yep, as mentioned elisp-benachmarks was made (in order to give meaningful results) to run from a known state, running two times will not give meaningful results. Anyway applying the selector to the runner as well seems a satisfactory fix to me. > But: IMHO, reserving > chunks of the symbol namespace for special uses is unsatisfactory and > should be avoided. This is true in both interactive and > non-interactive emacs runs. Running benchmarks in a live Emacs > session can be useful; running functions based on their symbol name > alone is dangerous. > > Of course, the selector is currently applied to file names, not test > names, so we'd have to decide what (elisp-benchmarks-run "font-lock"), > for example, is supposed to do. We can also decide to apply it only to test names to disambiguate if we prefer.
bug-gnu-emacs@HIDDEN
:bug#75358
; Package emacs
.
Full text available.Received: (at submit) by debbugs.gnu.org; 4 Jan 2025 16:37:17 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Sat Jan 04 11:37:17 2025 Received: from localhost ([127.0.0.1]:56884 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1tU79J-000145-BP for submit <at> debbugs.gnu.org; Sat, 04 Jan 2025 11:37:17 -0500 Received: from lists.gnu.org ([2001:470:142::17]:48104) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <pipcet@HIDDEN>) id 1tU79I-00013r-8y for submit <at> debbugs.gnu.org; Sat, 04 Jan 2025 11:37:16 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <pipcet@HIDDEN>) id 1tU79C-0007Ae-GC for bug-gnu-emacs@HIDDEN; Sat, 04 Jan 2025 11:37:10 -0500 Received: from mail-4316.protonmail.ch ([185.70.43.16]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <pipcet@HIDDEN>) id 1tU79A-0005Qy-PG for bug-gnu-emacs@HIDDEN; Sat, 04 Jan 2025 11:37:10 -0500 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com; s=protonmail3; t=1736008627; x=1736267827; bh=rJZiDrP9gDVyDuZEi/CHMZn264d3LYLlkJ4rjAG4lH4=; h=Date:To:From:Subject:Message-ID:Feedback-ID:From:To:Cc:Date: Subject:Reply-To:Feedback-ID:Message-ID:BIMI-Selector: List-Unsubscribe:List-Unsubscribe-Post; b=wVy9VqrtG5Froe3rkA6G4WYs+RKTHiGVkhGRrJnpZfEIThB5msg8X5+xXHLqe4wqx 4Gj2GwyHnT2VbGb9EZonNSIuiH8RvmUwl/gFZiblo0m2ChxxYqVshLU0Merkh/Y0a/ 2oJabxkLVfvb3CSl5jiLBLrZRVd26XjJH2r3PNjQnyjawZC06tFfn4ViJQPAFQ2Ri5 Gn+mvhxGohift1hT63APG2TQYT9krNP40Fe36iZ0vx6MGsIPyAWQf+nVaQdFyQkJqD P4xEilN3Y2cPRCzeaeAFsbl22p2PtF5Ew3CKpRcPywuwfd+tYAhSIS0fxSU7rBPPtK An6kui5ajyqIw== Date: Sat, 04 Jan 2025 16:37:03 +0000 To: bug-gnu-emacs@HIDDEN From: Pip Cet <pipcet@HIDDEN> Subject: [scratch/elisp-benchmarks] repeated runs don't apply selector Message-ID: <87cyh2fsep.fsf@HIDDEN> Feedback-ID: 112775352:user:proton X-Pm-Message-ID: 61437615580d5d247ab3fa80711b192ce4f12e12 MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=185.70.43.16; envelope-from=pipcet@HIDDEN; helo=mail-4316.protonmail.ch X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 1.0 (+) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -0.0 (/) On scratch/elisp-benchmarks, the following emacs -Q invocation: ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(p= rogn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run "b= ubble"))' is equivalent to ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(p= rogn (elisp-benchmarks-run) (delete-other-windows) (elisp-benchmarks-run))' but ./src/emacs --batch -Q -l ./elisp-benchmarks/elisp-benchmarks.el --eval '(p= rogn (elisp-benchmarks-run "bubble") (delete-other-windows) (elisp-benchmar= ks-run))' is not. (The (delete-other-windows) is necessary because of other issues). The expected behavior is for the SELECTOR to determine the tests to be executed, as described in the documentation; in reality, it merely determines which tests are compiled, then all symbols matching the regexp produced below are executed. In the first example, the second SELECTOR argument has no effect, because the tests to be run are determined as: =09 (mapatoms (lambda (s) =09 (let ((name (symbol-name s))) =09 (when (and (fboundp s) =09 (string-match =09 "\\`elb-\\(.*\\)-entry\\'" name)) =09 (push (match-string 1 name) names))))) without respecting the SELECTOR argument in any fashion: any elisp function that happens to match the symbol format is run. "Fixing" this by applying the selector as a regular expression to the "name" value seems simple enough, as a stop-gap. But: IMHO, reserving chunks of the symbol namespace for special uses is unsatisfactory and should be avoided. This is true in both interactive and non-interactive emacs runs. Running benchmarks in a live Emacs session can be useful; running functions based on their symbol name alone is dangerous. Of course, the selector is currently applied to file names, not test names, so we'd have to decide what (elisp-benchmarks-run "font-lock"), for example, is supposed to do. IMHO, the proper fix is to use a working test registration mechanism, ideally ERT.
Pip Cet <pipcet@HIDDEN>
:bug-gnu-emacs@HIDDEN
.
Full text available.bug-gnu-emacs@HIDDEN
:bug#75358
; Package emacs
.
Full text available.
GNU bug tracking system
Copyright (C) 1999 Darren O. Benham,
1997 nCipher Corporation Ltd,
1994-97 Ian Jackson.