GNU bug report logs - #69233
30.0.50; project-files + project-find-file is slow in large repositories

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: emacs; Reported by: Spencer Baugh <sbaugh@HIDDEN>; merged with #69188; dated Sun, 18 Feb 2024 18:24:16 UTC; Maintainer for emacs is bug-gnu-emacs@HIDDEN.

Message received at 69233 <at> debbugs.gnu.org:


Received: (at 69233) by debbugs.gnu.org; 18 Feb 2024 20:12:15 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun Feb 18 15:12:15 2024
Received: from localhost ([127.0.0.1]:38418 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1rbnWJ-0004Eh-0X
	for submit <at> debbugs.gnu.org; Sun, 18 Feb 2024 15:12:15 -0500
Received: from wout3-smtp.messagingengine.com ([64.147.123.19]:40757)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <dmitry@HIDDEN>) id 1rbnWG-0004EP-KR
 for 69233 <at> debbugs.gnu.org; Sun, 18 Feb 2024 15:12:14 -0500
Received: from compute3.internal (compute3.nyi.internal [10.202.2.43])
 by mailout.west.internal (Postfix) with ESMTP id 1FF30320092C;
 Sun, 18 Feb 2024 15:11:46 -0500 (EST)
Received: from mailfrontend2 ([10.202.2.163])
 by compute3.internal (MEProxy); Sun, 18 Feb 2024 15:11:46 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gutov.dev; h=cc
 :cc:content-transfer-encoding:content-type:content-type:date
 :date:from:from:in-reply-to:in-reply-to:message-id:mime-version
 :references:reply-to:subject:subject:to:to; s=fm2; t=1708287105;
 x=1708373505; bh=tDfFef92uIBbmZQyQeJuf++P9ziZOX7yW2qmOT1eQgE=; b=
 INH5HT8C+buW4gX+owbAkDsktFBnUbAy+IrCHEMiAjtniM5G7vfQ5DOuiYNsqXlF
 vbX3bPLZV8/5S6P8dwLLKLTJR0iuo99NCJFn/+mbCVpkpglEvD3q8eSznYeq6995
 0868a9Ud6isV50lNosj3VFaBSJPY1djlPDsGHd8rjAA7bFgPXhsrNAs6XGS46UyY
 JwGzeBgX+W+bEqgeDEuVlpbvd7DslrlNaJoxoOCkcJl47Xyy5UsKNJH3CDAV8Tfs
 6hRzIk00lzyUxoR4zlUxgo2AENcRhrQqexUOQd9x3Z+AumAtn4vQnlL8wxi/XEjV
 M42g8t3WkjJQZus1veUtlQ==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=cc:cc:content-transfer-encoding
 :content-type:content-type:date:date:feedback-id:feedback-id
 :from:from:in-reply-to:in-reply-to:message-id:mime-version
 :references:reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy
 :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1708287105; x=
 1708373505; bh=tDfFef92uIBbmZQyQeJuf++P9ziZOX7yW2qmOT1eQgE=; b=q
 CXIcz8FqMpFryD81dmIFN3foZsgf2gJ6WEb6BhuH36GwyyWv8ni20ckE5t6+eEXk
 tPJvg7PAMmgalARG8aetrhNXy7exfSRu2BiVrqBx1DUD9xvkM6MNXH8o7qHgcz6A
 /ZZiyWXAbswCJqXvdGzWFWnQkSnuTQITxWwTG+XmhH12dqvAryBEPM7FAApoCRJu
 ZUBuXhqBnxtoWA3nHVnmhe5rrKNBdEOVdsollPgqUpjo+aazyXNW3Ow6kE9MNQGq
 JQ2cGHYSqeXcyZZNiP8JMhmprQZqfHeOevpRQmMeNoxLmhTxT2/zfBNhbZrAvk2Z
 Oidgudh3XZjNjVcMyg6Tw==
X-ME-Sender: <xms:gWTSZXTvdUF6zbH2g-yrYg0tERygtr-dCMJoatrlWM31o1xgC1X2zA>
 <xme:gWTSZYxIP3OBwO5k1ZJEv7Puiej2DROJr36eEuxf4TnNdm4e-IeDhJ_2bZIzpn_dz
 IksK4fHLxvQ3TFHcCA>
X-ME-Received: <xmr:gWTSZc0DkC3QmnWVGELAy1nqJPyZ0a4ShRknWEgd_kkXkx6QR1Q4_IpJbbpzjMfgFrJv>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrvdeigddufeejucetufdoteggodetrfdotf
 fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen
 uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne
 cujfgurhepkfffgggfuffvvehfhfgjtgfgsehtjeertddtvdejnecuhfhrohhmpeffmhhi
 thhrhicuifhuthhovhcuoegumhhithhrhiesghhuthhovhdruggvvheqnecuggftrfgrth
 htvghrnhepteduleejgeehtefgheegjeekueehvdevieekueeftddvtdevfefhvdevgedu
 jeehnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepug
 hmihhtrhihsehguhhtohhvrdguvghv
X-ME-Proxy: <xmx:gWTSZXA4m1WQo1wWv2hFd9B21LZ8QeI1_Tg17Sna_sKMLK5j8riLYw>
 <xmx:gWTSZQhsT0s5UjUjaizfJvH9QWMFrrY3bLKgxWOH3fiA-Qv-MnvPFw>
 <xmx:gWTSZbrLJnSF3N24DXHhYshj5RoK16NmMIV6qJVteIzTti_rnmzXPw>
 <xmx:gWTSZcbhlkQmrufMHZHlcYbIUEOYmaP8JycPNZzgvyY0OUGJBN0gFQ>
Feedback-ID: i0e71465a:Fastmail
Received: by mail.messagingengine.com (Postfix) with ESMTPA; Sun,
 18 Feb 2024 15:11:44 -0500 (EST)
Message-ID: <391ea08d-9d52-4f03-a602-045b76ac862c@HIDDEN>
Date: Sun, 18 Feb 2024 22:11:43 +0200
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: bug#69233: 30.0.50; project-files + project-find-file is slow in
 large repositories
Content-Language: en-US
To: Eli Zaretskii <eliz@HIDDEN>
References: <iera5o11gnh.fsf@HIDDEN>
 <86y1bhr47o.fsf@HIDDEN> <f95199e0-c585-4dea-beb1-305b9cac83f5@HIDDEN>
 <86frxpr1yl.fsf@HIDDEN>
From: Dmitry Gutov <dmitry@HIDDEN>
In-Reply-To: <86frxpr1yl.fsf@HIDDEN>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Score: -2.6 (--)
X-Debbugs-Envelope-To: 69233
Cc: sbaugh@HIDDEN, 69233 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.6 (---)

On 18/02/2024 21:45, Eli Zaretskii wrote:
>> Date: Sun, 18 Feb 2024 21:42:37 +0200
>> Cc:69233 <at> debbugs.gnu.org
>> From: Dmitry Gutov<dmitry@HIDDEN>
>>
>> On 18/02/2024 20:56, Eli Zaretskii wrote:
>>> This is a duplicate of another bug report you submitted not long ago.
>> Any reason I didn't receive the first one to my inbox?
> I don't have the foggiest, sorry.

It seems Spencer didn't get the confirmation email either, or he 
wouldn't resubmit.




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#69233; Package emacs. Full text available.

Message received at 69233 <at> debbugs.gnu.org:


Received: (at 69233) by debbugs.gnu.org; 18 Feb 2024 19:45:57 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun Feb 18 14:45:57 2024
Received: from localhost ([127.0.0.1]:38378 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1rbn6r-0003P0-0I
	for submit <at> debbugs.gnu.org; Sun, 18 Feb 2024 14:45:57 -0500
Received: from eggs.gnu.org ([209.51.188.92]:37878)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <eliz@HIDDEN>) id 1rbn6o-0003On-PV
 for 69233 <at> debbugs.gnu.org; Sun, 18 Feb 2024 14:45:55 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <eliz@HIDDEN>)
 id 1rbn6O-00017N-Ky; Sun, 18 Feb 2024 14:45:28 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=References:Subject:In-Reply-To:To:From:Date:
 mime-version; bh=aZPjogCMNvBOrbD16nfLVfmNIKEjN2olgRCOtStOif0=; b=mZ9s1v2QA066
 /OxDoNOA+GTYg8b7FWecpt3HfadnERoD6J7NbjhX1nG/B2SXKNdOuSINs2UlBIrOLJqIPNfDUNmQ0
 T+1LMvznH6Z9D/U2bWSCK9dwQDqDTmvnGXuit8BUd8Mi7W8cwvU6vi5tLyQYmcq/zCurkuYsPvbys
 gcWYXguLkqLmT1CFzHsUSnWrhA96d9jcpvWFsd28aSI7pvsWa24wLKIGfEIz5MdkFQpmRtM5HBqyk
 /fHT5rkBK4/hcJibndjcmZRJtX+KD4p2km7NU04kRNRzS2/9cbA7fIF5MHf/H0i5s2DApD7HpN1pu
 ykxgh6MMG1L5FiMron8tYg==;
Date: Sun, 18 Feb 2024 21:45:22 +0200
Message-Id: <86frxpr1yl.fsf@HIDDEN>
From: Eli Zaretskii <eliz@HIDDEN>
To: Dmitry Gutov <dmitry@HIDDEN>
In-Reply-To: <f95199e0-c585-4dea-beb1-305b9cac83f5@HIDDEN> (message from
 Dmitry Gutov on Sun, 18 Feb 2024 21:42:37 +0200)
Subject: Re: bug#69233: 30.0.50; project-files + project-find-file is slow in
 large repositories
References: <iera5o11gnh.fsf@HIDDEN>
 <86y1bhr47o.fsf@HIDDEN> <f95199e0-c585-4dea-beb1-305b9cac83f5@HIDDEN>
X-Spam-Score: -4.2 (----)
X-Debbugs-Envelope-To: 69233
Cc: sbaugh@HIDDEN, 69233 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -5.2 (-----)

> Date: Sun, 18 Feb 2024 21:42:37 +0200
> Cc: 69233 <at> debbugs.gnu.org
> From: Dmitry Gutov <dmitry@HIDDEN>
> 
> On 18/02/2024 20:56, Eli Zaretskii wrote:
> > This is a duplicate of another bug report you submitted not long ago.
> 
> Any reason I didn't receive the first one to my inbox?

I don't have the foggiest, sorry.




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#69233; Package emacs. Full text available.

Message received at 69233 <at> debbugs.gnu.org:


Received: (at 69233) by debbugs.gnu.org; 18 Feb 2024 19:43:15 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun Feb 18 14:43:15 2024
Received: from localhost ([127.0.0.1]:38368 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1rbn4C-0003KZ-Ez
	for submit <at> debbugs.gnu.org; Sun, 18 Feb 2024 14:43:15 -0500
Received: from wout3-smtp.messagingengine.com ([64.147.123.19]:36543)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <dmitry@HIDDEN>) id 1rbn47-0003KJ-DN
 for 69233 <at> debbugs.gnu.org; Sun, 18 Feb 2024 14:43:11 -0500
Received: from compute1.internal (compute1.nyi.internal [10.202.2.41])
 by mailout.west.internal (Postfix) with ESMTP id A4FB6320077A;
 Sun, 18 Feb 2024 14:42:40 -0500 (EST)
Received: from mailfrontend2 ([10.202.2.163])
 by compute1.internal (MEProxy); Sun, 18 Feb 2024 14:42:40 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gutov.dev; h=cc
 :cc:content-transfer-encoding:content-type:content-type:date
 :date:from:from:in-reply-to:in-reply-to:message-id:mime-version
 :references:reply-to:subject:subject:to:to; s=fm2; t=1708285360;
 x=1708371760; bh=czlHWi++F7Rmtc2A98kVpBhIRJEV1TuXVBKvY6OKKQc=; b=
 W/E9kjOnoFGF9p1YKVrFaIx/ZQJZ34LB1bFI22a84FH+xPOO3km63uZdCWgly3fA
 TcPPhW/DVqQ0qYK3Tl7J3SFq+NIwJ+NhYsYAxci6BdVwypRQMLuC6TfRcNNjQfkQ
 YeT9AZ9E+YAxXtkyxEyBgfWyK43i4h/VrN8pLzBqlyzlMMzfkwXcSBbLqTIBqMrU
 uOkkgxf5bBIH0OI8bQfz2Y0vE9QFUXFPRbcsErNlb1oakQa/RrPhH8MJvzdZtjp6
 Sqi29T1tvLppwnecF6Yh1DvAj50tMkUTz2aWTbV9QurJ5U6HZyzA17Dfe4curGOP
 UgoYMe7wNaF1sDpn4n3OOQ==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=cc:cc:content-transfer-encoding
 :content-type:content-type:date:date:feedback-id:feedback-id
 :from:from:in-reply-to:in-reply-to:message-id:mime-version
 :references:reply-to:subject:subject:to:to:x-me-proxy:x-me-proxy
 :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=1708285360; x=
 1708371760; bh=czlHWi++F7Rmtc2A98kVpBhIRJEV1TuXVBKvY6OKKQc=; b=U
 lhkTGznAyEbR9QGkg3MFdzt10DKQrvwlM8R7QiW5siSdObrcvg5Rx022bavv1aoa
 zaNZQlEtJIEE7X6xo6e5rMc5iluT1FgkVV7cYb6ysTvLJwgbCn9crEHXoiVf7k0/
 0+FdzY4gO9KHxKpO5BptJuqoVlnlFJ8ka5RGnbWGGSfAAE3dHLj+XnwmEGZD9ZHn
 zYZ+R+q0Icg6jVO1YlJV41GgZMjCU5eSQ4/LiecjjWqr6Nea2QNVPzEkvEZfm3yC
 bs2OdI2n9krEL7KSs4nF0mGGy2YXBMIFu9Mf52yj9g9LDzDCdZN4NfinNNbib3eS
 /WyQvfFOyuJfg8uvWbyww==
X-ME-Sender: <xms:sF3SZZDzx-TP07BZ3y0FgHu2E9395ppa9BDAU4P6pyxxjkdMN8BmKg>
 <xme:sF3SZXgwrL6mH0PsRM4p_F4YAQNfvG3VM1xTPdcB-Dw_SptWmwP0dnqwFnB93vBrl
 q9Ty3S4OUHzuqK4hwQ>
X-ME-Received: <xmr:sF3SZUnL3JiqKHS75G5169YgLjcpH7fbZ4W8nD95VWd5SuPmjQ9UL9rIkGurgH55_1ER>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvledrvdeigddufeduucetufdoteggodetrfdotf
 fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen
 uceurghilhhouhhtmecufedttdenucesvcftvggtihhpihgvnhhtshculddquddttddmne
 cujfgurhepkfffgggfuffvvehfhfgjtgfgsehtjeertddtvdejnecuhfhrohhmpeffmhhi
 thhrhicuifhuthhovhcuoegumhhithhrhiesghhuthhovhdruggvvheqnecuggftrfgrth
 htvghrnhepteduleejgeehtefgheegjeekueehvdevieekueeftddvtdevfefhvdevgedu
 jeehnecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghilhhfrhhomhepug
 hmihhtrhihsehguhhtohhvrdguvghv
X-ME-Proxy: <xmx:sF3SZTyQ1W5dKf1t9Gh5t4ZJzNW4uyFy-rWuwQmV4r0VhdsS-yQHYg>
 <xmx:sF3SZeQVGEz6sI1HL1uspPsoDqkmr2uLo31DkU0OycM8gd7CWt-PGQ>
 <xmx:sF3SZWbGAnEyynfugSiuzS75q_jfRjR99tkkGgMHMi1-ivyjwKXWjw>
 <xmx:sF3SZRLnHyZyt7zRhSIO2DWpQBsYibDo3M1sMjMFhV1ffCFWvemBUQ>
Feedback-ID: i0e71465a:Fastmail
Received: by mail.messagingengine.com (Postfix) with ESMTPA; Sun,
 18 Feb 2024 14:42:39 -0500 (EST)
Message-ID: <f95199e0-c585-4dea-beb1-305b9cac83f5@HIDDEN>
Date: Sun, 18 Feb 2024 21:42:37 +0200
MIME-Version: 1.0
User-Agent: Mozilla Thunderbird
Subject: Re: bug#69233: 30.0.50; project-files + project-find-file is slow in
 large repositories
Content-Language: en-US
To: Eli Zaretskii <eliz@HIDDEN>, Spencer Baugh <sbaugh@HIDDEN>
References: <iera5o11gnh.fsf@HIDDEN>
 <86y1bhr47o.fsf@HIDDEN>
From: Dmitry Gutov <dmitry@HIDDEN>
In-Reply-To: <86y1bhr47o.fsf@HIDDEN>
Content-Type: text/plain; charset=UTF-8; format=flowed
Content-Transfer-Encoding: 7bit
X-Spam-Score: -1.9 (-)
X-Debbugs-Envelope-To: 69233
Cc: 69233 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.6 (---)

On 18/02/2024 20:56, Eli Zaretskii wrote:
> This is a duplicate of another bug report you submitted not long ago.

Any reason I didn't receive the first one to my inbox?




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#69233; Package emacs. Full text available.
Merged 69188 69233. Request was from Eli Zaretskii <eliz@HIDDEN> to control <at> debbugs.gnu.org. Full text available.

Message received at 69233 <at> debbugs.gnu.org:


Received: (at 69233) by debbugs.gnu.org; 18 Feb 2024 18:57:17 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun Feb 18 13:57:17 2024
Received: from localhost ([127.0.0.1]:38274 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1rbmLl-0007jb-5X
	for submit <at> debbugs.gnu.org; Sun, 18 Feb 2024 13:57:17 -0500
Received: from eggs.gnu.org ([209.51.188.92]:45462)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <eliz@HIDDEN>)
 id 1rbmLg-0007jJ-Vn; Sun, 18 Feb 2024 13:57:15 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <eliz@HIDDEN>)
 id 1rbmLG-00014z-ER; Sun, 18 Feb 2024 13:56:46 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=References:Subject:In-Reply-To:To:From:Date:
 mime-version; bh=5GXb3EjeBGvqcIFHrQIKYajPL8gOklMVatE6vzWcp0g=; b=V1RKgXfk7p3h
 qdmMwrS/ZzdFtuTpqvvnhXWCYPem8dxxWZRJ573GhnwztDglweA6biy/Gy6g2R4B3X6jVHdqLDk/a
 VU5Cam2RRP0O0GOXa5udJ9nMmpZpTx7FHM8xQUNdoIcg5FRMosB6q2wyf7zsBXs0qTHBZlzTlOyge
 TrNw6aN5N0+dUyS/kZXi2QGcxrslZVabqQlZC7nadOkuSpLtthuvOjuZdsGhLvHbIn27Lh4d5+rij
 hqWIwPsv5Ki7cTYSblSAawfFsjmAFUhpTXQ39tpm5mcjnrsuVTEBbqtSB56T/mXjXDkiULPzNxjwq
 KY+B4EznI7QBnpS2tvlyYg==;
Date: Sun, 18 Feb 2024 20:56:43 +0200
Message-Id: <86y1bhr47o.fsf@HIDDEN>
From: Eli Zaretskii <eliz@HIDDEN>
To: Spencer Baugh <sbaugh@HIDDEN>
In-Reply-To: <iera5o11gnh.fsf@HIDDEN>
 (message from Spencer Baugh on Thu, 15 Feb 2024 17:55:46 -0500)
Subject: Re: bug#69233: 30.0.50;
 project-files + project-find-file is slow in large repositories
References: <iera5o11gnh.fsf@HIDDEN>
X-Spam-Score: -4.2 (----)
X-Debbugs-Envelope-To: 69233
Cc: dmitry@HIDDEN, 69233 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -5.2 (-----)

merge 69233 69188
thanks

> Cc: Dmitry Gutov <dmitry@HIDDEN>
> From: Spencer Baugh <sbaugh@HIDDEN>
> Date: Thu, 15 Feb 2024 17:55:46 -0500
> 
> 
> (project-files (project-current)) takes around 1 second in Linux (80k
> files) and 7 seconds in my larger (500k file) repository.

This is a duplicate of another bug report you submitted not long ago.




Information forwarded to bug-gnu-emacs@HIDDEN:
bug#69233; Package emacs. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 18 Feb 2024 18:24:15 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun Feb 18 13:24:15 2024
Received: from localhost ([127.0.0.1]:37325 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1rblpl-0003LR-Oy
	for submit <at> debbugs.gnu.org; Sun, 18 Feb 2024 13:24:14 -0500
Received: from lists.gnu.org ([209.51.188.17]:48948)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <sbaugh@HIDDEN>) id 1rblU6-0001wK-Vx
 for submit <at> debbugs.gnu.org; Sun, 18 Feb 2024 13:01:51 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <sbaugh@HIDDEN>)
 id 1rake7-0004Ib-Dy
 for bug-gnu-emacs@HIDDEN; Thu, 15 Feb 2024 17:55:59 -0500
Received: from mxout5.mail.janestreet.com ([64.215.233.18])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <sbaugh@HIDDEN>)
 id 1rakdy-0000BC-27
 for bug-gnu-emacs@HIDDEN; Thu, 15 Feb 2024 17:55:59 -0500
From: Spencer Baugh <sbaugh@HIDDEN>
To: bug-gnu-emacs@HIDDEN
Subject: 30.0.50; project-files + project-find-file is slow in large
 repositories
X-Debbugs-Cc: 
Date: Thu, 15 Feb 2024 17:55:46 -0500
Message-ID: <iera5o11gnh.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=janestreet.com;
 s=waixah; t=1708037747;
 bh=t9/KDA79OABR2WeY/27WB0uFtBQh2wam0ho3GDDdr48=;
 h=From:To:Cc:Subject:Date;
 b=3wpDHI/CHfprutcuCrSC8yPjWWn1sysdNdtb3H6pczIcW9L+sv4hPLhVE3Y9cTtz8
 xIEyidqmNKTPrT3udhKrGcKeb2fFJX+4VTmQ8zQFfzRtk/nHRptVyq2SV6LJfXRVeC
 YvoPg+XWbd2z7PH0BsAXRHAZjyh3QNFuSPRwQXVnCxwgbH9EaLx6bdmGhMM+Ue4uW2
 5759TU8ja1OFPj5XhF90n5A9ZfpZ+Wlw/Se+Mvpzs4QO+5wjaA2nNBA9WPHkPoQ22W
 ZtcGNJVQi8VPXm6RkmkX3gP98Lwa08N+5+jYL0WyzfDs6hu1RkaHwD3uvsl45XlhLc
 6AChXtjUoDH5A==
Received-SPF: pass client-ip=64.215.233.18; envelope-from=sbaugh@HIDDEN;
 helo=mxout5.mail.janestreet.com
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, SPF_HELO_PASS=-0.001,
 SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -4.2 (----)
X-Debbugs-Envelope-To: submit
Cc: Dmitry Gutov <dmitry@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -5.2 (-----)


(project-files (project-current)) takes around 1 second in Linux (80k
files) and 7 seconds in my larger (500k file) repository.

With this patch:
diff --git a/lisp/progmodes/project.el b/lisp/progmodes/project.el
index c7c07c3d34c..037beaa835a 100644
--- a/lisp/progmodes/project.el
+++ b/lisp/progmodes/project.el
@@ -667,12 +667,15 @@
                                               (setq i (concat i "**"))))
                                         i)))
                                    extra-ignores)))))
-       (setq files
-             (mapcar
-              (lambda (file) (concat default-directory file))
-              (split-string
-               (apply #'vc-git--run-command-string nil "ls-files" args)
-               "\0" t)))
+       (with-temp-buffer
+         (let ((ok (apply #'vc-git--out-ok "ls-files" args))
+               (pt (point-min)))
+           (unless ok
+             (error "File listing failed: %s" (buffer-string)))
+           (goto-char pt)
+           (while (search-forward "\0" nil t)
+             (push (concat default-directory (buffer-substring-no-properties pt (1- (point)))) files)
+             (setq pt (point)))))
        (when (project--vc-merge-submodules-p default-directory)
          ;; Unfortunately, 'ls-files --recurse-submodules' conflicts with '-o'.
          (let* ((submodules (project--git-submodules))

project-files in Linux takes around .75 seconds.

If I further remove the (concat default-directory ...) around each file,
it speeds up to .5 seconds.

(Note that git ls-files itself takes only around 20 milliseconds)

My large repository (which uses Mercurial) has a custom project-files
which is basically:

(with-temp-buffer
  (unless (zerop (apply #'call-process "rhg" nil t nil "files"))
    (error "File listing failed: %s" (buffer-string)))
  (goto-char (point-min))
  (let ((pt (point))
        res)
    (while (search-forward "\n" nil t)
      (push (file-name-concat default-directory (buffer-substring-no-properties pt (1- (point)))) res)
      (setq pt (point)))
    res))

Likewise, removing the (concat default-directory ...) speeds my
project-files up from 7 seconds to 4.5 seconds.

This is especially silly because project-find-file then just removes
this default-directory again from all the files, which has yet more
overhead.

My proposal: Could we find a way to make the default-directory not
necessary for the files returned from project-files?

Perhaps project-files could be allowed to return relative file paths
which are relative to the project root.  Then in the common case where
all the files are within the project root, project-find-file would be
way faster.  Happy to implement this, if it makes sense.

Another optimization I've considered: We could run the process
asynchronously so project-files parsing can be parallel with the
process; but the process is usually very fast anyway, that's not most of
the overhead, so that won't be a big win.

However, that would make it easy for project-files as a whole to be
asynchronous.  Then that would allow project-find-file to start the
listing in the background, and then we'd write a completion table which
completes only over whatever files we've already read into Emacs.  I
think this would be a lot nicer for most use-cases, and I'd again be
happy to implement this.

Also happy to implement any other optimizations you think might make
sense.


In GNU Emacs 30.0.50 (build 37, x86_64-pc-linux-gnu, X toolkit, cairo
 version 1.15.12, Xaw scroll bars) of 2024-02-13 built on
 igm-qws-u22796a
Repository revision: a24a2b1ceb12f11c9d345190fbf554f27c4ec186
Repository branch: master
Windowing system distributor 'The X.Org Foundation', version 11.0.12011000
System Description: Rocky Linux 8.9 (Green Obsidian)

Configured using:
 'configure -C --with-x-toolkit=lucid 'CFLAGS=-O0 -g3'
 --without-native-compilation --without-gif'

Configured features:
CAIRO DBUS FREETYPE GLIB GMP GNUTLS GSETTINGS HARFBUZZ JPEG JSON
LIBSELINUX LIBSYSTEMD LIBXML2 MODULES NOTIFY INOTIFY PDUMPER PNG RSVG
SECCOMP SOUND SQLITE3 THREADS TIFF TOOLKIT_SCROLL_BARS X11 XDBE XIM
XINPUT2 XPM LUCID ZLIB

Important settings:
  value of $LANG: en_US.UTF-8
  locale-coding-system: utf-8-unix

Major mode: Lisp Interaction

Minor modes in effect:
  tooltip-mode: t
  global-eldoc-mode: t
  eldoc-mode: t
  show-paren-mode: t
  electric-indent-mode: t
  mouse-wheel-mode: t
  tool-bar-mode: t
  menu-bar-mode: t
  file-name-shadow-mode: t
  global-font-lock-mode: t
  font-lock-mode: t
  blink-cursor-mode: t
  minibuffer-regexp-mode: t
  line-number-mode: t
  indent-tabs-mode: t
  transient-mark-mode: t
  auto-composition-mode: t
  auto-encryption-mode: t
  auto-compression-mode: t

Load-path shadows:
None found.

Features:
(shadow sort mail-extr emacsbug message mailcap yank-media puny dired
dired-loaddefs rfc822 mml mml-sec password-cache epa derived epg rfc6068
epg-config gnus-util text-property-search time-date subr-x mm-decode
mm-bodies mm-encode mail-parse rfc2231 mailabbrev gmm-utils mailheader
cl-loaddefs cl-lib sendmail rfc2047 rfc2045 ietf-drums mm-util
mail-prsvr mail-utils rmc iso-transl tooltip cconv eldoc paren electric
uniquify ediff-hook vc-hooks lisp-float-type elisp-mode mwheel
term/x-win x-win term/common-win x-dnd touch-screen tool-bar dnd fontset
image regexp-opt fringe tabulated-list replace newcomment text-mode
lisp-mode prog-mode register page tab-bar menu-bar rfn-eshadow isearch
easymenu timer select scroll-bar mouse jit-lock font-lock syntax
font-core term/tty-colors frame minibuffer nadvice seq simple cl-generic
indonesian philippine cham georgian utf-8-lang misc-lang vietnamese
tibetan thai tai-viet lao korean japanese eucjp-ms cp51932 hebrew greek
romanian slovak czech european ethiopic indian cyrillic chinese
composite emoji-zwj charscript charprop case-table epa-hook
jka-cmpr-hook help abbrev obarray oclosure cl-preloaded button loaddefs
theme-loaddefs faces cus-face macroexp files window text-properties
overlay sha1 md5 base64 format env code-pages mule custom widget keymap
hashtable-print-readable backquote threads dbusbind inotify
dynamic-setting system-font-setting font-render-setting cairo x-toolkit
xinput2 x multi-tty move-toolbar make-network-process emacs)

Memory information:
((conses 16 65052 9318) (symbols 48 9539 0) (strings 32 22452 1449)
 (string-bytes 1 659675) (vectors 16 9245)
 (vector-slots 8 111110 9295) (floats 8 40 17) (intervals 56 262 0)
 (buffers 976 10))




Acknowledgement sent to Spencer Baugh <sbaugh@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-gnu-emacs@HIDDEN. Full text available.
Report forwarded to bug-gnu-emacs@HIDDEN:
bug#69233; Package emacs. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Sun, 18 Feb 2024 20:15:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.