GNU bug report logs - #8288
vc-git slow on large repository

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: emacs; Reported by: S Boucher <stbya@HIDDEN>; dated Fri, 18 Mar 2011 19:33:02 UTC; Maintainer for emacs is bug-gnu-emacs@HIDDEN.

Message received at 8288 <at> debbugs.gnu.org:


Received: (at 8288) by debbugs.gnu.org; 14 Jun 2011 23:52:34 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Jun 14 19:52:34 2011
Received: from localhost ([127.0.0.1] helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.69)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1QWdPN-0002GJ-6s
	for submit <at> debbugs.gnu.org; Tue, 14 Jun 2011 19:52:34 -0400
Received: from mx1.redhat.com ([209.132.183.28])
	by debbugs.gnu.org with esmtp (Exim 4.69)
	(envelope-from <jason@HIDDEN>) id 1QWdDz-00020E-PT
	for 8288 <at> debbugs.gnu.org; Tue, 14 Jun 2011 19:40:49 -0400
Received: from int-mx02.intmail.prod.int.phx2.redhat.com
	(int-mx02.intmail.prod.int.phx2.redhat.com [10.5.11.12])
	by mx1.redhat.com (8.14.4/8.14.4) with ESMTP id p5ENegp9005568
	(version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK)
	for <8288 <at> debbugs.gnu.org>; Tue, 14 Jun 2011 19:40:42 -0400
Received: from [127.0.0.1] (ovpn-113-40.phx2.redhat.com [10.3.113.40])
	by int-mx02.intmail.prod.int.phx2.redhat.com (8.13.8/8.13.8) with ESMTP
	id p5ENefha022601
	for <8288 <at> debbugs.gnu.org>; Tue, 14 Jun 2011 19:40:41 -0400
Message-ID: <4DF7F178.7050704@HIDDEN>
Date: Tue, 14 Jun 2011 19:40:40 -0400
From: Jason Merrill <jason@HIDDEN>
User-Agent: Mozilla/5.0 (X11; U; Linux i686; en-US;
	rv:1.9.2.17) Gecko/20110428 Fedora/3.1.10-1.fc14 Lightning/1.0b2
	Thunderbird/3.1.10
MIME-Version: 1.0
To: 8288 <at> debbugs.gnu.org
Subject: vc-git slow on large repository
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
X-Scanned-By: MIMEDefang 2.67 on 10.5.11.12
X-Spam-Score: -10.6 (----------)
X-Debbugs-Envelope-To: 8288
X-Mailman-Approved-At: Tue, 14 Jun 2011 19:52:31 -0400
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.11
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
	<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/pipermail/debbugs-submit>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
	<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Sender: debbugs-submit-bounces <at> debbugs.gnu.org
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
X-Spam-Score: -10.6 (----------)

This issue has been very frustrating for me with GCC git; when the 
repository isn't in the cache saving a file can cause emacs to freeze 
for about 10 seconds.  I work around it with

(defun vc-git-state-heuristic (file)
   "Just claim we're up to date."
   'up-to-date)




Information forwarded to owner <at> debbugs.gnu.org, bug-gnu-emacs@HIDDEN:
bug#8288; Package emacs. Full text available.

Message received at 8288 <at> debbugs.gnu.org:


Received: (at 8288) by debbugs.gnu.org; 19 Mar 2011 07:32:12 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Mar 19 03:32:12 2011
Received: from localhost ([127.0.0.1] helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.69)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1Q0qdv-0006sm-QR
	for submit <at> debbugs.gnu.org; Sat, 19 Mar 2011 03:32:11 -0400
Received: from mail-out.m-online.net ([212.18.0.9])
	by debbugs.gnu.org with esmtp (Exim 4.69)
	(envelope-from <whitebox@HIDDEN>) id 1Q0qdt-0006sZ-LN
	for 8288 <at> debbugs.gnu.org; Sat, 19 Mar 2011 03:32:10 -0400
Received: from frontend1.mail.m-online.net (unknown [192.168.8.180])
	by mail-out.m-online.net (Postfix) with ESMTP id 719621C01EC5;
	Sat, 19 Mar 2011 08:32:03 +0100 (CET)
Received: from localhost (dynscan1.mnet-online.de [192.168.8.164])
	by mail.m-online.net (Postfix) with ESMTP id 447A01C000A6;
	Sat, 19 Mar 2011 08:32:03 +0100 (CET)
X-Virus-Scanned: amavisd-new at mnet-online.de
Received: from mail.mnet-online.de ([192.168.8.180])
	by localhost (dynscan1.mail.m-online.net [192.168.8.164]) (amavisd-new,
	port 10024)
	with ESMTP id j4bi5kXUAmSb; Sat, 19 Mar 2011 08:32:02 +0100 (CET)
Received: from igel.home (ppp-93-104-145-233.dynamic.mnet-online.de
	[93.104.145.233]) by mail.mnet-online.de (Postfix) with ESMTP;
	Sat, 19 Mar 2011 08:32:02 +0100 (CET)
Received: by igel.home (Postfix, from userid 501)
	id 2F17FCA2A0; Sat, 19 Mar 2011 08:32:02 +0100 (CET)
From: Andreas Schwab <schwab@HIDDEN>
To: S Boucher <stbya@HIDDEN>
Subject: Re: bug#8288: Acknowledgement (vc-git slow on large repository)
References: <193424.94757.qm@HIDDEN>
	<handler.8288.B.130047675931219.ack <at> debbugs.gnu.org>
	<566274.87174.qm@HIDDEN>
X-Yow: Yow!  I'm out of work...I could go into shock absorbers...or SCUBA
	GEAR!!
Date: Sat, 19 Mar 2011 08:32:02 +0100
In-Reply-To: <566274.87174.qm@HIDDEN> (S. Boucher's
	message of "Fri, 18 Mar 2011 19:54:38 -0700 (PDT)")
Message-ID: <m2oc57bm6l.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/23.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Spam-Score: -2.6 (--)
X-Debbugs-Envelope-To: 8288
Cc: 8288 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.11
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
	<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/pipermail/debbugs-submit>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
	<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Sender: debbugs-submit-bounces <at> debbugs.gnu.org
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
X-Spam-Score: -2.6 (--)

S Boucher <stbya@HIDDEN> writes:

> I think 'git diff-index -z HEAD -- <file>' could be replaced with 'git status -z 
> --porcelain <file>' in vc-git-state.

This requires at least git 1.7.0, but it can be replaced by --short in
older versions.

Andreas.

-- 
Andreas Schwab, schwab@HIDDEN
GPG Key fingerprint = 58CA 54C7 6D53 942B 1756  01D3 44D5 214B 8276 4ED5
"And now for something completely different."




Information forwarded to owner <at> debbugs.gnu.org, bug-gnu-emacs@HIDDEN:
bug#8288; Package emacs. Full text available.

Message received at 8288 <at> debbugs.gnu.org:


Received: (at 8288) by debbugs.gnu.org; 19 Mar 2011 02:54:48 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Mar 18 22:54:47 2011
Received: from localhost ([127.0.0.1] helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.69)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1Q0mJT-0000sw-5c
	for submit <at> debbugs.gnu.org; Fri, 18 Mar 2011 22:54:47 -0400
Received: from web161614.mail.bf1.yahoo.com ([98.139.211.136])
	by debbugs.gnu.org with smtp (Exim 4.69)
	(envelope-from <stbya@HIDDEN>) id 1Q0mJQ-0000sj-32
	for 8288 <at> debbugs.gnu.org; Fri, 18 Mar 2011 22:54:44 -0400
Received: (qmail 5948 invoked by uid 60001); 19 Mar 2011 02:54:38 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024;
	t=1300503278; bh=Dql4xxl0WKkmqGMVCpTyFTcWLFgBBqjVMffZ7HRHPok=;
	h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type;
	b=fkojwljhr/qJM7Az+zMBw/xGVvJlVsgk5T5X0EgRAX7jxgJAVchno9fDg4uBdFoGvWiiX1Ko7VFMANpC+ZccO8xnu544dNEzU2lGcrYVIwFxP3/C7fG8Y3fMdK2Vyk/lw2Jka2fwAJcqkEK6d9e+VjmVR4ObCBuz144h4qYof2s=
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com;
	h=Message-ID:X-YMail-OSG:Received:X-Mailer:References:Date:From:Subject:To:In-Reply-To:MIME-Version:Content-Type;
	b=rrVw/Eg/AdzL1WSd3o6rrvCewjwkuYAohuAhADtO7GRZk/DQ2ydWe67uALb053NQx/cflt1tQejlxt4IVWQs93yNQvyE/iN6JDGog9Yr8dU2P207SmeAAzAn6FU5bc3MPJp7pjn3ZSXb3tZhZ5xdhQDdo2SDAHVhnrY6wLfA/m0=;
Message-ID: <566274.87174.qm@HIDDEN>
X-YMail-OSG: 0qWUyJMVM1lJtPGOvdW2V8.z2oVxBN.HG84_lBY0MgBgT4k
	vkDXVH1JJjFFYbvSIzaI7PXXDaNg_DhTb7WgYuszH.bs6cHhrHPmxh3snu_V
	DJi.X769FU3941j_qawpHz8PiL_Y051YVCRq9nWOf4VgT5Nk8O0p.RuDyL7T
	jGm1zNQOvqrIYKyhx_s71grUNAiClNhnyfMxJs__Tqjfbhi.z4AP0S6e2hcr
	EKhDQF_vdyunqmr8g2b42Wi2rIbt5yrIj6XHC14_y0O_ZiAu_w_iMh6iTQMX
	I3hzGNC_RrKQIXUqq.z2K380LtyCQoOhClva6c3NgdnJ6vbyp
Received: from [74.57.21.97] by web161614.mail.bf1.yahoo.com via HTTP;
	Fri, 18 Mar 2011 19:54:38 PDT
X-Mailer: YahooMailRC/559 YahooMailWebService/0.8.109.295617
References: <193424.94757.qm@HIDDEN>
	<handler.8288.B.130047675931219.ack <at> debbugs.gnu.org>
Date: Fri, 18 Mar 2011 19:54:38 -0700 (PDT)
From: S Boucher <stbya@HIDDEN>
Subject: Re: bug#8288: Acknowledgement (vc-git slow on large repository)
To: 8288 <at> debbugs.gnu.org
In-Reply-To: <handler.8288.B.130047675931219.ack <at> debbugs.gnu.org>
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-Spam-Score: -2.6 (--)
X-Debbugs-Envelope-To: 8288
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.11
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
	<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/pipermail/debbugs-submit>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
	<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Sender: debbugs-submit-bounces <at> debbugs.gnu.org
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
X-Spam-Score: -2.6 (--)

I think 'git diff-index -z HEAD -- <file>' could be replaced with 'git status -z 
--porcelain <file>' in vc-git-state.

It is 10times faster on a large webkit repository.




----- Original Message ----
> From: GNU bug Tracking System <help-debbugs@HIDDEN>
> To: S Boucher <stbya@HIDDEN>
> Sent: Fri, March 18, 2011 3:33:02 PM
> Subject: bug#8288: Acknowledgement (vc-git slow on large repository)
> 
> Thank you for filing a new bug report with GNU.
> 
> This is an automatically  generated reply to let you know your message
> has been received.
> 
> Your  message is being forwarded to the package maintainers and other
> interested  parties for their attention; they will reply in due course.
> 
> Your message  has been sent to the package maintainer(s):
> bug-gnu-emacs@HIDDEN
> 
> If you wish  to submit further information on this problem, please
> send it to 8288 <at> debbugs.gnu.org.
> 
> Please do  not send mail to help-debbugs@HIDDEN unless you  wish
> to report a problem with the Bug-tracking system.
> 
> -- 
> 8288: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=8288
> GNU Bug Tracking  System
> Contact help-debbugs@HIDDEN with problems
> 






Information forwarded to owner <at> debbugs.gnu.org, bug-gnu-emacs@HIDDEN:
bug#8288; Package emacs. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 18 Mar 2011 19:32:39 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Mar 18 15:32:38 2011
Received: from localhost ([127.0.0.1] helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.69)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1Q0fPa-00087U-4J
	for submit <at> debbugs.gnu.org; Fri, 18 Mar 2011 15:32:38 -0400
Received: from eggs.gnu.org ([140.186.70.92])
	by debbugs.gnu.org with esmtp (Exim 4.69)
	(envelope-from <stbya@HIDDEN>) id 1Q0fPY-00087H-B0
	for submit <at> debbugs.gnu.org; Fri, 18 Mar 2011 15:32:36 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <stbya@HIDDEN>) id 1Q0fPN-0002Q1-37
	for submit <at> debbugs.gnu.org; Fri, 18 Mar 2011 15:32:31 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM,
	RFC_ABUSE_POST, T_DKIM_INVALID, T_RP_MATCHES_RCVD,
	T_TO_NO_BRKTS_FREEMAIL autolearn=unavailable version=3.3.1
Received: from lists.gnu.org ([199.232.76.165]:38040)
	by eggs.gnu.org with esmtp (Exim 4.71)
	(envelope-from <stbya@HIDDEN>) id 1Q0fPN-0002Px-12
	for submit <at> debbugs.gnu.org; Fri, 18 Mar 2011 15:32:25 -0400
Received: from [140.186.70.92] (port=58565 helo=eggs.gnu.org)
	by lists.gnu.org with esmtp (Exim 4.43) id 1Q0fPM-00020D-41
	for bug-gnu-emacs@HIDDEN; Fri, 18 Mar 2011 15:32:24 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
	(envelope-from <stbya@HIDDEN>) id 1Q0fPH-0002P0-CG
	for bug-gnu-emacs@HIDDEN; Fri, 18 Mar 2011 15:32:23 -0400
Received: from web161618.mail.bf1.yahoo.com ([98.139.211.140]:46027)
	by eggs.gnu.org with smtp (Exim 4.71)
	(envelope-from <stbya@HIDDEN>) id 1Q0fPH-0002OK-7Q
	for bug-gnu-emacs@HIDDEN; Fri, 18 Mar 2011 15:32:19 -0400
Received: (qmail 5114 invoked by uid 60001); 18 Mar 2011 19:32:17 -0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024;
	t=1300476737; bh=QSJPdBM+rr5YBMiGAlJGHTdrxAh1ZqZLwdV3Uah4QK4=;
	h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type;
	b=1HZfkCiPhwGs9pJ5nZPoBWyuQbTBuuARQv82rNUYrBELO+b7YE130VCauIkS1HWnF+ZB9WIBSMOIdm6WRdfrAbplWB78UmiQ1XUwfDZIG/mapoith5PAkkr6NKPCxiuOAAN0cYXZye5g8aADdLS+vufxJEySb5527/3McB3zxz8=
DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=s1024; d=yahoo.com;
	h=Message-ID:X-YMail-OSG:Received:X-Mailer:Date:From:Subject:To:MIME-Version:Content-Type;
	b=OfKn3/EL2pIqcONXsb116jzb8PblPAXOS7OVzy+TomSLF0IDFFX+Tt4fkNb2a1UATbBRl5OC9QFwtzN9pU21Jiglv8iyCJMwGC++swjoV5aKxBkxPg0JThk6jNlY7E639aJRdxNrQGmOzLGny3Wb7D86DopPhWu1MvfLKQHtduk=;
Message-ID: <193424.94757.qm@HIDDEN>
X-YMail-OSG: yNoX4mUVM1ml1KLpY6d0nD0SGLNwhdz5s7v_MXW5x6FADl2
	cWsC70vvcxVXU1AsV4PFoILgfrxAWPuZv58KvSZC4lAO9kjcK.piqchi1WLa
	eHDnLJf.6m4D3orkiX0MPi8QrHm1MwURnu7CjXPKPRZmQZe2GD03Pi78Yk8A
	Asv5Yl8la7b7fbQKQ0bcvgqdNFZANdmchNTD.9VJ9GGF_vE2XR7rLZGYLewe
	WbEIYC3m5xIhBkQ0DHx4dDkkouVGSx3m6pGNdIqeMD8vhsVxgaQy81Pmlv9F
	TraXu3Lw-
Received: from [209.5.112.166] by web161618.mail.bf1.yahoo.com via HTTP;
	Fri, 18 Mar 2011 12:32:17 PDT
X-Mailer: YahooMailRC/559 YahooMailWebService/0.8.109.295617
Date: Fri, 18 Mar 2011 12:32:17 -0700 (PDT)
From: S Boucher <stbya@HIDDEN>
Subject: vc-git slow on large repository
To: bug-gnu-emacs@HIDDEN
MIME-Version: 1.0
Content-Type: text/plain; charset=us-ascii
X-detected-operating-system: by eggs.gnu.org: FreeBSD 6.x (1)
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6 (newer, 2)
X-Received-From: 199.232.76.165
X-Spam-Score: -5.6 (-----)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.11
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <http://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
	<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <http://debbugs.gnu.org/pipermail/debbugs-submit>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <http://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
	<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Sender: debbugs-submit-bounces <at> debbugs.gnu.org
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
X-Spam-Score: -5.7 (-----)

find-file and save-buffer are slow.  It appears to be due to vc-git-state.

vc-git-state calls:

     git diff-index -z HEAD -- file.cpp

Which is slow on large git repository, such as webkit.

The question is then whether or not vc-git.el can be more clever than it is now.

I don't have the answer to this.


System:
ubuntu 10.04 64bit
emacs 23.2
git 1.7.0.4
8G of ram
Intel Core i7 (8 processors)






Acknowledgement sent to S Boucher <stbya@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-gnu-emacs@HIDDEN. Full text available.
Report forwarded to owner <at> debbugs.gnu.org, bug-gnu-emacs@HIDDEN:
bug#8288; Package emacs. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Fri, 31 Oct 2014 17:00:04 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.