GNU bug report logs - #78194
`guix pull --list-generations' is extremely slow

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Reported by: Ian Eure <ian@HIDDEN>; dated Thu, 1 May 2025 15:36:02 UTC; Maintainer for guix is bug-guix@HIDDEN.

Message received at 78194 <at> debbugs.gnu.org:


Received: (at 78194) by debbugs.gnu.org; 14 May 2025 21:51:05 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed May 14 17:51:05 2025
Received: from localhost ([127.0.0.1]:46783 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1uFK0H-0005jc-Iv
	for submit <at> debbugs.gnu.org; Wed, 14 May 2025 17:51:05 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:47068)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1uFK0C-0005hu-V2
 for 78194 <at> debbugs.gnu.org; Wed, 14 May 2025 17:51:01 -0400
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <ludo@HIDDEN>)
 id 1uFK07-0007vw-4V; Wed, 14 May 2025 17:50:55 -0400
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: bug#78194: `guix pull --list-generations' is extremely slow
In-Reply-To: <87h61nywww.fsf@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?=
 =?utf-8?Q?s?= message of "Wed, 14 May 2025 18:33:35 +0200")
References: <87msbw4a4m.fsf@HIDDEN> <87h61nywww.fsf@HIDDEN>
Date: Wed, 14 May 2025 22:28:37 +0200
Message-ID: <877c2jym16.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 78194
Cc: 78194 <at> debbugs.gnu.org, Ian Eure <ian@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Ludovic Court=C3=A8s <ludo@HIDDEN> writes:

> Because for each pair of generations, it shows the corresponding news
> entries (as per =E2=80=98guix pull --news=E2=80=99), and that part is qui=
te expensive
> because it involves a Git log traversal.
>
> I think we should (1) optimize the news code (that=E2=80=99s
> =E2=80=98channel-news-for-commit=E2=80=99), and (2) if that=E2=80=99s not=
 enough consider
> keeping it off by default in =E2=80=98guix pull --list-generations=E2=80=
=99.

That turned out to be easier than I thought, see
<https://issues.guix.gnu.org/78432>, which makes it 10=E2=80=9320x faster.

Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#78194; Package guix. Full text available.

Message received at 78194 <at> debbugs.gnu.org:


Received: (at 78194) by debbugs.gnu.org; 14 May 2025 17:04:11 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed May 14 13:04:11 2025
Received: from localhost ([127.0.0.1]:44771 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1uFFWc-0004oe-Sn
	for submit <at> debbugs.gnu.org; Wed, 14 May 2025 13:04:11 -0400
Received: from hera.aquilenet.fr ([185.233.100.1]:47836)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1uFFWY-0004mc-C4
 for 78194 <at> debbugs.gnu.org; Wed, 14 May 2025 13:04:07 -0400
Received: from localhost (localhost [127.0.0.1])
 by hera.aquilenet.fr (Postfix) with ESMTP id B9F20E4C;
 Wed, 14 May 2025 19:03:57 +0200 (CEST)
X-Virus-Scanned: Debian amavis at hera.aquilenet.fr
Received: from hera.aquilenet.fr ([127.0.0.1])
 by localhost (hera.aquilenet.fr [127.0.0.1]) (amavis, port 10024) with ESMTP
 id 5mJSX86gdgVn; Wed, 14 May 2025 19:03:57 +0200 (CEST)
Received: from ribbon (91-160-117-201.subs.proxad.net [91.160.117.201])
 by hera.aquilenet.fr (Postfix) with ESMTPSA id 0A88EE49;
 Wed, 14 May 2025 19:03:57 +0200 (CEST)
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: Ian Eure <ian@HIDDEN>
Subject: Re: bug#78194: `guix pull --list-generations' is extremely slow
In-Reply-To: <87msbw4a4m.fsf@HIDDEN> (Ian Eure's message of "Thu, 01 May
 2025 08:35:21 -0700")
References: <87msbw4a4m.fsf@HIDDEN>
Date: Wed, 14 May 2025 18:33:35 +0200
Message-ID: <87h61nywww.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.7 (/)
X-Debbugs-Envelope-To: 78194
Cc: 78194 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.3 (/)

Hi,

Ian Eure <ian@HIDDEN> writes:

> I=E2=80=99ve been frustrated by this before, but decided to measure thing=
s:
>
> `guix home list-generations' takes 3.535s to list 28 items.
> `guix system list-generations' takes 1.406s to list 35 items.
> `guix pull --list-generations' takes 232.599s to list 41 items.
>
> Why is `guix pull --list-generations' >100x slower than `guix system
> list-generations'?

Because for each pair of generations, it shows the corresponding news
entries (as per =E2=80=98guix pull --news=E2=80=99), and that part is quite=
 expensive
because it involves a Git log traversal.

I think we should (1) optimize the news code (that=E2=80=99s
=E2=80=98channel-news-for-commit=E2=80=99), and (2) if that=E2=80=99s not e=
nough consider
keeping it off by default in =E2=80=98guix pull --list-generations=E2=80=99.

Thoughts?

Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#78194; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 1 May 2025 15:35:47 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu May 01 11:35:47 2025
Received: from localhost ([127.0.0.1]:52378 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1uAVwx-0002iV-0w
	for submit <at> debbugs.gnu.org; Thu, 01 May 2025 11:35:47 -0400
Received: from lists.gnu.org ([2001:470:142::17]:51916)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <ian@HIDDEN>) id 1uAVwt-0002hw-Ii
 for submit <at> debbugs.gnu.org; Thu, 01 May 2025 11:35:45 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <ian@HIDDEN>) id 1uAVwk-00057R-FX
 for bug-guix@HIDDEN; Thu, 01 May 2025 11:35:34 -0400
Received: from fout-b1-smtp.messagingengine.com ([202.12.124.144])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <ian@HIDDEN>) id 1uAVwh-0002FH-8U
 for bug-guix@HIDDEN; Thu, 01 May 2025 11:35:34 -0400
Received: from phl-compute-11.internal (phl-compute-11.phl.internal
 [10.202.2.51])
 by mailfout.stl.internal (Postfix) with ESMTP id 96E951140187
 for <bug-guix@HIDDEN>; Thu,  1 May 2025 11:35:27 -0400 (EDT)
Received: from phl-mailfrontend-02 ([10.202.2.163])
 by phl-compute-11.internal (MEProxy); Thu, 01 May 2025 11:35:27 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=retrospec.tv; h=
 cc:content-transfer-encoding:content-type:content-type:date:date
 :from:from:in-reply-to:message-id:mime-version:reply-to:subject
 :subject:to:to; s=fm2; t=1746113727; x=1746200127; bh=LIwsLlcjFA
 ycNreMIw6Ho3RDDr5yxRbUYGVDTL3nvrw=; b=JaQo06EEjrJxImaEkAJ7XHDY/I
 rvhn2XVGxnrflWUXB7zG8Bh4BvOMYsRboFdK1Gff3gWc6OHd5Qs/6/qS1MpcYiOW
 x+MDamKVMU55yNAdW19jdeRd+IXOpJC9tEO2ANXeMn9kYL2gLRUqY6OqWJWjc75X
 CiKtTbvXSo/blTvNMS2N3FKsYZFARomh0ZS0haL/8gVKp2TTCVwDCyaMXy55I5vU
 fDApKD45UrlettRPnpUR0yvppyRyBjSPhDefvc+MyqpaD4o9d4/Un4dgYj92W6Ax
 FkeiklY8NC/OPTMqI/G8ycQ8MfFbATIiFyEnvV9x5XGAJShQumuCLSvaVtcg==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=cc:content-transfer-encoding:content-type
 :content-type:date:date:feedback-id:feedback-id:from:from
 :in-reply-to:message-id:mime-version:reply-to:subject:subject:to
 :to:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t=
 1746113727; x=1746200127; bh=LIwsLlcjFAycNreMIw6Ho3RDDr5yxRbUYGV
 DTL3nvrw=; b=Kj3cSYtL8VQVjJqi7WTB3xX1NMQcCzepwOJvVSqnvLVkdjRvqjx
 dCvfuLcFOhZ6JVYTh6v52hMQrJzd7CgQu0Hz+GsTvKMbGrShA2a0TDeV45Udb1WN
 3frKgN/Z3J9ue9/ApjkmLeviKYqz7u/+UnnrxMvcjZMdrYew5RnoeGQku+fXBx+m
 rRn582eBEZ81dHdiVTJstM4MpQk5Rn4r397dtYdl4rkIfwP4zJZinFT5jdqWKqTT
 pzfvRNUhCJWuK9aFtK1wm5E/4pfJ5Z/XOq5BSy5CGFfwA/I4vOu+6jL0URRob6uD
 6hiWvC12BQv48O4jNPj8CF/Tw1Wgf2Eibkg==
X-ME-Sender: <xms:vpQTaK5SXRtzmI9-cXStMaPiBXrNWiGyG63Wn_jlH8ECRGuxgrcI7w>
 <xme:vpQTaD6kYuML3TaMTN2-div0TXYrHWBG0MldNYJACUp3e9kHlt3McN7B-1u6eudsK
 vNj6lbjUiaA-CZRQQ>
X-ME-Received: <xmr:vpQTaJf6F5VS6PHh8qkwCD7RFNhXebAdNzxYR4XBeo64KwXn-TF9zd7UGW_gVoJ8kAF0bFZWoV4ey6JVfI-i_Y3tCJwJI6s-2eo>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefvddrtddtgddvieelleegucetufdoteggodetrf
 dotffvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggv
 pdfurfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpefhvf
 fufgffkfggtgfgsehtqhertddtreejnecuhfhrohhmpefkrghnucfguhhrvgcuoehirghn
 sehrvghtrhhoshhpvggtrdhtvheqnecuggftrfgrthhtvghrnhepieeffeekkeegtedutd
 eiteegudefgedtieevueeftdeggefgjeeludevjeevvdejnecuvehluhhsthgvrhfuihii
 vgeptdenucfrrghrrghmpehmrghilhhfrhhomhepihgrnhesrhgvthhrohhsphgvtgdrth
 hvpdhnsggprhgtphhtthhopedupdhmohguvgepshhmthhpohhuthdprhgtphhtthhopegs
 uhhgqdhguhhigiesghhnuhdrohhrgh
X-ME-Proxy: <xmx:vpQTaHLIcEBhruTdUgxJD3dWMu05WFQpHSaum94zu9udL0GxoJuUtw>
 <xmx:vpQTaOKId6UX1esWXikoE78oYjZzXuN2-EyVLglgZ9jtbjGaNqlJww>
 <xmx:vpQTaIzwHoa4HyTCpve_21t2Z5YHpuOFp0cVIVKYQxxfRb3Nftozew>
 <xmx:vpQTaCLF94Jm8LtnzlBT5Pbm0-EEal1P7iXmrin4ysoGqSJkf3xyOA>
 <xmx:v5QTaPq51R9QGKtrU9k1H_TzIaeIrOjKA6AJNTZ_exKPM-LaSIQplAUB>
Feedback-ID: id9014242:Fastmail
Received: by mail.messagingengine.com (Postfix) with ESMTPA for
 <bug-guix@HIDDEN>; Thu, 1 May 2025 11:35:26 -0400 (EDT)
From: Ian Eure <ian@HIDDEN>
To: bug-guix@HIDDEN
Subject: `guix pull --list-generations' is extremely slow
User-Agent: mu4e 1.12.9; emacs 29.4
Date: Thu, 01 May 2025 08:35:21 -0700
Message-ID: <87msbw4a4m.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=202.12.124.144; envelope-from=ian@HIDDEN;
 helo=fout-b1-smtp.messagingengine.com
X-Spam_score_int: -27
X-Spam_score: -2.8
X-Spam_bar: --
X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,
 RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001,
 RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, SPF_HELO_PASS=-0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: 0.7 (/)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.3 (/)

I=E2=80=99ve been frustrated by this before, but decided to measure=20
things:

`guix home list-generations' takes 3.535s to list 28 items.
`guix system list-generations' takes 1.406s to list 35 items.
`guix pull --list-generations' takes 232.599s to list 41 items.

Why is `guix pull --list-generations' >100x slower than `guix=20
system list-generations'?

Thanks,

  -- Ian







Acknowledgement sent to Ian Eure <ian@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#78194; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Wed, 14 May 2025 22:00:04 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.