GNU logs - #78194, boring messages


Message sent to bug-guix@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#78194: `guix pull --list-generations' is extremely slow
Resent-From: Ian Eure <ian@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Thu, 01 May 2025 15:36:02 +0000
Resent-Message-ID: <handler.78194.B.174611374710452 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: report 78194
X-GNU-PR-Package: guix
X-GNU-PR-Keywords: 
To: 78194 <at> debbugs.gnu.org
X-Debbugs-Original-To: bug-guix@HIDDEN
Received: via spool by submit <at> debbugs.gnu.org id=B.174611374710452
          (code B ref -1); Thu, 01 May 2025 15:36:02 +0000
Received: (at submit) by debbugs.gnu.org; 1 May 2025 15:35:47 +0000
Received: from localhost ([127.0.0.1]:52378 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1uAVwx-0002iV-0w
	for submit <at> debbugs.gnu.org; Thu, 01 May 2025 11:35:47 -0400
Received: from lists.gnu.org ([2001:470:142::17]:51916)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <ian@HIDDEN>) id 1uAVwt-0002hw-Ii
 for submit <at> debbugs.gnu.org; Thu, 01 May 2025 11:35:45 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <ian@HIDDEN>) id 1uAVwk-00057R-FX
 for bug-guix@HIDDEN; Thu, 01 May 2025 11:35:34 -0400
Received: from fout-b1-smtp.messagingengine.com ([202.12.124.144])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <ian@HIDDEN>) id 1uAVwh-0002FH-8U
 for bug-guix@HIDDEN; Thu, 01 May 2025 11:35:34 -0400
Received: from phl-compute-11.internal (phl-compute-11.phl.internal
 [10.202.2.51])
 by mailfout.stl.internal (Postfix) with ESMTP id 96E951140187
 for <bug-guix@HIDDEN>; Thu,  1 May 2025 11:35:27 -0400 (EDT)
Received: from phl-mailfrontend-02 ([10.202.2.163])
 by phl-compute-11.internal (MEProxy); Thu, 01 May 2025 11:35:27 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=retrospec.tv; h=
 cc:content-transfer-encoding:content-type:content-type:date:date
 :from:from:in-reply-to:message-id:mime-version:reply-to:subject
 :subject:to:to; s=fm2; t=1746113727; x=1746200127; bh=LIwsLlcjFA
 ycNreMIw6Ho3RDDr5yxRbUYGVDTL3nvrw=; b=JaQo06EEjrJxImaEkAJ7XHDY/I
 rvhn2XVGxnrflWUXB7zG8Bh4BvOMYsRboFdK1Gff3gWc6OHd5Qs/6/qS1MpcYiOW
 x+MDamKVMU55yNAdW19jdeRd+IXOpJC9tEO2ANXeMn9kYL2gLRUqY6OqWJWjc75X
 CiKtTbvXSo/blTvNMS2N3FKsYZFARomh0ZS0haL/8gVKp2TTCVwDCyaMXy55I5vU
 fDApKD45UrlettRPnpUR0yvppyRyBjSPhDefvc+MyqpaD4o9d4/Un4dgYj92W6Ax
 FkeiklY8NC/OPTMqI/G8ycQ8MfFbATIiFyEnvV9x5XGAJShQumuCLSvaVtcg==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=cc:content-transfer-encoding:content-type
 :content-type:date:date:feedback-id:feedback-id:from:from
 :in-reply-to:message-id:mime-version:reply-to:subject:subject:to
 :to:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t=
 1746113727; x=1746200127; bh=LIwsLlcjFAycNreMIw6Ho3RDDr5yxRbUYGV
 DTL3nvrw=; b=Kj3cSYtL8VQVjJqi7WTB3xX1NMQcCzepwOJvVSqnvLVkdjRvqjx
 dCvfuLcFOhZ6JVYTh6v52hMQrJzd7CgQu0Hz+GsTvKMbGrShA2a0TDeV45Udb1WN
 3frKgN/Z3J9ue9/ApjkmLeviKYqz7u/+UnnrxMvcjZMdrYew5RnoeGQku+fXBx+m
 rRn582eBEZ81dHdiVTJstM4MpQk5Rn4r397dtYdl4rkIfwP4zJZinFT5jdqWKqTT
 pzfvRNUhCJWuK9aFtK1wm5E/4pfJ5Z/XOq5BSy5CGFfwA/I4vOu+6jL0URRob6uD
 6hiWvC12BQv48O4jNPj8CF/Tw1Wgf2Eibkg==
X-ME-Sender: <xms:vpQTaK5SXRtzmI9-cXStMaPiBXrNWiGyG63Wn_jlH8ECRGuxgrcI7w>
 <xme:vpQTaD6kYuML3TaMTN2-div0TXYrHWBG0MldNYJACUp3e9kHlt3McN7B-1u6eudsK
 vNj6lbjUiaA-CZRQQ>
X-ME-Received: <xmr:vpQTaJf6F5VS6PHh8qkwCD7RFNhXebAdNzxYR4XBeo64KwXn-TF9zd7UGW_gVoJ8kAF0bFZWoV4ey6JVfI-i_Y3tCJwJI6s-2eo>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefvddrtddtgddvieelleegucetufdoteggodetrf
 dotffvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggv
 pdfurfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpefhvf
 fufgffkfggtgfgsehtqhertddtreejnecuhfhrohhmpefkrghnucfguhhrvgcuoehirghn
 sehrvghtrhhoshhpvggtrdhtvheqnecuggftrfgrthhtvghrnhepieeffeekkeegtedutd
 eiteegudefgedtieevueeftdeggefgjeeludevjeevvdejnecuvehluhhsthgvrhfuihii
 vgeptdenucfrrghrrghmpehmrghilhhfrhhomhepihgrnhesrhgvthhrohhsphgvtgdrth
 hvpdhnsggprhgtphhtthhopedupdhmohguvgepshhmthhpohhuthdprhgtphhtthhopegs
 uhhgqdhguhhigiesghhnuhdrohhrgh
X-ME-Proxy: <xmx:vpQTaHLIcEBhruTdUgxJD3dWMu05WFQpHSaum94zu9udL0GxoJuUtw>
 <xmx:vpQTaOKId6UX1esWXikoE78oYjZzXuN2-EyVLglgZ9jtbjGaNqlJww>
 <xmx:vpQTaIzwHoa4HyTCpve_21t2Z5YHpuOFp0cVIVKYQxxfRb3Nftozew>
 <xmx:vpQTaCLF94Jm8LtnzlBT5Pbm0-EEal1P7iXmrin4ysoGqSJkf3xyOA>
 <xmx:v5QTaPq51R9QGKtrU9k1H_TzIaeIrOjKA6AJNTZ_exKPM-LaSIQplAUB>
Feedback-ID: id9014242:Fastmail
Received: by mail.messagingengine.com (Postfix) with ESMTPA for
 <bug-guix@HIDDEN>; Thu, 1 May 2025 11:35:26 -0400 (EDT)
From: Ian Eure <ian@HIDDEN>
User-Agent: mu4e 1.12.9; emacs 29.4
Date: Thu, 01 May 2025 08:35:21 -0700
Message-ID: <87msbw4a4m.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=202.12.124.144; envelope-from=ian@HIDDEN;
 helo=fout-b1-smtp.messagingengine.com
X-Spam_score_int: -27
X-Spam_score: -2.8
X-Spam_bar: --
X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,
 RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001,
 RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, SPF_HELO_PASS=-0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: 0.7 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.3 (/)

I=E2=80=99ve been frustrated by this before, but decided to measure=20
things:

`guix home list-generations' takes 3.535s to list 28 items.
`guix system list-generations' takes 1.406s to list 35 items.
`guix pull --list-generations' takes 232.599s to list 41 items.

Why is `guix pull --list-generations' >100x slower than `guix=20
system list-generations'?

Thanks,

  -- Ian







Message sent:


Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.505 (Entity 5.505)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Ian Eure <ian@HIDDEN>
Subject: bug#78194: Acknowledgement (`guix pull --list-generations' is
 extremely slow)
Message-ID: <handler.78194.B.174611374710452.ack <at> debbugs.gnu.org>
References: <87msbw4a4m.fsf@HIDDEN>
X-Gnu-PR-Message: ack 78194
X-Gnu-PR-Package: guix
Reply-To: 78194 <at> debbugs.gnu.org
Date: Thu, 01 May 2025 15:36:02 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 bug-guix@HIDDEN

If you wish to submit further information on this problem, please
send it to 78194 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
78194: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D78194
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems


Message sent to bug-guix@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#78194: `guix pull --list-generations' is extremely slow
Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Wed, 14 May 2025 17:05:02 +0000
Resent-Message-ID: <handler.78194.B78194.174724225118522 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 78194
X-GNU-PR-Package: guix
X-GNU-PR-Keywords: 
To: Ian Eure <ian@HIDDEN>
Cc: 78194 <at> debbugs.gnu.org
Received: via spool by 78194-submit <at> debbugs.gnu.org id=B78194.174724225118522
          (code B ref 78194); Wed, 14 May 2025 17:05:02 +0000
Received: (at 78194) by debbugs.gnu.org; 14 May 2025 17:04:11 +0000
Received: from localhost ([127.0.0.1]:44771 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1uFFWc-0004oe-Sn
	for submit <at> debbugs.gnu.org; Wed, 14 May 2025 13:04:11 -0400
Received: from hera.aquilenet.fr ([185.233.100.1]:47836)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1uFFWY-0004mc-C4
 for 78194 <at> debbugs.gnu.org; Wed, 14 May 2025 13:04:07 -0400
Received: from localhost (localhost [127.0.0.1])
 by hera.aquilenet.fr (Postfix) with ESMTP id B9F20E4C;
 Wed, 14 May 2025 19:03:57 +0200 (CEST)
X-Virus-Scanned: Debian amavis at hera.aquilenet.fr
Received: from hera.aquilenet.fr ([127.0.0.1])
 by localhost (hera.aquilenet.fr [127.0.0.1]) (amavis, port 10024) with ESMTP
 id 5mJSX86gdgVn; Wed, 14 May 2025 19:03:57 +0200 (CEST)
Received: from ribbon (91-160-117-201.subs.proxad.net [91.160.117.201])
 by hera.aquilenet.fr (Postfix) with ESMTPSA id 0A88EE49;
 Wed, 14 May 2025 19:03:57 +0200 (CEST)
From: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
In-Reply-To: <87msbw4a4m.fsf@HIDDEN> (Ian Eure's message of "Thu, 01 May
 2025 08:35:21 -0700")
References: <87msbw4a4m.fsf@HIDDEN>
Date: Wed, 14 May 2025 18:33:35 +0200
Message-ID: <87h61nywww.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.7 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.3 (/)

Hi,

Ian Eure <ian@HIDDEN> writes:

> I=E2=80=99ve been frustrated by this before, but decided to measure thing=
s:
>
> `guix home list-generations' takes 3.535s to list 28 items.
> `guix system list-generations' takes 1.406s to list 35 items.
> `guix pull --list-generations' takes 232.599s to list 41 items.
>
> Why is `guix pull --list-generations' >100x slower than `guix system
> list-generations'?

Because for each pair of generations, it shows the corresponding news
entries (as per =E2=80=98guix pull --news=E2=80=99), and that part is quite=
 expensive
because it involves a Git log traversal.

I think we should (1) optimize the news code (that=E2=80=99s
=E2=80=98channel-news-for-commit=E2=80=99), and (2) if that=E2=80=99s not e=
nough consider
keeping it off by default in =E2=80=98guix pull --list-generations=E2=80=99.

Thoughts?

Ludo=E2=80=99.




Message sent to bug-guix@HIDDEN:


X-Loop: help-debbugs@HIDDEN
Subject: bug#78194: `guix pull --list-generations' is extremely slow
Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Wed, 14 May 2025 21:52:03 +0000
Resent-Message-ID: <handler.78194.B78194.174725946522052 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 78194
X-GNU-PR-Package: guix
X-GNU-PR-Keywords: 
To: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Cc: 78194 <at> debbugs.gnu.org, Ian Eure <ian@HIDDEN>
Received: via spool by 78194-submit <at> debbugs.gnu.org id=B78194.174725946522052
          (code B ref 78194); Wed, 14 May 2025 21:52:03 +0000
Received: (at 78194) by debbugs.gnu.org; 14 May 2025 21:51:05 +0000
Received: from localhost ([127.0.0.1]:46783 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1uFK0H-0005jc-Iv
	for submit <at> debbugs.gnu.org; Wed, 14 May 2025 17:51:05 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:47068)
 by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1uFK0C-0005hu-V2
 for 78194 <at> debbugs.gnu.org; Wed, 14 May 2025 17:51:01 -0400
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <ludo@HIDDEN>)
 id 1uFK07-0007vw-4V; Wed, 14 May 2025 17:50:55 -0400
From: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
In-Reply-To: <87h61nywww.fsf@HIDDEN> ("Ludovic =?UTF-8?Q?Court=C3=A8s?="'s message of "Wed, 14 May 2025 18:33:35 +0200")
References: <87msbw4a4m.fsf@HIDDEN> <87h61nywww.fsf@HIDDEN>
Date: Wed, 14 May 2025 22:28:37 +0200
Message-ID: <877c2jym16.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Ludovic Court=C3=A8s <ludo@HIDDEN> writes:

> Because for each pair of generations, it shows the corresponding news
> entries (as per =E2=80=98guix pull --news=E2=80=99), and that part is qui=
te expensive
> because it involves a Git log traversal.
>
> I think we should (1) optimize the news code (that=E2=80=99s
> =E2=80=98channel-news-for-commit=E2=80=99), and (2) if that=E2=80=99s not=
 enough consider
> keeping it off by default in =E2=80=98guix pull --list-generations=E2=80=
=99.

That turned out to be easier than I thought, see
<https://issues.guix.gnu.org/78432>, which makes it 10=E2=80=9320x faster.

Ludo=E2=80=99.





Last modified: Wed, 14 May 2025 22:00:04 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.