X-Loop: help-debbugs@HIDDEN Subject: bug#78194: `guix pull --list-generations' is extremely slow Resent-From: Ian Eure <ian@HIDDEN> Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> Resent-CC: bug-guix@HIDDEN Resent-Date: Thu, 01 May 2025 15:36:02 +0000 Resent-Message-ID: <handler.78194.B.174611374710452 <at> debbugs.gnu.org> Resent-Sender: help-debbugs@HIDDEN X-GNU-PR-Message: report 78194 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: 78194 <at> debbugs.gnu.org X-Debbugs-Original-To: bug-guix@HIDDEN Received: via spool by submit <at> debbugs.gnu.org id=B.174611374710452 (code B ref -1); Thu, 01 May 2025 15:36:02 +0000 Received: (at submit) by debbugs.gnu.org; 1 May 2025 15:35:47 +0000 Received: from localhost ([127.0.0.1]:52378 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1uAVwx-0002iV-0w for submit <at> debbugs.gnu.org; Thu, 01 May 2025 11:35:47 -0400 Received: from lists.gnu.org ([2001:470:142::17]:51916) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <ian@HIDDEN>) id 1uAVwt-0002hw-Ii for submit <at> debbugs.gnu.org; Thu, 01 May 2025 11:35:45 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <ian@HIDDEN>) id 1uAVwk-00057R-FX for bug-guix@HIDDEN; Thu, 01 May 2025 11:35:34 -0400 Received: from fout-b1-smtp.messagingengine.com ([202.12.124.144]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <ian@HIDDEN>) id 1uAVwh-0002FH-8U for bug-guix@HIDDEN; Thu, 01 May 2025 11:35:34 -0400 Received: from phl-compute-11.internal (phl-compute-11.phl.internal [10.202.2.51]) by mailfout.stl.internal (Postfix) with ESMTP id 96E951140187 for <bug-guix@HIDDEN>; Thu, 1 May 2025 11:35:27 -0400 (EDT) Received: from phl-mailfrontend-02 ([10.202.2.163]) by phl-compute-11.internal (MEProxy); Thu, 01 May 2025 11:35:27 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=retrospec.tv; h= cc:content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:message-id:mime-version:reply-to:subject :subject:to:to; s=fm2; t=1746113727; x=1746200127; bh=LIwsLlcjFA ycNreMIw6Ho3RDDr5yxRbUYGVDTL3nvrw=; b=JaQo06EEjrJxImaEkAJ7XHDY/I rvhn2XVGxnrflWUXB7zG8Bh4BvOMYsRboFdK1Gff3gWc6OHd5Qs/6/qS1MpcYiOW x+MDamKVMU55yNAdW19jdeRd+IXOpJC9tEO2ANXeMn9kYL2gLRUqY6OqWJWjc75X CiKtTbvXSo/blTvNMS2N3FKsYZFARomh0ZS0haL/8gVKp2TTCVwDCyaMXy55I5vU fDApKD45UrlettRPnpUR0yvppyRyBjSPhDefvc+MyqpaD4o9d4/Un4dgYj92W6Ax FkeiklY8NC/OPTMqI/G8ycQ8MfFbATIiFyEnvV9x5XGAJShQumuCLSvaVtcg== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:message-id:mime-version:reply-to:subject:subject:to :to:x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm3; t= 1746113727; x=1746200127; bh=LIwsLlcjFAycNreMIw6Ho3RDDr5yxRbUYGV DTL3nvrw=; b=Kj3cSYtL8VQVjJqi7WTB3xX1NMQcCzepwOJvVSqnvLVkdjRvqjx dCvfuLcFOhZ6JVYTh6v52hMQrJzd7CgQu0Hz+GsTvKMbGrShA2a0TDeV45Udb1WN 3frKgN/Z3J9ue9/ApjkmLeviKYqz7u/+UnnrxMvcjZMdrYew5RnoeGQku+fXBx+m rRn582eBEZ81dHdiVTJstM4MpQk5Rn4r397dtYdl4rkIfwP4zJZinFT5jdqWKqTT pzfvRNUhCJWuK9aFtK1wm5E/4pfJ5Z/XOq5BSy5CGFfwA/I4vOu+6jL0URRob6uD 6hiWvC12BQv48O4jNPj8CF/Tw1Wgf2Eibkg== X-ME-Sender: <xms:vpQTaK5SXRtzmI9-cXStMaPiBXrNWiGyG63Wn_jlH8ECRGuxgrcI7w> <xme:vpQTaD6kYuML3TaMTN2-div0TXYrHWBG0MldNYJACUp3e9kHlt3McN7B-1u6eudsK vNj6lbjUiaA-CZRQQ> X-ME-Received: <xmr:vpQTaJf6F5VS6PHh8qkwCD7RFNhXebAdNzxYR4XBeo64KwXn-TF9zd7UGW_gVoJ8kAF0bFZWoV4ey6JVfI-i_Y3tCJwJI6s-2eo> X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeefvddrtddtgddvieelleegucetufdoteggodetrf dotffvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdggtfgfnhhsuhgsshgtrhhisggv pdfurfetoffkrfgpnffqhgenuceurghilhhouhhtmecufedttdenucenucfjughrpefhvf fufgffkfggtgfgsehtqhertddtreejnecuhfhrohhmpefkrghnucfguhhrvgcuoehirghn sehrvghtrhhoshhpvggtrdhtvheqnecuggftrfgrthhtvghrnhepieeffeekkeegtedutd eiteegudefgedtieevueeftdeggefgjeeludevjeevvdejnecuvehluhhsthgvrhfuihii vgeptdenucfrrghrrghmpehmrghilhhfrhhomhepihgrnhesrhgvthhrohhsphgvtgdrth hvpdhnsggprhgtphhtthhopedupdhmohguvgepshhmthhpohhuthdprhgtphhtthhopegs uhhgqdhguhhigiesghhnuhdrohhrgh X-ME-Proxy: <xmx:vpQTaHLIcEBhruTdUgxJD3dWMu05WFQpHSaum94zu9udL0GxoJuUtw> <xmx:vpQTaOKId6UX1esWXikoE78oYjZzXuN2-EyVLglgZ9jtbjGaNqlJww> <xmx:vpQTaIzwHoa4HyTCpve_21t2Z5YHpuOFp0cVIVKYQxxfRb3Nftozew> <xmx:vpQTaCLF94Jm8LtnzlBT5Pbm0-EEal1P7iXmrin4ysoGqSJkf3xyOA> <xmx:v5QTaPq51R9QGKtrU9k1H_TzIaeIrOjKA6AJNTZ_exKPM-LaSIQplAUB> Feedback-ID: id9014242:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for <bug-guix@HIDDEN>; Thu, 1 May 2025 11:35:26 -0400 (EDT) From: Ian Eure <ian@HIDDEN> User-Agent: mu4e 1.12.9; emacs 29.4 Date: Thu, 01 May 2025 08:35:21 -0700 Message-ID: <87msbw4a4m.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: quoted-printable Received-SPF: pass client-ip=202.12.124.144; envelope-from=ian@HIDDEN; helo=fout-b1-smtp.messagingengine.com X-Spam_score_int: -27 X-Spam_score: -2.8 X-Spam_bar: -- X-Spam_report: (-2.8 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_LOW=-0.7, RCVD_IN_VALIDITY_RPBL_BLOCKED=0.001, RCVD_IN_VALIDITY_SAFE_BLOCKED=0.001, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 0.7 (/) X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -0.3 (/) I=E2=80=99ve been frustrated by this before, but decided to measure=20 things: `guix home list-generations' takes 3.535s to list 28 items. `guix system list-generations' takes 1.406s to list 35 items. `guix pull --list-generations' takes 232.599s to list 41 items. Why is `guix pull --list-generations' >100x slower than `guix=20 system list-generations'? Thanks, -- Ian
Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.505 (Entity 5.505) Content-Type: text/plain; charset=utf-8 X-Loop: help-debbugs@HIDDEN From: help-debbugs@HIDDEN (GNU bug Tracking System) To: Ian Eure <ian@HIDDEN> Subject: bug#78194: Acknowledgement (`guix pull --list-generations' is extremely slow) Message-ID: <handler.78194.B.174611374710452.ack <at> debbugs.gnu.org> References: <87msbw4a4m.fsf@HIDDEN> X-Gnu-PR-Message: ack 78194 X-Gnu-PR-Package: guix Reply-To: 78194 <at> debbugs.gnu.org Date: Thu, 01 May 2025 15:36:02 +0000 Thank you for filing a new bug report with debbugs.gnu.org. This is an automatically generated reply to let you know your message has been received. Your message is being forwarded to the package maintainers and other interested parties for their attention; they will reply in due course. Your message has been sent to the package maintainer(s): bug-guix@HIDDEN If you wish to submit further information on this problem, please send it to 78194 <at> debbugs.gnu.org. Please do not send mail to help-debbugs@HIDDEN unless you wish to report a problem with the Bug-tracking system. --=20 78194: https://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D78194 GNU Bug Tracking System Contact help-debbugs@HIDDEN with problems
X-Loop: help-debbugs@HIDDEN Subject: bug#78194: `guix pull --list-generations' is extremely slow Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludo@HIDDEN> Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> Resent-CC: bug-guix@HIDDEN Resent-Date: Wed, 14 May 2025 17:05:02 +0000 Resent-Message-ID: <handler.78194.B78194.174724225118522 <at> debbugs.gnu.org> Resent-Sender: help-debbugs@HIDDEN X-GNU-PR-Message: followup 78194 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Ian Eure <ian@HIDDEN> Cc: 78194 <at> debbugs.gnu.org Received: via spool by 78194-submit <at> debbugs.gnu.org id=B78194.174724225118522 (code B ref 78194); Wed, 14 May 2025 17:05:02 +0000 Received: (at 78194) by debbugs.gnu.org; 14 May 2025 17:04:11 +0000 Received: from localhost ([127.0.0.1]:44771 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1uFFWc-0004oe-Sn for submit <at> debbugs.gnu.org; Wed, 14 May 2025 13:04:11 -0400 Received: from hera.aquilenet.fr ([185.233.100.1]:47836) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1uFFWY-0004mc-C4 for 78194 <at> debbugs.gnu.org; Wed, 14 May 2025 13:04:07 -0400 Received: from localhost (localhost [127.0.0.1]) by hera.aquilenet.fr (Postfix) with ESMTP id B9F20E4C; Wed, 14 May 2025 19:03:57 +0200 (CEST) X-Virus-Scanned: Debian amavis at hera.aquilenet.fr Received: from hera.aquilenet.fr ([127.0.0.1]) by localhost (hera.aquilenet.fr [127.0.0.1]) (amavis, port 10024) with ESMTP id 5mJSX86gdgVn; Wed, 14 May 2025 19:03:57 +0200 (CEST) Received: from ribbon (91-160-117-201.subs.proxad.net [91.160.117.201]) by hera.aquilenet.fr (Postfix) with ESMTPSA id 0A88EE49; Wed, 14 May 2025 19:03:57 +0200 (CEST) From: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludo@HIDDEN> In-Reply-To: <87msbw4a4m.fsf@HIDDEN> (Ian Eure's message of "Thu, 01 May 2025 08:35:21 -0700") References: <87msbw4a4m.fsf@HIDDEN> Date: Wed, 14 May 2025 18:33:35 +0200 Message-ID: <87h61nywww.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: 0.7 (/) X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -0.3 (/) Hi, Ian Eure <ian@HIDDEN> writes: > I=E2=80=99ve been frustrated by this before, but decided to measure thing= s: > > `guix home list-generations' takes 3.535s to list 28 items. > `guix system list-generations' takes 1.406s to list 35 items. > `guix pull --list-generations' takes 232.599s to list 41 items. > > Why is `guix pull --list-generations' >100x slower than `guix system > list-generations'? Because for each pair of generations, it shows the corresponding news entries (as per =E2=80=98guix pull --news=E2=80=99), and that part is quite= expensive because it involves a Git log traversal. I think we should (1) optimize the news code (that=E2=80=99s =E2=80=98channel-news-for-commit=E2=80=99), and (2) if that=E2=80=99s not e= nough consider keeping it off by default in =E2=80=98guix pull --list-generations=E2=80=99. Thoughts? Ludo=E2=80=99.
X-Loop: help-debbugs@HIDDEN Subject: bug#78194: `guix pull --list-generations' is extremely slow Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludo@HIDDEN> Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> Resent-CC: bug-guix@HIDDEN Resent-Date: Wed, 14 May 2025 21:52:03 +0000 Resent-Message-ID: <handler.78194.B78194.174725946522052 <at> debbugs.gnu.org> Resent-Sender: help-debbugs@HIDDEN X-GNU-PR-Message: followup 78194 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludo@HIDDEN> Cc: 78194 <at> debbugs.gnu.org, Ian Eure <ian@HIDDEN> Received: via spool by 78194-submit <at> debbugs.gnu.org id=B78194.174725946522052 (code B ref 78194); Wed, 14 May 2025 21:52:03 +0000 Received: (at 78194) by debbugs.gnu.org; 14 May 2025 21:51:05 +0000 Received: from localhost ([127.0.0.1]:46783 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1uFK0H-0005jc-Iv for submit <at> debbugs.gnu.org; Wed, 14 May 2025 17:51:05 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:47068) by debbugs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1uFK0C-0005hu-V2 for 78194 <at> debbugs.gnu.org; Wed, 14 May 2025 17:51:01 -0400 Received: from fencepost.gnu.org ([2001:470:142:3::e]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <ludo@HIDDEN>) id 1uFK07-0007vw-4V; Wed, 14 May 2025 17:50:55 -0400 From: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludo@HIDDEN> In-Reply-To: <87h61nywww.fsf@HIDDEN> ("Ludovic =?UTF-8?Q?Court=C3=A8s?="'s message of "Wed, 14 May 2025 18:33:35 +0200") References: <87msbw4a4m.fsf@HIDDEN> <87h61nywww.fsf@HIDDEN> Date: Wed, 14 May 2025 22:28:37 +0200 Message-ID: <877c2jym16.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -2.3 (--) X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Ludovic Court=C3=A8s <ludo@HIDDEN> writes: > Because for each pair of generations, it shows the corresponding news > entries (as per =E2=80=98guix pull --news=E2=80=99), and that part is qui= te expensive > because it involves a Git log traversal. > > I think we should (1) optimize the news code (that=E2=80=99s > =E2=80=98channel-news-for-commit=E2=80=99), and (2) if that=E2=80=99s not= enough consider > keeping it off by default in =E2=80=98guix pull --list-generations=E2=80= =99. That turned out to be easier than I thought, see <https://issues.guix.gnu.org/78432>, which makes it 10=E2=80=9320x faster. Ludo=E2=80=99.
GNU bug tracking system
Copyright (C) 1999 Darren O. Benham,
1997 nCipher Corporation Ltd,
1994-97 Ian Jackson.