GNU bug report logs - #47543
“Repeated allocation of very large block” during ‘guix pull’

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Package: guix; Severity: important; Reported by: Ludovic Courtès <ludovic.courtes@HIDDEN>; dated Thu, 1 Apr 2021 14:01:02 UTC; Maintainer for guix is bug-guix@HIDDEN.

Message received at 47543 <at> debbugs.gnu.org:


Received: (at 47543) by debbugs.gnu.org; 20 Sep 2023 07:24:32 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Sep 20 03:24:32 2023
Received: from localhost ([127.0.0.1]:58205 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1qirZX-0002t0-UD
	for submit <at> debbugs.gnu.org; Wed, 20 Sep 2023 03:24:32 -0400
Received: from mail-lf1-x12c.google.com ([2a00:1450:4864:20::12c]:45559)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <rostislav.svoboda@HIDDEN>) id 1qirZV-0002sg-Nd
 for 47543 <at> debbugs.gnu.org; Wed, 20 Sep 2023 03:24:30 -0400
Received: by mail-lf1-x12c.google.com with SMTP id
 2adb3069b0e04-501eec0a373so10637441e87.3
 for <47543 <at> debbugs.gnu.org>; Wed, 20 Sep 2023 00:24:20 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=gmail.com; s=20230601; t=1695194654; x=1695799454; darn=debbugs.gnu.org;
 h=to:subject:message-id:date:from:mime-version:from:to:cc:subject
 :date:message-id:reply-to;
 bh=2UZ6TLpkanoUWiAnG0wGAmcAEb2OLyjx7S1V1b/fV4E=;
 b=c0HGDgmFDvZzXn1IkyFntWf60hyjkAubE/f5c70xVuKZ+yv4xMt/Qgi+6VAbF8ZmGs
 kQ1dCu//+CfMXsh9Vv+khFH76fFo0/pLcuAgQxF1UNGGTrgRTrywunAo876CXo3zG7US
 Wq/ui21iHK7qgUZAe/78Z4ZjpXzFWfRnfmNXzoHvc3n+HI82Btzof5TrlQd+Qz/reIps
 mjU3dghWkDNR2w+n+fF9i7JJUc0W0KP+321hboGz+Q7AYDsirBL841c6nCkBItYGfeGZ
 m/tGB0Ls84uBMeLknmeHBqbnZj3gQAPsVNuJUjVDBKlR7oh1WY5BIwFHfxp35+TFeEUX
 ENiw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20230601; t=1695194654; x=1695799454;
 h=to:subject:message-id:date:from:mime-version:x-gm-message-state
 :from:to:cc:subject:date:message-id:reply-to;
 bh=2UZ6TLpkanoUWiAnG0wGAmcAEb2OLyjx7S1V1b/fV4E=;
 b=F+5cHqjntu9iqX8oSgCFYBVDu7PwkRnWwJMXh9WoVoKcgVl+Az5rFXnaxm8+uE/p/u
 KTorKvIWopfwRhhn1h+8s7S3NLLJ7vi2/N+KizoEq+wlH+uy/O/v5vTOLwt9oYgTKTxj
 wp24zBkElUNbHqr+ht65dL+ubNB2tFbHuWQ+ql2ke+Lu2MYxfG9JU4ZefCOivzwSPd3G
 +4AE0M/mH+fzYBKJ7WJ+3XSE2oZ+dHXZvzVimkotmuEwru/EbVp6aZWx/Zc6NjvHbzm1
 044x9S6JY1SgeCdFpfbdaPcNNTDD8x1caqes5L/O/PdBnWYUPuJkCcDi13q2WazP0tj6
 JyTw==
X-Gm-Message-State: AOJu0YyokGFE5FUMnHypspiojOcEfj5xf4jRljlxcjm7YsWycDyGBQJX
 vmHBu5N6MuHdxey5GBAsnUMFWxUp3eAhtgNpe2zBkYZxEnU=
X-Google-Smtp-Source: AGHT+IEy59NA/BlKCS6InkQixD8BX0JpJdVYH2s8vuLysi7KOLOsHSUR9H9/FrT++B5Yay9hgKh+kOUZXEfbsss7dBI=
X-Received: by 2002:a05:6512:2005:b0:500:a08e:2fd3 with SMTP id
 a5-20020a056512200500b00500a08e2fd3mr1441007lfb.21.1695194653713; Wed, 20 Sep
 2023 00:24:13 -0700 (PDT)
MIME-Version: 1.0
From: Rostislav Svoboda <rostislav.svoboda@HIDDEN>
Date: Wed, 20 Sep 2023 09:23:37 +0200
Message-ID: <CAEtmmew-fi7t9dJzN0uLwRt5zzmZsV9iS82cKw30swE=d6yn3w@HIDDEN>
Subject: "Repeated allocation of very large block" during `guix pull`
To: 47543 <at> debbugs.gnu.org
Content-Type: text/plain; charset="UTF-8"
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 47543
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hope it will help.
Cheers Bost

$ guix pull --cores=24
Updating channel 'nonguix' from Git repository at
'https://gitlab.com/nonguix/nonguix'...
Updating channel 'haskell-and-clojure' from Git repository at
'file:///home/bost/dev/haskell-guix'...
Updating channel 'bost' from Git repository at
'file:///home/bost/dev/guix-packages'...
Updating channel 'guix' from Git repository at
'https://git.savannah.gnu.org/git/guix.git'...
GC Warning: Repeated allocation of very large block (appr. size 69632):
    May lead to memory leak and poor performance
GC Warning: Repeated allocation of very large block (appr. size 69632):
    May lead to memory leak and poor performance
GC Warning: Repeated allocation of very large block (appr. size 69632):
    May lead to memory leak and poor performance
Building from these channels:
  bost      file:///home/bost/dev/guix-packages    251ce7d
  guix      https://git.savannah.gnu.org/git/guix.git    4b3b2e6
  haskell-and-clojurefile:///home/bost/dev/haskell-guix    a8b30a6
  nonguix   https://gitlab.com/nonguix/nonguix    bb184bd
Computing Guix derivation for 'x86_64-linux'... \
nothing to be done


$ guix describe
Generation 707    Sep 20 2023 01:24:32    (current)
  bost 251ce7d
    repository URL: file:///home/bost/dev/guix-packages
    branch: master
    commit: 251ce7d9ce4dd2bbc690189b84706368a5f20823
  guix 4b3b2e6
    repository URL: https://git.savannah.gnu.org/git/guix.git
    branch: master
    commit: 4b3b2e63007acee9e3a8c2ea728190480d092c3c
  haskell-and-clojure a8b30a6
    repository URL: file:///home/bost/dev/haskell-guix
    branch: master
    commit: a8b30a606f91caabec3cc8dc4b1255a69836554e
  nonguix bb184bd
    repository URL: https://gitlab.com/nonguix/nonguix
    branch: master
    commit: bb184bd0a8f91beec3a00718759e96c7828853de

$ guix system describe
Generation 58    Sep 18 2023 14:26:00    (current)
  file name: /var/guix/profiles/system-58-link
  canonical file name: /gnu/store/l91cqriia6jrkasbqdl2k14shd1rnm3w-system
  label: GNU with Linux-Libre 6.4.16
  bootloader: grub-efi
  root device: UUID: 67ce5d9c-7af1-4435-a2a9-68651ab9a281
  kernel: /gnu/store/qhynq8jfskirrn7fj5965ajmrs7zfshc-linux-libre-6.4.16/bzImage
  channels:
    bost:
      repository URL: file:///home/bost/dev/guix-packages
      branch: master
      commit: 36e44740eefa0aa313c2bb4ab30e5d93ee3e8448
    guix:
      repository URL: https://git.savannah.gnu.org/git/guix.git
      branch: master
      commit: 273709932fa47f6ae56c96564a9415fdbff4a169
    haskell-and-clojure:
      repository URL: file:///home/bost/dev/haskell-guix
      branch: master
      commit: a8b30a606f91caabec3cc8dc4b1255a69836554e
    nonguix:
      repository URL: https://gitlab.com/nonguix/nonguix
      branch: master
      commit: bb184bd0a8f91beec3a00718759e96c7828853de
  configuration file:
/gnu/store/f87bpd2bs8zn09jfcjbinwgffjyjy6ng-configuration.scm

$ guix home describe
Generation 894    Sep 20 2023 01:25:31    (current)
  file name: /var/guix/profiles/per-user/bost/guix-home-894-link
  canonical file name: /gnu/store/y67m6gf7jvq06f0pnr06s59hz2hb3wf1-home
  channels:
    bost:
      repository URL: file:///home/bost/dev/guix-packages
      branch: master
      commit: 251ce7d9ce4dd2bbc690189b84706368a5f20823
    guix:
      repository URL: https://git.savannah.gnu.org/git/guix.git
      branch: master
      commit: 4b3b2e63007acee9e3a8c2ea728190480d092c3c
    haskell-and-clojure:
      repository URL: file:///home/bost/dev/haskell-guix
      branch: master
      commit: a8b30a606f91caabec3cc8dc4b1255a69836554e
    nonguix:
      repository URL: https://gitlab.com/nonguix/nonguix
      branch: master
      commit: bb184bd0a8f91beec3a00718759e96c7828853de
  configuration file:
/gnu/store/sz4vw81k5hacngc437w57yqm8zpg8c88-configuration.scm


The two channels specified by file URLs are local copies of my github repos:
  bost:                https://github.com/Bost/guix-packages
  haskell-and-clojure: https://github.com/Bost/haskell-guix
Information forwarded to bug-guix@HIDDEN:
bug#47543; Package guix. Full text available.
Severity set to 'important' from 'normal' Request was from Ludovic Courtès <ludo@HIDDEN> to control <at> debbugs.gnu.org. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 1 Apr 2021 14:00:14 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Apr 01 10:00:14 2021
Received: from localhost ([127.0.0.1]:58118 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1lRxrq-0005N6-5W
	for submit <at> debbugs.gnu.org; Thu, 01 Apr 2021 10:00:14 -0400
Received: from lists.gnu.org ([209.51.188.17]:60764)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludovic.courtes@HIDDEN>) id 1lRxro-0005LB-Cf
 for submit <at> debbugs.gnu.org; Thu, 01 Apr 2021 10:00:12 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:50596)
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <ludovic.courtes@HIDDEN>)
 id 1lRxro-0003C5-1v
 for bug-guix@HIDDEN; Thu, 01 Apr 2021 10:00:12 -0400
Received: from mail2-relais-roc.national.inria.fr ([192.134.164.83]:51052)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <ludovic.courtes@HIDDEN>)
 id 1lRxrl-0006uM-P0
 for bug-guix@HIDDEN; Thu, 01 Apr 2021 10:00:11 -0400
IronPort-HdrOrdr: =?us-ascii?q?A9a23=3AIOduCKrjp/UGHh3n+7D83ZkaV5tvL9V00zAX?=
 =?us-ascii?q?/kB9WHVpW+afkN2jm+le8BfyhioYVn1Io6H9BICrR3TA+ZlppbQAJLvKZniahE?=
 =?us-ascii?q?KEDqFHqbHjzTrpBjHk+odmuptIXqBiBLTLfCFHpOng5g3QKadF/PCm9+SSif7a?=
 =?us-ascii?q?3zNRS2hRGttdxiNYLireLUFsXglBAvMCZeGhz+5KvSCpd3hSTunTPAhiY8H5q9?=
 =?us-ascii?q?fGlI3rbHc9bnZMhWXu7Q+A07L0HwOV2R0TSVp0sNUf2FLYmA/07LjLiYDZ9jbg?=
 =?us-ascii?q?0QbonvFrsef6xsAGLMKBjdV9EESVti+YIKtmQKOLpz04raWK5EwxmNfB5zcsVv?=
 =?us-ascii?q?4DjE/5TyWIhV/G3gnt1ytrw3Lu0jaj6kfLkIjHRCknEY56j4pfdRfVgnBPgO1B?=
X-IronPort-AV: E=Sophos;i="5.81,296,1610406000"; d="scan'208";a="501146466"
Received: from 91-160-117-201.subs.proxad.net (HELO ribbon) ([91.160.117.201])
 by mail2-relais-roc.national.inria.fr with
 ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 01 Apr 2021 16:00:06 +0200
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludovic.courtes@HIDDEN>
To: <bug-guix@HIDDEN>
Subject: =?utf-8?Q?=E2=80=9CRepeated?= allocation of very large
 =?utf-8?Q?block=E2=80=9D?= during =?utf-8?B?4oCYZ3VpeCBwdWxs4oCZ?=
X-URL: http://www.fdn.fr/~lcourtes/
X-Revolutionary-Date: 12 Germinal an 229 de la =?utf-8?Q?R=C3=A9volution?=
X-PGP-Key-ID: 0x090B11993D9AEBB5
X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc
X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4  0CFB 090B 1199 3D9A EBB5
X-OS: x86_64-pc-linux-gnu
Date: Thu, 01 Apr 2021 16:00:06 +0200
Message-ID: <87v9966r6h.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=192.134.164.83;
 envelope-from=ludovic.courtes@HIDDEN;
 helo=mail2-relais-roc.national.inria.fr
X-Spam_score_int: -41
X-Spam_score: -4.2
X-Spam_bar: ----
X-Spam_report: (-4.2 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3,
 RCVD_IN_MSPIKE_H3=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.3 (-)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)

While running =E2=80=98guix pull=E2=80=99, sometime between the actual =E2=
=80=98git pull=E2=80=99 (via
Guile-Git) and channel authentication, I saw the dreaded libgc warning:

  Repeated allocation of very large block

I forgot to capture the command output though, and it does not seem to
be reproducible.  (This is with a recent Guix,
ca. 9098745b181b3022587a35afd255f7ff1d41ac86.)

Running the command below from a Guix checkout, which authenticates 15+K
commits, isn=E2=80=99t enough to trigger it:

  guix git authenticate --cache-key=3Dwhatever \
    "9edb3f66fd807b096b48283debdcddccfea34bad" \
    "BBB0 2DDF 2CEA F6A8 0D1D E643 A2A0 6DF2 A33A 54FA"

So it might rather be =E2=80=98update-cached-checkout=E2=80=99 that trigger=
s it.

If you experience it, please share the command line and command output!

Ludo=E2=80=99.
Acknowledgement sent to Ludovic Courtès <ludovic.courtes@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#47543; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Wed, 20 Sep 2023 07:30:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.