GNU bug report logs - #38167
guix pull takes over 8 GiB of memory to finish if there are no substitutes

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Reported by: Danny Milosavljevic <dannym@HIDDEN>; dated Mon, 11 Nov 2019 07:08:02 UTC; Maintainer for guix is bug-guix@HIDDEN.

Message received at 38167 <at> debbugs.gnu.org:


Received: (at 38167) by debbugs.gnu.org; 11 Nov 2019 20:42:35 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Nov 11 15:42:35 2019
Received: from localhost ([127.0.0.1]:56038 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1iUGWB-0002Ts-Do
	for submit <at> debbugs.gnu.org; Mon, 11 Nov 2019 15:42:35 -0500
Received: from eggs.gnu.org ([209.51.188.92]:41855)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1iUGW8-0002Te-Qj
 for 38167 <at> debbugs.gnu.org; Mon, 11 Nov 2019 15:42:34 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e]:49804)
 by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <ludo@HIDDEN>)
 id 1iUGW2-0005Ju-Nv; Mon, 11 Nov 2019 15:42:26 -0500
Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=42470 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1iUGW2-0000rp-BC; Mon, 11 Nov 2019 15:42:26 -0500
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: Christopher Baines <mail@HIDDEN>
Subject: Re: bug#38167: guix pull takes over 8 GiB of memory to finish if
 there are no substitutes
References: <20191111080635.14f7b39a@HIDDEN>
 <87eeyec18l.fsf@HIDDEN>
Date: Mon, 11 Nov 2019 21:42:24 +0100
In-Reply-To: <87eeyec18l.fsf@HIDDEN> (Christopher Baines's message of
 "Mon, 11 Nov 2019 07:37:30 +0000")
Message-ID: <878somno0f.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 38167
Cc: 38167 <at> debbugs.gnu.org, dannym@HIDDEN
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Hi Chris & Danny,

Christopher Baines <mail@HIDDEN> skribis:

> Danny Milosavljevic <dannym@HIDDEN> writes:
>
>> Hi,
>>
>> guix pull takes over 8 GiB of memory to finish if there are no substitut=
es.
>>
>> My laptop only takes max 8 GiB of RAM.  I've set up swap, but that kind =
of
>> memory usage still seems ridiculous.
>
> Do you know if the derivations got built in parallel? So, does guix pull
> --max-jobs=3D1 use the same amount of memory?

Also, it would be great if you could identify which derivation build
requires that much memory, if this was happening sequentially.  (I
suspect =E2=80=9Cguix-packages.drv=E2=80=9D is the one that eats up the mos=
t memory.)

I agree it=E2=80=99s ridiculous.  That memory usage comes from Guile=E2=80=
=99s
compiler.  A couple of years ago, Andy managed to cut memory usage
somewhat, but that=E2=80=99s not enough.

Thanks,
Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#38167; Package guix. Full text available.

Message received at 38167 <at> debbugs.gnu.org:


Received: (at 38167) by debbugs.gnu.org; 11 Nov 2019 07:37:35 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Nov 11 02:37:35 2019
Received: from localhost ([127.0.0.1]:53099 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1iU4GU-0004Rt-PA
	for submit <at> debbugs.gnu.org; Mon, 11 Nov 2019 02:37:34 -0500
Received: from mira.cbaines.net ([212.71.252.8]:38430)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <mail@HIDDEN>) id 1iU4GS-0004Rk-7f
 for 38167 <at> debbugs.gnu.org; Mon, 11 Nov 2019 02:37:32 -0500
Received: from localhost (cpc102582-walt20-2-0-cust14.13-2.cable.virginm.net
 [86.27.34.15])
 by mira.cbaines.net (Postfix) with ESMTPSA id 35F9E176AC;
 Mon, 11 Nov 2019 07:37:31 +0000 (GMT)
Received: from capella (localhost [127.0.0.1])
 by localhost (OpenSMTPD) with ESMTP id 428c21bb;
 Mon, 11 Nov 2019 07:37:30 +0000 (UTC)
References: <20191111080635.14f7b39a@HIDDEN>
User-agent: mu4e 1.2.0; emacs 26.3
From: Christopher Baines <mail@HIDDEN>
To: dannym@HIDDEN
Subject: Re: bug#38167: guix pull takes over 8 GiB of memory to finish if
 there are no substitutes
In-reply-to: <20191111080635.14f7b39a@HIDDEN>
Date: Mon, 11 Nov 2019 07:37:30 +0000
Message-ID: <87eeyec18l.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
 micalg=pgp-sha512; protocol="application/pgp-signature"
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 38167
Cc: 38167 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

--=-=-=
Content-Type: text/plain


Danny Milosavljevic <dannym@HIDDEN> writes:

> Hi,
>
> guix pull takes over 8 GiB of memory to finish if there are no substitutes.
>
> My laptop only takes max 8 GiB of RAM.  I've set up swap, but that kind of
> memory usage still seems ridiculous.

Do you know if the derivations got built in parallel? So, does guix pull
--max-jobs=1 use the same amount of memory?

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQKTBAEBCgB9FiEEPonu50WOcg2XVOCyXiijOwuE9XcFAl3JD7pfFIAAAAAALgAo
aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF
ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcACgkQXiijOwuE
9XcH3Q//TDm3fCeVrrdYOqceJfsw4Ygwn+hxQsIhLULPvq6IN69D/i95Fs70wVTe
mnZDHDMxlcit3etUFiOV8EfUn7q7rR9PSPlGCeYqpNlhjZlUta0/w035dPwTmeR9
NnUd05xWne/TNw7zjLGgOmXq5UBoVCKCl1ud2RRfGiiem2WslmL6rT0bjHmuj0R6
5Sdzjv4t3ksE7YhPDw/lUBUosgbGkaL4XBU/LwspDGx8MxmnaA5wznJIlW0z3WpT
MQoLgGudwELe4srDVbmNO9A1Hqp7SU7SyZZtx5WeN5JUUk7T1UqG41rm6qOb6ej0
Zd9mi7argYodCeeLCFvdX7OpuqP5yAAK23viLPsgobt+D+JBAFy2y3V8nGI2MNL8
qGzp4w1QD4TUkFci64EbfFB53BtLnsib/VCP5pOHI+lHotg7W8QHMGJob1CT421R
GjpYINC8NBUJq+OVMMc1zr1VJZP082So+85BzHDJOGHRlRxQ/3xyahn9ll9xIPrj
UhzlyfaBe2rJMs6Cve7a+9Ew9O16N97Dip1I0z2ZqOCtMMxlSoyAbZCcz/E0hi0l
6GjML8KadHHeue9qXr4R7kBBtmt8cfupXIWDFm99JKbWGQhQcGgoIs+nNm4QByuL
wL6xLgXbihTTQgurrvjaRnHkYX3MkYY/E9ZrMEm2di0WD9HnrMQ=
=GUK0
-----END PGP SIGNATURE-----
--=-=-=--




Information forwarded to bug-guix@HIDDEN:
bug#38167; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 11 Nov 2019 07:07:02 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Nov 11 02:07:02 2019
Received: from localhost ([127.0.0.1]:53092 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1iU3mw-0003XB-4D
	for submit <at> debbugs.gnu.org; Mon, 11 Nov 2019 02:07:02 -0500
Received: from lists.gnu.org ([209.51.188.17]:59121)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <dannym@HIDDEN>) id 1iU3mu-0003Wy-Ak
 for submit <at> debbugs.gnu.org; Mon, 11 Nov 2019 02:07:00 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10]:50744)
 by lists.gnu.org with esmtp (Exim 4.90_1)
 (envelope-from <dannym@HIDDEN>) id 1iU3ms-0000SR-HQ
 for bug-guix@HIDDEN; Mon, 11 Nov 2019 02:06:59 -0500
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-1.2 required=5.0 tests=BAYES_05,RCVD_IN_DNSWL_LOW
 autolearn=disabled version=3.3.2
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <dannym@HIDDEN>) id 1iU3mq-0004sN-H1
 for bug-guix@HIDDEN; Mon, 11 Nov 2019 02:06:58 -0500
Received: from dd26836.kasserver.com ([85.13.145.193]:59558)
 by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <dannym@HIDDEN>)
 id 1iU3mo-0004qt-Sz
 for bug-guix@HIDDEN; Mon, 11 Nov 2019 02:06:56 -0500
Received: from localhost (unknown [185.17.13.127])
 by dd26836.kasserver.com (Postfix) with ESMTPSA id D58EF3365593
 for <bug-guix@HIDDEN>; Mon, 11 Nov 2019 08:06:50 +0100 (CET)
Date: Mon, 11 Nov 2019 08:06:35 +0100
From: Danny Milosavljevic <dannym@HIDDEN>
To: <bug-guix@HIDDEN>
Subject: guix pull takes over 8 GiB of memory to finish if there are no
 substitutes
Message-ID: <20191111080635.14f7b39a@HIDDEN>
X-Mailer: Claws Mail 3.17.3 (GTK+ 2.24.32; x86_64-unknown-linux-gnu)
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="Sig_/hGo06621cNVgTPrlL66QD/z";
 protocol="application/pgp-signature"; micalg=pgp-sha256
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
 [fuzzy]
X-Received-From: 85.13.145.193
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

--Sig_/hGo06621cNVgTPrlL66QD/z
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: quoted-printable

Hi,

guix pull takes over 8 GiB of memory to finish if there are no substitutes.

My laptop only takes max 8 GiB of RAM.  I've set up swap, but that kind of
memory usage still seems ridiculous.

--Sig_/hGo06621cNVgTPrlL66QD/z
Content-Type: application/pgp-signature
Content-Description: OpenPGP digital signature

-----BEGIN PGP SIGNATURE-----

iQEzBAEBCAAdFiEEds7GsXJ0tGXALbPZ5xo1VCwwuqUFAl3JCHwACgkQ5xo1VCww
uqXfNwgAjWsb15CzB4loVYOc8WXIQw3qPd8IOKEu1fnbNlenT/qLHIBVyZvDRYhx
X6eiZXtfByrjZL2sJ6VA1lY/6v9+xlqGkhU2/1Uvi+bX7IocgrNTYFe/2XntqWdU
bZJ9YIAAdQDht61aB98gGFH9+jeDiaT6m/r7iMaluRCuqKY6i1clsAMAmKeOkBhZ
CVCCsPHWY9ziv0ixiC1BR8T52v0GGqaa5P/uwCxbknKm5FHavSWOyetIyY23YNsW
QNrIkkBNrOMUfZ+qm4DCiyhLHE8/3lytI7n/GWdPctsqi7a54+jeLZkmUhLdw0wZ
G4s/5HrD2HNAQwX3eKsA1kDh7nmi0A==
=YZ/o
-----END PGP SIGNATURE-----

--Sig_/hGo06621cNVgTPrlL66QD/z--




Acknowledgement sent to Danny Milosavljevic <dannym@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#38167; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Mon, 25 Nov 2019 12:00:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.