Received: (at 38167) by debbugs.gnu.org; 11 Nov 2019 20:42:35 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Nov 11 15:42:35 2019 Received: from localhost ([127.0.0.1]:56038 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1iUGWB-0002Ts-Do for submit <at> debbugs.gnu.org; Mon, 11 Nov 2019 15:42:35 -0500 Received: from eggs.gnu.org ([209.51.188.92]:41855) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <ludo@HIDDEN>) id 1iUGW8-0002Te-Qj for 38167 <at> debbugs.gnu.org; Mon, 11 Nov 2019 15:42:34 -0500 Received: from fencepost.gnu.org ([2001:470:142:3::e]:49804) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <ludo@HIDDEN>) id 1iUGW2-0005Ju-Nv; Mon, 11 Nov 2019 15:42:26 -0500 Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=42470 helo=ribbon) by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256) (Exim 4.82) (envelope-from <ludo@HIDDEN>) id 1iUGW2-0000rp-BC; Mon, 11 Nov 2019 15:42:26 -0500 From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN> To: Christopher Baines <mail@HIDDEN> Subject: Re: bug#38167: guix pull takes over 8 GiB of memory to finish if there are no substitutes References: <20191111080635.14f7b39a@HIDDEN> <87eeyec18l.fsf@HIDDEN> Date: Mon, 11 Nov 2019 21:42:24 +0100 In-Reply-To: <87eeyec18l.fsf@HIDDEN> (Christopher Baines's message of "Mon, 11 Nov 2019 07:37:30 +0000") Message-ID: <878somno0f.fsf@HIDDEN> User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.3 (gnu/linux) MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: 38167 Cc: 38167 <at> debbugs.gnu.org, dannym@HIDDEN X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) Hi Chris & Danny, Christopher Baines <mail@HIDDEN> skribis: > Danny Milosavljevic <dannym@HIDDEN> writes: > >> Hi, >> >> guix pull takes over 8 GiB of memory to finish if there are no substitut= es. >> >> My laptop only takes max 8 GiB of RAM. I've set up swap, but that kind = of >> memory usage still seems ridiculous. > > Do you know if the derivations got built in parallel? So, does guix pull > --max-jobs=3D1 use the same amount of memory? Also, it would be great if you could identify which derivation build requires that much memory, if this was happening sequentially. (I suspect =E2=80=9Cguix-packages.drv=E2=80=9D is the one that eats up the mos= t memory.) I agree it=E2=80=99s ridiculous. That memory usage comes from Guile=E2=80= =99s compiler. A couple of years ago, Andy managed to cut memory usage somewhat, but that=E2=80=99s not enough. Thanks, Ludo=E2=80=99.
bug-guix@HIDDEN:bug#38167; Package guix.
Full text available.Received: (at 38167) by debbugs.gnu.org; 11 Nov 2019 07:37:35 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Nov 11 02:37:35 2019 Received: from localhost ([127.0.0.1]:53099 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1iU4GU-0004Rt-PA for submit <at> debbugs.gnu.org; Mon, 11 Nov 2019 02:37:34 -0500 Received: from mira.cbaines.net ([212.71.252.8]:38430) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <mail@HIDDEN>) id 1iU4GS-0004Rk-7f for 38167 <at> debbugs.gnu.org; Mon, 11 Nov 2019 02:37:32 -0500 Received: from localhost (cpc102582-walt20-2-0-cust14.13-2.cable.virginm.net [86.27.34.15]) by mira.cbaines.net (Postfix) with ESMTPSA id 35F9E176AC; Mon, 11 Nov 2019 07:37:31 +0000 (GMT) Received: from capella (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id 428c21bb; Mon, 11 Nov 2019 07:37:30 +0000 (UTC) References: <20191111080635.14f7b39a@HIDDEN> User-agent: mu4e 1.2.0; emacs 26.3 From: Christopher Baines <mail@HIDDEN> To: dannym@HIDDEN Subject: Re: bug#38167: guix pull takes over 8 GiB of memory to finish if there are no substitutes In-reply-to: <20191111080635.14f7b39a@HIDDEN> Date: Mon, 11 Nov 2019 07:37:30 +0000 Message-ID: <87eeyec18l.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 38167 Cc: 38167 <at> debbugs.gnu.org X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) --=-=-= Content-Type: text/plain Danny Milosavljevic <dannym@HIDDEN> writes: > Hi, > > guix pull takes over 8 GiB of memory to finish if there are no substitutes. > > My laptop only takes max 8 GiB of RAM. I've set up swap, but that kind of > memory usage still seems ridiculous. Do you know if the derivations got built in parallel? So, does guix pull --max-jobs=1 use the same amount of memory? --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKTBAEBCgB9FiEEPonu50WOcg2XVOCyXiijOwuE9XcFAl3JD7pfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcACgkQXiijOwuE 9XcH3Q//TDm3fCeVrrdYOqceJfsw4Ygwn+hxQsIhLULPvq6IN69D/i95Fs70wVTe mnZDHDMxlcit3etUFiOV8EfUn7q7rR9PSPlGCeYqpNlhjZlUta0/w035dPwTmeR9 NnUd05xWne/TNw7zjLGgOmXq5UBoVCKCl1ud2RRfGiiem2WslmL6rT0bjHmuj0R6 5Sdzjv4t3ksE7YhPDw/lUBUosgbGkaL4XBU/LwspDGx8MxmnaA5wznJIlW0z3WpT MQoLgGudwELe4srDVbmNO9A1Hqp7SU7SyZZtx5WeN5JUUk7T1UqG41rm6qOb6ej0 Zd9mi7argYodCeeLCFvdX7OpuqP5yAAK23viLPsgobt+D+JBAFy2y3V8nGI2MNL8 qGzp4w1QD4TUkFci64EbfFB53BtLnsib/VCP5pOHI+lHotg7W8QHMGJob1CT421R GjpYINC8NBUJq+OVMMc1zr1VJZP082So+85BzHDJOGHRlRxQ/3xyahn9ll9xIPrj UhzlyfaBe2rJMs6Cve7a+9Ew9O16N97Dip1I0z2ZqOCtMMxlSoyAbZCcz/E0hi0l 6GjML8KadHHeue9qXr4R7kBBtmt8cfupXIWDFm99JKbWGQhQcGgoIs+nNm4QByuL wL6xLgXbihTTQgurrvjaRnHkYX3MkYY/E9ZrMEm2di0WD9HnrMQ= =GUK0 -----END PGP SIGNATURE----- --=-=-=--
bug-guix@HIDDEN:bug#38167; Package guix.
Full text available.Received: (at submit) by debbugs.gnu.org; 11 Nov 2019 07:07:02 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Nov 11 02:07:02 2019 Received: from localhost ([127.0.0.1]:53092 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1iU3mw-0003XB-4D for submit <at> debbugs.gnu.org; Mon, 11 Nov 2019 02:07:02 -0500 Received: from lists.gnu.org ([209.51.188.17]:59121) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <dannym@HIDDEN>) id 1iU3mu-0003Wy-Ak for submit <at> debbugs.gnu.org; Mon, 11 Nov 2019 02:07:00 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]:50744) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from <dannym@HIDDEN>) id 1iU3ms-0000SR-HQ for bug-guix@HIDDEN; Mon, 11 Nov 2019 02:06:59 -0500 X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org X-Spam-Level: X-Spam-Status: No, score=-1.2 required=5.0 tests=BAYES_05,RCVD_IN_DNSWL_LOW autolearn=disabled version=3.3.2 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from <dannym@HIDDEN>) id 1iU3mq-0004sN-H1 for bug-guix@HIDDEN; Mon, 11 Nov 2019 02:06:58 -0500 Received: from dd26836.kasserver.com ([85.13.145.193]:59558) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from <dannym@HIDDEN>) id 1iU3mo-0004qt-Sz for bug-guix@HIDDEN; Mon, 11 Nov 2019 02:06:56 -0500 Received: from localhost (unknown [185.17.13.127]) by dd26836.kasserver.com (Postfix) with ESMTPSA id D58EF3365593 for <bug-guix@HIDDEN>; Mon, 11 Nov 2019 08:06:50 +0100 (CET) Date: Mon, 11 Nov 2019 08:06:35 +0100 From: Danny Milosavljevic <dannym@HIDDEN> To: <bug-guix@HIDDEN> Subject: guix pull takes over 8 GiB of memory to finish if there are no substitutes Message-ID: <20191111080635.14f7b39a@HIDDEN> X-Mailer: Claws Mail 3.17.3 (GTK+ 2.24.32; x86_64-unknown-linux-gnu) MIME-Version: 1.0 Content-Type: multipart/signed; boundary="Sig_/hGo06621cNVgTPrlL66QD/z"; protocol="application/pgp-signature"; micalg=pgp-sha256 X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic] [fuzzy] X-Received-From: 85.13.145.193 X-Spam-Score: -2.3 (--) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -3.3 (---) --Sig_/hGo06621cNVgTPrlL66QD/z Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: quoted-printable Hi, guix pull takes over 8 GiB of memory to finish if there are no substitutes. My laptop only takes max 8 GiB of RAM. I've set up swap, but that kind of memory usage still seems ridiculous. --Sig_/hGo06621cNVgTPrlL66QD/z Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iQEzBAEBCAAdFiEEds7GsXJ0tGXALbPZ5xo1VCwwuqUFAl3JCHwACgkQ5xo1VCww uqXfNwgAjWsb15CzB4loVYOc8WXIQw3qPd8IOKEu1fnbNlenT/qLHIBVyZvDRYhx X6eiZXtfByrjZL2sJ6VA1lY/6v9+xlqGkhU2/1Uvi+bX7IocgrNTYFe/2XntqWdU bZJ9YIAAdQDht61aB98gGFH9+jeDiaT6m/r7iMaluRCuqKY6i1clsAMAmKeOkBhZ CVCCsPHWY9ziv0ixiC1BR8T52v0GGqaa5P/uwCxbknKm5FHavSWOyetIyY23YNsW QNrIkkBNrOMUfZ+qm4DCiyhLHE8/3lytI7n/GWdPctsqi7a54+jeLZkmUhLdw0wZ G4s/5HrD2HNAQwX3eKsA1kDh7nmi0A== =YZ/o -----END PGP SIGNATURE----- --Sig_/hGo06621cNVgTPrlL66QD/z--
Danny Milosavljevic <dannym@HIDDEN>:bug-guix@HIDDEN.
Full text available.bug-guix@HIDDEN:bug#38167; Package guix.
Full text available.
GNU bug tracking system
Copyright (C) 1999 Darren O. Benham,
1997 nCipher Corporation Ltd,
1994-97 Ian Jackson.