GNU bug report logs - #35701
guix size should account for hard links in its disk space calculation

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Reported by: Maxim Cournoyer <maxim.cournoyer@HIDDEN>; dated Sun, 12 May 2019 19:19:01 UTC; Maintainer for guix is bug-guix@HIDDEN.

Message received at 35701 <at> debbugs.gnu.org:


Received: (at 35701) by debbugs.gnu.org; 14 May 2019 08:18:09 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue May 14 04:18:09 2019
Received: from localhost ([127.0.0.1]:47202 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1hQSdV-0002Uo-HC
	for submit <at> debbugs.gnu.org; Tue, 14 May 2019 04:18:09 -0400
Received: from eggs.gnu.org ([209.51.188.92]:47857)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1hQSdU-0002Uc-2x
 for 35701 <at> debbugs.gnu.org; Tue, 14 May 2019 04:18:08 -0400
Received: from fencepost.gnu.org ([2001:470:142:3::e]:59528)
 by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <ludo@HIDDEN>)
 id 1hQSdO-00054w-Mb; Tue, 14 May 2019 04:18:02 -0400
Received: from [2001:660:6102:320:e120:2c8f:8909:cdfe] (port=46948 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1hQSdN-0005uz-LL; Tue, 14 May 2019 04:18:02 -0400
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
Subject: Re: bug#35701: guix size should account for hard links in its disk
 space calculation
References: <878svbv5v7.fsf@HIDDEN>
Date: Tue, 14 May 2019 10:17:59 +0200
In-Reply-To: <878svbv5v7.fsf@HIDDEN> (Maxim Cournoyer's message of "Sun, 12
 May 2019 15:18:36 -0400")
Message-ID: <877eat30w8.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 35701
Cc: 35701 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Salut Maxim,

Maxim Cournoyer <maxim.cournoyer@HIDDEN> skribis:

> Conclusion: the size of grafts is added multiple times even though they
> should be very light on disk usage given that they are mostly hard links
> to the original, ungrafted output.

I think there should be an option to take hard links into account, but
it should probably not be done by default.  There are cases (e.g., when
using =E2=80=98guix pack=E2=80=99 or when evaluating the amount of data tha=
t will
actually be transferred over the wire) where you want to know the
=E2=80=9Capparent size=E2=80=9D, ignoring hard links.

Note that it=E2=80=99s a bit more work to take hard links into account since
currently =E2=80=98guix size=E2=80=99 just queries each store item=E2=80=99=
s size to the
daemon.

Thanks,
Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#35701; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 12 May 2019 19:18:52 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun May 12 15:18:52 2019
Received: from localhost ([127.0.0.1]:43335 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1hPtzn-0001Th-NF
	for submit <at> debbugs.gnu.org; Sun, 12 May 2019 15:18:51 -0400
Received: from eggs.gnu.org ([209.51.188.92]:52328)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <maxim.cournoyer@HIDDEN>) id 1hPtzm-0001TV-Hk
 for submit <at> debbugs.gnu.org; Sun, 12 May 2019 15:18:50 -0400
Received: from lists.gnu.org ([209.51.188.17]:33067)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <maxim.cournoyer@HIDDEN>)
 id 1hPtzh-00075f-7z
 for submit <at> debbugs.gnu.org; Sun, 12 May 2019 15:18:45 -0400
Received: from eggs.gnu.org ([209.51.188.92]:38471)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <maxim.cournoyer@HIDDEN>) id 1hPtzd-00081m-E0
 for bug-guix@HIDDEN; Sun, 12 May 2019 15:18:42 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50,FREEMAIL_FROM
 autolearn=disabled version=3.3.2
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <maxim.cournoyer@HIDDEN>) id 1hPtzc-0006tD-Hj
 for bug-guix@HIDDEN; Sun, 12 May 2019 15:18:41 -0400
Received: from mail-qt1-x836.google.com ([2607:f8b0:4864:20::836]:42788)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16)
 (Exim 4.71) (envelope-from <maxim.cournoyer@HIDDEN>)
 id 1hPtzc-0006rP-CF
 for bug-guix@HIDDEN; Sun, 12 May 2019 15:18:40 -0400
Received: by mail-qt1-x836.google.com with SMTP id j53so12382734qta.9
 for <bug-guix@HIDDEN>; Sun, 12 May 2019 12:18:40 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=from:to:subject:date:message-id:mime-version;
 bh=GrVlEPrdD5e+OyxIVsTqwcpnSAJRr+XO4w1hVPnWjcU=;
 b=tPgCp1E0X5/PkyHj5l8f+kKo3clkXWbIVgHe2N5l22uE87g5jkQ7nuYFyTxBxZCzCB
 AtdbKttNb6BdKmDdEgdW/jsHhwrkmTkILg11MJcJ0iz53oyVrmi/Cqy7grPvTp1jJECr
 K2DlQUCne2p+iNB+d2tsRB5Xu4uPfWi3t2xT+rrZ7v8sGQj4WciX/BCvpjvz0Y2TnrOA
 upwLSRrQlIm4Y0ilOLFiZVrgJOfMMbN5hPMuzdkee6qknO+CGIhXYkh/VKJ4TpqxP1lk
 I6okek2p1/1hyfF087KgaQe5r2CeISun4CcA/W+FzEo4LS6Tt4e88NQVbxrAHwSBqaft
 UVRw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:subject:date:message-id:mime-version;
 bh=GrVlEPrdD5e+OyxIVsTqwcpnSAJRr+XO4w1hVPnWjcU=;
 b=kBJOxLO36/awSikqijivmkQCJrZmJRarmj7cEjhzkhjlflfUNj8NKPu7FO0UDODt8E
 lPwGNM3ACOegti39PcfNyUePvQwPFvyXBBpciKBiwfw3SODTDj4iDWMAGbNJFVSQYGa7
 SdokkjjrKpBW/RTjSIwcTiAU7A4+aobif4htNr/w9pi1QjGxRsjgrZfkkl2+6gvcIoMT
 4xLgNtkzIIfa4ytOXQ8iZXWFLkLiv/fDD+2MXadHwNh8T79gXszMBn7j9sF2BDFtwA/+
 IERyDqRZQY/52UYLDcIGs+j0AgomAGNle6RYHH9pz3b49QxwdJ64eNJEclWcK/A1o77j
 yFlw==
X-Gm-Message-State: APjAAAU1/AmqEG/5l2GWk8ac1fe41rLdlXICUljzHGf7JC355Rzl38pT
 i4zR3J/px77VSAbpJWZIwQ6Q6DFS
X-Google-Smtp-Source: APXvYqwMjt7X48v8dMxIaPIT3hpqidVJAd9xGjCoWzQSMfNk643QJtObNOiRcU2cocj2S4aIqjSnBw==
X-Received: by 2002:ac8:288a:: with SMTP id i10mr20671539qti.278.1557688719341; 
 Sun, 12 May 2019 12:18:39 -0700 (PDT)
Received: from kwak (dsl-150-248.b2b2c.ca. [66.158.150.248])
 by smtp.gmail.com with ESMTPSA id 11sm7801999qtp.88.2019.05.12.12.18.37
 for <bug-guix@HIDDEN>
 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256);
 Sun, 12 May 2019 12:18:38 -0700 (PDT)
From: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
To: bug-guix <bug-guix@HIDDEN>
Subject: guix size should account for hard links in its disk space calculation
Date: Sun, 12 May 2019 15:18:36 -0400
Message-ID: <878svbv5v7.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="=-=-="
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
 recognized.
X-Received-From: 2607:f8b0:4864:20::836
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x
X-Spam-Score: -1.3 (-)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)

--=-=-=
Content-Type: text/plain

Consider the following operating system declaration:


--=-=-=
Content-Type: application/octet-stream
Content-Disposition: inline; filename=robot-framework-system.scm
Content-Transfer-Encoding: base64

OzsgVGhpcyBpcyBhbiBvcGVyYXRpbmcgc3lzdGVtIGNvbmZpZ3VyYXRpb24gdGVtcGxhdGUgZm9y
IGEgYmFyZS1ib25lLAo7OyBjb250YWluZXJpemF0aW9uLWZyaWVuZGx5IHNldHVwLCB3aXRoIG5v
IFgxMSBkaXNwbGF5IHNlcnZlciBhbmQKOzsgbm8gR3VpeCBkYWVtb24gLyBjbGllbnQuCgoodXNl
LW1vZHVsZXMgKGdudSkKCSAgICAgKGdudSBwYWNrYWdlcyBiYXNoKQoJICAgICAoZ251IHBhY2th
Z2VzIHB5dGhvbikKCSAgICAgKGdudSBwYWNrYWdlcyBweXRob24teHl6KQoJICAgICAoZ251IHBh
Y2thZ2VzIHhtbCkKCSAgICAgKGd1aXggcGFja2FnZXMpKQoKKG9wZXJhdGluZy1zeXN0ZW0KICAo
aG9zdC1uYW1lICJyb2JvdC1mcmFtZXdvcmsiKQogICh0aW1lem9uZSAiQW1lcmljYS9Nb250cmVh
bCIpCgogIDs7IEJvb3QgaW4gImxlZ2FjeSIgQklPUyBtb2RlLCBhc3N1bWluZyAvZGV2L3NkWCBp
cyB0aGUKICA7OyB0YXJnZXQgaGFyZCBkaXNrLCBhbmQgIm15LXJvb3QiIGlzIHRoZSBsYWJlbCBv
ZiB0aGUgdGFyZ2V0CiAgOzsgcm9vdCBmaWxlIHN5c3RlbS4KICAoYm9vdGxvYWRlciAoYm9vdGxv
YWRlci1jb25maWd1cmF0aW9uCiAgICAgICAgICAgICAgIChib290bG9hZGVyIGdydWItYm9vdGxv
YWRlcikKICAgICAgICAgICAgICAgKHRhcmdldCAiL2Rldi9zZGEiKSkpCiAgKGZpbGUtc3lzdGVt
cyAoY29ucyAoZmlsZS1zeXN0ZW0KICAgICAgICAgICAgICAgICAgICAgICAgKGRldmljZSAoZmls
ZS1zeXN0ZW0tbGFiZWwgIm15LXJvb3QiKSkKICAgICAgICAgICAgICAgICAgICAgICAgKG1vdW50
LXBvaW50ICIvIikKICAgICAgICAgICAgICAgICAgICAgICAgKHR5cGUgImV4dDQiKSkKICAgICAg
ICAgICAgICAgICAgICAgICViYXNlLWZpbGUtc3lzdGVtcykpCgogICh1c2VycyAoY29ucyAodXNl
ci1hY2NvdW50CiAgICAgICAgICAgICAgICAobmFtZSAiYnVpbGRlciIpCiAgICAgICAgICAgICAg
ICAoZ3JvdXAgInVzZXJzIikKCQkoc3VwcGxlbWVudGFyeS1ncm91cHMgJygid2hlZWwiKSkKCQko
aG9tZS1kaXJlY3RvcnkgIi9ob21lL2J1aWxkZXIiKSkKCSAgICAgICAlYmFzZS11c2VyLWFjY291
bnRzKSkKCiAgOzsgR2xvYmFsbHktaW5zdGFsbGVkIHBhY2thZ2VzLgogIChwYWNrYWdlcyAoY29u
cyogcHl0aG9uLXdyYXBwZXIKCQkgICAobGlzdCBweXRob24gInRrIikKCQkgICBweXRob24tcm9i
b3RmcmFtZXdvcmsKCQkgICBweXRob24tcm9ib3RmcmFtZXdvcmstc3NobGlicmFyeQoJCSAgIHB5
dGhvbi1yb2JvdGZyYW1ld29yay1saW50CgkJICAgcHl0aG9uLXhtbHRvZGljdAoJCSAgICViYXNl
LXBhY2thZ2VzKSkKCiAgKHNlcnZpY2VzIChsaXN0CgkgICAgIDs7IEVuYWJsZSAjIS9iaW4vc2gg
YW5kICMhL2Jpbi9iYXNoIHNoZWJhbmdzLgoJICAgICAoc2VydmljZSBzcGVjaWFsLWZpbGVzLXNl
cnZpY2UtdHlwZQoJCSAgICAgIGAoKCIvYmluL2Jhc2giICwoZmlsZS1hcHBlbmQgKGNhbm9uaWNh
bC1wYWNrYWdlIGJhc2gpCgkJCQkJCSAgICIvYmluL2Jhc2giKSkpKQoJICAgICAoc2VydmljZSBz
cGVjaWFsLWZpbGVzLXNlcnZpY2UtdHlwZQogICAgICAgICAgICAgICAgICAgICAgYCgoIi9iaW4v
c2giICwoZmlsZS1hcHBlbmQgKGNhbm9uaWNhbC1wYWNrYWdlIGJhc2gpCgkJCQkJCSAiL2Jpbi9z
aCIpKSkpCgkgICAgIDs7IFRoZSBmb2xsb3dpbmcgaXMgYSB2ZXJ5IHNtYWxsIHN1YnNldCBleHRy
YWN0ZWQgb2YKCSAgICAgOzsgJWJhc2Utc2VydmljZXMuCgkgICAgIChzZXJ2aWNlIGxvZ2luLXNl
cnZpY2UtdHlwZSkKCSAgICAgKHNlcnZpY2UgdWRldi1zZXJ2aWNlLXR5cGUgKHVkZXYtY29uZmln
dXJhdGlvbikpCgkgICAgIChzeXNsb2ctc2VydmljZSkpKQoKICA7OyBXaGVuIHVzaW5nIHN1ZG8s
IGJ5IGRlZmF1bHQgc29tZSBlbnZpcm9ubWVudCB2YXJpYWJsZXMgc3VjaCBhcwogIDs7IFBZVEhP
TlBBVEggYXJlIGRyb3BwZWQuICBNYWtlIGl0IHNvIHRoYXQgYW55IGVudmlyb25tZW50CiAgOzsg
dmFyaWFibGVzIGFyZSBob25vcmVkLiAgVGhpcyBpcyBpbXBvcnRhbnQgc28gdGhhdCB0aGUgR3Vp
eCBzeXN0ZW0KICA7OyBwcm9maWxlIGNhbiB3b3JrIGNvcnJlY3RseSBmb3IgYW55IHVzZXIuCiAg
KHN1ZG9lcnMtZmlsZSAocGxhaW4tZmlsZSAic3Vkb2VycyIgIlwKcm9vdCBBTEw9KEFMTCkgQUxM
CiV3aGVlbCBBTEw9KEFMTCkgQUxMCkRlZmF1bHRzICFlbnZfcmVzZXQsIWVudl9kZWxldGVcbiIp
KSkK
--=-=-=
Content-Type: text/plain


$ guix size `guix system build robot-framework-system.scm`

gives:

store item                                                       total    self
/gnu/store/f9fy1b2yf1qxy523732r7z34ymwqz64b-linux-libre-5.1        241.5   241.5  21.8%
/gnu/store/1lcniyxkxkh8g73zvh2gpbccvl6ggna7-locale-2.28             91.8    91.8   8.3%
/gnu/store/zm3188ipzi262s0m8bxm24br77yh9pd8-python-3.7.0           183.0    74.6   6.7%
/gnu/store/h8l1pby3cm6b4fxsfwwr65b4d1hyh6cs-python-3.7.0           183.0    74.6   6.7%
/gnu/store/wqr8rwnwpmag01i6kb0laf62vsqnhrxy-python-3.7.0           183.0    74.6   6.7%
/gnu/store/b7fqhszxl02g6pfm3vw6b3cjz472qrly-python-3.7.0           182.8    74.6   6.7%
[...]

total: 1106.3 MiB

But,

$ guix size `guix system --no-grafts build robot-framework-system.scm`

store item                                                       total    self
/gnu/store/f9fy1b2yf1qxy523732r7z34ymwqz64b-linux-libre-5.1        241.5   241.5  28.4%
/gnu/store/1lcniyxkxkh8g73zvh2gpbccvl6ggna7-locale-2.28             91.8    91.8  10.8%
/gnu/store/b7fqhszxl02g6pfm3vw6b3cjz472qrly-python-3.7.0           182.8    74.6   8.8%
/gnu/store/ybglr7nfs8v9kpnm8vf4drg3gafnvd15-guile-static-stripped-2.2.4    45.9    45.9   5.4%
total: 851.2 MiB

Conclusion: the size of grafts is added multiple times even though they
should be very light on disk usage given that they are mostly hard links
to the original, ungrafted output.

--=-=-=--




Acknowledgement sent to Maxim Cournoyer <maxim.cournoyer@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#35701; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Mon, 25 Nov 2019 12:00:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.