X-Loop: help-debbugs@HIDDEN
Subject: bug#35701: guix size should account for hard links in its disk space calculation
Resent-From: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Sun, 12 May 2019 19:19:01 +0000
Resent-Message-ID: <handler.35701.B.15576887325689 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: report 35701
X-GNU-PR-Package: guix
X-GNU-PR-Keywords:
To: 35701 <at> debbugs.gnu.org
X-Debbugs-Original-To: bug-guix <bug-guix@HIDDEN>
Received: via spool by submit <at> debbugs.gnu.org id=B.15576887325689
(code B ref -1); Sun, 12 May 2019 19:19:01 +0000
Received: (at submit) by debbugs.gnu.org; 12 May 2019 19:18:52 +0000
Received: from localhost ([127.0.0.1]:43335 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1hPtzn-0001Th-NF
for submit <at> debbugs.gnu.org; Sun, 12 May 2019 15:18:51 -0400
Received: from eggs.gnu.org ([209.51.188.92]:52328)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <maxim.cournoyer@HIDDEN>) id 1hPtzm-0001TV-Hk
for submit <at> debbugs.gnu.org; Sun, 12 May 2019 15:18:50 -0400
Received: from lists.gnu.org ([209.51.188.17]:33067)
by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32)
(Exim 4.71) (envelope-from <maxim.cournoyer@HIDDEN>)
id 1hPtzh-00075f-7z
for submit <at> debbugs.gnu.org; Sun, 12 May 2019 15:18:45 -0400
Received: from eggs.gnu.org ([209.51.188.92]:38471)
by lists.gnu.org with esmtp (Exim 4.71)
(envelope-from <maxim.cournoyer@HIDDEN>) id 1hPtzd-00081m-E0
for bug-guix@HIDDEN; Sun, 12 May 2019 15:18:42 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level:
X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50,FREEMAIL_FROM
autolearn=disabled version=3.3.2
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
(envelope-from <maxim.cournoyer@HIDDEN>) id 1hPtzc-0006tD-Hj
for bug-guix@HIDDEN; Sun, 12 May 2019 15:18:41 -0400
Received: from mail-qt1-x836.google.com ([2607:f8b0:4864:20::836]:42788)
by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16)
(Exim 4.71) (envelope-from <maxim.cournoyer@HIDDEN>)
id 1hPtzc-0006rP-CF
for bug-guix@HIDDEN; Sun, 12 May 2019 15:18:40 -0400
Received: by mail-qt1-x836.google.com with SMTP id j53so12382734qta.9
for <bug-guix@HIDDEN>; Sun, 12 May 2019 12:18:40 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
h=from:to:subject:date:message-id:mime-version;
bh=GrVlEPrdD5e+OyxIVsTqwcpnSAJRr+XO4w1hVPnWjcU=;
b=tPgCp1E0X5/PkyHj5l8f+kKo3clkXWbIVgHe2N5l22uE87g5jkQ7nuYFyTxBxZCzCB
AtdbKttNb6BdKmDdEgdW/jsHhwrkmTkILg11MJcJ0iz53oyVrmi/Cqy7grPvTp1jJECr
K2DlQUCne2p+iNB+d2tsRB5Xu4uPfWi3t2xT+rrZ7v8sGQj4WciX/BCvpjvz0Y2TnrOA
upwLSRrQlIm4Y0ilOLFiZVrgJOfMMbN5hPMuzdkee6qknO+CGIhXYkh/VKJ4TpqxP1lk
I6okek2p1/1hyfF087KgaQe5r2CeISun4CcA/W+FzEo4LS6Tt4e88NQVbxrAHwSBqaft
UVRw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20161025;
h=x-gm-message-state:from:to:subject:date:message-id:mime-version;
bh=GrVlEPrdD5e+OyxIVsTqwcpnSAJRr+XO4w1hVPnWjcU=;
b=kBJOxLO36/awSikqijivmkQCJrZmJRarmj7cEjhzkhjlflfUNj8NKPu7FO0UDODt8E
lPwGNM3ACOegti39PcfNyUePvQwPFvyXBBpciKBiwfw3SODTDj4iDWMAGbNJFVSQYGa7
SdokkjjrKpBW/RTjSIwcTiAU7A4+aobif4htNr/w9pi1QjGxRsjgrZfkkl2+6gvcIoMT
4xLgNtkzIIfa4ytOXQ8iZXWFLkLiv/fDD+2MXadHwNh8T79gXszMBn7j9sF2BDFtwA/+
IERyDqRZQY/52UYLDcIGs+j0AgomAGNle6RYHH9pz3b49QxwdJ64eNJEclWcK/A1o77j
yFlw==
X-Gm-Message-State: APjAAAU1/AmqEG/5l2GWk8ac1fe41rLdlXICUljzHGf7JC355Rzl38pT
i4zR3J/px77VSAbpJWZIwQ6Q6DFS
X-Google-Smtp-Source: APXvYqwMjt7X48v8dMxIaPIT3hpqidVJAd9xGjCoWzQSMfNk643QJtObNOiRcU2cocj2S4aIqjSnBw==
X-Received: by 2002:ac8:288a:: with SMTP id i10mr20671539qti.278.1557688719341;
Sun, 12 May 2019 12:18:39 -0700 (PDT)
Received: from kwak (dsl-150-248.b2b2c.ca. [66.158.150.248])
by smtp.gmail.com with ESMTPSA id 11sm7801999qtp.88.2019.05.12.12.18.37
for <bug-guix@HIDDEN>
(version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256);
Sun, 12 May 2019 12:18:38 -0700 (PDT)
From: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
Date: Sun, 12 May 2019 15:18:36 -0400
Message-ID: <878svbv5v7.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="=-=-="
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
recognized.
X-Received-From: 2607:f8b0:4864:20::836
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x
X-Spam-Score: -1.3 (-)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)
--=-=-=
Content-Type: text/plain
Consider the following operating system declaration:
--=-=-=
Content-Type: application/octet-stream
Content-Disposition: inline; filename=robot-framework-system.scm
Content-Transfer-Encoding: base64
OzsgVGhpcyBpcyBhbiBvcGVyYXRpbmcgc3lzdGVtIGNvbmZpZ3VyYXRpb24gdGVtcGxhdGUgZm9y
IGEgYmFyZS1ib25lLAo7OyBjb250YWluZXJpemF0aW9uLWZyaWVuZGx5IHNldHVwLCB3aXRoIG5v
IFgxMSBkaXNwbGF5IHNlcnZlciBhbmQKOzsgbm8gR3VpeCBkYWVtb24gLyBjbGllbnQuCgoodXNl
LW1vZHVsZXMgKGdudSkKCSAgICAgKGdudSBwYWNrYWdlcyBiYXNoKQoJICAgICAoZ251IHBhY2th
Z2VzIHB5dGhvbikKCSAgICAgKGdudSBwYWNrYWdlcyBweXRob24teHl6KQoJICAgICAoZ251IHBh
Y2thZ2VzIHhtbCkKCSAgICAgKGd1aXggcGFja2FnZXMpKQoKKG9wZXJhdGluZy1zeXN0ZW0KICAo
aG9zdC1uYW1lICJyb2JvdC1mcmFtZXdvcmsiKQogICh0aW1lem9uZSAiQW1lcmljYS9Nb250cmVh
bCIpCgogIDs7IEJvb3QgaW4gImxlZ2FjeSIgQklPUyBtb2RlLCBhc3N1bWluZyAvZGV2L3NkWCBp
cyB0aGUKICA7OyB0YXJnZXQgaGFyZCBkaXNrLCBhbmQgIm15LXJvb3QiIGlzIHRoZSBsYWJlbCBv
ZiB0aGUgdGFyZ2V0CiAgOzsgcm9vdCBmaWxlIHN5c3RlbS4KICAoYm9vdGxvYWRlciAoYm9vdGxv
YWRlci1jb25maWd1cmF0aW9uCiAgICAgICAgICAgICAgIChib290bG9hZGVyIGdydWItYm9vdGxv
YWRlcikKICAgICAgICAgICAgICAgKHRhcmdldCAiL2Rldi9zZGEiKSkpCiAgKGZpbGUtc3lzdGVt
cyAoY29ucyAoZmlsZS1zeXN0ZW0KICAgICAgICAgICAgICAgICAgICAgICAgKGRldmljZSAoZmls
ZS1zeXN0ZW0tbGFiZWwgIm15LXJvb3QiKSkKICAgICAgICAgICAgICAgICAgICAgICAgKG1vdW50
LXBvaW50ICIvIikKICAgICAgICAgICAgICAgICAgICAgICAgKHR5cGUgImV4dDQiKSkKICAgICAg
ICAgICAgICAgICAgICAgICViYXNlLWZpbGUtc3lzdGVtcykpCgogICh1c2VycyAoY29ucyAodXNl
ci1hY2NvdW50CiAgICAgICAgICAgICAgICAobmFtZSAiYnVpbGRlciIpCiAgICAgICAgICAgICAg
ICAoZ3JvdXAgInVzZXJzIikKCQkoc3VwcGxlbWVudGFyeS1ncm91cHMgJygid2hlZWwiKSkKCQko
aG9tZS1kaXJlY3RvcnkgIi9ob21lL2J1aWxkZXIiKSkKCSAgICAgICAlYmFzZS11c2VyLWFjY291
bnRzKSkKCiAgOzsgR2xvYmFsbHktaW5zdGFsbGVkIHBhY2thZ2VzLgogIChwYWNrYWdlcyAoY29u
cyogcHl0aG9uLXdyYXBwZXIKCQkgICAobGlzdCBweXRob24gInRrIikKCQkgICBweXRob24tcm9i
b3RmcmFtZXdvcmsKCQkgICBweXRob24tcm9ib3RmcmFtZXdvcmstc3NobGlicmFyeQoJCSAgIHB5
dGhvbi1yb2JvdGZyYW1ld29yay1saW50CgkJICAgcHl0aG9uLXhtbHRvZGljdAoJCSAgICViYXNl
LXBhY2thZ2VzKSkKCiAgKHNlcnZpY2VzIChsaXN0CgkgICAgIDs7IEVuYWJsZSAjIS9iaW4vc2gg
YW5kICMhL2Jpbi9iYXNoIHNoZWJhbmdzLgoJICAgICAoc2VydmljZSBzcGVjaWFsLWZpbGVzLXNl
cnZpY2UtdHlwZQoJCSAgICAgIGAoKCIvYmluL2Jhc2giICwoZmlsZS1hcHBlbmQgKGNhbm9uaWNh
bC1wYWNrYWdlIGJhc2gpCgkJCQkJCSAgICIvYmluL2Jhc2giKSkpKQoJICAgICAoc2VydmljZSBz
cGVjaWFsLWZpbGVzLXNlcnZpY2UtdHlwZQogICAgICAgICAgICAgICAgICAgICAgYCgoIi9iaW4v
c2giICwoZmlsZS1hcHBlbmQgKGNhbm9uaWNhbC1wYWNrYWdlIGJhc2gpCgkJCQkJCSAiL2Jpbi9z
aCIpKSkpCgkgICAgIDs7IFRoZSBmb2xsb3dpbmcgaXMgYSB2ZXJ5IHNtYWxsIHN1YnNldCBleHRy
YWN0ZWQgb2YKCSAgICAgOzsgJWJhc2Utc2VydmljZXMuCgkgICAgIChzZXJ2aWNlIGxvZ2luLXNl
cnZpY2UtdHlwZSkKCSAgICAgKHNlcnZpY2UgdWRldi1zZXJ2aWNlLXR5cGUgKHVkZXYtY29uZmln
dXJhdGlvbikpCgkgICAgIChzeXNsb2ctc2VydmljZSkpKQoKICA7OyBXaGVuIHVzaW5nIHN1ZG8s
IGJ5IGRlZmF1bHQgc29tZSBlbnZpcm9ubWVudCB2YXJpYWJsZXMgc3VjaCBhcwogIDs7IFBZVEhP
TlBBVEggYXJlIGRyb3BwZWQuICBNYWtlIGl0IHNvIHRoYXQgYW55IGVudmlyb25tZW50CiAgOzsg
dmFyaWFibGVzIGFyZSBob25vcmVkLiAgVGhpcyBpcyBpbXBvcnRhbnQgc28gdGhhdCB0aGUgR3Vp
eCBzeXN0ZW0KICA7OyBwcm9maWxlIGNhbiB3b3JrIGNvcnJlY3RseSBmb3IgYW55IHVzZXIuCiAg
KHN1ZG9lcnMtZmlsZSAocGxhaW4tZmlsZSAic3Vkb2VycyIgIlwKcm9vdCBBTEw9KEFMTCkgQUxM
CiV3aGVlbCBBTEw9KEFMTCkgQUxMCkRlZmF1bHRzICFlbnZfcmVzZXQsIWVudl9kZWxldGVcbiIp
KSkK
--=-=-=
Content-Type: text/plain
$ guix size `guix system build robot-framework-system.scm`
gives:
store item total self
/gnu/store/f9fy1b2yf1qxy523732r7z34ymwqz64b-linux-libre-5.1 241.5 241.5 21.8%
/gnu/store/1lcniyxkxkh8g73zvh2gpbccvl6ggna7-locale-2.28 91.8 91.8 8.3%
/gnu/store/zm3188ipzi262s0m8bxm24br77yh9pd8-python-3.7.0 183.0 74.6 6.7%
/gnu/store/h8l1pby3cm6b4fxsfwwr65b4d1hyh6cs-python-3.7.0 183.0 74.6 6.7%
/gnu/store/wqr8rwnwpmag01i6kb0laf62vsqnhrxy-python-3.7.0 183.0 74.6 6.7%
/gnu/store/b7fqhszxl02g6pfm3vw6b3cjz472qrly-python-3.7.0 182.8 74.6 6.7%
[...]
total: 1106.3 MiB
But,
$ guix size `guix system --no-grafts build robot-framework-system.scm`
store item total self
/gnu/store/f9fy1b2yf1qxy523732r7z34ymwqz64b-linux-libre-5.1 241.5 241.5 28.4%
/gnu/store/1lcniyxkxkh8g73zvh2gpbccvl6ggna7-locale-2.28 91.8 91.8 10.8%
/gnu/store/b7fqhszxl02g6pfm3vw6b3cjz472qrly-python-3.7.0 182.8 74.6 8.8%
/gnu/store/ybglr7nfs8v9kpnm8vf4drg3gafnvd15-guile-static-stripped-2.2.4 45.9 45.9 5.4%
total: 851.2 MiB
Conclusion: the size of grafts is added multiple times even though they
should be very light on disk usage given that they are mostly hard links
to the original, ungrafted output.
--=-=-=--
Content-Disposition: inline Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Mailer: MIME-tools 5.505 (Entity 5.505) Content-Type: text/plain; charset=utf-8 X-Loop: help-debbugs@HIDDEN From: help-debbugs@HIDDEN (GNU bug Tracking System) To: Maxim Cournoyer <maxim.cournoyer@HIDDEN> Subject: bug#35701: Acknowledgement (guix size should account for hard links in its disk space calculation) Message-ID: <handler.35701.B.15576887325689.ack <at> debbugs.gnu.org> References: <878svbv5v7.fsf@HIDDEN> X-Gnu-PR-Message: ack 35701 X-Gnu-PR-Package: guix Reply-To: 35701 <at> debbugs.gnu.org Date: Sun, 12 May 2019 19:19:02 +0000 Thank you for filing a new bug report with debbugs.gnu.org. This is an automatically generated reply to let you know your message has been received. Your message is being forwarded to the package maintainers and other interested parties for their attention; they will reply in due course. Your message has been sent to the package maintainer(s): bug-guix@HIDDEN If you wish to submit further information on this problem, please send it to 35701 <at> debbugs.gnu.org. Please do not send mail to help-debbugs@HIDDEN unless you wish to report a problem with the Bug-tracking system. --=20 35701: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D35701 GNU Bug Tracking System Contact help-debbugs@HIDDEN with problems
X-Loop: help-debbugs@HIDDEN
Subject: bug#35701: guix size should account for hard links in its disk space calculation
Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Tue, 14 May 2019 08:19:02 +0000
Resent-Message-ID: <handler.35701.B35701.15578218899602 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 35701
X-GNU-PR-Package: guix
X-GNU-PR-Keywords:
To: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
Cc: 35701 <at> debbugs.gnu.org
Received: via spool by 35701-submit <at> debbugs.gnu.org id=B35701.15578218899602
(code B ref 35701); Tue, 14 May 2019 08:19:02 +0000
Received: (at 35701) by debbugs.gnu.org; 14 May 2019 08:18:09 +0000
Received: from localhost ([127.0.0.1]:47202 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1hQSdV-0002Uo-HC
for submit <at> debbugs.gnu.org; Tue, 14 May 2019 04:18:09 -0400
Received: from eggs.gnu.org ([209.51.188.92]:47857)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <ludo@HIDDEN>) id 1hQSdU-0002Uc-2x
for 35701 <at> debbugs.gnu.org; Tue, 14 May 2019 04:18:08 -0400
Received: from fencepost.gnu.org ([2001:470:142:3::e]:59528)
by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <ludo@HIDDEN>)
id 1hQSdO-00054w-Mb; Tue, 14 May 2019 04:18:02 -0400
Received: from [2001:660:6102:320:e120:2c8f:8909:cdfe] (port=46948 helo=ribbon)
by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
(Exim 4.82) (envelope-from <ludo@HIDDEN>)
id 1hQSdN-0005uz-LL; Tue, 14 May 2019 04:18:02 -0400
From: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
References: <878svbv5v7.fsf@HIDDEN>
Date: Tue, 14 May 2019 10:17:59 +0200
In-Reply-To: <878svbv5v7.fsf@HIDDEN> (Maxim Cournoyer's message of "Sun, 12
May 2019 15:18:36 -0400")
Message-ID: <877eat30w8.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Spam-Score: -2.3 (--)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)
Salut Maxim,
Maxim Cournoyer <maxim.cournoyer@HIDDEN> skribis:
> Conclusion: the size of grafts is added multiple times even though they
> should be very light on disk usage given that they are mostly hard links
> to the original, ungrafted output.
I think there should be an option to take hard links into account, but
it should probably not be done by default. There are cases (e.g., when
using =E2=80=98guix pack=E2=80=99 or when evaluating the amount of data tha=
t will
actually be transferred over the wire) where you want to know the
=E2=80=9Capparent size=E2=80=9D, ignoring hard links.
Note that it=E2=80=99s a bit more work to take hard links into account since
currently =E2=80=98guix size=E2=80=99 just queries each store item=E2=80=99=
s size to the
daemon.
Thanks,
Ludo=E2=80=99.
GNU bug tracking system
Copyright (C) 1999 Darren O. Benham,
1997 nCipher Corporation Ltd,
1994-97 Ian Jackson.