GNU bug report logs - #62379
/gnu/store/.links filling the hard drive on foreign distro

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Package: guix; Reported by: Elias Kueny <elias.kueny@HIDDEN>; Done: Maxim Cournoyer <maxim.cournoyer@HIDDEN>; Maintainer for guix is bug-guix@HIDDEN.

Message received at 62379-done <at> debbugs.gnu.org:


Received: (at 62379-done) by debbugs.gnu.org; 7 May 2023 15:05:30 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun May 07 11:05:30 2023
Received: from localhost ([127.0.0.1]:38158 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1pvfx4-0008Np-G6
	for submit <at> debbugs.gnu.org; Sun, 07 May 2023 11:05:30 -0400
Received: from mail-qv1-f49.google.com ([209.85.219.49]:53320)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <maxim.cournoyer@HIDDEN>) id 1pvfx2-0008Nc-S8
 for 62379-done <at> debbugs.gnu.org; Sun, 07 May 2023 11:05:29 -0400
Received: by mail-qv1-f49.google.com with SMTP id
 6a1803df08f44-61a80fcc4c9so17077216d6.2
 for <62379-done <at> debbugs.gnu.org>; Sun, 07 May 2023 08:05:28 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=gmail.com; s=20221208; t=1683471923; x=1686063923;
 h=content-transfer-encoding:mime-version:user-agent:message-id
 :in-reply-to:date:references:subject:cc:to:from:from:to:cc:subject
 :date:message-id:reply-to;
 bh=9AaU+t7x4MzjNjVUZovIAquiYe4ruo7WXBEUa3xWbzY=;
 b=fivGjshbj7BQ2mF6q9rLYaw3jfXk0hLJszrxfK0cYF9eR5MzqZCCuzRUZaO7LohKeg
 YwzvgzBK+ObQQStYqU0nGErCPsj8I/0sdElghdVlDq0J+42+TgMcwlFwoj5jpGtRr6Yt
 C+zl9JXa+D0FW1kV01f/HXBxZpH++d20wfcv14/Wf4ki2gTAvcAnJ2Gt+FPD0VZwlaRg
 W564BuEvWx0pDnEqoTQ7K0ZwkcbxTmQtYbh32o/yhqyHlFG58yX3DG5ivYW5b/ppQS4U
 obqJNoIf17/JRTIoJzPlCmixw8q1BIZMAgdON85WJCXqhKWZ1ZR2riPfFXjpKx8cBi+N
 KECQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20221208; t=1683471923; x=1686063923;
 h=content-transfer-encoding:mime-version:user-agent:message-id
 :in-reply-to:date:references:subject:cc:to:from:x-gm-message-state
 :from:to:cc:subject:date:message-id:reply-to;
 bh=9AaU+t7x4MzjNjVUZovIAquiYe4ruo7WXBEUa3xWbzY=;
 b=H+AJGBIZ1saBrTH3gpJPolZljLde28AlH60UWXQiXUQcz5bJnwYWECMANeiZXX0Jms
 4JCrOR0Q+Tl/E/SPdJ4KLHRiBqsjzpABrCvqWbxzDmtMHKSZwbjTbr6j0aKU3mIYkyYc
 b8ThZUctE10sp9RlmhWkPBFYsXjiYj5u3l27PzbCwpReLgaHX5qU9EWKB75xrh9FVJMJ
 aO+xkCMm6IAngNm5CtmEyMuOvN5w3T2fS+E1EAFGdbZkvBED4SVqGAlU9MtVpW0yy0JD
 o4NfjkGKeYwK2tQOBGS+XPbAynAsNE+1yoK064dojNNMEx3uDosOJs9hjLGuWZb0JCSN
 vMsA==
X-Gm-Message-State: AC+VfDz/tOoyrKWtgSHk3kx0asFJuR6DKVLK5qFugxW3XNrMYhDMZbO4
 EyKiWqRInfP2/kQN+vw79/cT1JIebjKmqQ==
X-Google-Smtp-Source: ACHHUZ5vOljwVm6wxWAOm/+51Vuo8FUNxLJ8Ynm+8lyTKlS5guOSoFo9k6zPD8sAIVE3G1Zybnm78w==
X-Received: by 2002:ad4:5f8e:0:b0:616:5460:aafd with SMTP id
 jp14-20020ad45f8e000000b006165460aafdmr12035183qvb.3.1683471923239; 
 Sun, 07 May 2023 08:05:23 -0700 (PDT)
Received: from hurd (dsl-10-131-119.b2b2c.ca. [72.10.131.119])
 by smtp.gmail.com with ESMTPSA id
 o11-20020ad443cb000000b0061b63237be3sm2090808qvs.131.2023.05.07.08.05.22
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Sun, 07 May 2023 08:05:22 -0700 (PDT)
From: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: bug#62379: /gnu/store/.links filling the hard drive on foreign
 distro
References: <g3cedph6it4.fsf@HIDDEN> <87cz4eaxit.fsf@HIDDEN>
Date: Sun, 07 May 2023 11:05:21 -0400
In-Reply-To: <87cz4eaxit.fsf@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?=
 =?utf-8?Q?s?= message of "Sat, 08 Apr 2023 23:12:42 +0200")
Message-ID: <877ctk18su.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 62379-done
Cc: 62379-done <at> debbugs.gnu.org, Elias Kueny <elias.kueny@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi,

Ludovic Court=C3=A8s <ludo@HIDDEN> writes:

> Hi,
>
> Elias Kueny <elias.kueny@HIDDEN> skribis:
>
>> The problem is the size of /gnu/store/.links: after garbage collection
>> with "guix gc --delete-generations=3D1w", /gnu/store is 17.4 GB in
>> total, and /gnu/store/.links is 14.5 GB (344120 items, ranging from 93
>> MB to 4.1 kB each).
>
> This is expected: /gnu/store/.links contains hard links to other files
> in /gnu/store.  IOW /gnu/store/.links is a subset of the rest of
> /gnu/store, sharing the same inodes.
>
>> The garbage collector prints that "currently hard linking saves
>> 3717.77 MiB".  With a 40GB hard drive, the gnu store regularly fills
>> up all the available space if I'm not careful. I found from an old
>> issue (https://issues.guix.gnu.org/24937#1) that 10 millions links
>> should need around 700 MB, so this sounds like a bug.
>
> Note that the issue you mention was addressed to a large extent in 2021:
>
>   https://issues.guix.gnu.org/24937#20
>

Closing, as this is working as intended.  If you do not wish to use the
guix-daemon deduplication feature, you can provide it with the
'--disable-deduplication', with the caveat that your hard drive may be
filled even faster :-).

--=20
Thanks,
Maxim
Notification sent to Elias Kueny <elias.kueny@HIDDEN>:
bug acknowledged by developer. Full text available.
Reply sent to Maxim Cournoyer <maxim.cournoyer@HIDDEN>:
You have taken responsibility. Full text available.

Message received at 62379 <at> debbugs.gnu.org:


Received: (at 62379) by debbugs.gnu.org; 8 Apr 2023 21:12:59 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Apr 08 17:12:59 2023
Received: from localhost ([127.0.0.1]:59730 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1plFrn-0005Ac-HY
	for submit <at> debbugs.gnu.org; Sat, 08 Apr 2023 17:12:59 -0400
Received: from eggs.gnu.org ([209.51.188.92]:46104)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1plFrm-0005AQ-0o
 for 62379 <at> debbugs.gnu.org; Sat, 08 Apr 2023 17:12:58 -0400
Received: from fencepost.gnu.org ([2001:470:142:3::e])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <ludo@HIDDEN>)
 id 1plFrg-0002LU-Fe; Sat, 08 Apr 2023 17:12:52 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
 s=fencepost-gnu-org; h=MIME-Version:In-Reply-To:Date:References:Subject:To:
 From; bh=Wwbcw5gszReAhr0+gxzPi4d/Gy+MVJV/m2NyUsQAAsQ=; b=GH39x9hy/gpA4Q6Nt6es
 2pOwZjWjvNAWFoWKvbyrp0cZ9HZpoMIwhHLQodyowZxdKqQ7jNdKoOm0bAIja7KYaKNtsk8FtT7yZ
 tfaXxZqKfWqm8ZxGh8BAXve5mhbRuKcnsDkLz28YNV7nJ4Il9YP/9OuqXHN43b1Wyxm9Y1GFCQgWZ
 179IAjiwhC8pdf9RbzBzMeyUYu1bVHXywlnnMUSP1LEUD5qDpODpTk9v2O0PqZGFYoCsexi/GC+fV
 wIsvkNBQ0ng73xAaxDSNELErBRFLGy+PiVnIWc9NT6fYNClifwys3bYje2QY6kriVl0OxFMwRB2JN
 qVxcJNShobRQWA==;
Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <ludo@HIDDEN>)
 id 1plFrY-0002eR-Iy; Sat, 08 Apr 2023 17:12:46 -0400
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: Elias Kueny <elias.kueny@HIDDEN>
Subject: Re: bug#62379: /gnu/store/.links filling the hard drive on foreign
 distro
References: <g3cedph6it4.fsf@HIDDEN>
Date: Sat, 08 Apr 2023 23:12:42 +0200
In-Reply-To: <g3cedph6it4.fsf@HIDDEN> (Elias Kueny's message
 of "Wed, 22 Mar 2023 10:48:04 +0000")
Message-ID: <87cz4eaxit.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/28.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 62379
Cc: 62379 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Hi,

Elias Kueny <elias.kueny@HIDDEN> skribis:

> The problem is the size of /gnu/store/.links: after garbage collection
> with "guix gc --delete-generations=3D1w", /gnu/store is 17.4 GB in
> total, and /gnu/store/.links is 14.5 GB (344120 items, ranging from 93
> MB to 4.1 kB each).

This is expected: /gnu/store/.links contains hard links to other files
in /gnu/store.  IOW /gnu/store/.links is a subset of the rest of
/gnu/store, sharing the same inodes.

> The garbage collector prints that "currently hard linking saves
> 3717.77 MiB".  With a 40GB hard drive, the gnu store regularly fills
> up all the available space if I'm not careful. I found from an old
> issue (https://issues.guix.gnu.org/24937#1) that 10 millions links
> should need around 700 MB, so this sounds like a bug.

Note that the issue you mention was addressed to a large extent in 2021:

  https://issues.guix.gnu.org/24937#20

HTH!

Ludo=E2=80=99.
Information forwarded to bug-guix@HIDDEN:
bug#62379; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 22 Mar 2023 13:02:14 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Mar 22 09:02:14 2023
Received: from localhost ([127.0.0.1]:33811 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1pey6Y-0005bq-EC
	for submit <at> debbugs.gnu.org; Wed, 22 Mar 2023 09:02:14 -0400
Received: from lists.gnu.org ([209.51.188.17]:34290)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <elias.kueny@HIDDEN>) id 1pey6W-0005bi-Np
 for submit <at> debbugs.gnu.org; Wed, 22 Mar 2023 09:02:13 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10])
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <elias.kueny@HIDDEN>)
 id 1pey6R-0008O2-Sv
 for bug-guix@HIDDEN; Wed, 22 Mar 2023 09:02:10 -0400
Received: from mout02.posteo.de ([185.67.36.66])
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <elias.kueny@HIDDEN>)
 id 1pey6O-0002aY-Oe
 for bug-guix@HIDDEN; Wed, 22 Mar 2023 09:02:06 -0400
Received: from submission (posteo.de [185.67.36.169]) 
 by mout02.posteo.de (Postfix) with ESMTPS id 4E293240147
 for <bug-guix@HIDDEN>; Wed, 22 Mar 2023 14:02:01 +0100 (CET)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=posteo.net; s=2017;
 t=1679490121; bh=IKf4CaoD0z7CqaRPWGJDcgx+OQj0w4Wkv2YMtBLmmX0=;
 h=From:To:Subject:Date:From;
 b=k+HoRK/wIeVVE4L8RIvKNkU8GEBRQyDY8kZFogySlamFI6pLxypN4StRB+4qS6XdZ
 6edoCOVE1oFIrNM3tIA8AD5tjFG3uoORnPipnpG/Nl7glnC4ePV6sOY1cUY8OSVG5y
 CDvisozQuv2cmsgRd89RrQ5pxD0FVbp2JaUnU/RawUro5VQL/KbnfPSSQJLuNPzGil
 +jacK4xGhx5inMEal1GZozwiTEgpG+Sp18kAJu/xEXeNJXxnvqOZ2sRYN6kUdl7xha
 nHj/JTuNhOv05xYSvDhQTzfqTzoqcB3MwmGtdXuJTLAdI1THeBp4TJPVeixTV6J3xV
 I3C05wMpwWhqQ==
Received: from customer (localhost [127.0.0.1])
 by submission (posteo.de) with ESMTPSA id 4PhTBw5LrSz6tmx
 for <bug-guix@HIDDEN>; Wed, 22 Mar 2023 14:02:00 +0100 (CET)
From: Elias Kueny <elias.kueny@HIDDEN>
To: bug-guix@HIDDEN
Subject: /gnu/store/.links filling the hard drive on foreign distro
Date: Wed, 22 Mar 2023 10:48:04 +0000
Message-ID: <g3cedph6it4.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; format=flowed
Received-SPF: pass client-ip=185.67.36.66; envelope-from=elias.kueny@HIDDEN;
 helo=mout02.posteo.de
X-Spam_score_int: -43
X-Spam_score: -4.4
X-Spam_bar: ----
X-Spam_report: (-4.4 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,
 RCVD_IN_DNSWL_MED=-2.3, RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.3 (-)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)

Hello,

I'm using guix over a foreign distro (Ubuntu 22.04). I initially installed guix from the Ubuntu repositories (version 1.3.0-4), and updated as user with guix pull (work computer: I don't have root access to run the installer script).

The problem is the size of /gnu/store/.links: after garbage collection with "guix gc --delete-generations=1w", /gnu/store is 17.4 GB in total, and /gnu/store/.links is 14.5 GB (344120 items, ranging from 93 MB to 4.1 kB each). The garbage collector prints that "currently hard linking saves 3717.77 MiB".
With a 40GB hard drive, the gnu store regularly fills up all the available space if I'm not careful. I found from an old issue (https://issues.guix.gnu.org/24937#1) that 10 millions links should need around 700 MB, so this sounds like a bug.

After garbage collection, there are only 16 profiles left in /var/guix/profiles/per-user/ for my account: 2 for current-guix, 2 for guix-profile, and the rest for guix-home (where almost every program is installed), plus one guix shell profile I keep activated during gc to not uninstall it. I can't check for the root account, but I'm guessing it contains only the profile of the initial guix installation. There are no other users.

I tried uninstalling the original guix from the Ubuntu repositories in case the issue is due to some interference between it and the current guix I pulled as user, but /var/guix/daemon-socket/socket was gone with it, so I couldn't try to run the garbage collection.

Elias
Acknowledgement sent to Elias Kueny <elias.kueny@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#62379; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Sun, 7 May 2023 15:15:01 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.