GNU bug report logs - #30875
Garbage collector may leave empty files

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Reported by: Marius Bakke <mbakke@HIDDEN>; dated Tue, 20 Mar 2018 11:22:01 UTC; Maintainer for guix is bug-guix@HIDDEN.

Message received at 30875 <at> debbugs.gnu.org:


Received: (at 30875) by debbugs.gnu.org; 21 Mar 2018 00:21:29 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Mar 20 20:21:29 2018
Received: from localhost ([127.0.0.1]:44434 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1eyRVQ-0008LG-Ur
	for submit <at> debbugs.gnu.org; Tue, 20 Mar 2018 20:21:29 -0400
Received: from world.peace.net ([50.252.239.5]:37480)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <mhw@HIDDEN>) id 1eyRVP-0008L3-5x
 for 30875 <at> debbugs.gnu.org; Tue, 20 Mar 2018 20:21:27 -0400
Received: from [172.16.1.2] (helo=jojen)
 by world.peace.net with esmtpsa (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.89) (envelope-from <mhw@HIDDEN>)
 id 1eyRVJ-0005X7-58; Tue, 20 Mar 2018 20:21:21 -0400
From: Mark H Weaver <mhw@HIDDEN>
To: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
Subject: Re: bug#30875: Garbage collector may leave empty files
References: <87muz3f0vz.fsf@HIDDEN> <87bmfiibti.fsf@HIDDEN>
Date: Tue, 20 Mar 2018 20:20:41 -0400
In-Reply-To: <87bmfiibti.fsf@HIDDEN> ("Ludovic
 \=\?utf-8\?Q\?Court\=C3\=A8s\=22'\?\=
 \=\?utf-8\?Q\?s\?\= message of "Wed, 21 Mar 2018 00:09:29 +0100")
Message-ID: <87fu4u46ue.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 30875
Cc: 30875 <at> debbugs.gnu.org, Marius Bakke <mbakke@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 0.0 (/)

ludo@HIDDEN (Ludovic Court=C3=A8s) writes:

> Marius Bakke <mbakke@HIDDEN> skribis:
>
>> Recently I've seen a couple of instances like these:
>>
>> exporting path `/gnu/store/mi1rbw8fdsbi4bc4pndbb6smq39722vm-baobab-3.26.=
1.tar.xz'
>> guix offload: error: build failed: hash of path
>> `/gnu/store/mi1rbw8fdsbi4bc4pndbb6smq39722vm-baobab-3.26.1.tar.xz'
>> has changed from
>> `4223b4813b2253e68ea2b824d0d0e284ff75714ad0faf5a33d65a78df6b65915'
>> to
>> `77ac62e2629d8e45f624589c0c8bf99e24b3a722349bf1e79bc186008534e246'!
>> cannot build derivation `/gnu/store/jbx6a4n1d55dpydr87d11m7xwapm3pcx-gno=
me-3.24.3.drv': 1 dependencies couldn't be built
>>
>> Without the build hook, it manifests as:
>>
>> starting phase `unpack'
>> tar: This does not look like a tar archive
>> xz: (stdin): File format not recognized
>> tar: Child returned status 1
>> tar: Error is not recoverable: exiting now
>>
>> There was another instance on help-guix recently with a user having
>> empty .drv files in the store.
>>
>> There is a bug lurking here somewhere, but I'm not sure where to start
>> looking.
>>
>> $ find /gnu/store/ -maxdepth 1 -size 0 | grep -v '\.lock$' | wc -l
>> 24
>
> Are we sure this is a Guix issue and not a disk or file system
> corruption issue?  The relevant code in guix-daemon hasn=E2=80=99t change=
d in
> ages.
>
> What file system are you using?  Btrfs?  :-)

The ext[234] filesystems are well known for leaving zero-length files
around after a crash.  So far, I've never seen Btrfs do that, and I
wouldn't expect it to based on its design.  That's partly why I switched
to it.

      Mark




Information forwarded to bug-guix@HIDDEN:
bug#30875; Package guix. Full text available.

Message received at 30875 <at> debbugs.gnu.org:


Received: (at 30875) by debbugs.gnu.org; 20 Mar 2018 23:09:33 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Mar 20 19:09:33 2018
Received: from localhost ([127.0.0.1]:44371 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1eyQNp-0004jm-9o
	for submit <at> debbugs.gnu.org; Tue, 20 Mar 2018 19:09:33 -0400
Received: from hera.aquilenet.fr ([185.233.100.1]:46608)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1eyQNn-0004jd-7p
 for 30875 <at> debbugs.gnu.org; Tue, 20 Mar 2018 19:09:31 -0400
Received: from localhost (localhost [127.0.0.1])
 by hera.aquilenet.fr (Postfix) with ESMTP id CE94212723;
 Wed, 21 Mar 2018 00:09:30 +0100 (CET)
X-Virus-Scanned: Debian amavisd-new at aquilenet.fr
Received: from hera.aquilenet.fr ([127.0.0.1])
 by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id 9FgstqO5_jco; Wed, 21 Mar 2018 00:09:29 +0100 (CET)
Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465])
 by hera.aquilenet.fr (Postfix) with ESMTPSA id A5C2B12721;
 Wed, 21 Mar 2018 00:09:29 +0100 (CET)
From: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
To: Marius Bakke <mbakke@HIDDEN>
Subject: Re: bug#30875: Garbage collector may leave empty files
References: <87muz3f0vz.fsf@HIDDEN>
Date: Wed, 21 Mar 2018 00:09:29 +0100
In-Reply-To: <87muz3f0vz.fsf@HIDDEN> (Marius Bakke's message of "Tue, 20
 Mar 2018 12:21:36 +0100")
Message-ID: <87bmfiibti.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: 30875
Cc: 30875 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 1.0 (+)

Hello,

Marius Bakke <mbakke@HIDDEN> skribis:

> Recently I've seen a couple of instances like these:
>
> exporting path `/gnu/store/mi1rbw8fdsbi4bc4pndbb6smq39722vm-baobab-3.26.1=
.tar.xz'
> guix offload: error: build failed: hash of path `/gnu/store/mi1rbw8fdsbi4=
bc4pndbb6smq39722vm-baobab-3.26.1.tar.xz' has changed from `4223b4813b2253e=
68ea2b824d0d0e284ff75714ad0faf5a33d65a78df6b65915' to `77ac62e2629d8e45f624=
589c0c8bf99e24b3a722349bf1e79bc186008534e246'!
> cannot build derivation `/gnu/store/jbx6a4n1d55dpydr87d11m7xwapm3pcx-gnom=
e-3.24.3.drv': 1 dependencies couldn't be built
>
> Without the build hook, it manifests as:
>
> starting phase `unpack'
> tar: This does not look like a tar archive
> xz: (stdin): File format not recognized
> tar: Child returned status 1
> tar: Error is not recoverable: exiting now
>
> There was another instance on help-guix recently with a user having
> empty .drv files in the store.
>
> There is a bug lurking here somewhere, but I'm not sure where to start
> looking.
>
> $ find /gnu/store/ -maxdepth 1 -size 0 | grep -v '\.lock$' | wc -l
> 24

Are we sure this is a Guix issue and not a disk or file system
corruption issue?  The relevant code in guix-daemon hasn=E2=80=99t changed =
in
ages.

What file system are you using?  Btrfs?  :-)

Thanks,
Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#30875; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 20 Mar 2018 11:21:54 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Mar 20 07:21:54 2018
Received: from localhost ([127.0.0.1]:42783 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1eyFL0-00056o-8y
	for submit <at> debbugs.gnu.org; Tue, 20 Mar 2018 07:21:54 -0400
Received: from eggs.gnu.org ([208.118.235.92]:59427)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <mbakke@HIDDEN>) id 1eyFKy-00056a-71
 for submit <at> debbugs.gnu.org; Tue, 20 Mar 2018 07:21:52 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <mbakke@HIDDEN>) id 1eyFKs-0003oR-8m
 for submit <at> debbugs.gnu.org; Tue, 20 Mar 2018 07:21:47 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM,
 T_DKIM_INVALID autolearn=disabled version=3.3.2
Received: from lists.gnu.org ([2001:4830:134:3::11]:60635)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <mbakke@HIDDEN>) id 1eyFKs-0003oD-55
 for submit <at> debbugs.gnu.org; Tue, 20 Mar 2018 07:21:46 -0400
Received: from eggs.gnu.org ([2001:4830:134:3::10]:50363)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <mbakke@HIDDEN>) id 1eyFKq-00086M-Pr
 for bug-guix@HIDDEN; Tue, 20 Mar 2018 07:21:45 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <mbakke@HIDDEN>) id 1eyFKm-0003hK-Of
 for bug-guix@HIDDEN; Tue, 20 Mar 2018 07:21:44 -0400
Received: from out5-smtp.messagingengine.com ([66.111.4.29]:53057)
 by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <mbakke@HIDDEN>) id 1eyFKm-0003h3-Ff
 for bug-guix@HIDDEN; Tue, 20 Mar 2018 07:21:40 -0400
Received: from compute5.internal (compute5.nyi.internal [10.202.2.45])
 by mailout.nyi.internal (Postfix) with ESMTP id E8F76212B4
 for <bug-guix@HIDDEN>; Tue, 20 Mar 2018 07:21:39 -0400 (EDT)
Received: from frontend2 ([10.202.2.161])
 by compute5.internal (MEProxy); Tue, 20 Mar 2018 07:21:39 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fastmail.com; h=
 content-type:date:from:message-id:mime-version:subject:to
 :x-me-sender:x-me-sender:x-sasl-enc; s=fm2; bh=WPOZwZCx0MEmuOj0B
 LDVFVz83ENxbIvmHSo8cqjLXsA=; b=nvS+/gGLoE2kMNvU/YY/0SueNCjFH9ZQg
 VdGoiz8qw/dVMaspAuEo1gG9R9XQSBCJ5KUkGtDWu0BQ4oYLNud9salVs/0ppXWg
 yu56fdUetFd9Sw+KNNBna3aIjO5bWzBQqqfRHHfPLkLqFpcalk3MHg4uwEYvg+wG
 iia5q/cKBUJffeRwCLS0/yPHnFKbIwmTR02Mfxg50CpePmUV8r5ZpMs/Zig7qExQ
 vUz5zKmHR5dnnsxI8scIpgYcVCq+31PZ4+YAEGfok1eeGD3IKuDGPyBxuys1HgiH
 A245n0+5uuz4pIioNN0CY52NEoLlWKERPxcvapaIjLZmNFMhHTRLw==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=content-type:date:from:message-id
 :mime-version:subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=
 fm2; bh=WPOZwZCx0MEmuOj0BLDVFVz83ENxbIvmHSo8cqjLXsA=; b=UfazjipD
 zTYaHoXdbBQcTomeOJ2Ykk1kDuBW0QBZ5UF5+FbiXNcZDhifN4xfs6ENqcq8/ArD
 L5bbv60lKTrg3UYmICucpmqQTT3ZsMOXF1gbh03S5UMSpbr2dWlKvkyCBMMgqdqc
 Cn8M/cVpahTwUaLwKow6+r/lXBFjeDIuj71v7DpDC4kFLiqhAfmDLeJKYAjd0ntH
 kP0Gi6IgFtL1uIycBWDVkpx5bSgrCwGtNR83AeQuVn8a34PZuwMPJw2QrZux2Mtj
 0mSpz3AxYWVbbMaUQ8e+Ac37hRbVLZFWS/ijfBCMBzmvGshii4iOCgP9NT1xNRlD
 +D0WgCmILOtWjQ==
X-ME-Sender: <xms:w-6wWh7aXU-4rw8ZDqNOt3mAWl6Zx3xwdsQAz9WrFaZ869bZs3E8SQ>
Received: from localhost (ti0019a400-2817.bb.online.no [88.90.102.17])
 by mail.messagingengine.com (Postfix) with ESMTPA id 7197824132
 for <bug-guix@HIDDEN>; Tue, 20 Mar 2018 07:21:39 -0400 (EDT)
From: Marius Bakke <mbakke@HIDDEN>
To: bug-guix@HIDDEN
Subject: Garbage collector may leave empty files
User-Agent: Notmuch/0.26 (https://notmuchmail.org) Emacs/25.3.1
 (x86_64-pc-linux-gnu)
Date: Tue, 20 Mar 2018 12:21:36 +0100
Message-ID: <87muz3f0vz.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
 micalg=pgp-sha512; protocol="application/pgp-signature"
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
 [fuzzy]
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x
X-Received-From: 2001:4830:134:3::11
X-Spam-Score: -4.4 (----)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -4.4 (----)

--=-=-=
Content-Type: text/plain

Hello,

Recently I've seen a couple of instances like these:

exporting path `/gnu/store/mi1rbw8fdsbi4bc4pndbb6smq39722vm-baobab-3.26.1.tar.xz'
guix offload: error: build failed: hash of path `/gnu/store/mi1rbw8fdsbi4bc4pndbb6smq39722vm-baobab-3.26.1.tar.xz' has changed from `4223b4813b2253e68ea2b824d0d0e284ff75714ad0faf5a33d65a78df6b65915' to `77ac62e2629d8e45f624589c0c8bf99e24b3a722349bf1e79bc186008534e246'!
cannot build derivation `/gnu/store/jbx6a4n1d55dpydr87d11m7xwapm3pcx-gnome-3.24.3.drv': 1 dependencies couldn't be built

Without the build hook, it manifests as:

starting phase `unpack'
tar: This does not look like a tar archive
xz: (stdin): File format not recognized
tar: Child returned status 1
tar: Error is not recoverable: exiting now

There was another instance on help-guix recently with a user having
empty .drv files in the store.

There is a bug lurking here somewhere, but I'm not sure where to start
looking.

$ find /gnu/store/ -maxdepth 1 -size 0 | grep -v '\.lock$' | wc -l
24

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQEzBAEBCgAdFiEEu7At3yzq9qgNHeZDoqBt8qM6VPoFAlqw7sAACgkQoqBt8qM6
VPqHIQf/cVrOzd4JJNmhSHnM19rUAqBdp/tFxD1OH3Ucohs13C3heWk4rDm4r+Aq
lv8Kb9v+OFxomtSgNSZNWhU97HBQtgwBIAd9AQ44yq3qt3CZu2l7KEdhcH8MPPyX
vugd6vZOZU3qF6mOx9IDDpHBX8B5pXvbNbttH0pEkb/9ZHd5prxUmbe5Zc7lLOG5
cxSi53L1cOmDZBgI3I8vIWcp0yBpobHfqAYwzoqepNitZHNhS9/l7/I5mQOmVQGa
kqSS6hSCb+CdvuI4sJA1kQ3s9u4SHqN7H9rDtaKJdqAsRJLm0uC2DuQCMUuLxkVC
Fx7VNy2bXc+pF8DjrdNKIcT3ajKjsA==
=+Csz
-----END PGP SIGNATURE-----
--=-=-=--




Acknowledgement sent to Marius Bakke <mbakke@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#30875; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Wed, 21 Mar 2018 00:30:01 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.