GNU bug report logs - #48462
Corrupt, un-repairable store after power cut during upgrade

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Reported by: elaexuotee@HIDDEN; dated Sun, 16 May 2021 08:59:01 UTC; Maintainer for guix is bug-guix@HIDDEN.

Message received at 48462 <at> debbugs.gnu.org:


Received: (at 48462) by debbugs.gnu.org; 23 Oct 2021 07:49:27 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Oct 23 03:49:27 2021
Received: from localhost ([127.0.0.1]:34288 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1meBmQ-00055z-NN
	for submit <at> debbugs.gnu.org; Sat, 23 Oct 2021 03:49:26 -0400
Received: from mail-wm1-f66.google.com ([209.85.128.66]:55838)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <liliana.prikler@HIDDEN>) id 1meBmO-00055m-Ka
 for 48462 <at> debbugs.gnu.org; Sat, 23 Oct 2021 03:49:25 -0400
Received: by mail-wm1-f66.google.com with SMTP id v127so5063630wme.5
 for <48462 <at> debbugs.gnu.org>; Sat, 23 Oct 2021 00:49:24 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112;
 h=message-id:subject:from:to:date:in-reply-to:references:user-agent
 :mime-version:content-transfer-encoding;
 bh=+hpjqECBcmvrp8hqPsCyFcAJ2BT0A5uP6Zmv4Y1Ru0w=;
 b=N98YMSxfEXg6fg/7Apy6jCJeArjM4ZopiUU+Uoaa8rDXLWG2jWgXJGTxhE5XTTWza2
 0hrxVwF25zmDuxacuqC6LBAAK9T/XiadW2qMNmUdqhvBCeM1VgYh2LN582HyFHHYUibf
 unf1jbfLDCFrrR+b2RLaXwDuVXfnp3Z+x0G1GYE2ybzcPtFK7tAY1QnWtyh/dCWMrSts
 zPG/yp7IF5G4PXSs6yjAqD2Jaz+/BJFZ8OUbQP3qRkZanfWWmVKLzE90WXwb8jE4PScb
 12LxOedv9CCjzzNUNxwwiHs1li0pLztg89B649aRTD6atc3EOvtlH4JfI0UwpHoczehk
 SQuw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20210112;
 h=x-gm-message-state:message-id:subject:from:to:date:in-reply-to
 :references:user-agent:mime-version:content-transfer-encoding;
 bh=+hpjqECBcmvrp8hqPsCyFcAJ2BT0A5uP6Zmv4Y1Ru0w=;
 b=klbeebH7mcDcR02rA4dO2DtIdvRf+UuT3L5XRt8R0q8OcQOwj56/I4yPGz2Duzuegd
 lc5kma8ImTAKD/L8c40oY6T5L3+b+tqUNS959/zHxKtK5NYdoaXjob9FtGLjLJdKP0s3
 UeB4oc/IctEFCUFpjKBJaajcvnXvGcw5oi6cP4f9K4n23WtBYumZAQgHoMDjRhfbeZpn
 SbWFT1BOAVPondEWH2f1RdZczL9H6UboZ6vhXx7u+hgsDZ5s7PzdJJHhK0sC8ZORCVQA
 WaJzLAkcO+aPLSgojpSc5xoM8Q9OEKAyoo9V2H83EBa0y6HL6C+gx0vPgPjM7PKuwZTj
 OqDA==
X-Gm-Message-State: AOAM532ikk//4U2QW/k6xLRuE7UekWCZmxJM940dMAPCWCtlECjZW8kf
 /OWXHyyvlNreLoVPb6NzRwY=
X-Google-Smtp-Source: ABdhPJzp/W0E/I4YJB9h0Um5r1ztTagag8Y0sT8BYXwHPUodln88TcHYlyxlPnU6G6bEJybt1fmhuA==
X-Received: by 2002:a7b:ce08:: with SMTP id m8mr34968543wmc.93.1634975358712; 
 Sat, 23 Oct 2021 00:49:18 -0700 (PDT)
Received: from nijino.fritz.box (85-127-52-93.dsl.dynamic.surfer.at.
 [85.127.52.93])
 by smtp.gmail.com with ESMTPSA id l40sm11253901wms.31.2021.10.23.00.49.17
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Sat, 23 Oct 2021 00:49:18 -0700 (PDT)
Message-ID: <182fe7e6dbcdfedce51c77efc56e35e45da817a6.camel@HIDDEN>
Subject: Re: Corrupt, un-repairable store after power cut during upgrade
From: Liliana Marie Prikler <liliana.prikler@HIDDEN>
To: elaexuotee@HIDDEN, 48462 <at> debbugs.gnu.org
Date: Sat, 23 Oct 2021 09:49:16 +0200
In-Reply-To: <3OE5JSDGIIX2D.3SOQ0QIKI7XZR@HIDDEN>
References: <3OE5JSDGIIX2D.3SOQ0QIKI7XZR@HIDDEN>
Content-Type: text/plain; charset="UTF-8"
User-Agent: Evolution 3.34.2 
MIME-Version: 1.0
Content-Transfer-Encoding: 8bit
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 48462
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi Guix,

Am Sonntag, den 16.05.2021, 17:59 +0900 schrieb elaexuotee@HIDDEN:
> Hey Guix,
> 
> Recently, during in the middle of a `guix package -m
> .guix/manifest.scm`, my
> machine had power failure. After rebotting, I simply reran the above
> and it completed without error.
> 
> However, it appears that some of files in the store items are
> corrupt:
> 
> [...]
> As an extra bit of annoyance, the handy verify and repair tools fail
> to see a problem:
> 
> [...]
> 
> Some questions:
> 
>   1) Am I just missing something obvious?
>   2) How could grafting end up producing empty files in the output?
>   3) Is the store supposed to be robust against power failures?
After dealing with some softer issues related to power outage during
`guix package', I think I'm now able to say that Guix does not process
grafts correctly during repair.

What happened for me, was that certain store files were empty and when
they were later grafted, those empty files were carried over.  Guix,
upon repairing the store, did then not regraft those, but rather kept
them as-is.  I have since fixed said issue by manually deleting the
graft and rebuilding (this was possible, because nothing referred to it
– I'm not sure why `guix gc' didn't pick it up as dead earlier,
though).  Stuff in my profiles seem to also have been rebuilt after
roll-back+gc.

So I think content repair needs to have at least two steps:
1. checking and repairing all "normal" derivations.
2. fixing grafts of packages that were repaired in step 1.

WDYT?





Information forwarded to bug-guix@HIDDEN:
bug#48462; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 16 May 2021 08:58:50 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sun May 16 04:58:50 2021
Received: from localhost ([127.0.0.1]:49698 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1liCbq-0002Nd-6K
	for submit <at> debbugs.gnu.org; Sun, 16 May 2021 04:58:50 -0400
Received: from lists.gnu.org ([209.51.188.17]:40160)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <bounce+7434c3.08547a-bug-guix=gnu.org@HIDDEN>)
 id 1liCbo-0002NW-BC
 for submit <at> debbugs.gnu.org; Sun, 16 May 2021 04:58:48 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:34714)
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1)
 (envelope-from <bounce+7434c3.08547a-bug-guix=gnu.org@HIDDEN>)
 id 1liCbo-0004aD-2I
 for bug-guix@HIDDEN; Sun, 16 May 2021 04:58:48 -0400
Received: from m42-5.mailgun.net ([69.72.42.5]:40279)
 by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128)
 (Exim 4.90_1)
 (envelope-from <bounce+7434c3.08547a-bug-guix=gnu.org@HIDDEN>)
 id 1liCbl-0002Gv-Rx
 for bug-guix@HIDDEN; Sun, 16 May 2021 04:58:47 -0400
DKIM-Signature: a=rsa-sha256; v=1; c=relaxed/relaxed; d=mg.wilsonb.com;
 q=dns/txt; 
 s=krs; t=1621155522; h=Content-Transfer-Encoding: Content-Type:
 MIME-Version: Message-Id: Subject: From: To: Date: Sender;
 bh=D5tGMTdC20H5SqzcDajopFKoQfz6TR/jQGLaZdRQmzo=;
 b=dG/AWD1wkUxGmez0wasDN/HAgiVdu7HTxZ5c5MXf72GEcPrTspzPV8ckbTmMjtHJz1un1LLo
 7TVdRak9mCxhCiZN2lhzEpNQaopE4vYtWj9rIbSj8b2ee34GU+od2y/sUwFfT7guifQWw6q/
 jw4JIcsprdMS0DAJLCqe576BPgykV+weFmHU+c21aubxub7oBQZSdAwXkhXsobFlK0j/2RWc
 Y5X5vrPs/R+ZfoIaR+7yKWup+L6GpOWbaLxZ5yYEPblPDlq/b4SjZEvnUyJpjEyV6g1ou0K5
 E6NZC4VpYqHyR8DVpAZ1g5z79Kmr9lSRGD2iy4Bg54xbhlo4E7ht2w==
X-Mailgun-Sending-Ip: 69.72.42.5
X-Mailgun-Sid: WyJkMDM0YyIsICJidWctZ3VpeEBnbnUub3JnIiwgIjA4NTQ3YSJd
Received: from wilsonb.com (wilsonb.com [104.199.203.42]) by
 smtp-out-n01.prod.us-east-1.postgun.com with SMTP id
 60a0deb7ac38d679b3a300e9 (version=TLS1.3, cipher=TLS_AES_128_GCM_SHA256);
 Sun, 16 May 2021 08:58:31 GMT
Received: from localhost (x111210.dynamic.ppp.asahi-net.or.jp
 [122.249.111.210])
 by wilsonb.com (Postfix) with ESMTPSA id 65622A2F81
 for <bug-guix@HIDDEN>; Sun, 16 May 2021 08:58:27 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=wilsonb.com;
 s=201703; t=1621155508;
 bh=D5tGMTdC20H5SqzcDajopFKoQfz6TR/jQGLaZdRQmzo=;
 h=Date:To:From:Subject:From;
 b=SoQiv0sc/L9X5ImWvgB3QiAYtsWJ2Q7pKW3U+GIZXeAuzsAWURJWHf3xKtkkgi9rX
 dsFnXjOIIZtsK7IlabtIzuxVBF4Gjy3xh/rO19DLKDG/4wudZJdvftIMAfN81NZUC7
 Q2dmskdE+UbZx1MpkUactMQ2GouAmX3Z1U1V9yIfEfHLwBkK1fv2/7UXrgy0S1d1kN
 W5aGa4D0moCgiwqfZ4XEhdnhiHtN5JyBtlKmeD6RqQjDuaI5yb1jXc3DUPdkhRXmpR
 6Ybd5SRWl7BYLt/Q3oyLntvGfUu4MDbc960fCxxYW+XWNztRCqJW+O92gXYTYXbDX/
 iFBqdJ6/XDif7wE57oihlYIwU2KQWqlQmVQsRsAaCDcjMBcloVe9E5EHruQCnRjRT2
 A9qSqEkh3yGu6UdyvNYnL+WfNQ5GUi0Bo1nokjhRpbw2uKATKSKjUrjBIQ78jeQMw9
 PATjobhW72j5DwZDb5SrehrhoISBlbgv3CKGPkrBetza3pVc54hiMFAGRVf+4iGpi5
 L8qLmgj1MhAMEbNn0VoVq7QEanbH5wZ3UEtUeCfd1OJ4XSuBL5MSmrFnvkKjRUMxSr
 qVndIk6fExyPn/cd8groY8+WRkPgJBC3JGc6k2JPpvv/H60x7c/kOOz6PNr6iLAQKS
 zac/chuVXitkkpRaf8L/4Q64=
Date: Sun, 16 May 2021 17:59:57 +0900
To: bug-guix@HIDDEN
From: elaexuotee@HIDDEN
Subject: Corrupt, un-repairable store after power cut during upgrade
Message-Id: <3OE5JSDGIIX2D.3SOQ0QIKI7XZR@HIDDEN>
User-Agent: mblaze/1.1
MIME-Version: 1.0
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=69.72.42.5;
 envelope-from=bounce+7434c3.08547a-bug-guix=gnu.org@HIDDEN;
 helo=m42-5.mailgun.net
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1,
 RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.3 (-)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)

Hey Guix,

Recently, during in the middle of a `guix package -m .guix/manifest.scm`, m=
y
machine had power failure. After rebotting, I simply reran the above and
it completed without error.

However, it appears that some of files in the store items are corrupt:

    $ vim
    vim: error while loading shared libraries: /gnu/store/6z2g9ybl3fkx6bdfg=
226mz8rpc0g53jx-gtk+-2.24.32/lib/libgdk-x11-2.0.so.0: file too short

    $ file -L /gnu/store/6z2g9ybl3fkx6bdfg226mz8rpc0g53jx-gtk+-2.24.32/lib/=
libgdk-x11-2.0.so.0
    /gnu/store/6z2g9ybl3fkx6bdfg226mz8rpc0g53jx-gtk+-2.24.32/lib/libgdk-x11=
-2.0.so.0: empty

As an extra bit of annoyance, the handy verify and repair tools fail to see=
 a
problem:

    $ command -v vim | xargs readlink -f
    /gnu/store/h9q2fik60axj9sai5b66cjk2sfl37ij1-vim-full-8.2.2689/bin/vim

    $ sudo guix build --repair vim-full
    /gnu/store/h9q2fik60axj9sai5b66cjk2sfl37ij1-vim-full-8.2.2689

    $ sudo guix build --repair --no-grafts vim-full
    path `/gnu/store/73p5rzka1cb9dx9fy059lmkf1jg6sv95-gtk+-2.24.32' is corr=
upted or missing!
    found corrupted or missing path `/gnu/store/73p5rzka1cb9dx9fy059lmkf1jg=
6sv95-gtk+-2.24.32' in the output closure of `/gnu/store/qyp10sss1ascp70ysh=
s87zdzr1lg71f8-vim-full-8.2.2689.drv'
    substituting /gnu/store/73p5rzka1cb9dx9fy059lmkf1jg6sv95-gtk+-2.24.32..=
=2E
    downloading from https://mirror.brielmaier.net/nar/lzip/73p5rzka1cb9dx9=
fy059lmkf1jg6sv95-gtk%2B-2.24.32 ...
     gtk%2B-2.24.32  6.4MiB          152KiB/s 00:43 [##################] 10=
0.0%

    /gnu/store/d21m63am0pxw77883h0y1jmy9iiazvvx-vim-full-8.2.2689

    $ sudo guix gc --verify=3Drepair,contents
    ...

    $ vim
    vim: error while loading shared libraries: /gnu/store/6z2g9ybl3fkx6bdfg=
226mz8rpc0g53jx-gtk+-2.24.32/lib/libgdk-x11-2.0.so.0: file too short

Even going in with a crude hammer doesn't fix things:

    $ sudo mount -o rw,remount /gnu/store

    $ sudo mv /gnu/store/6z2g9ybl3fkx6bdfg226mz8rpc0g53jx-gtk+-2.24.32 .

    $ sudo guix build --repair vim-full
    path `/gnu/store/6z2g9ybl3fkx6bdfg226mz8rpc0g53jx-gtk+-2.24.32' is corr=
upted or missing!
    found corrupted or missing path `/gnu/store/6z2g9ybl3fkx6bdfg226mz8rpc0=
g53jx-gtk+-2.24.32' in the output closure of `/gnu/store/z2q3zna20cn32if3v2=
71x4xavd70ml5z-vim-full-8.2.2689.drv'
    path `/gnu/store/73p5rzka1cb9dx9fy059lmkf1jg6sv95-gtk+-2.24.32' is corr=
upted or missing!
    substituting /gnu/store/73p5rzka1cb9dx9fy059lmkf1jg6sv95-gtk+-2.24.32..=
=2E
    downloading from https://mirror.brielmaier.net/nar/lzip/73p5rzka1cb9dx9=
fy059lmkf1jg6sv95-gtk%2B-2.24.32 ...
     gtk%2B-2.24.32  6.4MiB          134KiB/s 00:49 [##################] 10=
0.0%

    applying 17 grafts for /gnu/store/lm9xqz82q4cwlqs79i0pq77z6cfsx3rw-gtk+=
-2.24.32.drv ...
    grafting '/gnu/store/73p5rzka1cb9dx9fy059lmkf1jg6sv95-gtk+-2.24.32' -> =
'/gnu/store/6z2g9ybl3fkx6bdfg226mz8rpc0g53jx-gtk+-2.24.32'...
    successfully built /gnu/store/lm9xqz82q4cwlqs79i0pq77z6cfsx3rw-gtk+-2.2=
4.32.drv
    gnu/store/h9q2fik60axj9sai5b66cjk2sfl37ij1-vim-full-8.2.2689

    $ vim
    vim: error while loading shared libraries: /gnu/store/6z2g9ybl3fkx6bdfg=
226mz8rpc0g53jx-gtk+-2.24.32/lib/libgdk-x11-2.0.so.0: file too short

It seems like the above graft is going badly:

    $ file -L /gnu/store/73p5rzka1cb9dx9fy059lmkf1jg6sv95-gtk+-2.24.32/lib/=
libgtk-x11-2.0.so.0
    /gnu/store/73p5rzka1cb9dx9fy059lmkf1jg6sv95-gtk+-2.24.32/lib/libgtk-x11=
-2.0.so.0: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), statical=
ly linked, not stripped

    $ file -L /gnu/store/6z2g9ybl3fkx6bdfg226mz8rpc0g53jx-gtk+-2.24.32/lib/=
libgdk-x11-2.0.so.0
    /gnu/store/6z2g9ybl3fkx6bdfg226mz8rpc0g53jx-gtk+-2.24.32/lib/libgdk-x11=
-2.0.so.0: empty

Some questions:

  1) Am I just missing something obvious?
  2) How could grafting end up producing empty files in the output?
  3) Is the store supposed to be robust against power failures?




Acknowledgement sent to elaexuotee@HIDDEN:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#48462; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Sat, 23 Oct 2021 08:00:01 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.