GNU bug report logs - #57838
failing to boot, probably due to guix gc

Previous Next

Package: guix;

Reported by: Attila Lendvai <attila <at> lendvai.name>

Date: Thu, 15 Sep 2022 19:46:01 UTC

Severity: normal

Done: Attila Lendvai <attila <at> lendvai.name>

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 57838 in the body.
You can then email your comments to 57838 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to bug-guix <at> gnu.org:
bug#57838; Package guix. (Thu, 15 Sep 2022 19:46:02 GMT) Full text and rfc822 format available.

Acknowledgement sent to Attila Lendvai <attila <at> lendvai.name>:
New bug report received and forwarded. Copy sent to bug-guix <at> gnu.org. (Thu, 15 Sep 2022 19:46:02 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Attila Lendvai <attila <at> lendvai.name>
To: "bug-guix <at> gnu.org" <bug-guix <at> gnu.org>
Subject: failing to boot, probably due to guix gc
Date: Thu, 15 Sep 2022 19:44:38 +0000
[Message part 1 (text/plain, inline)]
dear Guixers,

on one of my installs i ran the following two commands as root:

guix gc --delete-generations=60d
guix system delete-generations 60d

i think i ran a reboot pretty soon after this, and the machine is failing to boot with the error "no code for module (ice-9 popen)".

i'm attaching a photo of the kernel panic screen.

the delete-generations left 3 generations, but all the three fail the same way.

i'll keep the machine as-is for a while if some inspection would help by providing logs/data. i also want to fix it and have it running soonish, so let me know if there's anything valuable i should extract from it before attempting to fix it. i hope a chroot and a reconfigure will fix it.

i think i ran the commands multiple times with different time ranges, and in different order.

i did something similar on another install, but IIRC i also ran a `guix system reconfigure` prior to the reboot, and that install didn't break.

HTH,

-- 
• attila lendvai
• PGP: 963F 5D5F 45C7 DFCD 0A39
--
“Politicians never accuse you of 'greed' for wanting other people's money - only for wanting to keep your own money.”
	— Joseph Sobran (1946–2010)
[kernelpanic.png (image/png, attachment)]

Information forwarded to bug-guix <at> gnu.org:
bug#57838; Package guix. (Fri, 16 Sep 2022 19:45:01 GMT) Full text and rfc822 format available.

Message #8 received at 57838 <at> debbugs.gnu.org (full text, mbox):

From: Attila Lendvai <attila <at> lendvai.name>
To: "57838 <at> debbugs.gnu.org" <57838 <at> debbugs.gnu.org>
Subject: (No Subject)
Date: Fri, 16 Sep 2022 19:44:27 +0000
i have fixed it by running a reconfigure in a chroot.

surprisingly, this has also fixed the old, previously broken system generations, not only the newly created one.

maybe some boot related references are not traversed while GC'ing?

-- 
• attila lendvai
• PGP: 963F 5D5F 45C7 DFCD 0A39
--
If you expect the world to be fair with you because you are fair, you're fooling yourself. Stop bitching about the lion, and get busy learning how not to get eaten.





Information forwarded to bug-guix <at> gnu.org:
bug#57838; Package guix. (Mon, 19 Sep 2022 19:32:01 GMT) Full text and rfc822 format available.

Message #11 received at 57838 <at> debbugs.gnu.org (full text, mbox):

From: Josselin Poiret <dev <at> jpoiret.xyz>
To: Attila Lendvai <attila <at> lendvai.name>, "57838 <at> debbugs.gnu.org"
 <57838 <at> debbugs.gnu.org>
Subject: Re: bug#57838: (No Subject)
Date: Mon, 19 Sep 2022 21:31:31 +0200
Hi Attila,
Attila Lendvai <attila <at> lendvai.name> writes:

> i have fixed it by running a reconfigure in a chroot.
>
> surprisingly, this has also fixed the old, previously broken system generations, not only the newly created one.
>
> maybe some boot related references are not traversed while GC'ing?

I just checked a couple of things on my own system generation:
* the boot script execl's shepherd, which specifies the (full) guile
  interpreter as a full path in the shebang line;
* that guile interpreter does contain the (ice-9 popen) module;
* that same guile interpreter does appear as a requisite of the system
  generation, so shouldn't be gc'd as long as it's a gc root.

I've got no clue :(

-- 
Josselin Poiret




Information forwarded to bug-guix <at> gnu.org:
bug#57838; Package guix. (Sat, 24 Sep 2022 01:44:01 GMT) Full text and rfc822 format available.

Message #14 received at 57838 <at> debbugs.gnu.org (full text, mbox):

From: Maxime Devos <maximedevos <at> telenet.be>
To: Attila Lendvai <attila <at> lendvai.name>, 57838 <at> debbugs.gnu.org
Subject: Re: bug#57838: failing to boot, probably due to guix gc
Date: Sat, 24 Sep 2022 03:43:26 +0200
[Message part 1 (text/plain, inline)]
For these kind of errors, I think I've an idea what's the cause in 
<https://issues.guix.gnu.org/58035>.


On 15-09-2022 21:44, Attila Lendvai wrote:
> dear Guixers,
> 
> on one of my installs i ran the following two commands as root:
> 
> guix gc --delete-generations=60d
> guix system delete-generations 60d
> 
> i think i ran a reboot pretty soon after this, and the machine is failing to boot with the error "no code for module (ice-9 popen)".

How did you reboot?  Maybe whatever rebooting mechanism you use doesn't 
do 'sync' first or doesn't wait for 'sync' to complete.

To test the hypothesis that there is store corruption, could you do 
"guix gc --verify=contents" (assuming there are some old system 
generations you can boot from)?

Greetings,
Maxime.
[OpenPGP_0x49E3EE22191725EE.asc (application/pgp-keys, attachment)]
[OpenPGP_signature (application/pgp-signature, attachment)]

Information forwarded to bug-guix <at> gnu.org:
bug#57838; Package guix. (Sun, 25 Sep 2022 16:33:01 GMT) Full text and rfc822 format available.

Message #17 received at 57838 <at> debbugs.gnu.org (full text, mbox):

From: Attila Lendvai <attila <at> lendvai.name>
To: Maxime Devos <maximedevos <at> telenet.be>
Cc: 57838 <at> debbugs.gnu.org
Subject: Re: bug#57838: failing to boot, probably due to guix gc
Date: Sun, 25 Sep 2022 16:31:45 +0000
> > on one of my installs i ran the following two commands as root:
> > 
> > guix gc --delete-generations=60d
> > guix system delete-generations 60d
> > 
> > i think i ran a reboot pretty soon after this, and the machine is failing to boot with the error "no code for module (ice-9 popen)".
> 
> 
> How did you reboot? Maybe whatever rebooting mechanism you use doesn't
> do 'sync' first or doesn't wait for 'sync' to complete.


i'm pretty sure i have issued a `reboot` in an ssh session.


> To test the hypothesis that there is store corruption, could you do
> "guix gc --verify=contents" (assuming there are some old system
> generations you can boot from)?


as i have explained in an earlier mail, all my old generations (3 remained after the GC) got broken, but they all got repaired by a subsequent reconfigure from a chroot. it has probably installed some files that were missing.

# guix gc --verify=contents
reading the store...
checking path existence...
checking hashes...
#

-- 
• attila lendvai
• PGP: 963F 5D5F 45C7 DFCD 0A39
--
“Self knowledge is always bad news.”
	— John Barth (1930–)





Information forwarded to bug-guix <at> gnu.org:
bug#57838; Package guix. (Sun, 18 Dec 2022 13:21:01 GMT) Full text and rfc822 format available.

Message #20 received at 57838 <at> debbugs.gnu.org (full text, mbox):

From: Attila Lendvai <attila <at> lendvai.name>
To: 57838 <at> debbugs.gnu.org
Date: Sun, 18 Dec 2022 13:19:41 +0000
close 57838
--

i just found out that this is a bug in that codebase that we don't
talk about here.

sorry about the noise!

https://gitlab.com/nonguix/nonguix/-/issues/111

-- 
• attila lendvai
• PGP: 963F 5D5F 45C7 DFCD 0A39
--
In the end, we only regret the chances we didn’t take, relationships
we were afraid to have, and the decisions we waited too long to make.




bug closed, send any further explanations to 57838 <at> debbugs.gnu.org and Attila Lendvai <attila <at> lendvai.name> Request was from Attila Lendvai <attila <at> lendvai.name> to control <at> debbugs.gnu.org. (Sun, 18 Dec 2022 13:47:02 GMT) Full text and rfc822 format available.

bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> debbugs.gnu.org. (Mon, 16 Jan 2023 12:24:05 GMT) Full text and rfc822 format available.

This bug report was last modified 1 year and 73 days ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.