GNU bug report logs - #24028
Linux-libre kernel does not build deterministically

Previous Next

Package: guix;

Reported by: ludo <at> gnu.org (Ludovic Courtès)

Date: Tue, 19 Jul 2016 17:23:02 UTC

Severity: normal

Done: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 24028 in the body.
You can then email your comments to 24028 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to bug-guix <at> gnu.org:
bug#24028; Package guix. (Tue, 19 Jul 2016 17:23:02 GMT) Full text and rfc822 format available.

Acknowledgement sent to ludo <at> gnu.org (Ludovic Courtès):
New bug report received and forwarded. Copy sent to bug-guix <at> gnu.org. (Tue, 19 Jul 2016 17:23:02 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: bug-guix <at> gnu.org 
Subject: Linux-libre kernel does not build deterministically
Date: Tue, 19 Jul 2016 19:22:29 +0200
As of version 4.6.4, Linux-libre does not build reproducibly:

--8<---------------cut here---------------start------------->8---
$ guix challenge linux-libre
/gnu/store/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4 contents differ:
  local hash: 1py214sd42qcq8l429m4zf4aibp8rl68kpkrzqi1nn65vnbxsx11
  https://hydra.gnu.org/nar/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4: 19hsdsjy5i9nfc1g28s074znzimzhylgkdpwz435j301sn9pxxp9
$ wget -q -O - https://hydra.gnu.org/nar/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4 | bunzip2 | guix archive -x t
$ diff -ur --no-dereference /gnu/store/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4 /tmp/t
Binary files /gnu/store/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4/bzImage and /tmp/t/bzImage differ
--8<---------------cut here---------------end--------------->8---

Apparently people are working on it:
<https://wiki.debian.org/SameKernel>.

Ludo’.




Information forwarded to bug-guix <at> gnu.org:
bug#24028; Package guix. (Fri, 09 Oct 2020 21:18:01 GMT) Full text and rfc822 format available.

Message #8 received at 24028 <at> debbugs.gnu.org (full text, mbox):

From: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
To: ludo <at> gnu.org (Ludovic Courtès)
Cc: 24028 <at> debbugs.gnu.org
Subject: Re: bug#24028: Linux-libre kernel does not build deterministically
Date: Fri, 09 Oct 2020 17:17:03 -0400
Hello,

ludo <at> gnu.org (Ludovic Courtès) writes:

> As of version 4.6.4, Linux-libre does not build reproducibly:
>
> $ guix challenge linux-libre
> /gnu/store/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4 contents differ:
>   local hash: 1py214sd42qcq8l429m4zf4aibp8rl68kpkrzqi1nn65vnbxsx11
>   https://hydra.gnu.org/nar/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4: 19hsdsjy5i9nfc1g28s074znzimzhylgkdpwz435j301sn9pxxp9
> $ wget -q -O - https://hydra.gnu.org/nar/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4 | bunzip2 | guix archive -x t
> $ diff -ur --no-dereference /gnu/store/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4 /tmp/t
> Binary files /gnu/store/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4/bzImage and /tmp/t/bzImage differ
>
> Apparently people are working on it:
> <https://wiki.debian.org/SameKernel>.
>
> Ludo’.

I just tested with linux-libre 5.8.10, and it still suffers from
reproducibility problems, but only for one file:

--8<---------------cut here---------------start------------->8---
diff -r /gnu/store/jc1dydmax5sdfljpi5mq5dhq9wdr92xy-linux-libre-5.8.10{,-check}
Binary files /gnu/store/jc1dydmax5sdfljpi5mq5dhq9wdr92xy-linux-libre-5.8.10/bzImage and /gnu/store/jc1dydmax5sdfljpi5mq5dhq9wdr92xy-linux-libre-5.8.10-check/bzImage differ
--8<---------------cut here---------------end--------------->8---

So, we're not far!

Maxim




Information forwarded to bug-guix <at> gnu.org:
bug#24028; Package guix. (Mon, 17 May 2021 18:49:01 GMT) Full text and rfc822 format available.

Message #11 received at 24028 <at> debbugs.gnu.org (full text, mbox):

From: Bone Baboon <bone.baboon <at> disroot.org>
To: 24028 <at> debbugs.gnu.org
Subject: Re: Linux-libre kernel does not build deterministically
Date: Mon, 17 May 2021 14:38:11 -0400
[Message part 1 (text/plain, inline)]
Linux-libre is not reproducible.

`guix describe` outputs:

```
Generation 24   May 12 2021 18:06:24    (current)
  guix d6aeebb
    repository URL: https://git.savannah.gnu.org/git/guix.git
    branch: master
    commit: d6aeebb23639258311fdfb9dbf5f903079fde51a
```

`guix challenge
/gnu/store/k029d836d3slh3s5k20306zvnph5ggq4-linux-libre-5.11.16`
outputs:

```
/gnu/store/k029d836d3slh3s5k20306zvnph5ggq4-linux-libre-5.11.16 contents differ:
  local hash: 1xkzhdkqbnh1prryz2bbbz1fsydsb9srhzpj27mpx1dv47fq2r05
  https://ci.guix.gnu.org/nar/zstd/k029d836d3slh3s5k20306zvnph5ggq4-linux-libre-5.11.16: 0w8n65xr91g9kiwik8kf8h1jn1scwfjcbwwnqbrfiyv8k7gr8kql
  differing file:
    /bzImage

1 store items were analyzed:
  - 0 (0.0%) were identical
  - 1 (100.0%) differed
  - 0 (0.0%) were inconclusive
```

`guix challenge
/gnu/store/rcav1xxn4ajkbnkmrnl6jr5d1zb20kq1-linux-libre-5.11.14`
outputs:

```
/gnu/store/rcav1xxn4ajkbnkmrnl6jr5d1zb20kq1-linux-libre-5.11.14 contents differ:
  local hash: 1z2v884l98ysl0vass4dchwfpavnk47x8brcx8h31qp3bj1xyhaz
  https://ci.guix.gnu.org/nar/zstd/rcav1xxn4ajkbnkmrnl6jr5d1zb20kq1-linux-libre-5.11.14: 1nlmjamm0yc2mjwdy0rq7qplilrwz1b8zm4m688kra21xqx09aar
differing file:
    /bzImage

1 store items were analyzed:
  - 0 (0.0%) were identical
  - 1 (100.0%) differed
  - 0 (0.0%) were inconclusive
```

Attached is the diffoscope output.
[diffoscope-linux-libre-5.11.14.txt.lz (application/octet-stream, attachment)]
[diffoscope-linux-libre-5.11.16.txt.lz (application/octet-stream, attachment)]

Information forwarded to bug-guix <at> gnu.org:
bug#24028; Package guix. (Tue, 14 Sep 2021 14:19:01 GMT) Full text and rfc822 format available.

Message #14 received at 24028 <at> debbugs.gnu.org (full text, mbox):

From: zimoun <zimon.toutoune <at> gmail.com>
To: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
Cc: Ludovic Courtès <ludo <at> gnu.org>, 24028 <at> debbugs.gnu.org
Subject: Re: bug#24028: Linux-libre kernel does not build deterministically
Date: Tue, 14 Sep 2021 13:59:38 +0200
Hi,

On Fri, 09 Oct 2020 at 17:17, Maxim Cournoyer <maxim.cournoyer <at> gmail.com> wrote:
> ludo <at> gnu.org (Ludovic Courtès) writes:
>
>> As of version 4.6.4, Linux-libre does not build reproducibly:
>>
>> $ guix challenge linux-libre
>> /gnu/store/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4 contents differ:
>>   local hash: 1py214sd42qcq8l429m4zf4aibp8rl68kpkrzqi1nn65vnbxsx11
>>   https://hydra.gnu.org/nar/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4:
>> 19hsdsjy5i9nfc1g28s074znzimzhylgkdpwz435j301sn9pxxp9
>> $ wget -q -O -
>> https://hydra.gnu.org/nar/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4
>> | bunzip2 | guix archive -x t
>> $ diff -ur --no-dereference /gnu/store/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4 /tmp/t
>> Binary files /gnu/store/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4/bzImage and /tmp/t/bzImage differ
>>
>> Apparently people are working on it:
>> <https://wiki.debian.org/SameKernel>.
>
> I just tested with linux-libre 5.8.10, and it still suffers from
> reproducibility problems, but only for one file:
>
> diff -r /gnu/store/jc1dydmax5sdfljpi5mq5dhq9wdr92xy-linux-libre-5.8.10{,-check}
> Binary files /gnu/store/jc1dydmax5sdfljpi5mq5dhq9wdr92xy-linux-libre-5.8.10/bzImage and /gnu/store/jc1dydmax5sdfljpi5mq5dhq9wdr92xy-linux-libre-5.8.10-check/bzImage differ

Still the same issue with 5.13.15.

diff -r --no-dereference /gnu/store/y9r7physjpa23znb7r6rg38wpmxrkp0s-linux-libre-5.13.15{,-check}
Binary files /gnu/store/y9r7physjpa23znb7r6rg38wpmxrkp0s-linux-libre-5.13.15/bzImage and /gnu/store/y9r7physjpa23znb7r6rg38wpmxrkp0s-linux-libre-5.13.15-check/bzImage differ


All the best,
simon




Reply sent to Maxim Cournoyer <maxim.cournoyer <at> gmail.com>:
You have taken responsibility. (Sun, 21 Nov 2021 14:13:01 GMT) Full text and rfc822 format available.

Notification sent to ludo <at> gnu.org (Ludovic Courtès):
bug acknowledged by developer. (Sun, 21 Nov 2021 14:13:02 GMT) Full text and rfc822 format available.

Message #19 received at 24028-done <at> debbugs.gnu.org (full text, mbox):

From: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
To: zimoun <zimon.toutoune <at> gmail.com>
Cc: 24028-done <at> debbugs.gnu.org, Ludovic Courtès <ludo <at> gnu.org>
Subject: Re: bug#24028: Linux-libre kernel does not build deterministically
Date: Sun, 21 Nov 2021 09:12:34 -0500
Hello,

zimoun <zimon.toutoune <at> gmail.com> writes:

> Hi,
>
> On Fri, 09 Oct 2020 at 17:17, Maxim Cournoyer <maxim.cournoyer <at> gmail.com> wrote:
>> ludo <at> gnu.org (Ludovic Courtès) writes:
>>
>>> As of version 4.6.4, Linux-libre does not build reproducibly:
>>>
>>> $ guix challenge linux-libre
>>> /gnu/store/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4 contents differ:
>>>   local hash: 1py214sd42qcq8l429m4zf4aibp8rl68kpkrzqi1nn65vnbxsx11
>>>   https://hydra.gnu.org/nar/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4:
>>> 19hsdsjy5i9nfc1g28s074znzimzhylgkdpwz435j301sn9pxxp9
>>> $ wget -q -O -
>>> https://hydra.gnu.org/nar/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4
>>> | bunzip2 | guix archive -x t
>>> $ diff -ur --no-dereference /gnu/store/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4 /tmp/t
>>> Binary files /gnu/store/wkdnd1dcgljr0jxmd3li8j0qsr2zwrci-linux-libre-4.6.4/bzImage and /tmp/t/bzImage differ
>>>
>>> Apparently people are working on it:
>>> <https://wiki.debian.org/SameKernel>.
>>
>> I just tested with linux-libre 5.8.10, and it still suffers from
>> reproducibility problems, but only for one file:
>>
>> diff -r /gnu/store/jc1dydmax5sdfljpi5mq5dhq9wdr92xy-linux-libre-5.8.10{,-check}
>> Binary files /gnu/store/jc1dydmax5sdfljpi5mq5dhq9wdr92xy-linux-libre-5.8.10/bzImage and /gnu/store/jc1dydmax5sdfljpi5mq5dhq9wdr92xy-linux-libre-5.8.10-check/bzImage differ
>
> Still the same issue with 5.13.15.
>
> diff -r --no-dereference /gnu/store/y9r7physjpa23znb7r6rg38wpmxrkp0s-linux-libre-5.13.15{,-check}
> Binary files /gnu/store/y9r7physjpa23znb7r6rg38wpmxrkp0s-linux-libre-5.13.15/bzImage and /gnu/store/y9r7physjpa23znb7r6rg38wpmxrkp0s-linux-libre-5.13.15-check/bzImage differ

Fixed in 01ea70a29c on core-updates-frozen, after taking hints from
https://lwn.net/Articles/841624/.

Thanks,

Closing.

Maxim




bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> debbugs.gnu.org. (Mon, 20 Dec 2021 12:24:10 GMT) Full text and rfc822 format available.

This bug report was last modified 2 years and 89 days ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.