GNU bug report logs - #35621
Simplify comparing guix challenge results

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 35621 in the body.
You can then email your comments to 35621 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Vagrant Cascadian <vagrant <at> reproducible-builds.org>
To: bug-guix <at> gnu.org
Subject: Simplify comparing guix challenge results
Date: Tue, 07 May 2019 11:02:05 -0700

[Message part 1 (text/plain, inline)]

I'd like to see a simpler process for comparing challenge results
producing differences.

While the manual documents how to compare a failing challenge result

  $ wget -q -O - https://ci.guix.info/nar/…-git-2.5.0 \
     | guix archive -x /tmp/git
  $ diff -ur --no-dereference /gnu/store/…-git.2.5.0 /tmp/git

To check "git", you need to run "guix challenge git" and if the results
are inconclusive, manually cut-and-paste the correct URL(s) from the
challenge output and manually download it and unpack with guix archive,
and then run a comparison utility...

What about an argument to "guix challenge" that handles the downloading
and unpacking to a temporary directory, and possibly another that also
runs a comparison tool against the results. Maybe something like:

  $ guix challenge --download-differences
  /tmp/git-XXXXX/SUBSTITTE-X/...-git-2.5.0
  /tmp/git-XXXXX/SUBSTITUTE-Y/...-git-2.5.0
  /gnu/store/...-git-2.5.0

Downloads and unpacks the substitutes, and outputs the resulting
directories.


  $ guix challenge --download-differences --compare-with="diffoscope ..."

This would do the above, plus run diffoscope on the directories
... though I think diffoscope can only compare between two things at a
time... so that might get difficult if many substitutes return results.


live well,
  vagrant

[signature.asc (application/pgp-signature, inline)]

Message #8 received at 35621 <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: Vagrant Cascadian <vagrant <at> reproducible-builds.org>
Cc: 35621 <at> debbugs.gnu.org
Subject: Re: bug#35621: Simplify comparing guix challenge results
Date: Wed, 08 May 2019 15:04:31 +0200

Hi!

Vagrant Cascadian <vagrant <at> reproducible-builds.org> skribis:

> What about an argument to "guix challenge" that handles the downloading
> and unpacking to a temporary directory, and possibly another that also
> runs a comparison tool against the results. Maybe something like:
>
>   $ guix challenge --download-differences
>   /tmp/git-XXXXX/SUBSTITTE-X/...-git-2.5.0
>   /tmp/git-XXXXX/SUBSTITUTE-Y/...-git-2.5.0
>   /gnu/store/...-git-2.5.0
>
> Downloads and unpacks the substitutes, and outputs the resulting
> directories.
>
>
>   $ guix challenge --download-differences --compare-with="diffoscope ..."
>
> This would do the above, plus run diffoscope on the directories
> ... though I think diffoscope can only compare between two things at a
> time... so that might get difficult if many substitutes return results.

Sounds like a good idea.  Perhaps ‘--compare-with’ is actually enough
(it would also download things), dunno.

Ludo’.

Message #11 received at 35621 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: 35621 <at> debbugs.gnu.org, Vagrant Cascadian <vagrant <at> reproducible-builds.org>
Subject: Re: bug#35621: Simplify comparing guix challenge results
Date: Wed, 08 May 2019 22:28:46 +0200

Ludovic Courtès <ludo <at> gnu.org> writes:

> Hi!
>
> Vagrant Cascadian <vagrant <at> reproducible-builds.org> skribis:
>
>> What about an argument to "guix challenge" that handles the downloading
>> and unpacking to a temporary directory, and possibly another that also
>> runs a comparison tool against the results. Maybe something like:
>>
>>   $ guix challenge --download-differences
>>   /tmp/git-XXXXX/SUBSTITTE-X/...-git-2.5.0
>>   /tmp/git-XXXXX/SUBSTITUTE-Y/...-git-2.5.0
>>   /gnu/store/...-git-2.5.0
>>
>> Downloads and unpacks the substitutes, and outputs the resulting
>> directories.
>>
>>
>>   $ guix challenge --download-differences --compare-with="diffoscope ..."
>>
>> This would do the above, plus run diffoscope on the directories
>> ... though I think diffoscope can only compare between two things at a
>> time... so that might get difficult if many substitutes return results.
>
> Sounds like a good idea.  Perhaps ‘--compare-with’ is actually enough
> (it would also download things), dunno.

I think it’s fine to have just “--compare-with”, which would print the
location of the downloaded things, so you could compare with “echo” if
all you wanted is to get the differences.

--
Ricardo

Message #14 received at 35621 <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: Vagrant Cascadian <vagrant <at> reproducible-builds.org>
Cc: 35621 <at> debbugs.gnu.org, 38518 <at> debbugs.gnu.org
Subject: Re: bug#35621: Simplify comparing guix challenge results
Date: Mon, 09 Dec 2019 12:02:42 +0100

Hello!

Vagrant Cascadian <vagrant <at> reproducible-builds.org> skribis:

> I'd like to see a simpler process for comparing challenge results
> producing differences.
>
> While the manual documents how to compare a failing challenge result
>
>   $ wget -q -O - https://ci.guix.info/nar/…-git-2.5.0 \
>      | guix archive -x /tmp/git
>   $ diff -ur --no-dereference /gnu/store/…-git.2.5.0 /tmp/git
>
> To check "git", you need to run "guix challenge git" and if the results
> are inconclusive, manually cut-and-paste the correct URL(s) from the
> challenge output and manually download it and unpack with guix archive,
> and then run a comparison utility...
>
> What about an argument to "guix challenge" that handles the downloading
> and unpacking to a temporary directory, and possibly another that also
> runs a comparison tool against the results. Maybe something like:
>
>   $ guix challenge --download-differences
>   /tmp/git-XXXXX/SUBSTITTE-X/...-git-2.5.0
>   /tmp/git-XXXXX/SUBSTITUTE-Y/...-git-2.5.0
>   /gnu/store/...-git-2.5.0
>
> Downloads and unpacks the substitutes, and outputs the resulting
> directories.
>
>
>   $ guix challenge --download-differences --compare-with="diffoscope ..."

I had forgotten about this bug report (thanks for the reminder on IRC!)
and came up with something similar to/different from it:

  https://issues.guix.gnu.org/issue/38518

Let’s see whether we should adapt it!

Ludo’.

Message #19 received at 35621-done <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: 38518-done <at> debbugs.gnu.org, 35621-done <at> debbugs.gnu.org
Subject: Re: [bug#38518] [PATCH 0/7] 'guix challenge' can diff archives
 directly
Date: Thu, 12 Dec 2019 18:21:43 +0100

Hi,

Ludovic Courtès <ludo <at> gnu.org> skribis:

>   serialization: Add 'fold-archive'.
>   guix archive: Add '--list'.
>   challenge: Report the best narinfo URI.
>   serialization: Remove unused procedure.
>   progress: Add 'progress-report-port'.
>   challenge: Add "--diff".
>   challenge: Support "--diff=diffoscope".

Pushed!

Ludo’.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.