GNU bug report logs - #33586
"updating substitutes" spam

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 33586 in the body.
You can then email your comments to 33586 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Taylan Kammer <taylan.kammer <at> gmail.com>
To: bug-guix <at> gnu.org
Subject: "updating substitutes" spam
Date: Sun, 02 Dec 2018 14:09:17 +0100

A minor issue, but I wanted to create a bug-report for this to make
sure it's on the radar.

During updates, guix may print this message hundreds of times:

    substitute: updating substitutes from 'http://...' 100%

Repetitions of this message should probably be coalesced into a single
message.


- Taylan

Message #8 received at 33586 <at> debbugs.gnu.org (full text, mbox):

From: Ricardo Wurmus <rekado <at> elephly.net>
To: Taylan Kammer <taylan.kammer <at> gmail.com>
Cc: 33586 <at> debbugs.gnu.org
Subject: Re: bug#33586: "updating substitutes" spam
Date: Tue, 04 Dec 2018 08:00:30 +0100

Taylan Kammer <taylan.kammer <at> gmail.com> writes:

> A minor issue, but I wanted to create a bug-report for this to make
> sure it's on the radar.
>
> During updates, guix may print this message hundreds of times:
>
>     substitute: updating substitutes from 'http://...' 100%
>
> Repetitions of this message should probably be coalesced into a single
> message.

Each of these messages is for a different substitute query.  We are
currently not showing the query, so it looks like the same work is done
multiple times.

The substitute queries are executed at different times.  Coalescing the
messages would mean that the messages for previous queries are delayed
until the last query is performed.  This would not be good.

I don’t know if we can reorder the queries so that they all happen at
once.

--
Ricardo

Message #11 received at 33586 <at> debbugs.gnu.org (full text, mbox):

From: ludo <at> gnu.org (Ludovic Courtès)
To: Ricardo Wurmus <rekado <at> elephly.net>
Cc: 33586 <at> debbugs.gnu.org, Taylan Kammer <taylan.kammer <at> gmail.com>
Subject: Re: bug#33586: "updating substitutes" spam
Date: Tue, 04 Dec 2018 15:20:49 +0100

Ricardo Wurmus <rekado <at> elephly.net> skribis:

> Taylan Kammer <taylan.kammer <at> gmail.com> writes:
>
>> A minor issue, but I wanted to create a bug-report for this to make
>> sure it's on the radar.
>>
>> During updates, guix may print this message hundreds of times:
>>
>>     substitute: updating substitutes from 'http://...' 100%
>>
>> Repetitions of this message should probably be coalesced into a single
>> message.
>
> Each of these messages is for a different substitute query.  We are
> currently not showing the query, so it looks like the same work is done
> multiple times.
>
> The substitute queries are executed at different times.  Coalescing the
> messages would mean that the messages for previous queries are delayed
> until the last query is performed.  This would not be good.
>
> I don’t know if we can reorder the queries so that they all happen at
> once.

In the absence of grafts, the system is designed to perform all the
substitute queries at once (with HTTP pipelining and all.)  So you see
only one message.

However, the current implementation of grafts relies on substitutes
(when enabled) to determine whether a given package should be grafted.
Due to the way this is implemented, the resulted queries are not
coalesced, leading to these messages and, more importantly, poor network
usage (no pipelining, no connection reuse, etc.)

This is really a shortcoming of the current implementation of grafts,
much as discussed in <https://issues.guix.info/issue/28310>.

Thanks,
Ludo’.

Message #16 received at 33586-done <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: 33586-done <at> debbugs.gnu.org
Subject: Re: bug#33586: "updating substitutes" spam
Date: Wed, 15 Jul 2020 00:17:50 +0200

Hi,

ludo <at> gnu.org (Ludovic Courtès) skribis:

> This is really a shortcoming of the current implementation of grafts,
> much as discussed in <https://issues.guix.info/issue/28310>.

This was fixed back in March:

  https://lists.gnu.org/archive/html/guix-devel/2020-03/msg00337.html
  https://guix.gnu.org/blog/2020/grafts-continued/

Ludo’.

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.