GNU logs - #48808, boring messages

Message sent to othacehe@HIDDEN, bug-guix@HIDDEN:

Subject: bug#48808: List of discovered substitute servers not refreshed?
Resent-From: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: othacehe@HIDDEN, bug-guix@HIDDEN
Resent-Date: Thu, 03 Jun 2021 10:09:02 +0000
Resent-Message-ID: <handler.48808.B.162271490310174 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: 48808 <at> debbugs.gnu.org
Cc: Mathieu Othacehe <othacehe@HIDDEN>
IronPort-HdrOrdr: A9a23:/rvFla1CTiPsS6L3wHKjrQqjBMckLtp133Aq2lEZdPU7SKClfqyV8cjzqyWbtN95YhhJ8uxoU5PufZqzz/RI3bU=
From: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>
Date: Thu, 03 Jun 2021 12:08:04 +0200
Message-ID: <87y2bruupn.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=192.134.164.83;
 envelope-from=ludovic.courtes@HIDDEN;
 helo=mail2-relais-roc.national.inria.fr
X-Spam_score_int: -41
X-Spam_score: -4.2
X-Spam_bar: ----
X-Spam_report: (-4.2 / 5.0 requ) BAYES_00=-1.9, RCVD_IN_DNSWL_MED=-2.3,
 RCVD_IN_MSPIKE_H2=-0.001, SPF_HELO_NONE=0.001,
 SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: -1.3 (-)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)

Hi!

I=E2=80=99ve turned on discovery and guix-daemon discovered the laptop next=
 to
me (yay!).  However, more than 10mn after said laptop has been turned
off, =E2=80=98guix substitute=E2=80=99 is still trying to connect to it.

The disconnected laptop is still listed in /var/guix/discover/publish.

It also shows up in =E2=80=98avahi-browse _guix_publish._tcp -r=E2=80=99, b=
ut it fails
to resolve:

--8<---------------cut here---------------start------------->8---
Failed to resolve service 'guix-publish-XYZ' of type '_guix_publish._tcp' i=
n domain 'local': Timeout reached
--8<---------------cut here---------------end--------------->8---

Perhaps (guix scripts discover) should not just wait for
=E2=80=98remove-service=E2=80=99 events but should also attempt to resolve =
them?

Or maybe the problem is that the TTL of the published entry is too long?
I cannot find how to change that in the Guile-Avahi API though.

Ludo=E2=80=99.

Message sent:

Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.505 (Entity 5.505)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Ludovic =?UTF-8?Q?Court=C3=A8s?= <ludovic.courtes@HIDDEN>
Subject: bug#48808: Acknowledgement (List of discovered substitute servers
 not refreshed?)
Message-ID: <handler.48808.B.162271490310174.ack <at> debbugs.gnu.org>
References: <87y2bruupn.fsf@HIDDEN>
X-Gnu-PR-Message: ack 48808
X-Gnu-PR-Package: guix
Reply-To: 48808 <at> debbugs.gnu.org
Date: Thu, 03 Jun 2021 10:09:02 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

As you requested using X-Debbugs-CC, your message was also forwarded to
  Mathieu Othacehe <othacehe@HIDDEN>
(after having been given a bug report number, if it did not have one).

Your message has been sent to the package maintainer(s):
 bug-guix@HIDDEN

If you wish to submit further information on this problem, please
send it to 48808 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
48808: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D48808
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems

Message received at control <at> debbugs.gnu.org:

Received: (at control) by debbugs.gnu.org; 4 Jun 2021 08:00:49 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Jun 04 04:00:49 2021
Received: from localhost ([127.0.0.1]:45237 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1lp4l6-00074y-Tk
	for submit <at> debbugs.gnu.org; Fri, 04 Jun 2021 04:00:49 -0400
Received: from eggs.gnu.org ([209.51.188.92]:60442)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <mathieu@HIDDEN>)
 id 1lp4l2-00074h-Ds
 for control <at> debbugs.gnu.org; Fri, 04 Jun 2021 04:00:46 -0400
Received: from fencepost.gnu.org ([2001:470:142:3::e]:59316)
 by eggs.gnu.org with esmtp (Exim 4.90_1)
 (envelope-from <mathieu@HIDDEN>)
 id 1lp4kx-000199-6M
 for control <at> debbugs.gnu.org; Fri, 04 Jun 2021 04:00:39 -0400
Received: from [2a01:e0a:19b:d9a0:f2f7:a404:c3d3:f8b4] (port=33694 helo=meije)
 by fencepost.gnu.org with esmtpsa
 (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1)
 (envelope-from <mathieu@HIDDEN>)
 id 1lp4ks-0006mx-79
 for control <at> debbugs.gnu.org; Fri, 04 Jun 2021 04:00:38 -0400
Date: Fri, 04 Jun 2021 10:00:33 +0200
Message-Id: <875yyuf49q.fsf@HIDDEN>
To: control <at> debbugs.gnu.org
From: Mathieu Othacehe
 <mathieu@HIDDEN>
Subject: control message for bug #48808
X-Spam-Score: -1.9 (-)
X-Debbugs-Envelope-To: control
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.9 (--)

merge 48808 45302
quit

Message received at control <at> debbugs.gnu.org:

Received: (at control) by debbugs.gnu.org; 11 Jan 2022 03:43:50 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 10 22:43:50 2022
Received: from localhost ([127.0.0.1]:53771 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1n784b-0008EQ-R1
	for submit <at> debbugs.gnu.org; Mon, 10 Jan 2022 22:43:50 -0500
Received: from mail-il1-f180.google.com ([209.85.166.180]:43916)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <maxim.cournoyer@HIDDEN>)
 id 1n784Y-0008E9-ID; Mon, 10 Jan 2022 22:43:48 -0500
Received: by mail-il1-f180.google.com with SMTP id d3so13288706ilr.10;
 Mon, 10 Jan 2022 19:43:46 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112;
 h=from:to:cc:subject:references:date:in-reply-to:message-id
 :user-agent:mime-version:content-transfer-encoding;
 bh=HyTnPKH+jIBOdAoS8b757xWDoqlRx56636WKJVPmQB8=;
 b=mfdYVFnistdFOFt2WmvCuWsgVjppGL5Uow/vPYFCHbvDzeAdTDfE7escfKUGmoMntn
 EewESSoOu4qZhNmU83y8yIGUoaXEuGll+N/I3uvF/BKUaR3M2PHd7Be1D53mQZUGkykh
 BOvpbMZ1AWsjvYCjRYh0KMM2B+ZUcaMNVe5fm+mvPzPQRASv83uRFU25M/HBPKPtWflw
 BhXlsqWIamZ2uDGm8t71Jwt6ubRVeq6OLTMDZ7CBJckBmIoK12kzXgGvduBU/L3DmanL
 iOOneNi4p8pPXWMZs5azoXm0c8GX3K2izrpzxDTj4HuXiXRzj5USA7jNnY+XVz96I+nV
 Fcbw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20210112;
 h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to
 :message-id:user-agent:mime-version:content-transfer-encoding;
 bh=HyTnPKH+jIBOdAoS8b757xWDoqlRx56636WKJVPmQB8=;
 b=p+xu0gfmRxEzovcg+bPEb+KSYbRElQteGYiUM/a9wRbsYq9zO/N4sPF4gW+9iVcJ7g
 hkq9biri//kEPKMmjszIoavzlMexmFgbAqEbzHR5BDokuQ6Mpnpdqa6uHhbDcUbRPdeh
 +Oatx2eQcfI2mNTdqYwHNMsu1JuNvTIyF0nn4aH5PwMWbgYYwDlh96qN3IftYGX2rk7O
 zKAEil52X3wiQSmivV436KlwHkrd95yPK8zoYenF9cUobEQTzVsvYzmVwAQVC/TbgCMh
 6aSZRFiFu7g9gC1WK72XRDQws9fhwtwCSO8UkRHIb7ZazMKuEqEwPK+GHfllb9WOWyGc
 Y3/w==
X-Gm-Message-State: AOAM5310R7mR/gc0zE9IuNE+dsNMmOubR47U2erAMVTd2wCIj4k5qGJi
 UPwLo7u6L7F5Ja2SkJ2nhrDm/lfMhdc=
X-Google-Smtp-Source: ABdhPJy8UqzbCCAISLcLZnaDkVAqgzRNuxz1N2AswDY1EKSF36+1VGNgO+ghPwhy2kacI4/VeTqb9A==
X-Received: by 2002:a05:6e02:15c4:: with SMTP id
 q4mr1489874ilu.133.1641872620685; 
 Mon, 10 Jan 2022 19:43:40 -0800 (PST)
Received: from hurd (dsl-205-151-56-104.b2b2c.ca. [205.151.56.104])
 by smtp.gmail.com with ESMTPSA id h23sm3465738ila.81.2022.01.10.19.43.39
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Mon, 10 Jan 2022 19:43:40 -0800 (PST)
From: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: bug#51472: substitute servers should be preferred according to
 their coverage rate
References: <87k0hwa8ic.fsf@HIDDEN> <874k8oknlj.fsf@HIDDEN>
Date: Mon, 10 Jan 2022 22:43:33 -0500
In-Reply-To: <874k8oknlj.fsf@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?=
 =?utf-8?Q?s?= message of "Sun, 07 Nov 2021 16:11:04 +0100")
Message-ID: <87pmozndi2.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: control
Cc: 51472 <at> debbugs.gnu.org, GNU Debbugs <control <at> debbugs.gnu.org>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

merge 48808 51472
thanks

Hello Ludovic,

Ludovic Court=C3=A8s <ludo@HIDDEN> writes:

> Hi,
>
> Maxim Cournoyer <maxim.cournoyer@HIDDEN> skribis:
>
>> When using substitute servers discovery, I've noticed that if one of the
>> substitute servers doesn't have any substitutes available, it'll keep
>> getting tried instead of others, leading to a slide-show of substitutes
>> updates such as:
>>
>> normalized load on machine '127.0.0.1' is 0.04
>> building /gnu/store/ajd0hx104702jpz2ycdwgrnyrv8jsp6d-xorg-server-21.1.0.=
tar.xz.drv...
>> process 9195 acquired build slot '/var/guix/offload/127.0.0.1:6666/1'
>> normalized load on machine '127.0.0.1' is 0.04
>> building /gnu/store/49rqi3wpvdm5pv6in9pamzdvg0wscrl8-xorgproto-2021.5.dr=
v...
>> substitute: updating substitutes from 'http://192.168.10.102:80'...   0.=
0%
>> substitute: updating substitutes from 'http://192.168.10.102:80'...   0.=
0%
>> substitute: updating substitutes from 'http://192.168.10.102:80'...   0.=
0%
>> substitute: updating substitutes from 'http://192.168.10.102:80'...   0.=
0%
>> substitute: updating substitutes from 'http://192.168.10.102:80'...   0.=
0%
>
> We=E2=80=99d need to check why this particular server is checked repeated=
ly.
> The fact that it displays =E2=80=9C0.0%=E2=80=9D doesn=E2=80=99t mean tha=
t the server lacks
> substitutes, but that it does not reply to =E2=80=98GET /xyz.narinfo=E2=
=80=99 requests,
> for example because it=E2=80=99s off-line (see
> <https://issues.guix.gnu.org/48808>.)
>
>> We should implement some scheme to prefer querying high-substitute
>> servers first, instead of wasting time querying servers always failed
>> queries; this would greatly improve performance when using substitute
>> discovery for example combined with low coverage.
>
> There are several problems with that.  First one is that you can=E2=80=99=
t tell
> what substitute coverage is until you=E2=80=99ve actually made those GET
> requests.  Second one is that substitute coverage varies and it=E2=80=99s=
 not an
> absolute measure; for example, if a server provides substitutes for only
> 0.1% of all the packages, but that=E2=80=99s precisely the 0.1% you care =
about,
> it=E2=80=99s more valuable than the one that has 99% of the packages but =
lacks
> those you want.
>
> There are other issues such as the fact that current semantics is to
> respect the order of substitute URLs, which is presumably chosen by the
> user according to their own criteria: download speed, bandwidth usage,
> etc.
>
> I hope this makes sense!

It does!  I agree that it'd be tricky to get this right; makes me
realize that my problem is probably due to #48808, and fixing that one
would probably have avoided that bug report :-).

I'm merging this one with 48808.

Thank you!

Maxim

Last modified: Tue, 11 Jan 2022 03:45:01 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.