GNU bug report logs - #30290
guix-daemon slows to a crawl when a substitute server is offline

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Reported by: Maxim Cournoyer <maxim.cournoyer@HIDDEN>; dated Tue, 30 Jan 2018 03:09:01 UTC; Maintainer for guix is bug-guix@HIDDEN.

Message received at 30290 <at> debbugs.gnu.org:


Received: (at 30290) by debbugs.gnu.org; 13 Jul 2021 09:02:16 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Jul 13 05:02:16 2021
Received: from localhost ([127.0.0.1]:39426 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1m3EIy-0004OH-3m
	for submit <at> debbugs.gnu.org; Tue, 13 Jul 2021 05:02:16 -0400
Received: from mail-wr1-f48.google.com ([209.85.221.48]:34339)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <zimon.toutoune@HIDDEN>) id 1m3EIw-0004Nl-Jj
 for 30290 <at> debbugs.gnu.org; Tue, 13 Jul 2021 05:02:15 -0400
Received: by mail-wr1-f48.google.com with SMTP id p8so29460551wrr.1
 for <30290 <at> debbugs.gnu.org>; Tue, 13 Jul 2021 02:02:14 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=from:to:cc:subject:references:date:in-reply-to:message-id
 :user-agent:mime-version:content-transfer-encoding;
 bh=cuSjQ7lN0u4sbvY9mm/0cT0mOIwf1d1iF5YwdgprEJw=;
 b=dVA2rNha8Xgl8r/+N32nnws6zfIMUXJR7Q+jInHtJjEBTfOIixuOuCTrn8g1uMD0BZ
 CnMeBrfMnX3AO/+/BDrojVNLLFJkoEi6tSWDensWgXRb8YlP9nNXAMcUrZlc3AHmo4H5
 L7Llopip9Y1RU+KOKFdBgbmmzE1oQSHEPlxudAotZ4sU711PEGwhFtBdB1g9iGx3/qwj
 se9f9jSLRzYmjQOqlVMlRwc+3+qh24FsWuSg+FT/yvPGI3OGqW88ndvNfF9tig750l6w
 Gp+N84tZdK8LnMVZMVHIqK5l+gUogctZnvus8p6tRS00SxwvehfR2NV+/S1BFWeFZnNl
 os1A==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to
 :message-id:user-agent:mime-version:content-transfer-encoding;
 bh=cuSjQ7lN0u4sbvY9mm/0cT0mOIwf1d1iF5YwdgprEJw=;
 b=X+3RT2+dcwHjK00Hi7+SSGQXKw6fLtMRtJ+k5dg1kirOMMv1T+xUzEepYkBWKYtJ1q
 gp0mhPEnO2mtVtsLQSWyYHFuhTtkpscYgzO/oHw+DQsK8tW32ou7YNqF4jklt3E4uO6E
 GojXRNqk30mwYmBDkHaHl4V7jac0H26SRs96vgXtG8vRRUdKbLJNUuLA94Uot3X7B5cj
 AOw8JOyZRoXB54dr7Ar57OAHEovvlouRqfPvy4hFfUYhd13oz0yTB5hskEUZzMpowzIx
 SuNlwGUdotDAWq6WPGIEfAk6flMMAY8H7RpvU05TaWSf/mKFphzNV0kFU1pshN7w8J84
 0ntw==
X-Gm-Message-State: AOAM531NVeBSYgNeMDgWb+6NbLkXPN3yKUXpVUlFwHpXJWgORFaMagJW
 P6tuu1506McHMdd9deSkDS77AFjAkao=
X-Google-Smtp-Source: ABdhPJxHmE+Tbo4eTg5lX/5uhDJQairYgi8um03heuBil3+iLW5jdO8SeS8hA/VSJ7whzNmvuMoSxw==
X-Received: by 2002:adf:f9c9:: with SMTP id w9mr4211032wrr.107.1626166929050; 
 Tue, 13 Jul 2021 02:02:09 -0700 (PDT)
Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e])
 by smtp.gmail.com with ESMTPSA id l39sm829488wms.1.2021.07.13.02.02.07
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Tue, 13 Jul 2021 02:02:08 -0700 (PDT)
From: zimoun <zimon.toutoune@HIDDEN>
To: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
Subject: Re: bug#30290: guix-daemon slows to a crawl when a substitute
 server is offline
References: <87fu6o2ge2.fsf@HIDDEN> <868s6cb4ji.fsf@HIDDEN>
 <86y2bilo26.fsf@HIDDEN>
Date: Tue, 13 Jul 2021 10:49:51 +0200
In-Reply-To: <86y2bilo26.fsf@HIDDEN> (zimoun's message of "Wed, 09 Jun 2021
 23:34:41 +0200")
Message-ID: <86wnpuoaxc.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 30290
Cc: Mathieu Othacehe <othacehe@HIDDEN>, 30290 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi,

What is the status of this old bug#30290 [1]?

1: <http://issues.guix.gnu.org/issue/30290>

On Wed, 09 Jun 2021 at 23:34, zimoun <zimon.toutoune@HIDDEN> wrote:
> On Wed, 24 Mar 2021 at 22:55, zimoun <zimon.toutoune@HIDDEN> wrote:
>> On Mon, 29 Jan 2018 at 22:07, Maxim Cournoyer <maxim.cournoyer@HIDDEN>
>> wrote:
>>> When a substitute server used by guix-daemon is offline, the daemon will
>>> keep attempting to connect to it, even when it shouldn't need any data
>>> (ran 'sudo guix system reconfigure my-config.scm' multiple times in a
>>> row.
>>>
>>> With the disconnected server (bayfront in my case), that command would
>>> take close to 8 minutes, with many system calls like:
>>>
>>> connect(14, {sa_family=3DAF_INET, sin_port=3Dhtons(443),
>>> sin_addr=3Dinet_addr("141.255.128.56")}, 16) =3D -1 EINPROGRESS
>>>
>>> which wasted 5 seconds each time.
>>>
>>> After removing this server from my substitute servers list, the same
>>> operation (system reconfigure) is 8 times faster (1 minute).
>>>
>>> Suggestion: the daemon should stop trying to use the offline substitute
>>> server after trying for X times, and print a warning about it.
>
> [...]
>
>> From: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
>> Date: Fri, 18 Dec 2020 22:04:04 -0500 (24 weeks, 4 days, 18 hours ago)
>>
>> I'm not sure if the recent offloading work that Mathieu did touched that
>> topic.  I'd need to test the scenario.  Perhaps a system test would be
>> useful.
>> ----------
>>
>> From: Ludovic Court=C3=A8s <ludo@HIDDEN>
>> Date: Tue, 22 Dec 2020 16:16:08 +0100
>> Date: Tue, 22 Dec 2020 16:16:08 +0100 (24 weeks, 1 day, 6 hours ago)
>>
>> Is it still a problem?  Commit 4f5234be0378368e6af25925db46612838d25e58
>> (Nov. 2019) added a table of unreachable hosts.  That way, a =E2=80=98gu=
ix
>> substitute --query=E2=80=99 process won=E2=80=99t retry connections to a=
n unreachable
>> host.
>> ----------
>>
>> From: Efraim Flashner <efraim@HIDDEN>
>> Date: Mon, 28 Dec 2020 14:19:02 +0200
>> Date: Mon, 28 Dec 2020 14:19:02 +0200 (23 weeks, 2 days, 9 hours ago)
>>
>> Occasionally my internet drops itself, and I find I'm left forever
>> waiting for a timeout to see what sources I have cached locally.
>> ----------
>
> What is the current stats of this bug?   Is it still happening with the
> recent improvements of Cuirass?

After reading all this, I think this bug can be closed.  WDYT?

Cheers,
simon




Information forwarded to bug-guix@HIDDEN:
bug#30290; Package guix. Full text available.

Message received at 30290 <at> debbugs.gnu.org:


Received: (at 30290) by debbugs.gnu.org; 9 Jun 2021 21:43:54 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Jun 09 17:43:53 2021
Received: from localhost ([127.0.0.1]:34800 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1lr5zN-0003Z6-Gk
	for submit <at> debbugs.gnu.org; Wed, 09 Jun 2021 17:43:53 -0400
Received: from mail-wm1-f54.google.com ([209.85.128.54]:45898)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <zimon.toutoune@HIDDEN>) id 1lr5zJ-0003Yk-KD
 for 30290 <at> debbugs.gnu.org; Wed, 09 Jun 2021 17:43:51 -0400
Received: by mail-wm1-f54.google.com with SMTP id
 v206-20020a1cded70000b02901a586d3fa23so5122124wmg.4
 for <30290 <at> debbugs.gnu.org>; Wed, 09 Jun 2021 14:43:49 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=from:to:cc:subject:references:date:in-reply-to:message-id
 :user-agent:mime-version:content-transfer-encoding;
 bh=UxHsHEt+SAL86OWzSp4gM+5EWgdjjEC/fsuWSFKmHz8=;
 b=LGrWRKNsKIvXs4rIz6W1GFjnN9iR0IP7/8++czCRCnFdbVFZMJf3myMf/iY2XolZue
 gd7HuQ2p6c6ku7F2CO9eQF+xUo9zW3dKHInvRwKrp7L1f0uCv+j7G+v/BbYj8SK9uZZL
 I/9wxJ5C4v1reKuxh4IR7u+kIB/4Em/J7w+pkMREQiy/O70LRyRuIa6PR4QiDnKTyGJm
 iDH3LUfAd6Rgvaw5lrPpnZNlXJofSxW8yl8+QmCsiVODbJjmn4Ht8ngyWR2pvvuD9FFS
 yaxE4AyM4qe95OkmfHXGRVnt+q9RSQh2RrDBBi7Eq8MfNi2T6m4emkkVTmxsXw/RKOeN
 fltA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to
 :message-id:user-agent:mime-version:content-transfer-encoding;
 bh=UxHsHEt+SAL86OWzSp4gM+5EWgdjjEC/fsuWSFKmHz8=;
 b=JnPzFNC3L7Rw/I9ZVvfbAKcI2Jg1meEsgjsq200H/u6gcUPYO939kt6AoFlZ9k33/i
 zb51mXWfBKo6jhOrS1rju2FudbxzxubH25ODPi1kL+pxv/yZk0wqtiSyOzwT24KsAZaH
 N2EWkm+93D+DCTY81K5Qr85I2foYgAcrgrphhyBj7sv45K7Wuz69Ec8trtBH2h2k1sLI
 T9ZLWySvldO2U1i3EBCvS4JBrp219PXJIBJRJ464xxLO2es73Oc0HhlfLBQEsedFsxLh
 n5FZ1pfhUDcFwLwjsRSDCCi8j5fY1RbgKmnEQvKndYc6rstZRbdnTSMWJTUeFygTdWBE
 ULHQ==
X-Gm-Message-State: AOAM530jM9nSEhkDLyUogAoBbmQundw+wEtvWqRsfj3TImfQAVGTD9UT
 e8zP5T1bQuRKIY/HYdyHcuqX3Be0RSo=
X-Google-Smtp-Source: ABdhPJxQou9nZXU0vy5mfszeDc9VvMbOXZCiS79d4BF72z2+SBUdjIdAcc0SfhzdaiD4OKwmK6+6YQ==
X-Received: by 2002:a1c:98d0:: with SMTP id a199mr11914498wme.22.1623275023800; 
 Wed, 09 Jun 2021 14:43:43 -0700 (PDT)
Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e])
 by smtp.gmail.com with ESMTPSA id j7sm1136495wrm.93.2021.06.09.14.43.42
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Wed, 09 Jun 2021 14:43:43 -0700 (PDT)
From: zimoun <zimon.toutoune@HIDDEN>
To: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
Subject: Re: bug#30290: guix-daemon slows to a crawl when a substitute
 server is offline
References: <87fu6o2ge2.fsf@HIDDEN> <868s6cb4ji.fsf@HIDDEN>
Date: Wed, 09 Jun 2021 23:34:41 +0200
In-Reply-To: <868s6cb4ji.fsf@HIDDEN> (zimoun's message of "Wed, 24 Mar 2021
 22:55:13 +0100")
Message-ID: <86y2bilo26.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 30290
Cc: Mathieu Othacehe <othacehe@HIDDEN>, 30290 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi,


On Wed, 24 Mar 2021 at 22:55, zimoun <zimon.toutoune@HIDDEN> wrote:
> On Mon, 29 Jan 2018 at 22:07, Maxim Cournoyer <maxim.cournoyer@HIDDEN>=
 wrote:
>> When a substitute server used by guix-daemon is offline, the daemon will
>> keep attempting to connect to it, even when it shouldn't need any data
>> (ran 'sudo guix system reconfigure my-config.scm' multiple times in a
>> row.
>>
>> With the disconnected server (bayfront in my case), that command would
>> take close to 8 minutes, with many system calls like:
>>
>> connect(14, {sa_family=3DAF_INET, sin_port=3Dhtons(443),
>> sin_addr=3Dinet_addr("141.255.128.56")}, 16) =3D -1 EINPROGRESS
>>
>> which wasted 5 seconds each time.
>>
>> After removing this server from my substitute servers list, the same
>> operation (system reconfigure) is 8 times faster (1 minute).
>>
>> Suggestion: the daemon should stop trying to use the offline substitute
>> server after trying for X times, and print a warning about it.

[...]

> From: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
> Date: Fri, 18 Dec 2020 22:04:04 -0500 (24 weeks, 4 days, 18 hours ago)
>
> I'm not sure if the recent offloading work that Mathieu did touched that
> topic.  I'd need to test the scenario.  Perhaps a system test would be
> useful.
> ----------
>
> From: Ludovic Court=C3=A8s <ludo@HIDDEN>
> Date: Tue, 22 Dec 2020 16:16:08 +0100
> Date: Tue, 22 Dec 2020 16:16:08 +0100 (24 weeks, 1 day, 6 hours ago)
>
> Is it still a problem?  Commit 4f5234be0378368e6af25925db46612838d25e58
> (Nov. 2019) added a table of unreachable hosts.  That way, a =E2=80=98guix
> substitute --query=E2=80=99 process won=E2=80=99t retry connections to an=
 unreachable
> host.
> ----------
>
> From: Efraim Flashner <efraim@HIDDEN>
> Date: Mon, 28 Dec 2020 14:19:02 +0200
> Date: Mon, 28 Dec 2020 14:19:02 +0200 (23 weeks, 2 days, 9 hours ago)
>
> Occasionally my internet drops itself, and I find I'm left forever
> waiting for a timeout to see what sources I have cached locally.
> ----------

What is the current stats of this bug?   Is it still happening with the
recent improvements of Cuirass?

Cheers,
simon




Information forwarded to bug-guix@HIDDEN:
bug#30290; Package guix. Full text available.

Message received at 30290 <at> debbugs.gnu.org:


Received: (at 30290) by debbugs.gnu.org; 24 Mar 2021 21:58:34 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Mar 24 17:58:34 2021
Received: from localhost ([127.0.0.1]:36276 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1lPBWM-0006J1-6C
	for submit <at> debbugs.gnu.org; Wed, 24 Mar 2021 17:58:34 -0400
Received: from mail-wm1-f52.google.com ([209.85.128.52]:40699)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <zimon.toutoune@HIDDEN>) id 1lPBWH-0006IT-MR
 for 30290 <at> debbugs.gnu.org; Wed, 24 Mar 2021 17:58:30 -0400
Received: by mail-wm1-f52.google.com with SMTP id
 y124-20020a1c32820000b029010c93864955so2017502wmy.5
 for <30290 <at> debbugs.gnu.org>; Wed, 24 Mar 2021 14:58:29 -0700 (PDT)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=from:to:cc:subject:references:date:in-reply-to:message-id
 :user-agent:mime-version:content-transfer-encoding;
 bh=phY8xc7EbJm6MstPaMvYf9sMFaEIhTgigQU3rIYOIHw=;
 b=c/CmF/R4oj6xt1ff0NgUo6V6UiOQsG2xu5Bztps+y7Ii6hAwH/eWhQNE16QqyogISB
 LvZfv0D002AIhCpTXSsKO9mO/h4eukqjSQJIVUQMlsMyt2qs7Mti/Tm8PqO9mAat6yPZ
 ul+wRqeATcX4RNCMZ4ViwmtFU+2OiblZN/7NjxbOhITvqxvgKJmwG8k3g/KeaCu3tzIb
 M2DrFKdVVbQ630qqbpp8JY+rS5yGTvdlFcru44Bd3/Uej0U3m3a8Pfv3O35asdfXkS8s
 Ye3msXD/yj7H9rFiyaN/VrhhowWzrzp6uCfZlz3KttlxAhHTTAPZEWf0JKJRD4QdyWSq
 fcHw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to
 :message-id:user-agent:mime-version:content-transfer-encoding;
 bh=phY8xc7EbJm6MstPaMvYf9sMFaEIhTgigQU3rIYOIHw=;
 b=Iikml5Bu5tTTgVIf9Y2jJbiHMkVPcZvlo0BA/tRDimuZaUD+PISXYIbU75iwVDL1I0
 buWKs+L8lTieAwSYZ3P7S8XZTu3rEehCOW82/e9CZA3sDDsc8KpwVHDGoHOa+g6RS4Cp
 TiE3ojO4zLYb44z47kYhxqXdOFKQQO0LmaGYzaVzNzmCXVXLBA3QunpXrQqTZj61FFxM
 Xn+3mAzPHV0AUXAIwS18zn2sIMHxKU5gtE6Ew9hKEtaFcaQuAVoRb/z88zdeZy3egNkU
 cuZU61Ogj10TgR1/jDbybt60HIYGYc/VW3JNRrRN0+aLA2nD1AfVGMkWD2AFudHFvbdo
 Kzpg==
X-Gm-Message-State: AOAM532zeQllQp65mhF8esRDHOeGhsbfPz8cIiCyRUU/035TksILDnuF
 anE5Hq5Qg3d+xslA8oZlCrX1DOQDq8M=
X-Google-Smtp-Source: ABdhPJySPgjnp2T1h/ke7WGeocpn9zdh7uZMeaBiYxO/1x9QnQVAs7wPcwxmEHQSrrZZvH5tglAsXQ==
X-Received: by 2002:a05:600c:1548:: with SMTP id
 f8mr4864462wmg.81.1616623104040; 
 Wed, 24 Mar 2021 14:58:24 -0700 (PDT)
Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e])
 by smtp.gmail.com with ESMTPSA id s3sm3830474wmd.21.2021.03.24.14.58.23
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Wed, 24 Mar 2021 14:58:23 -0700 (PDT)
From: zimoun <zimon.toutoune@HIDDEN>
To: Maxim Cournoyer <maxim.cournoyer@HIDDEN>, Mathieu Othacehe
 <othacehe@HIDDEN>
Subject: Re: bug#30290: guix-daemon slows to a crawl when a substitute
 server is offline
References: <87fu6o2ge2.fsf@HIDDEN>
Date: Wed, 24 Mar 2021 22:55:13 +0100
In-Reply-To: <87fu6o2ge2.fsf@HIDDEN> (Maxim Cournoyer's message of "Mon, 29
 Jan 2018 22:07:49 -0500")
Message-ID: <868s6cb4ji.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 30290
Cc: 30290 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi,

On Mon, 29 Jan 2018 at 22:07, Maxim Cournoyer <maxim.cournoyer@HIDDEN> w=
rote:
> When a substitute server used by guix-daemon is offline, the daemon will
> keep attempting to connect to it, even when it shouldn't need any data
> (ran 'sudo guix system reconfigure my-config.scm' multiple times in a
> row.
>
> With the disconnected server (bayfront in my case), that command would
> take close to 8 minutes, with many system calls like:
>
> connect(14, {sa_family=3DAF_INET, sin_port=3Dhtons(443), sin_addr=3Dinet_=
addr("141.255.128.56")}, 16) =3D -1 EINPROGRESS
>
> which wasted 5 seconds each time.
>
> After removing this server from my substitute servers list, the same
> operation (system reconfigure) is 8 times faster (1 minute).
>
> Suggestion: the daemon should stop trying to use the offline substitute
> server after trying for X times, and print a warning about it.

What is the status of this bug?  Especially with the recent additions in
Cuirass?

Is it still an issue?  Is some timeout still happening?

Well, in summary, the 3 relevant messages are:

-------------------- Start of forwarded message --------------------
From: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
Date: Fri, 18 Dec 2020 22:04:04 -0500

I'm not sure if the recent offloading work that Mathieu did touched that
topic.  I'd need to test the scenario.  Perhaps a system test would be
useful.
-------------------- End of forwarded message --------------------

-------------------- Start of forwarded message --------------------
From: Ludovic Court=C3=A8s <ludo@HIDDEN>
Date: Tue, 22 Dec 2020 16:16:08 +0100

Is it still a problem?  Commit 4f5234be0378368e6af25925db46612838d25e58
(Nov. 2019) added a table of unreachable hosts.  That way, a =E2=80=98guix
substitute --query=E2=80=99 process won=E2=80=99t retry connections to an u=
nreachable
host.
-------------------- End of forwarded message --------------------

-------------------- Start of forwarded message --------------------
Date: Mon, 28 Dec 2020 14:19:02 +0200
From: Efraim Flashner <efraim@HIDDEN>

Occasionally my internet drops itself, and I find I'm left forever
waiting for a timeout to see what sources I have cached locally.
-------------------- End of forwarded message --------------------


Cheers,
simon




Information forwarded to bug-guix@HIDDEN:
bug#30290; Package guix. Full text available.

Message received at 30290 <at> debbugs.gnu.org:


Received: (at 30290) by debbugs.gnu.org; 28 Dec 2020 12:19:49 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Dec 28 07:19:49 2020
Received: from localhost ([127.0.0.1]:34482 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1ktrV7-00015Q-E0
	for submit <at> debbugs.gnu.org; Mon, 28 Dec 2020 07:19:49 -0500
Received: from flashner.co.il ([178.62.234.194]:55266)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <efraim@HIDDEN>) id 1ktrV5-00015D-4e
 for 30290 <at> debbugs.gnu.org; Mon, 28 Dec 2020 07:19:48 -0500
Received: from localhost (unknown [5.102.238.249])
 by flashner.co.il (Postfix) with ESMTPSA id 4E88840148;
 Mon, 28 Dec 2020 12:19:41 +0000 (UTC)
Date: Mon, 28 Dec 2020 14:19:02 +0200
From: Efraim Flashner <efraim@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: bug#30290: guix-daemon slows to a crawl when a substitute server
 is offline
Message-ID: <X+nNNn8n3orFiPR1@3900XT>
References: <87fu6o2ge2.fsf@HIDDEN>
 <87r1nhzxaf.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha512;
 protocol="application/pgp-signature"; boundary="BDZvg5AoZ6C4XZS9"
Content-Disposition: inline
In-Reply-To: <87r1nhzxaf.fsf@HIDDEN>
X-PGP-Key-ID: 0x41AAE7DCCA3D8351
X-PGP-Key: https://flashner.co.il/~efraim/efraim_flashner.asc
X-PGP-Fingerprint: A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 30290
Cc: 30290 <at> debbugs.gnu.org, Maxim Cournoyer <maxim.cournoyer@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)


--BDZvg5AoZ6C4XZS9
Content-Type: text/plain; charset=utf-8
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Tue, Dec 22, 2020 at 04:16:08PM +0100, Ludovic Court=C3=A8s wrote:
> Hi,
>=20
> Maxim Cournoyer <maxim.cournoyer@HIDDEN> skribis:
>=20
> > When a substitute server used by guix-daemon is offline, the daemon will
> > keep attempting to connect to it, even when it shouldn't need any data
> > (ran 'sudo guix system reconfigure my-config.scm' multiple times in a
> > row.
> >
> > With the disconnected server (bayfront in my case), that command would
> > take close to 8 minutes, with many system calls like:
> >
> > connect(14, {sa_family=3DAF_INET, sin_port=3Dhtons(443), sin_addr=3Dine=
t_addr("141.255.128.56")}, 16) =3D -1 EINPROGRESS
> >
> > which wasted 5 seconds each time.
>=20
> Is it still a problem?  Commit 4f5234be0378368e6af25925db46612838d25e58
> (Nov. 2019) added a table of unreachable hosts.  That way, a =E2=80=98guix
> substitute --query=E2=80=99 process won=E2=80=99t retry connections to an=
 unreachable
> host.
>=20
> Ludo=E2=80=99.
>=20

Occasionally my internet drops itself, and I find I'm left forever
waiting for a timeout to see what sources I have cached locally.

--=20
Efraim Flashner   <efraim@HIDDEN>   =D7=90=D7=A4=D7=A8=D7=99=D7=9D =
=D7=A4=D7=9C=D7=A9=D7=A0=D7=A8
GPG key =3D A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted

--BDZvg5AoZ6C4XZS9
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQIzBAABCgAdFiEEoov0DD5VE3JmLRT3Qarn3Mo9g1EFAl/pzTMACgkQQarn3Mo9
g1F/jhAAj2cB9IKVLCIsvozRZXNMd9WCT25zaNNN6oRPuNoRozDD4555fic0FPdw
tv/S3aFnKrHjGuHsMs/qhQd1RzJXsFPO8szbPnwckyC8Cn70+1SvQIMCDfY7osXa
r94XBxPl0P9gAYNCmDSIgRGT8WhAlKAeuXAA6DnqrWyU0DvLADGsTLPab+olbe9F
28uIqkQDf0689Z6lYgPd0FvjzRiR869/B3DYY+Kk1hSYWd3xTWan/NCdzHrvNAzg
M5oYXUUur1BqLPT+deV2JBvPrJ5p2vsWZIjrx4AvI4cDB/xvYIAhJJuWD9+uP6as
0oZt9wxSsvr8zYwpO2YO1Q6E7a/fuEzhCYGoVtw4pDLx5BKWBYBVWM0K+grrZq5n
amJ2fKcDjYHb0wWmk57wzaSqcuPGM22QA+WSehbYrkXsZCuCtGhkIawQAmUHmXDl
u05hShPVy0CjhNA35dMlupNdXzOledt87K+H31YVdGAOaHVEd0NJ/RYLkm0aFkhU
5cHFg8gJidOeAfiy1qxgO1msU0EParCBRb2D1c6JaXl1ClWz/8NszWcw6cbIkodV
NeglZHLn1f4btEWkdigEjctxM4NL/DhJxleXXBp30VNGMmJ07dMhmgBTDqESK1SO
xVZ4LudByowYJU9Pg57y083YuJqSB0XVPJC+laR2Mw8A1nXZT50=
=IRoi
-----END PGP SIGNATURE-----

--BDZvg5AoZ6C4XZS9--




Information forwarded to bug-guix@HIDDEN:
bug#30290; Package guix. Full text available.

Message received at 30290 <at> debbugs.gnu.org:


Received: (at 30290) by debbugs.gnu.org; 22 Dec 2020 15:16:16 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Dec 22 10:16:16 2020
Received: from localhost ([127.0.0.1]:50693 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1krjOa-0001Pb-CZ
	for submit <at> debbugs.gnu.org; Tue, 22 Dec 2020 10:16:16 -0500
Received: from eggs.gnu.org ([209.51.188.92]:38894)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1krjOZ-0001PQ-OP
 for 30290 <at> debbugs.gnu.org; Tue, 22 Dec 2020 10:16:16 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e]:59604)
 by eggs.gnu.org with esmtp (Exim 4.90_1)
 (envelope-from <ludo@HIDDEN>)
 id 1krjOU-0007C6-JQ; Tue, 22 Dec 2020 10:16:10 -0500
Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=44072 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1krjOU-0002MU-2q; Tue, 22 Dec 2020 10:16:10 -0500
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
Subject: Re: bug#30290: guix-daemon slows to a crawl when a substitute
 server is offline
References: <87fu6o2ge2.fsf@HIDDEN>
Date: Tue, 22 Dec 2020 16:16:08 +0100
In-Reply-To: <87fu6o2ge2.fsf@HIDDEN> (Maxim Cournoyer's message of "Mon, 29
 Jan 2018 22:07:49 -0500")
Message-ID: <87r1nhzxaf.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 30290
Cc: 30290 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

Hi,

Maxim Cournoyer <maxim.cournoyer@HIDDEN> skribis:

> When a substitute server used by guix-daemon is offline, the daemon will
> keep attempting to connect to it, even when it shouldn't need any data
> (ran 'sudo guix system reconfigure my-config.scm' multiple times in a
> row.
>
> With the disconnected server (bayfront in my case), that command would
> take close to 8 minutes, with many system calls like:
>
> connect(14, {sa_family=3DAF_INET, sin_port=3Dhtons(443), sin_addr=3Dinet_=
addr("141.255.128.56")}, 16) =3D -1 EINPROGRESS
>
> which wasted 5 seconds each time.

Is it still a problem?  Commit 4f5234be0378368e6af25925db46612838d25e58
(Nov. 2019) added a table of unreachable hosts.  That way, a =E2=80=98guix
substitute --query=E2=80=99 process won=E2=80=99t retry connections to an u=
nreachable
host.

Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#30290; Package guix. Full text available.

Message received at 30290 <at> debbugs.gnu.org:


Received: (at 30290) by debbugs.gnu.org; 19 Dec 2020 03:04:15 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Dec 18 22:04:15 2020
Received: from localhost ([127.0.0.1]:40622 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kqSXX-0005PZ-89
	for submit <at> debbugs.gnu.org; Fri, 18 Dec 2020 22:04:15 -0500
Received: from mail-qk1-f172.google.com ([209.85.222.172]:45970)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <maxim.cournoyer@HIDDEN>) id 1kqSXV-0005PN-Iz
 for 30290 <at> debbugs.gnu.org; Fri, 18 Dec 2020 22:04:13 -0500
Received: by mail-qk1-f172.google.com with SMTP id b64so4071706qkc.12
 for <30290 <at> debbugs.gnu.org>; Fri, 18 Dec 2020 19:04:13 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=from:to:cc:subject:references:date:in-reply-to:message-id
 :user-agent:mime-version;
 bh=SfZypc43K7mTAIIrdWyT6DElSlzUe31ihGZjRuTTcxI=;
 b=jxNmILHa+G9gZRGX4LeHD363xfqGua+HZj30VmRFElRexy+r6/YmswORqxGqXjDEds
 dYbuOorvBTbQ9wa4nucoFlyrTl+kSLObigXwo5+x0HlkH/KHltsezRQ+ZTkJcgNnMOiK
 xGVkGlG8h+8/r4PSJ7Q/0Osr4XV2Q5Eun7hJPxtHH9V6nDthnFOEV8SByfNjeYrIYfdR
 u1JfmcKeunYizFlcaPvnKEHZaprl8scruAMfvM6JLdIOBy1E4Jwb9khcpVEjN7yEFwVv
 K2BQCrQ/gwIFOeAT+6Mmg41rKWF/OL/Ryl4dvcVUzoafLdVPOQ137kDWUSZcmqc47Kgi
 8POg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to
 :message-id:user-agent:mime-version;
 bh=SfZypc43K7mTAIIrdWyT6DElSlzUe31ihGZjRuTTcxI=;
 b=JcukoQ6/te10m8IHjehP3yL6WrWdJ6cwGgcf6QMI7nSWLHNOqb4dUYkKNc0KQEVtnl
 ToFdQmlfUGqA9AoFTTkBbPkH5fdBK0wM5bnVWKIH79vOXIFejYXs7ZHCTt21hdILk83K
 WjmVV3G+cCF3VwCqFp/EaQruoilBNakUC1fb5rAyCYmsW3ocepUZZAFZ9+famPTlyBOQ
 09iFFhbN9el7iJTu179hMy6v8wRpnyM/TJ4qcoO2gqFJbQzsqhUZiAvyorpcYiVupXEM
 phCOtLca0toFNKqt/ypiSRMaRxdUZcGtP1Ye+He4fMrOxIpEzY8wVjLVHbHhoTBiNb3c
 urEg==
X-Gm-Message-State: AOAM532b1ZplwjJ4i+sn4lpwGwz4BIqO4k9X6B/HdSK21Vs+26vFV/gf
 SZEUJNYWncoxnzmk7N/szJEI50IZJwHAgsR2
X-Google-Smtp-Source: ABdhPJzQeAR+CswnDBj1KZvJNhQ8SO26JNFA8kIVqx98NoLm45IKXQbRVYO11kUQeIwxjuqEvjv59A==
X-Received: by 2002:a37:b083:: with SMTP id z125mr8171132qke.246.1608347048051; 
 Fri, 18 Dec 2020 19:04:08 -0800 (PST)
Received: from hurd (dsl-10-146-235.b2b2c.ca. [72.10.146.235])
 by smtp.gmail.com with ESMTPSA id b12sm6500486qtj.12.2020.12.18.19.04.07
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Fri, 18 Dec 2020 19:04:07 -0800 (PST)
From: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
To: zimoun <zimon.toutoune@HIDDEN>
Subject: Re: bug#30290: guix-daemon slows to a crawl when a substitute
 server is offline
References: <87fu6o2ge2.fsf@HIDDEN> <86mtyvzqo8.fsf@HIDDEN>
Date: Fri, 18 Dec 2020 22:04:04 -0500
In-Reply-To: <86mtyvzqo8.fsf@HIDDEN> (zimoun's message of "Thu, 03 Dec 2020
 01:20:07 +0100")
Message-ID: <87h7oiebtn.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 30290
Cc: 30290 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi!

zimoun <zimon.toutoune@HIDDEN> writes:

> Hi Maxim,
>
> On Mon, 29 Jan 2018 at 22:07, Maxim Cournoyer <maxim.cournoyer@HIDDEN> wrote:
>> When a substitute server used by guix-daemon is offline, the daemon will
>> keep attempting to connect to it, even when it shouldn't need any data
>> (ran 'sudo guix system reconfigure my-config.scm' multiple times in a
>> row.
>>
>> With the disconnected server (bayfront in my case), that command would
>> take close to 8 minutes, with many system calls like:
>>
>> connect(14, {sa_family=AF_INET, sin_port=htons(443), sin_addr=inet_addr("141.255.128.56")}, 16) = -1 EINPROGRESS
>>
>> which wasted 5 seconds each time.
>>
>> After removing this server from my substitute servers list, the same
>> operation (system reconfigure) is 8 times faster (1 minute).
>>
>> Suggestion: the daemon should stop trying to use the offline substitute
>> server after trying for X times, and print a warning about it.
>
> This looks like as a wishlist, right?  Do it make sense to include such
> feature to the recent discussions about the revamp of offloading,
> Cuirass, publish, etc.

To me it's an issue more than a feature request, especially in a build
farm setting; having a substitute machine down shouldn't cause a slow
down for as long as it's down!

I'm not sure if the recent offloading work that Mathieu did touched that
topic.  I'd need to test the scenario.  Perhaps a system test would be
useful.

Maxim




Information forwarded to bug-guix@HIDDEN:
bug#30290; Package guix. Full text available.

Message received at 30290 <at> debbugs.gnu.org:


Received: (at 30290) by debbugs.gnu.org; 3 Dec 2020 00:25:46 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Dec 02 19:25:46 2020
Received: from localhost ([127.0.0.1]:37742 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1kkcRN-0002Td-QP
	for submit <at> debbugs.gnu.org; Wed, 02 Dec 2020 19:25:45 -0500
Received: from mail-wr1-f52.google.com ([209.85.221.52]:43942)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <zimon.toutoune@HIDDEN>) id 1kkcRN-0002TN-5f
 for 30290 <at> debbugs.gnu.org; Wed, 02 Dec 2020 19:25:45 -0500
Received: by mail-wr1-f52.google.com with SMTP id s8so80734wrw.10
 for <30290 <at> debbugs.gnu.org>; Wed, 02 Dec 2020 16:25:45 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=from:to:cc:subject:references:date:in-reply-to:message-id
 :user-agent:mime-version;
 bh=Lk8z8s7PCaULIiFoulALFpITb8aPYRTgtDUhAj2cgKw=;
 b=SZ9FS1jN3Xob7FpECAbPQOYH0seMwuxX8NpVuwHLcZyyHTKmO2k86A5dgyvsK9Romz
 1ql7M+S+quHurGZxee88X5RVGs7W5K0A83cd8bvR3Q7VsNv+3xPSTDyBmYaJALzgBreb
 8lwPhEfUGiN7VJAaCxDsVmbjmEuZQ2Hl8Yen1V2cZ6tKI0GCH48UqdacQZiNAAL6ImUm
 gVU95eK0a4YVygvs5NTH98T9LL1irviIL4edRo3SVQRQbYi1LyfbwaZZdXfhO/k8p/P6
 ycTbAIIH1zAyUlP9q72yYOzOYrx2mV59BGPOrzlTfW9iaVqm+3CZUdWaVkbCp4vMc/aY
 5CWA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:cc:subject:references:date:in-reply-to
 :message-id:user-agent:mime-version;
 bh=Lk8z8s7PCaULIiFoulALFpITb8aPYRTgtDUhAj2cgKw=;
 b=uewiQKSnfFpYzUs6/VvWvX5b0cigrC3t2VSgOoWVDNO1HKfQbTiGR7sI63vICY7Mqz
 oMzOeKIowEsp3CPLwZ8Vzg879ciWAMX1/NKE0h1aFlvkTJ9Yn6967sTI7UuUyzMARo9m
 GVdKp8dquJsU4X4AiOglOCfuvlc5SuZzT3SNUVu71hxgnQke8As5vaPTOD4QH4fanTP7
 UgVX7P4ATR2OL3dxvuzhU7oHZNwQ4KcKIPZGXDIDa5xDNE6Sb3+VbPVrWEw/GzPvNKOn
 OcY5QJX7NqDdM0/rfA1VMiF24VsxhTHttphboGuVOXN7Z4qVifPNl1OSsi7lqp1mskmy
 z91w==
X-Gm-Message-State: AOAM531DF3VzSPSmDB1iRiGTj4RZZBF6EsdyC2A4rbq7BOv0vUVgnZX7
 RFnLd1AizGsTGjuIqpD7Km/XhHruz47Cbw==
X-Google-Smtp-Source: ABdhPJztoTpiwKemPBfBuaCOy6Oc1zHl5xX1o3pWqm+5yrpfWtxkp9FcUjCqDuPWJSYD+YyQVUu5UA==
X-Received: by 2002:adf:fa05:: with SMTP id m5mr688564wrr.26.1606955139112;
 Wed, 02 Dec 2020 16:25:39 -0800 (PST)
Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e])
 by smtp.gmail.com with ESMTPSA id l24sm373003wrb.28.2020.12.02.16.25.38
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Wed, 02 Dec 2020 16:25:38 -0800 (PST)
From: zimoun <zimon.toutoune@HIDDEN>
To: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
Subject: Re: bug#30290: guix-daemon slows to a crawl when a substitute
 server is offline
References: <87fu6o2ge2.fsf@HIDDEN>
Date: Thu, 03 Dec 2020 01:20:07 +0100
In-Reply-To: <87fu6o2ge2.fsf@HIDDEN> (Maxim Cournoyer's message of "Mon, 29
 Jan 2018 22:07:49 -0500")
Message-ID: <86mtyvzqo8.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/27.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 30290
Cc: 30290 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi Maxim,

On Mon, 29 Jan 2018 at 22:07, Maxim Cournoyer <maxim.cournoyer@HIDDEN> wrote:
> When a substitute server used by guix-daemon is offline, the daemon will
> keep attempting to connect to it, even when it shouldn't need any data
> (ran 'sudo guix system reconfigure my-config.scm' multiple times in a
> row.
>
> With the disconnected server (bayfront in my case), that command would
> take close to 8 minutes, with many system calls like:
>
> connect(14, {sa_family=AF_INET, sin_port=htons(443), sin_addr=inet_addr("141.255.128.56")}, 16) = -1 EINPROGRESS
>
> which wasted 5 seconds each time.
>
> After removing this server from my substitute servers list, the same
> operation (system reconfigure) is 8 times faster (1 minute).
>
> Suggestion: the daemon should stop trying to use the offline substitute
> server after trying for X times, and print a warning about it.

This looks like as a wishlist, right?  Do it make sense to include such
feature to the recent discussions about the revamp of offloading,
Cuirass, publish, etc.


All the best,
simon




Information forwarded to bug-guix@HIDDEN:
bug#30290; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 30 Jan 2018 03:08:04 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Jan 29 22:08:04 2018
Received: from localhost ([127.0.0.1]:48403 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1egMHE-0000QD-0R
	for submit <at> debbugs.gnu.org; Mon, 29 Jan 2018 22:08:04 -0500
Received: from eggs.gnu.org ([208.118.235.92]:55301)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <maxim.cournoyer@HIDDEN>) id 1egMHC-0000Ph-H4
 for submit <at> debbugs.gnu.org; Mon, 29 Jan 2018 22:08:02 -0500
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <maxim.cournoyer@HIDDEN>) id 1egMH6-0002Lw-Gv
 for submit <at> debbugs.gnu.org; Mon, 29 Jan 2018 22:07:57 -0500
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,FREEMAIL_FROM,
 T_DKIM_INVALID autolearn=disabled version=3.3.2
Received: from lists.gnu.org ([2001:4830:134:3::11]:54211)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <maxim.cournoyer@HIDDEN>)
 id 1egMH6-0002Lf-Ci
 for submit <at> debbugs.gnu.org; Mon, 29 Jan 2018 22:07:56 -0500
Received: from eggs.gnu.org ([2001:4830:134:3::10]:46261)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <maxim.cournoyer@HIDDEN>) id 1egMH5-000397-Ac
 for bug-guix@HIDDEN; Mon, 29 Jan 2018 22:07:56 -0500
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <maxim.cournoyer@HIDDEN>) id 1egMH2-0002Iw-4V
 for bug-guix@HIDDEN; Mon, 29 Jan 2018 22:07:55 -0500
Received: from mail-it0-x231.google.com ([2607:f8b0:4001:c0b::231]:51959)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16)
 (Exim 4.71) (envelope-from <maxim.cournoyer@HIDDEN>)
 id 1egMH1-0002IX-VF
 for bug-guix@HIDDEN; Mon, 29 Jan 2018 22:07:52 -0500
Received: by mail-it0-x231.google.com with SMTP id p139so10790673itb.1
 for <bug-guix@HIDDEN>; Mon, 29 Jan 2018 19:07:51 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=from:to:subject:date:message-id:user-agent:mime-version;
 bh=HZrV870pvnu3h0KHzLjpMCG0EUepQxbKrKh1dcs3yyM=;
 b=hN3SwdL9oahkklRwyAOXIw93UeQZMURISVrNudk5uCllH0jdDgGC5vfL+HZNY+SREo
 uKV5xNMcKDP+HCAZYj6J2uHu7qIMDZVkPzuKjhVEmzjigDYb7pCwez81Kuh/FcbS5LHq
 HpslFsghA30QKLWXjZ58YgmOvOL6hS0FaE8E++YhFygkYEy97fYCs7UkLHtk1h2+3/6h
 1xGpFkFcghjyVD5cWg1Q/w1t2VZneVeGP3AOlwot1qyMJjIlBTOJ4nBry/GaA7otZniv
 yx3zn2Qyw1iuRpEQUXl/8y8LyLUuYfA/Wy1tunSlJ++/rblv1P7eWIj/tx5tbnGcyWgG
 aklw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:subject:date:message-id:user-agent
 :mime-version;
 bh=HZrV870pvnu3h0KHzLjpMCG0EUepQxbKrKh1dcs3yyM=;
 b=UANhPP6NPUVsEHfEC9v0EYv9a8FDabzl3N6p3BsX7yzk0722E/HtFzYa83tqESHHeD
 INaB+wRT6fc7gYjMZbL3MH7rPTLNdngKU8GFeTbgYg68MhrMx6dPZ9Gt0v4bfjLoVU+b
 +mar2CbReUUTMDEdClZDt4f395cEIeBxqptpi1XVwfdrwVy3CBc6hnpcXmU1M8y4WZiO
 1OpuXN69BDDczyl+swd/D+oDh1I0jS7zPY7Vr/WY53D+y/AXVxE3CU5xmeziyKB8ic48
 +r1cbb7vkmdmIrTygVIPXAAorFH+pvH2Y9K3lEI6RuCrY1qDPiwe9w/kY8zykt188Z7i
 liqw==
X-Gm-Message-State: AKwxytfK4bgvxm6Kl4yrxglu4zLBZ1S7CttnCq/HiClR6RioDv9Y2Owb
 UPs547uXSfZgGk7AoekVhuV5uA==
X-Google-Smtp-Source: AH8x225nPfsM3wbGOBu3NdG+vefB/cKJk08tQ6e0y6GN3emWZxG6zZyt/lL6bs/rD7OZOcQE+p9FUQ==
X-Received: by 10.36.148.139 with SMTP id j133mr30508142ite.148.1517281670836; 
 Mon, 29 Jan 2018 19:07:50 -0800 (PST)
Received: from apteryx ([45.72.232.234])
 by smtp.gmail.com with ESMTPSA id z84sm5079347itc.21.2018.01.29.19.07.49
 for <bug-guix@HIDDEN>
 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256);
 Mon, 29 Jan 2018 19:07:50 -0800 (PST)
From: Maxim Cournoyer <maxim.cournoyer@HIDDEN>
To: bug-guix <bug-guix@HIDDEN>
Subject: guix-daemon slows to a crawl when a substitute server is offline
Date: Mon, 29 Jan 2018 22:07:49 -0500
Message-ID: <87fu6o2ge2.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
 recognized.
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x
X-Received-From: 2001:4830:134:3::11
X-Spam-Score: -4.0 (----)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -4.0 (----)

When a substitute server used by guix-daemon is offline, the daemon will
keep attempting to connect to it, even when it shouldn't need any data
(ran 'sudo guix system reconfigure my-config.scm' multiple times in a
row.

With the disconnected server (bayfront in my case), that command would
take close to 8 minutes, with many system calls like:

--8<---------------cut here---------------start------------->8---
connect(14, {sa_family=AF_INET, sin_port=htons(443), sin_addr=inet_addr("141.255.128.56")}, 16) = -1 EINPROGRESS
--8<---------------cut here---------------end--------------->8---

which wasted 5 seconds each time.

After removing this server from my substitute servers list, the same
operation (system reconfigure) is 8 times faster (1 minute).

Suggestion: the daemon should stop trying to use the offline substitute
server after trying for X times, and print a warning about it.

Maxim




Acknowledgement sent to Maxim Cournoyer <maxim.cournoyer@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#30290; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Tue, 13 Jul 2021 09:15:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.