GNU bug report logs - #29200
`guix build --fallback` does not work with offloading

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Reported by: Marius Bakke <mbakke@HIDDEN>; merged with #24626; dated Tue, 7 Nov 2017 22:25:02 UTC; Maintainer for guix is bug-guix@HIDDEN.
Merged 24626 29200. Request was from ludo@HIDDEN (Ludovic Courtès) to control <at> debbugs.gnu.org. Full text available.

Message received at 29200 <at> debbugs.gnu.org:


Received: (at 29200) by debbugs.gnu.org; 8 Nov 2017 08:53:18 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Nov 08 03:53:18 2017
Received: from localhost ([127.0.0.1]:57551 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1eCM6o-0004n7-AF
	for submit <at> debbugs.gnu.org; Wed, 08 Nov 2017 03:53:18 -0500
Received: from hera.aquilenet.fr ([141.255.128.1]:40954)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1eCM6m-0004n0-R1
 for 29200 <at> debbugs.gnu.org; Wed, 08 Nov 2017 03:53:17 -0500
Received: from localhost (localhost [127.0.0.1])
 by hera.aquilenet.fr (Postfix) with ESMTP id D9530F811;
 Wed,  8 Nov 2017 09:53:17 +0100 (CET)
X-Virus-Scanned: Debian amavisd-new at aquilenet.fr
Received: from hera.aquilenet.fr ([127.0.0.1])
 by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id AZBIx07trjB8; Wed,  8 Nov 2017 09:53:17 +0100 (CET)
Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465])
 by hera.aquilenet.fr (Postfix) with ESMTPSA id 079F8F6A0;
 Wed,  8 Nov 2017 09:53:16 +0100 (CET)
From: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
To: Marius Bakke <mbakke@HIDDEN>
Subject: Re: bug#29200: `guix build --fallback` does not work with offloading
References: <878tfh3eym.fsf@HIDDEN>
X-URL: http://www.fdn.fr/~lcourtes/
X-Revolutionary-Date: 18 Brumaire an 226 de la =?utf-8?Q?R=C3=A9volution?=
X-PGP-Key-ID: 0x090B11993D9AEBB5
X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc
X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4  0CFB 090B 1199 3D9A EBB5
X-OS: x86_64-pc-linux-gnu
Date: Wed, 08 Nov 2017 09:53:14 +0100
In-Reply-To: <878tfh3eym.fsf@HIDDEN> (Marius Bakke's message of "Tue, 07
 Nov 2017 23:24:01 +0100")
Message-ID: <87vailup6t.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: 29200
Cc: 29200 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 1.0 (+)

Marius Bakke <mbakke@HIDDEN> skribis:

> I've noticed that when offloading, --fallback sometimes fails to
> actually fall back.  Here is a shell transcript:

The problem is that guix-daemon does not pass =E2=80=9Cfallbackness=E2=80=
=9D settings to
=E2=80=98guix offload=E2=80=99 (you can check (guix scripts offload) to see=
 what
settings are passed.)

We should adjust guix-daemon and (guix scripts offload) to pass this
extra setting, though there are probably other bits missing.

Thanks,
Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#29200; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 7 Nov 2017 22:24:20 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Nov 07 17:24:20 2017
Received: from localhost ([127.0.0.1]:57190 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1eCCI7-0001lN-LQ
	for submit <at> debbugs.gnu.org; Tue, 07 Nov 2017 17:24:19 -0500
Received: from eggs.gnu.org ([208.118.235.92]:41484)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <mbakke@HIDDEN>) id 1eCCI4-0001l9-Pi
 for submit <at> debbugs.gnu.org; Tue, 07 Nov 2017 17:24:17 -0500
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <mbakke@HIDDEN>) id 1eCCHy-00080V-Am
 for submit <at> debbugs.gnu.org; Tue, 07 Nov 2017 17:24:11 -0500
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=0.0 required=5.0 tests=BAYES_20,FREEMAIL_FROM,
 T_DKIM_INVALID autolearn=disabled version=3.3.2
Received: from lists.gnu.org ([2001:4830:134:3::11]:51365)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <mbakke@HIDDEN>) id 1eCCHy-00080O-6S
 for submit <at> debbugs.gnu.org; Tue, 07 Nov 2017 17:24:10 -0500
Received: from eggs.gnu.org ([2001:4830:134:3::10]:60685)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <mbakke@HIDDEN>) id 1eCCHw-00089n-Mo
 for bug-guix@HIDDEN; Tue, 07 Nov 2017 17:24:10 -0500
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <mbakke@HIDDEN>) id 1eCCHt-0007ws-F2
 for bug-guix@HIDDEN; Tue, 07 Nov 2017 17:24:08 -0500
Received: from out4-smtp.messagingengine.com ([66.111.4.28]:60733)
 by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <mbakke@HIDDEN>) id 1eCCHt-0007v8-8C
 for bug-guix@HIDDEN; Tue, 07 Nov 2017 17:24:05 -0500
Received: from compute5.internal (compute5.nyi.internal [10.202.2.45])
 by mailout.nyi.internal (Postfix) with ESMTP id 05C02205D6
 for <bug-guix@HIDDEN>; Tue,  7 Nov 2017 17:24:03 -0500 (EST)
Received: from frontend1 ([10.202.2.160])
 by compute5.internal (MEProxy); Tue, 07 Nov 2017 17:24:03 -0500
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fastmail.com; h=
 content-type:date:from:message-id:mime-version:subject:to
 :x-me-sender:x-me-sender:x-sasl-enc; s=fm1; bh=Z7s70Zj9V1wo1QZS9
 ISNLBrVTt6b4TPOAbea3T8gRSc=; b=ClHZctQ4+rkvlaj5c9mxc29+fvCkkuscN
 GH1eXaZWkY0yGraK2QSvsg+Bi5v4dC0Y576mu0dXBvabOsthBvLLMoCy4/pXOpWx
 cEihiefytLzzVymHsN/Smtt5+lrbxAp6MYAVh1GWMMZ650qaQQY8LSfhS7UVorq1
 8J3nq42YuEWbFomTdxXQPO+K6380Wsd4IUzy/u1TVC/3r27PbHOOb3ykSUWmnNWi
 tnNLiHXq87X23r/w3CkyJddSZvdjEUAlu3+zTCSm7CEL/nNGJbSS+N6a2xGGOUHp
 xm2im4VpC2PD5g/ObPfq2CYh1HZ8UI6O6rprRK5Fc3EdLK1qtqyGA==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=content-type:date:from:message-id
 :mime-version:subject:to:x-me-sender:x-me-sender:x-sasl-enc; s=
 fm1; bh=Z7s70Zj9V1wo1QZS9ISNLBrVTt6b4TPOAbea3T8gRSc=; b=S7+OYpJj
 bjpZnRp9oxrN8/d17+cjTQp33MgQ67JR7vw6IinEIZkJh7hIWihzSNwlOlIB9eu9
 2r9ANqixsbIHdwOgBwWqx/pfDXMq6/63VTxwv1PaoZWTpoe3Nw7mgUTej2+IrhhN
 EM+TVE2+BPzk2i0rGm8YtRL7m+Hny7iWVlKodChWrD1G5kCnfg4sztYdWVfUYl3q
 0ZWyEk/OVdsQZhMKpx5AnuIl0Kl1/51/5VIuzrWfds3MBb1a9RsPS+A/2FwEtO9L
 yGUolGby5REACnXnJpJ0M+LQ++rUByC0mpgo2k+pvOyq4xjaoT4I2XV0X3jcH6y7
 de+fleYrli0Seg==
X-ME-Sender: <xms:gjICWtyiubUOZp0MOcDyxwxCCeD-r17OHy6tLpRlCdVnQ_FV8geZWw>
Received: from localhost (cm-84.214.173.174.getinternet.no [84.214.173.174])
 by mail.messagingengine.com (Postfix) with ESMTPA id 8726B7F982
 for <bug-guix@HIDDEN>; Tue,  7 Nov 2017 17:24:02 -0500 (EST)
From: Marius Bakke <mbakke@HIDDEN>
To: bug-guix@HIDDEN
Subject: `guix build --fallback` does not work with offloading
User-Agent: Notmuch/0.25.1 (https://notmuchmail.org) Emacs/25.3.1
 (x86_64-pc-linux-gnu)
Date: Tue, 07 Nov 2017 23:24:01 +0100
Message-ID: <878tfh3eym.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
 micalg=pgp-sha512; protocol="application/pgp-signature"
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
 [fuzzy]
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x
X-Received-From: 2001:4830:134:3::11
X-Spam-Score: -4.4 (----)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -4.4 (----)

--=-=-=
Content-Type: text/plain
Content-Transfer-Encoding: quoted-printable

Hello!

I've noticed that when offloading, --fallback sometimes fails to
actually fall back.  Here is a shell transcript:

=2D-8<---------------cut here---------------start------------->8---
$ ./pre-inst-env guix build --substitute-urls=3D"https://mirror.hydra.gnu.o=
rg" --fallback font-arabic-misc
@ substituter-started /gnu/store/26nk7rgc2rhi7v0d8xhqqxglpg532syh-font-arab=
ic-misc-1.0.3.tar.xz /gnu/store/19wpps1nmlg4j1530knl7kdhvgcmj5fc-guix-0.13.=
0-8.357ab93/libexec/guix/substitute
Downloading https://mirror.hydra.gnu.org/guix/nar/26nk7rgc2rhi7v0d8xhqqxglp=
g532syh-font-arabic-misc-1.0.3.tar.xz...
guix substitute: error: download from 'https://mirror.hydra.gnu.org/guix/na=
r/26nk7rgc2rhi7v0d8xhqqxglpg532syh-font-arabic-misc-1.0.3.tar.xz' failed: 4=
04, "Not Found"
@ substituter-failed /gnu/store/26nk7rgc2rhi7v0d8xhqqxglpg532syh-font-arabi=
c-misc-1.0.3.tar.xz 256 fetching path `/gnu/store/26nk7rgc2rhi7v0d8xhqqxglp=
g532syh-font-arabic-misc-1.0.3.tar.xz' failed with exit code 1
process 8395 acquired build slot '/var/guix/offload/192.168.2.11/0'
process 8395 acquired build slot '/var/guix/offload/192.168.2.5/0'
load on machine '192.168.2.11' is 0.08 (normalized: 0.02)
@ build-started /gnu/store/rqgfr39aamfzqq93fl87ai2y61b5s992-font-arabic-mis=
c-1.0.3.tar.xz.drv - x86_64-linux /var/log/guix/drvs/rq//gfr39aamfzqq93fl87=
ai2y61b5s992-font-arabic-misc-1.0.3.tar.xz.drv.bz2
sending 0 store items to '192.168.2.11'...
offloading '/gnu/store/rqgfr39aamfzqq93fl87ai2y61b5s992-font-arabic-misc-1.=
0.3.tar.xz.drv' to '192.168.2.11'...
@ build-remote /gnu/store/rqgfr39aamfzqq93fl87ai2y61b5s992-font-arabic-misc=
-1.0.3.tar.xz.drv 192.168.2.11
@ substituter-started /gnu/store/26nk7rgc2rhi7v0d8xhqqxglpg532syh-font-arab=
ic-misc-1.0.3.tar.xz /gnu/store/19wpps1nmlg4j1530knl7kdhvgcmj5fc-guix-0.13.=
0-8.357ab93/libexec/guix/substitute
Downloading https://mirror.hydra.gnu.org/guix/nar/26nk7rgc2rhi7v0d8xhqqxglp=
g532syh-font-arabic-misc-1.0.3.tar.xz...
guix substitute: error: download from 'https://mirror.hydra.gnu.org/guix/na=
r/26nk7rgc2rhi7v0d8xhqqxglpg532syh-font-arabic-misc-1.0.3.tar.xz' failed: 4=
04, "Not Found"
@ substituter-failed /gnu/store/26nk7rgc2rhi7v0d8xhqqxglpg532syh-font-arabi=
c-misc-1.0.3.tar.xz 256 fetching path `/gnu/store/26nk7rgc2rhi7v0d8xhqqxglp=
g532syh-font-arabic-misc-1.0.3.tar.xz' failed with exit code 1
derivation '/gnu/store/rqgfr39aamfzqq93fl87ai2y61b5s992-font-arabic-misc-1.=
0.3.tar.xz.drv' offloaded to '192.168.2.11' failed: some substitutes for th=
e outputs of derivation `/gnu/store/rqgfr39aamfzqq93fl87ai2y61b5s992-font-a=
rabic-misc-1.0.3.tar.xz.drv' failed (usually happens due to networking issu=
es); try `--fallback' to build derivation from source=20
@ build-failed /gnu/store/rqgfr39aamfzqq93fl87ai2y61b5s992-font-arabic-misc=
-1.0.3.tar.xz.drv - 1 builder for `/gnu/store/rqgfr39aamfzqq93fl87ai2y61b5s=
992-font-arabic-misc-1.0.3.tar.xz.drv' failed with exit code 100
cannot build derivation `/gnu/store/gna22xl7ycq4rzaj487axa5ijbyhqq1q-font-a=
rabic-misc-1.0.3.drv': 1 dependencies couldn't be built
guix build: error: build failed: build of `/gnu/store/gna22xl7ycq4rzaj487ax=
a5ijbyhqq1q-font-arabic-misc-1.0.3.drv' failed
=2D-8<---------------cut here---------------end--------------->8---

Passing --no-build-hook makes it succeed:

=2D-8<---------------cut here---------------start------------->8---
$ ./pre-inst-env guix build --substitute-urls=3D"https://mirror.hydra.gnu.o=
rg" --fallback --no-build-hook font-arabic-misc
@ substituter-started /gnu/store/26nk7rgc2rhi7v0d8xhqqxglpg532syh-font-arab=
ic-misc-1.0.3.tar.xz /gnu/store/19wpps1nmlg4j1530knl7kdhvgcmj5fc-guix-0.13.=
0-8.357ab93/libexec/guix/substitute=20=20=20=20=20=20=20=20=20=20=20=20=20
Downloading https://mirror.hydra.gnu.org/guix/nar/26nk7rgc2rhi7v0d8xhqqxglp=
g532syh-font-arabic-misc-1.0.3.tar.xz...=20=20=20=20=20=20=20=20=20=20=20=
=20=20=20=20=20=20=20=20=20=20=20
guix substitute: error: download from 'https://mirror.hydra.gnu.org/guix/na=
r/26nk7rgc2rhi7v0d8xhqqxglpg532syh-font-arabic-misc-1.0.3.tar.xz' failed: 4=
04, "Not Found"
@ substituter-failed /gnu/store/26nk7rgc2rhi7v0d8xhqqxglpg532syh-font-arabi=
c-misc-1.0.3.tar.xz 256 fetching path `/gnu/store/26nk7rgc2rhi7v0d8xhqqxglp=
g532syh-font-arabic-misc-1.0.3.tar.xz' failed with exit code 1
@ build-started /gnu/store/rqgfr39aamfzqq93fl87ai2y61b5s992-font-arabic-mis=
c-1.0.3.tar.xz.drv - x86_64-linux /var/log/guix/drvs/rq//gfr39aamfzqq93fl87=
ai2y61b5s992-font-arabic-misc-1.0.3.tar.xz.drv.bz2
font-arabic-misc-1.0.3/
font-arabic-misc-1.0.3/arabic24.bdf
font-arabic-misc-1.0.3/aclocal.m4
[...]
=2D-8<---------------cut here---------------end--------------->8---

Interestingly no download was done on the second try, so apparently the
source was already in my store.

It looks like the offload hook starts before the actual download
(possibly because a substitute was advertised), and then fails when the
substitute 404s.

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQEzBAEBCgAdFiEEu7At3yzq9qgNHeZDoqBt8qM6VPoFAloCMoEACgkQoqBt8qM6
VPrgRggAztHhgGyH8Ll7+XnCd7gqWrwbfaN49DIxaWp2PQ6myevI05ggvRQVag7E
Tsl80O1oae/G/TT9PvV6u4AyZNq/bsLrCfroaAoJd5T9R1tnK5MnJNifkMtA0LAp
KFrJ3fy4NqUeK2wJVf/mV7TSWnB7l9hnbssnjtd7+cAQLar5pghwMwKzdS9vt5iy
LV4R8S1KEfCF5vQdpPQ1bxCLn4oev45+b+v0gbsh3iGtmac04se/K4BwdBTwj2Oj
6oQfDyAn6TwLISqxqYY9S+vKNTS1MueavoJ6pJo8ZKU7X+jINaJKursmIrkXU0nz
EmI4clWuuvQQHqm1I5CGKlzTK/FaGQ==
=cgml
-----END PGP SIGNATURE-----
--=-=-=--




Acknowledgement sent to Marius Bakke <mbakke@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#29200; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Mon, 25 Nov 2019 12:00:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.