Received: (at 67250) by debbugs.gnu.org; 18 May 2024 13:23:37 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat May 18 09:23:37 2024
Received: from localhost ([127.0.0.1]:33486 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1s8K2D-0006Dz-6g
for submit <at> debbugs.gnu.org; Sat, 18 May 2024 09:23:37 -0400
Received: from mira.cbaines.net ([212.71.252.8]:43560)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <mail@HIDDEN>) id 1s8K2B-0006Dt-O3
for 67250 <at> debbugs.gnu.org; Sat, 18 May 2024 09:23:36 -0400
Received: from localhost (unknown [89.207.171.92])
by mira.cbaines.net (Postfix) with ESMTPSA id 7B2BE27BBE2
for <67250 <at> debbugs.gnu.org>; Sat, 18 May 2024 14:22:59 +0100 (BST)
Received: from felis (localhost [127.0.0.1])
by localhost (OpenSMTPD) with ESMTP id ae6e59f8
for <67250 <at> debbugs.gnu.org>; Sat, 18 May 2024 13:22:57 +0000 (UTC)
From: Christopher Baines <mail@HIDDEN>
To: 67250 <at> debbugs.gnu.org
Subject: Re: bug#67250: builtin:git-download capability detection not
working for the bordeaux build farm
In-Reply-To: <87y1ehlsup.fsf@HIDDEN> (Christopher Baines's message of
"Tue, 28 Nov 2023 16:54:07 +0000")
References: <87pm08f41q.fsf@HIDDEN> <87bkbmm6o1.fsf@HIDDEN>
<87y1ehlsup.fsf@HIDDEN>
User-Agent: mu4e 1.12.2; emacs 29.3
Date: Sat, 18 May 2024 14:22:55 +0100
Message-ID: <87pltjb6fk.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
micalg=pgp-sha512; protocol="application/pgp-signature"
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 67250
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
--=-=-=
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Christopher Baines <mail@HIDDEN> writes:
> Ludovic Court=C3=A8s <ludo@HIDDEN> writes:
>
>> Hi,
>>
>> Christopher Baines <mail@HIDDEN> skribis:
>>
>>> The bordeaux build farm depends on computing the derivations on one
>>> machine, then potentially building them on a different machine.
>>>
>>> Some of the build machines don't have a new enough guix-daemon that
>>> understands builtin:git-download, so derivations that use this are
>>> sometimes failing (e.g. [1])
>>>
>>> 1: https://bordeaux.guix.gnu.org/build/10cc5622-6b1f-4f28-ad9a-41cf796d=
7a15
>>>
>>> One potential approach to address this is somehow have the data service
>>> indicate that it wants compatible derivations when computing them,
>>> rather than to have guix do feature detection against the guix-daemon
>>> that is being used at the point the derivations are being computed.
>>
>> Would it work for you if we added a keyword argument to
>> =E2=80=98open-connection=E2=80=99 in (guix store) that would let you sel=
ect which
>> builtins to use?
>>
>> As in:
>>
>> (open-connection
>> #:assume-available-builtin-builders '("download"))
>
> Yep, that would at least allow freezing the available builtins going
> forward and separating it from the running daemon.
I've now sent some patches which add this option to #71038.
--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmZIq69fFIAAAAAALgAo
aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF
ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh
aW5lcy5uZXQACgkQXiijOwuE9XdyAg/+IrxdTR5jNvjbENQbYbde48p0pQnRspQx
sTcPBZatt0gfzKI0wyxcDotnxB6K1qv6KjLHVHW1Lusky3WlF385YmSu54XnOQkY
N7Ki5KsN8FBuUX2O8+g/YQt4T7eUdVRQKNRknur1FjyTaF/bKcy9XbbHcYjm+Ais
gtbdaNR0syiur2TFKcXYV7Ns7+zAlVoQ+TCrVoQi/HhBWvqsK8KZ+jxcORFDosiW
a+kpPASR96CupgPfF1mv3KtHkeFxehRRtY5D0/tCSvxV10S1V4he/ntwPBXOP5Iv
ZMcdDhsL9XH2y6oFD6uZrk/FwHx112M3MaopfwVLLgvaIdyjlr1yz/+bSwPPSVNf
B5k5kObRHr1XtiNKJTREvkF5uj8De/cFvS4bjkSeNvGzUwuvHjJ9h9+6ZwK6fapJ
kIJ+JC1aNbtAFUbpCaoYC98wHALmYRjG9isNxjJoXCwRDTdNm5NLrLe2c0dXLm/R
JMEPXsxPReyKSoJZq5/8QrtUMGsOQOd81CjFpLhoh+Hx6jGg9S8oNslk6nY9hNKs
HIKX0iOGV01n2mkr2nrsncwk65lq6bjjPKbx/adiZDNSnEANdhpD0eucTbNj2Mmq
hWdita0M4yvKXEZbgr9ospSLaFtclZRsxQeDRpcj9y2NMmQXlPUYzy+RPmvL8fki
xlEfJXW6U14=
=u9nJ
-----END PGP SIGNATURE-----
--=-=-=--
bug-guix@HIDDEN:bug#67250; Package guix.
Full text available.
Received: (at 67250) by debbugs.gnu.org; 28 Nov 2023 16:56:28 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Nov 28 11:56:28 2023
Received: from localhost ([127.0.0.1]:47537 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1r81Ns-0003s1-B3
for submit <at> debbugs.gnu.org; Tue, 28 Nov 2023 11:56:28 -0500
Received: from mira.cbaines.net ([212.71.252.8]:43050)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <mail@HIDDEN>) id 1r81Nq-0003rs-32
for 67250 <at> debbugs.gnu.org; Tue, 28 Nov 2023 11:56:27 -0500
Received: from localhost (unknown [217.155.61.229])
by mira.cbaines.net (Postfix) with ESMTPSA id 9B42127BBE2;
Tue, 28 Nov 2023 16:56:17 +0000 (GMT)
Received: from felis (localhost [127.0.0.1])
by localhost (OpenSMTPD) with ESMTP id 9f8dbdce;
Tue, 28 Nov 2023 16:56:16 +0000 (UTC)
References: <87pm08f41q.fsf@HIDDEN> <87bkbmm6o1.fsf@HIDDEN>
User-agent: mu4e 1.10.7; emacs 29.1
From: Christopher Baines <mail@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: bug#67250: builtin:git-download capability detection not
working for the bordeaux build farm
Date: Tue, 28 Nov 2023 16:54:07 +0000
In-reply-to: <87bkbmm6o1.fsf@HIDDEN>
Message-ID: <87y1ehlsup.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
micalg=pgp-sha512; protocol="application/pgp-signature"
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 67250
Cc: 67250 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
--=-=-=
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Ludovic Court=C3=A8s <ludo@HIDDEN> writes:
> Hi,
>
> Christopher Baines <mail@HIDDEN> skribis:
>
>> The bordeaux build farm depends on computing the derivations on one
>> machine, then potentially building them on a different machine.
>>
>> Some of the build machines don't have a new enough guix-daemon that
>> understands builtin:git-download, so derivations that use this are
>> sometimes failing (e.g. [1])
>>
>> 1: https://bordeaux.guix.gnu.org/build/10cc5622-6b1f-4f28-ad9a-41cf796d7=
a15
>>
>> One potential approach to address this is somehow have the data service
>> indicate that it wants compatible derivations when computing them,
>> rather than to have guix do feature detection against the guix-daemon
>> that is being used at the point the derivations are being computed.
>
> Would it work for you if we added a keyword argument to
> =E2=80=98open-connection=E2=80=99 in (guix store) that would let you sele=
ct which
> builtins to use?
>
> As in:
>
> (open-connection
> #:assume-available-builtin-builders '("download"))
Yep, that would at least allow freezing the available builtins going
forward and separating it from the running daemon.
--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"
-----BEGIN PGP SIGNATURE-----
iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmVmG65fFIAAAAAALgAo
aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF
ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh
aW5lcy5uZXQACgkQXiijOwuE9XfwYQ/+IUTIhIaLgxttyy41q7Us57Ellh1bOIeB
yiceqRqT12w1QvT0G8oazuvc8ZBdr3BLENEvcAqL01dDX0JevcSePuOMSQO8tEtk
0Rxy+iJ6ozdzjcsv9wXGHbcucwdfmhlT6yUVvkIhPIFxL29Dp8GqLlrNfWRMbl3n
1u6MQKgzTDq6yq0gK/2Y3cfoBJUvHuWtX7z/lF4+if7EeEQRolIaqmGt2xRr1sYu
5r8mheyXBdr0Ri2VyxWInQ7PM4WhGsYSRnp86fL3yUEsRcrtG/mAUQRgHv8hPlTy
KiQQICISDK7XYIFYjG+Dci2XqBp9qqGGiam9rLFqucepO9+bwSuq5WdxxmEeUG0m
Y3GGshyjlNWb0B9mvlcz7eRipHvSKHi2s/mbgy3ljypyaJuAO3d+w65B91n/gEXw
IN9GWXt4UF+mtiYYVztlFY+/+sB2NJ4KGh8qzuJKEJanlS2V5Qs6XVtP1P6LZ6ej
UPaL3fAgMBsDTE8L2xOgUKnS8qfC6ogQHmjellUmnjz4siss3veltcb13lEv/1dI
nwcrQsCXwv1MnYBXzorN7gu4VP5AUKwYpjG/zKMhLWXRzkK4HG601FKYAutraOYv
xRviG3ZoK8otcvS+qS4OzVu8vtRzh4TihJNEV0qyrsJqjOJe+SDIs+Y2q1Xp6kjn
1fZVGYJJVIc=
=MQR4
-----END PGP SIGNATURE-----
--=-=-=--
bug-guix@HIDDEN:bug#67250; Package guix.
Full text available.
Received: (at 67250) by debbugs.gnu.org; 28 Nov 2023 15:43:41 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Nov 28 10:43:41 2023
Received: from localhost ([127.0.0.1]:47464 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1r80FR-0001bP-CP
for submit <at> debbugs.gnu.org; Tue, 28 Nov 2023 10:43:41 -0500
Received: from mail-wm1-x331.google.com ([2a00:1450:4864:20::331]:39938)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <zimon.toutoune@HIDDEN>) id 1r80Ex-0001ZQ-17
for 67250 <at> debbugs.gnu.org; Tue, 28 Nov 2023 10:43:12 -0500
Received: by mail-wm1-x331.google.com with SMTP id
5b1f17b1804b1-40b2a85c99bso7438035e9.0
for <67250 <at> debbugs.gnu.org>; Tue, 28 Nov 2023 07:43:03 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=gmail.com; s=20230601; t=1701186178; x=1701790978; darn=debbugs.gnu.org;
h=content-transfer-encoding:mime-version:message-id:date:references
:in-reply-to:subject:cc:to:from:from:to:cc:subject:date:message-id
:reply-to; bh=H6RWtKc0MP7ePJDYKfJzIJs21J4YHcvJtKXKhBUp478=;
b=LY6niKW1HGck2YwJDZvYlqyIRUy2O4EtzddmN8v0lHZ+0UouUphRXY08DfPGzxyAMU
xyJX0qkS4ATM4vbDwdQPmPjjqFOx8kXO9PyFi++eZnRwHVO3i4Skzn96UciOhF9NwwRX
o/E1L6FBBkM7y8KQovV2UmaC7/OvW/B1BYlZXQYA8fsJmuoxOodlMc1tTNTTDk5WtcYB
RPnTn9jUddGd8LntUCp/1NkTM77XIQY4V5WMGLWU9GZWU+1ODpi6AGhcM5DTrlc7Z3K+
a3GVWDPyS6myO7g8PM1UyToW04jAuK9Kk5m9NCCRuBxR93Xcsju/DAxSkkhZaozqI9xQ
bOdQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
d=1e100.net; s=20230601; t=1701186178; x=1701790978;
h=content-transfer-encoding:mime-version:message-id:date:references
:in-reply-to:subject:cc:to:from:x-gm-message-state:from:to:cc
:subject:date:message-id:reply-to;
bh=H6RWtKc0MP7ePJDYKfJzIJs21J4YHcvJtKXKhBUp478=;
b=w8bsfd5l5h5puo/tC4Sdu8+7zJzbPOjstDi6UNEsh9q2NIgqclB52iciLJi4Eskyv1
BLu7BoJM+eACSJfwEzWxFWFrma7aPbmRbUrfaFBNiix4kt36Pnr1bdJGQDAqV6Pa0eUs
Aw4YuUCDzb1rstfH848QUiCeO4SxMeD4rkCwX5ydeWM1uPnq16Kn1j7TIwaenn7U4IVI
/aCMY7K7Y99GPdNGbvB4m4ckYi5Qv77dvjvCTxrBwim45I/gy4yzmVnduSe3RthCQzmO
FzK7gy6zdzKCKI1qPR0o0OEFv0G8eksweazXtbawzoYYNWnPWWwkphA9WiwWC8vq8g+5
W0fg==
X-Gm-Message-State: AOJu0YyJt2E+woNPTsgHD8W2i8vsY3Vxo6Tohq2uqnypytgU5YDxGjjc
ZHdNz9rGfz8iICji1+BneZgE+pX+LCI=
X-Google-Smtp-Source: AGHT+IH5I6BFE9QNpSmkCyTJ/GuYUpJu4aZvApf3Rx5K7sXLXG7JYTtSY78KMRNrDcMva3xYlAQQ3g==
X-Received: by 2002:a05:600c:8512:b0:405:358c:ba75 with SMTP id
gw18-20020a05600c851200b00405358cba75mr10846424wmb.0.1701186178098;
Tue, 28 Nov 2023 07:42:58 -0800 (PST)
Received: from pfiuh07 ([193.48.40.241]) by smtp.gmail.com with ESMTPSA id
h9-20020a05600c314900b0040b32edf626sm12272330wmo.31.2023.11.28.07.42.57
(version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
Tue, 28 Nov 2023 07:42:57 -0800 (PST)
From: Simon Tournier <zimon.toutoune@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>, Christopher Baines
<mail@HIDDEN>
Subject: Re: bug#67250: builtin:git-download capability detection not
working for the bordeaux build farm
In-Reply-To: <87bkbmm6o1.fsf@HIDDEN>
References: <87pm08f41q.fsf@HIDDEN> <87bkbmm6o1.fsf@HIDDEN>
Date: Tue, 28 Nov 2023 15:10:41 +0100
Message-ID: <87msuy9dem.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 67250
Cc: 67250 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)
Hi,
On Wed, 22 Nov 2023 at 11:19, Ludovic Court=C3=A8s <ludo@HIDDEN> wrote:
> As in:
>
> (open-connection
> #:assume-available-builtin-builders '("download"))
Instead, why not check in =E2=80=99git-fetch=E2=80=99? Currently, the test=
is done
against the local daemon, right?
--8<---------------cut here---------------start------------->8---
(define* (git-fetch ref hash-algo hash
#:optional name
#:key (system (%current-system))
guile git)
"Return a fixed-output derivation that fetches REF, a <git-reference>
object. The output is expected to have recursive hash HASH of type
HASH-ALGO (a symbol). Use NAME as the file name, or a generic name if #f."
(mlet %store-monad ((builtins (built-in-builders*)))
(if (member "git-download" builtins)
(git-fetch/built-in ref hash-algo hash name
#:system system)
(git-fetch/in-band ref hash-algo hash name
#:system system
#:guile guile
#:git git))))
--8<---------------cut here---------------end--------------->8---
For example, why not a test as:
(if (and SOMETHING
(member "git-download" builtins))
And this SOMETHING could be a global variable, as
%assume-builtin-builder, set to true by default and turn to false with
an environment variable, as GUIX_ASSUME_BUILTIN.
Cheers,
simon
bug-guix@HIDDEN:bug#67250; Package guix.
Full text available.Ludovic Courtès <ludo@HIDDEN>
to control <at> debbugs.gnu.org.
Full text available.
Received: (at 67250) by debbugs.gnu.org; 22 Nov 2023 10:19:54 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Nov 22 05:19:54 2023
Received: from localhost ([127.0.0.1]:58045 helo=debbugs.gnu.org)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
id 1r5kKn-00069l-VM
for submit <at> debbugs.gnu.org; Wed, 22 Nov 2023 05:19:54 -0500
Received: from eggs.gnu.org ([2001:470:142:3::10]:44330)
by debbugs.gnu.org with esmtp (Exim 4.84_2)
(envelope-from <ludo@HIDDEN>) id 1r5kKm-00069Y-E3
for 67250 <at> debbugs.gnu.org; Wed, 22 Nov 2023 05:19:53 -0500
Received: from fencepost.gnu.org ([2001:470:142:3::e])
by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
(Exim 4.90_1) (envelope-from <ludo@HIDDEN>)
id 1r5kKd-0007s1-UB; Wed, 22 Nov 2023 05:19:43 -0500
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=gnu.org;
s=fencepost-gnu-org; h=MIME-Version:Date:References:In-Reply-To:Subject:To:
From; bh=PxDCx2hBRKzSorKfiL3viERpJuSg5YXGfyimnvO+StE=; b=hgIFtmVwwcW3x6tB4ZeT
MKH4jzHbRSU20Nt3KQcITdCvxKfeDm4ShxHk4628IZkDSRsFrh7RJXJlfLPOVWqdITWe7FK4jwHvU
fEBV0PzKpZvHN71jZcMuqMqs/jQidGHAXO3sF0oPTqvbgVNxzwA4cY7G5644EnbKYUxQh0BozAIRW
Zrny+VeAprDyQCSa7yNQ40J1yUA7eirfY4h/+qGb+PZqlJuoHxl8BprO3nDg8pjHscLVaWY6liakB
uHE2OXgSNkteUGxVBFYzOljangp4eydw2PwO/Wavw/ZVF+I42P81qB4JBTaeXNRXcGHSoTqELM3I8
LrQIo364i56ftA==;
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: Christopher Baines <mail@HIDDEN>
Subject: Re: bug#67250: builtin:git-download capability detection not
working for the bordeaux build farm
In-Reply-To: <87pm08f41q.fsf@HIDDEN> (Christopher Baines's message of
"Fri, 17 Nov 2023 21:39:48 +0000")
References: <87pm08f41q.fsf@HIDDEN>
Date: Wed, 22 Nov 2023 11:19:42 +0100
Message-ID: <87bkbmm6o1.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: 67250
Cc: 67250 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>,
<mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)
Hi,
Christopher Baines <mail@HIDDEN> skribis:
> The bordeaux build farm depends on computing the derivations on one
> machine, then potentially building them on a different machine.
>
> Some of the build machines don't have a new enough guix-daemon that
> understands builtin:git-download, so derivations that use this are
> sometimes failing (e.g. [1])
>
> 1: https://bordeaux.guix.gnu.org/build/10cc5622-6b1f-4f28-ad9a-41cf796d7a=
15
>
> One potential approach to address this is somehow have the data service
> indicate that it wants compatible derivations when computing them,
> rather than to have guix do feature detection against the guix-daemon
> that is being used at the point the derivations are being computed.
Would it work for you if we added a keyword argument to
=E2=80=98open-connection=E2=80=99 in (guix store) that would let you select=
which
builtins to use?
As in:
(open-connection
#:assume-available-builtin-builders '("download"))
Ludo=E2=80=99.
bug-guix@HIDDEN:bug#67250; Package guix.
Full text available.Received: (at 67250) by debbugs.gnu.org; 20 Nov 2023 10:31:34 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Nov 20 05:31:34 2023 Received: from localhost ([127.0.0.1]:52535 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1r51Yz-0007t1-Ms for submit <at> debbugs.gnu.org; Mon, 20 Nov 2023 05:31:34 -0500 Received: from mira.cbaines.net ([2a01:7e00:e000:2f8:fd4d:b5c7:13fb:3d27]:40423) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <mail@HIDDEN>) id 1r51Yx-0007sq-8j for 67250 <at> debbugs.gnu.org; Mon, 20 Nov 2023 05:31:32 -0500 Received: from localhost (unknown [217.155.61.229]) by mira.cbaines.net (Postfix) with ESMTPSA id C8E0927BBE2; Mon, 20 Nov 2023 10:31:27 +0000 (GMT) Received: from felis (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id 07f2bed9; Mon, 20 Nov 2023 10:31:27 +0000 (UTC) References: <87pm08f41q.fsf@HIDDEN> <86zfz8219i.fsf@HIDDEN> User-agent: mu4e 1.10.7; emacs 29.1 From: Christopher Baines <mail@HIDDEN> To: Simon Tournier <zimon.toutoune@HIDDEN> Subject: Re: bug#67250: builtin:git-download capability detection not working for the bordeaux build farm Date: Mon, 20 Nov 2023 10:29:19 +0000 In-reply-to: <86zfz8219i.fsf@HIDDEN> Message-ID: <87cyw4g1hd.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 67250 Cc: 67250 <at> debbugs.gnu.org X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) --=-=-= Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Simon Tournier <zimon.toutoune@HIDDEN> writes: > Hi Chris, > > On Fri, 17 Nov 2023 at 21:39, Christopher Baines <mail@HIDDEN> wrote: > >> The bordeaux build farm depends on computing the derivations on one >> machine, then potentially building them on a different machine. >> >> Some of the build machines don't have a new enough guix-daemon that >> understands builtin:git-download, so derivations that use this are >> sometimes failing (e.g. [1]) > > Do you mean that the drv file is generated using a new daemon then this > drv file is =E2=80=9Coffloaded=E2=80=9D to another machine using an older= daemon and > thus fails to build it? Roughly, yep. >> One potential approach to address this is somehow have the data service >> indicate that it wants compatible derivations when computing them, >> rather than to have guix do feature detection against the guix-daemon >> that is being used at the point the derivations are being computed. > > Other solutions are: downgrade the daemon of one of the machine or > update the daemon of other machines, no? > > Why would the latter not be possible? It's possible, just difficult. Because with the current guix-daemon, the build coordinator can only build things that can be GC'd, some machines deliberately run older daemons to allow building newer things without hitting this issue. --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmVbNX5fFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9XfSyg//Yhf+0cVF3Qw626oFC1NZPqR6jZc2pYvV Wei5tO5SKUn47BeO6T3wz9kCQSuZoV3IM+ShpLKzp5jmLz2y/r7HH78T6EPR5hK6 PqSgUCV06mua4sAg/EiHADgo1lsM8koPiUo3QvkvqlFxgruG+QV4icoFYVq1EEMH PUD+10hgnYIMhr+Y8CiWwF+EnboOAbHAa9TAMghkkkhLXcjG8smG7JLt0JarhIzj mTMNq77s2BJ6NIgPRXWyagyxbbOroorDtsilYKB1ODQg8MRt6O4FcNJZlVIdctRS ZedqHtM7OzKJGq39xU4RmSXs7RW1sBVBS/WBKVfuFSoWJWg9KGXrePdt7zm/feJ3 p/GdFRon2y0OTXusMrGB2Wf4H2vGn/CqWfnyAexJcvA7jHgY8AYLwfJLoT17thJD b74n9AhCc5Zllg9Oggsbg4o1lJJOLcqbv21ExWYBNtUcW4DZukgJUkTk3hN596Ws CtRsxMoO3EznvFi+7Y/K3PbGFtqmr/zTfluKhuP6Qr4xKv92Y9xZ5AakTHRb9klq gF7KNr/cKwBSbRBYEKvC/hBHEfgSQYklFU16GKMts7yxPlAC44CQfkCKck1tsNVo vTfKDU8qCWX+Xoco1Md3xxgJxRlo5wTVtYvXK7uexAXD49lMqKVXxdhoHakHZG4Y BDdn5vO6Kb0= =injp -----END PGP SIGNATURE----- --=-=-=--
bug-guix@HIDDEN:bug#67250; Package guix.
Full text available.Received: (at 67250) by debbugs.gnu.org; 20 Nov 2023 10:22:33 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Mon Nov 20 05:22:33 2023 Received: from localhost ([127.0.0.1]:52512 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1r51QH-00053R-B4 for submit <at> debbugs.gnu.org; Mon, 20 Nov 2023 05:22:33 -0500 Received: from mail-wm1-x32b.google.com ([2a00:1450:4864:20::32b]:38347) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <zimon.toutoune@HIDDEN>) id 1r51QC-00052s-OF for 67250 <at> debbugs.gnu.org; Mon, 20 Nov 2023 05:22:29 -0500 Received: by mail-wm1-x32b.google.com with SMTP id 5b1f17b1804b1-408ffb55b35so4270435e9.1 for <67250 <at> debbugs.gnu.org>; Mon, 20 Nov 2023 02:22:26 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20230601; t=1700475741; x=1701080541; darn=debbugs.gnu.org; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:to:from:from:to:cc:subject:date:message-id :reply-to; bh=7BxQpUphK9lqvCBx3yTZAdG+7mx5gkMSVOkpffnaVog=; b=Ms/Sov3KbGzjhqx1N/Tkl3JJqM/KD03q1mMm5IEwrhfpJPK/yPLjM9Y14rQuBiEjpe ny5LH4UFd/GgeFl55u6fMu3yn9zSeC+iKFTsNEMpigRlDI3NgsY1Ojs3Yb35zwHBGEav l3m6H57Wn7FpVLbdzWbT8maWmJQpjP1ofxni9qGn0OMvFa8RAaTDeNDpVlVvkQQof6p+ x9yoqeQME2ZTmGzjCbvcYczsoGI2wAMsLQ0CmMIMm8kAatKmR4bep1vtez2sPgUBDNb8 9x777+NgeD1VliWJ18lwCsMYlC4oEP1wCY9tP45hS/iaR6ygubTOHlMx6Ns32aH/66yv f4Gg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1700475741; x=1701080541; h=content-transfer-encoding:mime-version:message-id:date:references :in-reply-to:subject:to:from:x-gm-message-state:from:to:cc:subject :date:message-id:reply-to; bh=7BxQpUphK9lqvCBx3yTZAdG+7mx5gkMSVOkpffnaVog=; b=UstX1R5IFjVHNXQl23hL2+P4IEI4sboV8/Vv7vyZA6MDIGOtD0B7RDCs9MBYIwADkn SldPeBBxsGHZ9kTHADvKQVrsukBi+Qj5doPr0//Juw/s7Yn+1IMt/7gv5vugAKrM9KZR SzmbaJLIKMUx3MfC02gaC21NTXgHQ66u9iCblvw3WxH1TwJArtHncVAkZv/oMht/OoC+ jVqredsiDs3vChJJMs8DbemTuVlX4oW9DM3TnP8bprskij6iH1nOCVVbsGwYopvRztHj PZpEtui3zM1Sf5/2YI7Z0sznCLuOWvl+iJjYAJH9exXD6LB0WmClU+xQcbK349BocZp7 E1yw== X-Gm-Message-State: AOJu0YxMQYZmEwKwnxPLL0YIBb4BVGhY6XPQC0ZR0Qt5ipYzRilpU1+x SGPT3bpIaW3bmOT0N6eROWgPucLCt8o= X-Google-Smtp-Source: AGHT+IEtjQ82Pc4aQDBSiwQ56FC+7pk59+55jUr4sainn6oEBoIZG/QyXdliIE+EK46HGESChJGEbQ== X-Received: by 2002:a1c:4c0f:0:b0:408:3ea2:1220 with SMTP id z15-20020a1c4c0f000000b004083ea21220mr6047904wmf.1.1700475740688; Mon, 20 Nov 2023 02:22:20 -0800 (PST) Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e]) by smtp.gmail.com with ESMTPSA id y3-20020a05600c17c300b0040586360a36sm16759543wmo.17.2023.11.20.02.22.20 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256); Mon, 20 Nov 2023 02:22:20 -0800 (PST) From: Simon Tournier <zimon.toutoune@HIDDEN> To: Christopher Baines <mail@HIDDEN>, 67250 <at> debbugs.gnu.org Subject: Re: bug#67250: builtin:git-download capability detection not working for the bordeaux build farm In-Reply-To: <87pm08f41q.fsf@HIDDEN> References: <87pm08f41q.fsf@HIDDEN> Date: Mon, 20 Nov 2023 10:59:53 +0100 Message-ID: <86zfz8219i.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-Spam-Score: -0.0 (/) X-Debbugs-Envelope-To: 67250 X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -1.0 (-) Hi Chris, On Fri, 17 Nov 2023 at 21:39, Christopher Baines <mail@HIDDEN> wrote: > The bordeaux build farm depends on computing the derivations on one > machine, then potentially building them on a different machine. > > Some of the build machines don't have a new enough guix-daemon that > understands builtin:git-download, so derivations that use this are > sometimes failing (e.g. [1]) Do you mean that the drv file is generated using a new daemon then this drv file is =E2=80=9Coffloaded=E2=80=9D to another machine using an older d= aemon and thus fails to build it? > One potential approach to address this is somehow have the data service > indicate that it wants compatible derivations when computing them, > rather than to have guix do feature detection against the guix-daemon > that is being used at the point the derivations are being computed. Other solutions are: downgrade the daemon of one of the machine or update the daemon of other machines, no? Why would the latter not be possible? Cheers simon
bug-guix@HIDDEN:bug#67250; Package guix.
Full text available.Received: (at submit) by debbugs.gnu.org; 17 Nov 2023 21:44:59 +0000 From debbugs-submit-bounces <at> debbugs.gnu.org Fri Nov 17 16:44:59 2023 Received: from localhost ([127.0.0.1]:47268 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>) id 1r46e2-00067w-NM for submit <at> debbugs.gnu.org; Fri, 17 Nov 2023 16:44:58 -0500 Received: from lists.gnu.org ([2001:470:142::17]:39706) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from <mail@HIDDEN>) id 1r46dx-00067X-Nj for submit <at> debbugs.gnu.org; Fri, 17 Nov 2023 16:44:56 -0500 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from <mail@HIDDEN>) id 1r46dk-0003ke-7J for bug-guix@HIDDEN; Fri, 17 Nov 2023 16:44:40 -0500 Received: from mira.cbaines.net ([212.71.252.8]) by eggs.gnu.org with esmtp (Exim 4.90_1) (envelope-from <mail@HIDDEN>) id 1r46di-0008Mm-My for bug-guix@HIDDEN; Fri, 17 Nov 2023 16:44:39 -0500 Received: from localhost (unknown [217.155.61.229]) by mira.cbaines.net (Postfix) with ESMTPSA id 0CF7327BBE2 for <bug-guix@HIDDEN>; Fri, 17 Nov 2023 21:44:36 +0000 (GMT) Received: from felis (localhost [127.0.0.1]) by localhost (OpenSMTPD) with ESMTP id a605ad14 for <bug-guix@HIDDEN>; Fri, 17 Nov 2023 21:44:35 +0000 (UTC) User-agent: mu4e 1.10.7; emacs 29.1 From: Christopher Baines <mail@HIDDEN> To: bug-guix@HIDDEN Subject: builtin:git-download capability detection not working for the bordeaux build farm Date: Fri, 17 Nov 2023 21:39:48 +0000 Message-ID: <87pm08f41q.fsf@HIDDEN> MIME-Version: 1.0 Content-Type: multipart/signed; boundary="=-=-="; micalg=pgp-sha512; protocol="application/pgp-signature" Received-SPF: pass client-ip=212.71.252.8; envelope-from=mail@HIDDEN; helo=mira.cbaines.net X-Spam_score_int: -18 X-Spam_score: -1.9 X-Spam_bar: - X-Spam_report: (-1.9 / 5.0 requ) BAYES_00=-1.9, SPF_HELO_PASS=-0.001, SPF_PASS=-0.001, T_SCC_BODY_TEXT_LINE=-0.01 autolearn=ham autolearn_force=no X-Spam_action: no action X-Spam-Score: 0.9 (/) X-Debbugs-Envelope-To: submit X-BeenThere: debbugs-submit <at> debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: <debbugs-submit.debbugs.gnu.org> List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe> List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/> List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org> List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help> List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe> Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org> X-Spam-Score: -0.1 (/) --=-=-= Content-Type: text/plain The bordeaux build farm depends on computing the derivations on one machine, then potentially building them on a different machine. Some of the build machines don't have a new enough guix-daemon that understands builtin:git-download, so derivations that use this are sometimes failing (e.g. [1]) 1: https://bordeaux.guix.gnu.org/build/10cc5622-6b1f-4f28-ad9a-41cf796d7a15 One potential approach to address this is somehow have the data service indicate that it wants compatible derivations when computing them, rather than to have guix do feature detection against the guix-daemon that is being used at the point the derivations are being computed. --=-=-= Content-Type: application/pgp-signature; name="signature.asc" -----BEGIN PGP SIGNATURE----- iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmVX3sFfFIAAAAAALgAo aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh aW5lcy5uZXQACgkQXiijOwuE9Xd58g/+IBe+dYxUo+IkUVhSmXhtTBsb5gkYDnpa rbFGAmUOMe99Yqtv2iz0RgV/aO2a1C/BxW3RVJXdEVUGFmM9MxqpOph2TLQ2s7Om mPGbgzjEtJyoVWItAnD5x9K9WCC7ln1U+SpscZurv33geq8fmB4iTTWhpmBjt+U8 A8YBqoSKYgjgiWKi4T/J1e/Bcn7SbZ0RnSSW7OGLBwoqEAzu4qa/NCUGidMsHZ/0 xn3sUXd/iOqd9+HfYgl7c7/wrDVBqF6Fsp+GEzR3OKoXLha6ZFRxSTOrUpSsHZ/W z9Q3/3zuGV5a8faNnZWzDaYMP6kNAYYrBBSqx58zS8xI74JpT5i8lG28jocfPmUG k9JWXjAcM1etFEPI0Z70Mf3UUQi+0ng+oVbZc4DSryJPfZbqYb5wQlv3gytk5tYm xYNtfZesLqRcuPWUlk3XvEIengQbWlABBk15RVDCMA1SFytIdiehMVrf1CopcwOC g1+hS9QEK++mEZOoTxs8fPDtzT1F2G+Kot6TQjhFro8pwBHA+ObmQpTNDH9/Ss9I VgCAcsqRYOF1jyAVDwvmDv4pCeLIuaBZA0FVqCUzC1vcsfJKkAY81Oc7momq2+5d iX0mLBdopi5SaHkbovEz8T1ph1jUA76qhbuO+2mzdfYwBsluzDOpmxzg3dEtWT7w 9mSQ5lZ8dow= =DeUn -----END PGP SIGNATURE----- --=-=-=--
Christopher Baines <mail@HIDDEN>:bug-guix@HIDDEN.
Full text available.bug-guix@HIDDEN:bug#67250; Package guix.
Full text available.
GNU bug tracking system
Copyright (C) 1999 Darren O. Benham,
1997 nCipher Corporation Ltd,
1994-97 Ian Jackson.