GNU bug report logs - #61324
[PATCH] download: Add bordeaux.guix.gnu.org as a content addressed mirror.

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 61324 in the body.
You can then email your comments to 61324 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Christopher Baines <mail <at> cbaines.net>
To: guix-patches <at> gnu.org
Subject: [PATCH] download: Add bordeaux.guix.gnu.org as a content addressed
 mirror.
Date: Mon,  6 Feb 2023 16:55:05 +0100

bordeaux.guix.gnu.org now provides access to some files by hash. This is done
through the nar-herder finding a nar produced by a fixed output derivation for
the requested content, and then providing the content stored inside that nar.

I've put this new entry at the start of the list, as I think it's more likely
to have content than the others. Because bordeaux.guix.gnu.org stores nars
indefinitely, my suspicion is that it's going to be able to fulfil more
requests than ci.guix.gnu.org, which relies on the file requested being in the
store (so the now frequent garbage collection is going to limit the files
available).

* guix/download.scm (%content-addressed-mirrors): Add bordeaux.guix.gnu.org.
---
 guix/download.scm | 6 +++++-
 1 file changed, 5 insertions(+), 1 deletion(-)

diff --git a/guix/download.scm b/guix/download.scm
index fff54d7a17..561a893eee 100644
--- a/guix/download.scm
+++ b/guix/download.scm
@@ -387,7 +387,11 @@ (define (guix-publish host)
                         file "/" (symbol->string algo) "/"
                         (bytevector->nix-base32-string hash))))
 
-     (list (guix-publish "ci.guix.gnu.org")
+     (list (guix-publish
+            ;; bordeaux.guix.gnu.org uses the nar-herder rather than guix
+            ;; publish, but it supports the same style of requests
+            "bordeaux.guix.gnu.org")
+           (guix-publish "ci.guix.gnu.org")
            (lambda (file algo hash)
              ;; 'tarballs.nixos.org' supports several algorithms.
              (string-append "https://tarballs.nixos.org/"
-- 
2.38.1

Message #8 received at 61324 <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: Christopher Baines <mail <at> cbaines.net>
Cc: 61324 <at> debbugs.gnu.org
Subject: Re: bug#61324: [PATCH] download: Add bordeaux.guix.gnu.org as a
 content addressed mirror.
Date: Fri, 10 Feb 2023 23:41:39 +0100

Hi!

Christopher Baines <mail <at> cbaines.net> skribis:

> bordeaux.guix.gnu.org now provides access to some files by hash. This is done
> through the nar-herder finding a nar produced by a fixed output derivation for
> the requested content, and then providing the content stored inside that nar.

Nice!

> I've put this new entry at the start of the list, as I think it's more likely
> to have content than the others. Because bordeaux.guix.gnu.org stores nars
> indefinitely, my suspicion is that it's going to be able to fulfil more
> requests than ci.guix.gnu.org, which relies on the file requested being in the
> store (so the now frequent garbage collection is going to limit the files
> available).

Right, could be.  (At one point we had nginx caching for /file URLs; not
sure if that’s still the case, and it wouldn’t really solve the
problem.)

> * guix/download.scm (%content-addressed-mirrors): Add bordeaux.guix.gnu.org.
> ---
>  guix/download.scm | 6 +++++-
>  1 file changed, 5 insertions(+), 1 deletion(-)
>
> diff --git a/guix/download.scm b/guix/download.scm
> index fff54d7a17..561a893eee 100644
> --- a/guix/download.scm
> +++ b/guix/download.scm
> @@ -387,7 +387,11 @@ (define (guix-publish host)
>                          file "/" (symbol->string algo) "/"
>                          (bytevector->nix-base32-string hash))))
>  
> -     (list (guix-publish "ci.guix.gnu.org")
> +     (list (guix-publish
> +            ;; bordeaux.guix.gnu.org uses the nar-herder rather than guix
> +            ;; publish, but it supports the same style of requests
> +            "bordeaux.guix.gnu.org")
> +           (guix-publish "ci.guix.gnu.org")

LGTM, thanks!

Ludo’.

Message #13 received at 61324-done <at> debbugs.gnu.org (full text, mbox):

From: Christopher Baines <mail <at> cbaines.net>
To: Ludovic Courtès <ludo <at> gnu.org>
Cc: 61324-done <at> debbugs.gnu.org
Subject: Re: bug#61324: [PATCH] download: Add bordeaux.guix.gnu.org as a
 content addressed mirror.
Date: Sat, 11 Feb 2023 21:04:46 +0000

[Message part 1 (text/plain, inline)]

Ludovic Courtès <ludo <at> gnu.org> writes:

>> * guix/download.scm (%content-addressed-mirrors): Add bordeaux.guix.gnu.org.
>> ---
>>  guix/download.scm | 6 +++++-
>>  1 file changed, 5 insertions(+), 1 deletion(-)
>>
>> diff --git a/guix/download.scm b/guix/download.scm
>> index fff54d7a17..561a893eee 100644
>> --- a/guix/download.scm
>> +++ b/guix/download.scm
>> @@ -387,7 +387,11 @@ (define (guix-publish host)
>>                          file "/" (symbol->string algo) "/"
>>                          (bytevector->nix-base32-string hash))))
>>  
>> -     (list (guix-publish "ci.guix.gnu.org")
>> +     (list (guix-publish
>> +            ;; bordeaux.guix.gnu.org uses the nar-herder rather than guix
>> +            ;; publish, but it supports the same style of requests
>> +            "bordeaux.guix.gnu.org")
>> +           (guix-publish "ci.guix.gnu.org")
>
> LGTM, thanks!

Awesome, I've gone ahead and pushed this as
7d0ebe040d80adcf143656e754a82b569243568c.

Thanks,

Chris

[signature.asc (application/pgp-signature, inline)]

Message #16 received at 61324-done <at> debbugs.gnu.org (full text, mbox):

From: zimoun <zimon.toutoune <at> gmail.com>
To: Christopher Baines <mail <at> cbaines.net>, Ludovic Courtès
 <ludo <at> gnu.org>
Cc: 61324-done <at> debbugs.gnu.org
Subject: Re: bug#61324: [PATCH] download: Add bordeaux.guix.gnu.org as a
 content addressed mirror.
Date: Thu, 16 Feb 2023 11:13:24 +0100

Hi,

I am late to the party. :-)

On Sat, 11 Feb 2023 at 21:04, Christopher Baines <mail <at> cbaines.net> wrote:

>>> -     (list (guix-publish "ci.guix.gnu.org")
>>> +     (list (guix-publish
>>> +            ;; bordeaux.guix.gnu.org uses the nar-herder rather than guix
>>> +            ;; publish, but it supports the same style of requests
>>> +            "bordeaux.guix.gnu.org")
>>> +           (guix-publish "ci.guix.gnu.org")

The attempts are done in the order of the list, right?  First, it tries
bordeaux.guix.gnu.org, then ci.guix.gnu.org, then tarballs.nixos.org.

Somehow it does not really matter, just to be sure the pressure is not
too much for the resources behind Bordeaux. :-)

Cheers,
simon

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.