GNU logs - #46942, boring messages

Message sent to bug-guix@HIDDEN:

Subject: bug#46942: ci.guix.gnu.org is slow from my system
Resent-From: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Fri, 05 Mar 2021 11:23:01 +0000
Resent-Message-ID: <handler.46942.B.161494335414266 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: 46942 <at> debbugs.gnu.org
Reply-To: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Date: Fri, 05 Mar 2021 11:22:17 +0000
From: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Message-ID: <o8ZL0xD90cccAtyMQf2WaXcVlgCTjddqRp0u-xWYYxfncv-VGatQvHBMICTmnxofKzDm7-aiieRIICqY-nHK2RO91C6Z75qczNj_s0u3TaA=@protonmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Received-SPF: pass client-ip=185.70.40.140;
 envelope-from=raid5atemyhomework@HIDDEN; helo=mail-40140.protonmail.ch
X-Spam_score_int: -20
X-Spam_score: -2.1
X-Spam_bar: --
X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1,
 DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001,
 RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H4=0.001, RCVD_IN_MSPIKE_WL=0.001,
 SPF_HELO_PASS=-0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no
X-Spam_action: no action
X-Spam-Score: 0.7 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -2.3 (--)

Downloading substitutes from ci.guix.gnu.org is slow from my two Guix-using=
 computers.

One is a pure Guix System install without any channels, the other one is a =
foreign Guix install with the-channel-that-cannot-be-named.

```
downloading from https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmw=
qrrb8lz-wine64-6.0 ...
 wine64-6.0  54.4MiB                                                       =
                                                                          1=
0KiB/s 01:55 [                  ]   2.1%
```

This can be very slow, including as slow as 4KiB/s at times. This is fairly=
 awful since sometimes I get this result:

```
downloading from https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmw=
qrrb8lz-wine64-6.0 ...
 wine64-6.0  54.4MiB                                                       =
                                                                          4=
9KiB/s 06:01 [#####             ]  31.9%guix substitute: error: TLS error i=
n procedure 'read_from_session_record_port': Error decoding the received TL=
S packet.
substitution of /gnu/store/1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0 fail=
ed
guix package: error: some substitutes for the outputs of derivation `/gnu/s=
tore/wr9kf2bgcsvwxcmhnl9lf047nr8xcklc-wine64-6.0.drv' failed (usually happe=
ns due to networking issues); try `--fallback' to build derivation from sou=
rce
```

Because of the failed incomplete download, I have to ***restart the downloa=
d again from 0%***, which is awful, awful UX. It would be really nice if:

1. The guix download process would make an effort to ***retry*** this a few=
 times.
2. Continue the previous download instead of restarting from 0%.

The problem is not on my ISP, or at least not solely on my ISP. Doing a `wg=
et` from `github.com`:

```
$ wget https://github.com/zfsonlinux/zfs/releases/download/zfs-2.0.3/zfs-2.=
0.3.tar.gz
--2021-03-05 17:39:46--  https://github.com/zfsonlinux/zfs/releases/downloa=
d/zfs-2.0.3/zfs-2.0.3.tar.gz
Resolving github.com (github.com)... 13.229.188.59
Connecting to github.com (github.com)|13.229.188.59|:443... connected.
HTTP request sent, awaiting response... 301 Moved Permanently
Location: https://github.com/openzfs/zfs/releases/download/zfs-2.0.3/zfs-2.=
0.3.tar.gz [following]
--2021-03-05 17:39:47--  https://github.com/openzfs/zfs/releases/download/z=
fs-2.0.3/zfs-2.0.3.tar.gz
Reusing existing connection to github.com:443.
HTTP request sent, awaiting response... 302 Found
Location: https://github-releases.githubusercontent.com/437011/71526a80-6ba=
3-11eb-893f-4ceb55b479d6?X-Amz-Algorithm=3DAWS4-HMAC-SHA256&X-Amz-Credentia=
l=3DAKIAIWNJYAX4CSVEH53A%2F20210305%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-D=
ate=3D20210305T093947Z&X-Amz-Expires=3D300&X-Amz-Signature=3D9454446348219a=
a0731af009a5232bf5772e3d45a3a34052fa61f64f04c3c979&X-Amz-SignedHeaders=3Dho=
st&actor_id=3D0&key_id=3D0&repo_id=3D437011&response-content-disposition=3D=
attachment%3B%20filename%3Dzfs-2.0.3.tar.gz&response-content-type=3Dapplica=
tion%2Foctet-stream [following]
--2021-03-05 17:39:47--  https://github-releases.githubusercontent.com/4370=
11/71526a80-6ba3-11eb-893f-4ceb55b479d6?X-Amz-Algorithm=3DAWS4-HMAC-SHA256&=
X-Amz-Credential=3DAKIAIWNJYAX4CSVEH53A%2F20210305%2Fus-east-1%2Fs3%2Faws4_=
request&X-Amz-Date=3D20210305T093947Z&X-Amz-Expires=3D300&X-Amz-Signature=
=3D9454446348219aa0731af009a5232bf5772e3d45a3a34052fa61f64f04c3c979&X-Amz-S=
ignedHeaders=3Dhost&actor_id=3D0&key_id=3D0&repo_id=3D437011&response-conte=
nt-disposition=3Dattachment%3B%20filename%3Dzfs-2.0.3.tar.gz&response-conte=
nt-type=3Dapplication%2Foctet-stream
Resolving github-releases.githubusercontent.com (github-releases.githubuser=
content.com)... 185.199.108.154, 185.199.109.154, 185.199.110.154, ...
Connecting to github-releases.githubusercontent.com (github-releases.github=
usercontent.com)|185.199.108.154|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 13114404 (13M) [application/octet-stream]
Saving to: =E2=80=98zfs-2.0.3.tar.gz=E2=80=99

zfs-2.0.3.tar.gz                                100%[=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>]  12.51M  9.34MB=
/s    in 1.3s

2021-03-05 17:39:49 (9.34 MB/s) - =E2=80=98zfs-2.0.3.tar.gz=E2=80=99 saved =
[13114404/13114404]

```

As can be seen above, I get 9.34MB/s elsewhere, which is better than the >6=
0Mbit/s promised by my ISP.

It's possible that the problem is between my ISP and ci.guix.gnu.org. If I =
`wget` directly:

```
$ wget https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wi=
ne64-6.0
--2021-03-05 18:56:21--  https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh=
76xw6hmwqrrb8lz-wine64-6.0
Resolving ci.guix.gnu.org (ci.guix.gnu.org)... 141.80.181.40
Connecting to ci.guix.gnu.org (ci.guix.gnu.org)|141.80.181.40|:443... conne=
cted.
HTTP request sent, awaiting response... 200 OK
Length: 57048561 (54M) [application/octet-stream]
Saving to: =E2=80=981bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0=E2=80=99

1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0       0%[                      =
                                                                           =
     ] 167.79K  13.4KB/s    eta 69m 20s^C
```

HOWEVER, if I `torify wget`:

```
$ torify wget https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmwqrr=
b8lz-wine64-6.0
--2021-03-05 18:57:00--  https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh=
76xw6hmwqrrb8lz-wine64-6.0
Resolving ci.guix.gnu.org (ci.guix.gnu.org)... 141.80.181.40
Connecting to ci.guix.gnu.org (ci.guix.gnu.org)|141.80.181.40|:443... conne=
cted.
HTTP request sent, awaiting response... 200 OK
Length: 57048561 (54M) [application/octet-stream]
Saving to: =E2=80=981bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0.1=E2=80=
=99

1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0.1    13%[=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D>                                                           =
                              ]   7.13M   683KB/s    eta 72s    ^C
```

Which is a big WHAT THE FUCK? Tor should not be 45x faster (683KB/s) than d=
irectly from my ISP (13KB/s). I am not using any special workarounds for To=
r, like meek or obfs4, which makes me doubt that my ISP is attempting to ce=
nsor --- if my ISP is the one doing the censoring, it would probably target=
 Tor first before ci.guix.gnu.org, but I can access Tor just fine without s=
pecial workarounds needed for very oppressive countries.

I've tried this a few times.  Consistently, using `torify wget` is much fas=
ter than `wget` alone, I don't have to bang my head in boredom with `torify=
 wget`.  This is not my expectation given what I understand of the Tor netw=
ork and the public network.

Is `ci.guix.gnu.org` doing some kind of per-IP or per-ISP or other throttli=
ng?  This looks very suspicious given the massive speed difference when usi=
ng Tor and not using Tor.

Doing `torify guix package -m manifest.scm` does not seem to perform the do=
wnload inside Tor, which makes sense since it's probably `guix-daemon` that=
 is doing the download.

So my questions are:

* WHY IS DIRECT DOWNLOAD FROM MY ISP SLOWER THAN TOR? What can I do to chec=
k if it's my ISP that is attempting to censor ci.guix.gnu.org?
* Is there a way to make `guix-daemon` use a Tor proxy?  I have two systems=
 using Guix, one is a Guix System, the other is using a foreign distro, and=
 I'd like to adjust both to use Tor instead since it's faster.
  * If not, is there a way to tell `guix-daemon` that I have these `nar` fi=
les and it can put them in its store somehow instead of me waiting for it t=
o ***SLOOOOOOOOWLY*** download it?
* Are there any mirrors I can use for substitutes instead? How do I change =
my systems (both the Guix System and the foreign distro) to use the mirrors=
? Is there some configuration option to do this?
* How hard would it be to make the substitute download process at least mak=
e an effort to attempt to continue a failed download instead of failing imm=
ediately and forcing a restart from 0%? `texlive` is something like 400Mb, =
it takes hours at 10KiB/s, I once had it fail at >90% which was very painfu=
l because it had to restart from 0%, I had to do `guix package -m manifest.=
scm` in a loop over and over again until it finished download. It would pro=
bably cut down on people hammering on the server as well.

Thanks
raid5atemyhomework

Message sent:

Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.505 (Entity 5.505)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Subject: bug#46942: Acknowledgement (ci.guix.gnu.org is slow from my system)
Message-ID: <handler.46942.B.161494335414266.ack <at> debbugs.gnu.org>
References: <o8ZL0xD90cccAtyMQf2WaXcVlgCTjddqRp0u-xWYYxfncv-VGatQvHBMICTmnxofKzDm7-aiieRIICqY-nHK2RO91C6Z75qczNj_s0u3TaA=@protonmail.com>
X-Gnu-PR-Message: ack 46942
X-Gnu-PR-Package: guix
Reply-To: 46942 <at> debbugs.gnu.org
Date: Fri, 05 Mar 2021 11:23:02 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 bug-guix@HIDDEN

If you wish to submit further information on this problem, please
send it to 46942 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
46942: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D46942
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems

Message sent to bug-guix@HIDDEN:

Subject: bug#46942: ci.guix.gnu.org is slow from my system
Resent-From: Christopher Baines <mail@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Fri, 05 Mar 2021 11:49:02 +0000
Resent-Message-ID: <handler.46942.B46942.161494493317602 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Cc: 46942 <at> debbugs.gnu.org
References: <o8ZL0xD90cccAtyMQf2WaXcVlgCTjddqRp0u-xWYYxfncv-VGatQvHBMICTmnxofKzDm7-aiieRIICqY-nHK2RO91C6Z75qczNj_s0u3TaA=@protonmail.com>
User-agent: mu4e 1.4.15; emacs 27.1
From: Christopher Baines <mail@HIDDEN>
In-reply-to: <o8ZL0xD90cccAtyMQf2WaXcVlgCTjddqRp0u-xWYYxfncv-VGatQvHBMICTmnxofKzDm7-aiieRIICqY-nHK2RO91C6Z75qczNj_s0u3TaA=@protonmail.com>
Date: Fri, 05 Mar 2021 11:48:44 +0000
Message-ID: <87o8fxn7mr.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
 micalg=pgp-sha512; protocol="application/pgp-signature"
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

--=-=-=
Content-Type: text/plain


raid5atemyhomework via Bug reports for GNU Guix <bug-guix@HIDDEN> writes:

> Downloading substitutes from ci.guix.gnu.org is slow from my two Guix-using computers.
>
> One is a pure Guix System install without any channels, the other one is a foreign Guix install with the-channel-that-cannot-be-named.
>
>
> ```
> downloading from https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0 ...
>  wine64-6.0  54.4MiB                                                                                                                                 10KiB/s 01:55 [                  ]   2.1%
> ```

If you try this same download again, do you get the same speed?

guix publish, which is used on ci.guix.gnu.org can dynamically create
nars if they're not cached, which will probably result in slower
download speeds.

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQKlBAEBCgCPFiEEPonu50WOcg2XVOCyXiijOwuE9XcFAmBCGp5fFIAAAAAALgAo
aXNzdWVyLWZwckBub3RhdGlvbnMub3BlbnBncC5maWZ0aGhvcnNlbWFuLm5ldDNF
ODlFRUU3NDU4RTcyMEQ5NzU0RTBCMjVFMjhBMzNCMEI4NEY1NzcRHG1haWxAY2Jh
aW5lcy5uZXQACgkQXiijOwuE9XeaphAAotp1sc8bmjJe+4HmKG6w8Fckf7qeOCx1
8MWekR9pV1fi6/5ULUedMlAVL6XEsKaAYLw7+NWb83J4YBbMZFmvt6jTo19HJdaG
CIjgTSIMLvbdvwZFtFZDfTtxJkwoRZcRaPm4UMwy3IUrviHAu27olpDa6MygS4Ox
GWnEaJuuCBWMlHEAbuDLZ4Xprtih44nTXNX6FzvGLKql00UqVRlmpDK1a3AZbwg9
0U64M7eHKrIe0y0QuXHZvf0FGgEss/3B4QB14Cz1CaZD/bR0iHY2WxoZmNGQVdcZ
B+zYMKOBBBz9dF4QYtIHNfETWc7DIv9tdpOXEsaMB2nADnlvl0PRjKq9gFjNEwy+
5nmni+bH6MuNRqsjA3IEj3aaOPMCvGQuGMkBrS0UCXd2DHgvHvDcJyu5M6f8HnLB
kt8n9BnyiPX2uFU+713+0nvH39enrf67K7qcRfLo3IoDv38RxlbyGa1e9FiVEW56
HtqWcqESJzZd+VvpYIP2iw4fiHjCx6iBzM9arq5sLsIYiFqGhJzBYEXvlPXaJFSM
l3WK6vPZYyE4HOF5/Jvyao+1vo/YwluDE/iMNcM7PHHRuG/tmUt3EcGxmST2Z7ED
LoVtKYdh7XIh1vecQ2sUmxFaYca8MArlab9JTpYJPBJmxoQYxYUDgkHPd3sLGGW7
gGxnRHXH8x4=
=fuaX
-----END PGP SIGNATURE-----
--=-=-=--

Message sent to bug-guix@HIDDEN:

Subject: bug#46942: ci.guix.gnu.org is slow from my system
Resent-From: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Fri, 05 Mar 2021 12:14:01 +0000
Resent-Message-ID: <handler.46942.B46942.161494638819934 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Christopher Baines <mail@HIDDEN>
Cc: "46942 <at> debbugs.gnu.org" <46942 <at> debbugs.gnu.org>
Reply-To: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Date: Fri, 05 Mar 2021 12:12:51 +0000
From: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Message-ID: <D00R0PNVPHdI9gTJMtHRUkbwKIrlh1sZO_nRfHdT7xjLgaFwg4XyDlkfHxBTz4Pg00-LdKZNmDcyRqKu7BIt5m9wd9LF5-UVH-XZxFAqYh4=@protonmail.com>
In-Reply-To: <87o8fxn7mr.fsf@HIDDEN>
References: <o8ZL0xD90cccAtyMQf2WaXcVlgCTjddqRp0u-xWYYxfncv-VGatQvHBMICTmnxofKzDm7-aiieRIICqY-nHK2RO91C6Z75qczNj_s0u3TaA=@protonmail.com>
 <87o8fxn7mr.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

Hello Christopher,

> raid5atemyhomework via Bug reports for GNU Guix bug-guix@HIDDEN writes:
>
> > Downloading substitutes from ci.guix.gnu.org is slow from my two Guix-u=
sing computers.
> > One is a pure Guix System install without any channels, the other one i=
s a foreign Guix install with the-channel-that-cannot-be-named.
> >
> >     downloading from https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh=
76xw6hmwqrrb8lz-wine64-6.0 ...
> >      wine64-6.0  54.4MiB                                               =
                                                                           =
       10KiB/s 01:55 [                  ]   2.1%
> >
>
> If you try this same download again, do you get the same speed?
>
> guix publish, which is used on ci.guix.gnu.org can dynamically create
> nars if they're not cached, which will probably result in slower
> download speeds.

Yes, I have been suffering slow download speeds for a few weeks now.  Even =
with repeated downloads, it is consistently slow.  I only just now tried ou=
t using `torify wget`, which surprised me since it was much much faster ---=
 one lucky download even got up to 6MB/s over frikking TOR before I ^Ced it=
.  I've even tried doing `torify wget` and `wget` in parallel on two separa=
te shells --- the `torify wget` was definitely faster, getting anywhere fro=
m 100kB/s to 700kB/s with a few outliers at >1MB/s, while `wget` was consis=
tently below 40kB/s and eventually settling to ~11kB/s after a few seconds.

This holds even for packages I expect to be popular and thus likely to be i=
n-cache with high probability, like `linux-libre`.

Thanks
raid5atemyhomework

Message sent to bug-guix@HIDDEN:

X-Loop: help-debbugs@HIDDEN
Subject: bug#46942: ci.guix.gnu.org is slow from my system
Resent-From: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Fri, 05 Mar 2021 12:27:01 +0000
Resent-Message-ID: <handler.46942.B46942.161494719921242 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 46942
X-GNU-PR-Package: guix
X-GNU-PR-Keywords: 
To: "46942 <at> debbugs.gnu.org" <46942 <at> debbugs.gnu.org>
Reply-To: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Received: via spool by 46942-submit <at> debbugs.gnu.org id=B46942.161494719921242
          (code B ref 46942); Fri, 05 Mar 2021 12:27:01 +0000
Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 12:26:39 +0000
Received: from localhost ([127.0.0.1]:33112 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1lI9XT-0005WX-3C
	for submit <at> debbugs.gnu.org; Fri, 05 Mar 2021 07:26:39 -0500
Received: from mail-40141.protonmail.ch ([185.70.40.141]:23608)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <raid5atemyhomework@HIDDEN>)
 id 1lI9XQ-0005W4-Bn
 for 46942 <at> debbugs.gnu.org; Fri, 05 Mar 2021 07:26:37 -0500
Date: Fri, 05 Mar 2021 12:26:22 +0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com;
 s=protonmail; t=1614947189;
 bh=+F1Etm1o2/xeuqvv38F4WXCF1PghszDf25dRWuoQJ4A=;
 h=Date:To:From:Reply-To:Subject:In-Reply-To:References:From;
 b=XLT2qSKOIrS8BzCB4jWZxYvfPbMrmkasQ6h200TdPIxI6ISFqzljGX5b1iHK9BJyy
 qNk81QEwyPWRIitiEG5+wgltdBrtY2OTbBo/U8MeLsNnTlEdq4g0j5iY2YzErtj4E0
 KNBFnQm9OTZulBH/0rw/QINcfoiIPjtu+zMsCGbo=
From: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Message-ID: <gGJ5ufbP7AiW8HkFcWkPNmZl1dqnZ_74LuNAZ_Ey-y3TF8cDLEwQrK0P9aE7KmsZRZ0Lr32EiUB_0L8BD5MkoHdptYv49ImcU8_gaENiMRs=@protonmail.com>
In-Reply-To: <87o8fxn7mr.fsf@HIDDEN>
References: <o8ZL0xD90cccAtyMQf2WaXcVlgCTjddqRp0u-xWYYxfncv-VGatQvHBMICTmnxofKzDm7-aiieRIICqY-nHK2RO91C6Z75qczNj_s0u3TaA=@protonmail.com>
 <87o8fxn7mr.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED,
 DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no
 autolearn=disabled version=3.4.4
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on
 mailout.protonmail.ch
X-Spam-Score: 0.0 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

> * Is there a way to make `guix-daemon` use a Tor proxy?  I have two syste=
ms using Guix, one is a Guix System, the other is using a foreign distro, a=
nd I'd like to adjust both to use Tor instead since it's faster.

I saw that `guix-daemon` respects `http_proxy` and `https_proxy` envvars, b=
ut trying it out on my foreign-distro Guix computer, adding `https_proxy=3D=
socks5h://127.0.0.1:9050 http_proxy=3Dsocks5h://127.0.0.1:9050` to the `sys=
temd` service file doesn't work.

```
guix substitute: error: TLS error in procedure 'handshake': The TLS connect=
ion was non-properly terminated.
substitution of /gnu/store/1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.0 fail=
ed
guix package: error: some substitutes for the outputs of derivation `/gnu/s=
tore/wr9kf2bgcsvwxcmhnl9lf047nr8xcklc-wine64-6.0.drv' failed (usually happe=
ns due to networking issues); try `--fallback' to build derivation from sou=
rce
```
Looking at the foreign distro's syslog:

```
Mar  5 19:52:03 developer guix-daemon[145182]: accepted connection from pid=
 145190, user raid5atemyhomework
Mar  5 19:52:05 developer guix-daemon[145200]: spurious SIGPOLL
Mar  5 19:52:07 developer Tor[1029]: Socks version 67 not recognized. (This=
 port is not an HTTP proxy; did you want to use HTTPTunnelPort?)
```

So it looks to me that `guix-daemon` expects `https_proxy` to be an HTTPS p=
roxy and not a SOCKS5/SOCKS5H proxy. I'll look into Tor's HTTPTunnelPort.

Thanks
raid5atemyhomework

Message sent to bug-guix@HIDDEN:

X-Loop: help-debbugs@HIDDEN
Subject: bug#46942: ci.guix.gnu.org is slow from my system
Resent-From: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Fri, 05 Mar 2021 12:42:01 +0000
Resent-Message-ID: <handler.46942.B46942.161494810730654 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 46942
X-GNU-PR-Package: guix
X-GNU-PR-Keywords: 
To: "46942 <at> debbugs.gnu.org" <46942 <at> debbugs.gnu.org>
Reply-To: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Received: via spool by 46942-submit <at> debbugs.gnu.org id=B46942.161494810730654
          (code B ref 46942); Fri, 05 Mar 2021 12:42:01 +0000
Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 12:41:47 +0000
Received: from localhost ([127.0.0.1]:33128 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1lI9m6-0007yM-LA
	for submit <at> debbugs.gnu.org; Fri, 05 Mar 2021 07:41:46 -0500
Received: from mail-40140.protonmail.ch ([185.70.40.140]:34872)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <raid5atemyhomework@HIDDEN>)
 id 1lI9m4-0007y4-Fb
 for 46942 <at> debbugs.gnu.org; Fri, 05 Mar 2021 07:41:45 -0500
Date: Fri, 05 Mar 2021 12:41:34 +0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com;
 s=protonmail; t=1614948097;
 bh=f3wPojrDQc0PQGaiv6TcjOzL7sxS3HrKqLAySaUo0jU=;
 h=Date:To:From:Reply-To:Subject:In-Reply-To:References:From;
 b=Tz8kXiWrL+SHINmnwQ2b+GQdRQriAtyTR7hYAUoFPphYpuCy9J5JW4dwSJh9DcGmL
 GIK4jfy3dTvgvoxCGcz41GVorlHUu2WpFSiVESZvtDQz5zCbialYmqsgd8Y+rmWgMI
 uEBNOQV5b9qGesCmoLr6f/CCd8wPFsb9kbexQUqs=
From: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Message-ID: <B2rGBGXuPprLVfDpjZ9D8nyA6jXmGlXasaaPuk5XCsfizBziMqyN30BPDkTbvnTnYMBIPTPn52zh8XbqoBdKsukVvfDN2mbT4CfsmcvSFnw=@protonmail.com>
In-Reply-To: <gGJ5ufbP7AiW8HkFcWkPNmZl1dqnZ_74LuNAZ_Ey-y3TF8cDLEwQrK0P9aE7KmsZRZ0Lr32EiUB_0L8BD5MkoHdptYv49ImcU8_gaENiMRs=@protonmail.com>
References: <o8ZL0xD90cccAtyMQf2WaXcVlgCTjddqRp0u-xWYYxfncv-VGatQvHBMICTmnxofKzDm7-aiieRIICqY-nHK2RO91C6Z75qczNj_s0u3TaA=@protonmail.com>
 <87o8fxn7mr.fsf@HIDDEN>
 <gGJ5ufbP7AiW8HkFcWkPNmZl1dqnZ_74LuNAZ_Ey-y3TF8cDLEwQrK0P9aE7KmsZRZ0Lr32EiUB_0L8BD5MkoHdptYv49ImcU8_gaENiMRs=@protonmail.com>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED,
 DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM,NUMERIC_HTTP_ADDR,
 WEIRD_PORT shortcircuit=no autolearn=disabled version=3.4.4
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on
 mailout.protonmail.ch
X-Spam-Score: 0.0 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi all,

> > -   Is there a way to make `guix-daemon` use a Tor proxy? I have two sy=
stems using Guix, one is a Guix System, the other is using a foreign distro=
, and I'd like to adjust both to use Tor instead since it's faster.
>
> I saw that`guix-daemon` respects `http_proxy` and `https_proxy` envvars, =
but trying it out on my foreign-distro Guix computer, adding `https_proxy=
=3Dsocks5h://127.0.0.1:9050 http_proxy=3Dsocks5h://127.0.0.1:9050` to the `=
systemd` service file doesn't work.
>
>     guix substitute: error: TLS error in procedure 'handshake': The TLS c=
onnection was non-properly terminated.
>     substitution of /gnu/store/1bdldr80p39g1mjnh76xw6hmwqrrb8lz-wine64-6.=
0 failed
>     guix package: error: some substitutes for the outputs of derivation `=
/gnu/store/wr9kf2bgcsvwxcmhnl9lf047nr8xcklc-wine64-6.0.drv' failed (usually=
 happens due to networking issues); try `--fallback' to build derivation fr=
om source
>
>
> Looking at the foreign distro's syslog:
>
>     Mar  5 19:52:03 developer guix-daemon[145182]: accepted connection fr=
om pid 145190, user raid5atemyhomework
>     Mar  5 19:52:05 developer guix-daemon[145200]: spurious SIGPOLL
>     Mar  5 19:52:07 developer Tor[1029]: Socks version 67 not recognized.=
 (This port is not an HTTP proxy; did you want to use HTTPTunnelPort?)
>
>
> So it looks to me that`guix-daemon` expects `https_proxy` to be an HTTPS =
proxy and not a SOCKS5/SOCKS5H proxy. I'll look into Tor's HTTPTunnelPort.

On the foreign distro computer, adding an `HTTPTunnelPort 9080` to `/etc/to=
r/torrc` and then adding `http_proxy=3Dhttps://127.0.0.1:9080 https_proxy=
=3Dhttps://127.0.0.1:9080` to `guix-daemon.service`, then restarting servic=
es, seems to work.

```
ownloading from https://ci.guix.gnu.org/nar/lzip/1bdldr80p39g1mjnh76xw6hmwq=
rrb8lz-wine64-6.0 ...
 wine64-6.0  54.4MiB                                                       =
                                                                         57=
9KiB/s 01:36 [##################] 100.0%

substitute: updating substitutes from 'https://ci.guix.gnu.org'... 100.0%
The following derivation will be built:
   /gnu/store/7mr17xka558smr0c76crf9g727ccj76g-profile.drv

3.2 MB will be downloaded
downloading from https://ci.guix.gnu.org/nar/lzip/gs3li4m0ydajm57r0qn1wvsdy=
fsa68p7-font-gnu-unifont-13.0.06 ...
 font-gnu-unifont-13.0.06  3.0MiB                                          =
                                                                         51=
5KiB/s 00:06 [##################] 100.0%

```

The above is significantly better than the previous runs where I get 11KiB/=
s, and matches the speeds I get from `torify wget`.

While it's a good ***workaround*** for my problem instead of me silently we=
eping at the ridiculous slowness of Guix substitutes, it doesn't solve my r=
oot problem:

* SOMETHING between my ISP and ci.guix.gnu.org is throttling access to the =
substitutes.
  * Given that I have been using my ISP for a year without experiencing suc=
h spurious slowdowns, and I have been using ci.guix.gnu.org for the past fe=
w months only and have been hit with this slowness in the past month or so,=
 I am more inclined to blame ci.guix.gnu.org, but please tell me how I can =
find out what is throttling the bandwidth here.  The fact that Tor is ***FA=
STER*** is very suspicious.

Thanks
raid5atemyhomework

Message sent to bug-guix@HIDDEN:

X-Loop: help-debbugs@HIDDEN
Subject: bug#46942: ci.guix.gnu.org is slow from my system
Resent-From: zimoun <zimon.toutoune@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Fri, 05 Mar 2021 12:44:02 +0000
Resent-Message-ID: <handler.46942.B46942.161494821630823 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 46942
X-GNU-PR-Package: guix
X-GNU-PR-Keywords: 
To: raid5atemyhomework <raid5atemyhomework@HIDDEN>, 46942 <at> debbugs.gnu.org
Received: via spool by 46942-submit <at> debbugs.gnu.org id=B46942.161494821630823
          (code B ref 46942); Fri, 05 Mar 2021 12:44:02 +0000
Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 12:43:36 +0000
Received: from localhost ([127.0.0.1]:33132 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1lI9nr-000813-3E
	for submit <at> debbugs.gnu.org; Fri, 05 Mar 2021 07:43:36 -0500
Received: from mail-wm1-f45.google.com ([209.85.128.45]:40099)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <zimon.toutoune@HIDDEN>) id 1lI9no-00080q-Ea
 for 46942 <at> debbugs.gnu.org; Fri, 05 Mar 2021 07:43:33 -0500
Received: by mail-wm1-f45.google.com with SMTP id o2so1344334wme.5
 for <46942 <at> debbugs.gnu.org>; Fri, 05 Mar 2021 04:43:32 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025;
 h=from:to:subject:in-reply-to:references:date:message-id:mime-version;
 bh=CQU88X/bcn65oA6ekal5gRJ0b2rx43rdGUNal9vxNQ8=;
 b=okmOfZCgLOpOXt+moG3+H0huL/88fnJp8JYlicAIbjjVmWXqjqKh0PP1jAz3sL4oWz
 fHoYOSPyGg276m/PqQzEE1PYbu51UEa3CQE+BHtaCXqzQm5FPb+u474OoeNdoMpqUWvZ
 gwH0ENjYH1D9MPYcFhH07sA8809F+OlZiFs1AnrpfkksVm4LR+WIWRtfgMsfN09Kpb0g
 tX0Ws2kFAi3ThJJQhHpSvuxFVPjpYAdN3Fmf7JsHa7rlfvjpo9vXzpW1Pa2RUPPs2HY2
 eCUrk5M+smjeuKwx02ACEqKPXDkoEtkN1HP9j8QGxDOGkrhKurZQq1T28Yw7tw6n/yD2
 F1bg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:subject:in-reply-to:references:date
 :message-id:mime-version;
 bh=CQU88X/bcn65oA6ekal5gRJ0b2rx43rdGUNal9vxNQ8=;
 b=uMVys3yiIJMl//m95aM7tEF/DjRJR39hRCPjrJgSZx3FQceoKiZAUILQVH0a5cDhqE
 DHDg2/d5zrf8jtx6PCg/fFgSm2OGCELJRfEOWYZCfQSv2fzLnaJnvguZRFEbRfOqjnWs
 SOpRegzFE+yADRyytq0NUOfEMDWn9viD2hO4/rQ8YXVu52eKAGTxxOBTWs+5kvu3KJy5
 IFZaN5f/70Es5KRMwvE4b7eambbRMs3ckQeg27+Wh7dDeRO3JxGr16VlsqT9s4H9oqR6
 2f4saaVR21den6eT1pCfm4RUuBhgONlrOh7t6JWKfYsTIsnU7aZfLkrcNpt639GhZ012
 b1/Q==
X-Gm-Message-State: AOAM533N6WtvrHAbQCM4H+BlQpAhfxFww8P5Xm9HPavQMOmNNxPXdQJN
 d8wsEzLSvPK11fn+eJv09WxX633Aw/E=
X-Google-Smtp-Source: ABdhPJzaLZWiMA9eO0gGIG1Mbds0nTB0tzla0lSzwTjtWTG+jACLOFvLxhH8UpyOEMLL0I7Dn1esyA==
X-Received: by 2002:a1c:e912:: with SMTP id q18mr8748631wmc.59.1614948206555; 
 Fri, 05 Mar 2021 04:43:26 -0800 (PST)
Received: from lili ([2a01:e0a:59b:9120:65d2:2476:f637:db1e])
 by smtp.gmail.com with ESMTPSA id x25sm4559345wmj.14.2021.03.05.04.43.25
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Fri, 05 Mar 2021 04:43:26 -0800 (PST)
From: zimoun <zimon.toutoune@HIDDEN>
In-Reply-To: <o8ZL0xD90cccAtyMQf2WaXcVlgCTjddqRp0u-xWYYxfncv-VGatQvHBMICTmnxofKzDm7-aiieRIICqY-nHK2RO91C6Z75qczNj_s0u3TaA=@protonmail.com>
References: <o8ZL0xD90cccAtyMQf2WaXcVlgCTjddqRp0u-xWYYxfncv-VGatQvHBMICTmnxofKzDm7-aiieRIICqY-nHK2RO91C6Z75qczNj_s0u3TaA=@protonmail.com>
Date: Fri, 05 Mar 2021 13:41:00 +0100
Message-ID: <86a6rh7oyr.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: 0.0 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi,

On Fri, 05 Mar 2021 at 11:22, raid5atemyhomework via Bug reports for GNU Guix <bug-guix@HIDDEN> wrote:

> This can be very slow, including as slow as 4KiB/s at times.

[...]

> The problem is not on my ISP, or at least not solely on my ISP. Doing a `wget` from `github.com`:

[...]

> As can be seen above, I get 9.34MB/s elsewhere, which is better than the >60Mbit/s promised by my ISP.

Where are you located?  I mean, ci.guix.gnu.org is in Berlin, so if you
are far, say in Alaska or in Puerto Williams[*], you get a poor
downloading rate.  However, github.com probably uses CDN or something
like that, so obviously the rate becomes much better.


*Puerto Williams, the World Southest town with an Internet
 connection. :-)


All the best,
simon

Message sent to bug-guix@HIDDEN:

X-Loop: help-debbugs@HIDDEN
Subject: bug#46942: ci.guix.gnu.org is slow from my system
Resent-From: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Fri, 05 Mar 2021 13:01:02 +0000
Resent-Message-ID: <handler.46942.B46942.16149492553339 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 46942
X-GNU-PR-Package: guix
X-GNU-PR-Keywords: 
To: zimoun <zimon.toutoune@HIDDEN>
Cc: "46942 <at> debbugs.gnu.org" <46942 <at> debbugs.gnu.org>
Reply-To: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Received: via spool by 46942-submit <at> debbugs.gnu.org id=B46942.16149492553339
          (code B ref 46942); Fri, 05 Mar 2021 13:01:02 +0000
Received: (at 46942) by debbugs.gnu.org; 5 Mar 2021 13:00:55 +0000
Received: from localhost ([127.0.0.1]:33178 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1lIA4W-0000l7-Hn
	for submit <at> debbugs.gnu.org; Fri, 05 Mar 2021 08:00:55 -0500
Received: from mail-40137.protonmail.ch ([185.70.40.137]:22203)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <raid5atemyhomework@HIDDEN>)
 id 1lIA4T-0000dA-TQ
 for 46942 <at> debbugs.gnu.org; Fri, 05 Mar 2021 08:00:46 -0500
Date: Fri, 05 Mar 2021 13:00:33 +0000
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=protonmail.com;
 s=protonmail; t=1614949238;
 bh=IksEqrAaf2skUNSBDSnVrT/5I43QfQKuBpDoQcskzUU=;
 h=Date:To:From:Cc:Reply-To:Subject:In-Reply-To:References:From;
 b=urJ3DHrNnxXMAIKh6FZZhNv7O6VlS5dgBXYnAaRb4pWg5xnqH8HxbwXCh6FjK6ZzW
 rcVvLZSLhjbfVROFazIPfMTZd+1BxKRpGVNaH9IOa77FLK5d9/AsBJGdpRGLRHCezx
 U2DoPnSv6r87V6wXDw3lMnR93v4NN7rEt8q12A1A=
From: raid5atemyhomework <raid5atemyhomework@HIDDEN>
Message-ID: <Tv5Og8T3E-ZDwSezIDZVRQrmcrz3u8TNXdJ25xZz-V7SOK6jpKVzFwKfwSQ3quUNMDqG4MhI5dGTNdxANnuDgujDCdB2CYBoLi3qKOLHQfA=@protonmail.com>
In-Reply-To: <86a6rh7oyr.fsf@HIDDEN>
References: <o8ZL0xD90cccAtyMQf2WaXcVlgCTjddqRp0u-xWYYxfncv-VGatQvHBMICTmnxofKzDm7-aiieRIICqY-nHK2RO91C6Z75qczNj_s0u3TaA=@protonmail.com>
 <86a6rh7oyr.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Status: No, score=-1.2 required=10.0 tests=ALL_TRUSTED,DKIM_SIGNED,
 DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,FREEMAIL_FROM shortcircuit=no
 autolearn=disabled version=3.4.4
X-Spam-Checker-Version: SpamAssassin 3.4.4 (2020-01-24) on
 mailout.protonmail.ch
X-Spam-Score: 0.0 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hi zimoun,

> Hi,
>
> On Fri, 05 Mar 2021 at 11:22, raid5atemyhomework via Bug reports for GNU =
Guix bug-guix@HIDDEN wrote:
>
> > This can be very slow, including as slow as 4KiB/s at times.
>
> [...]
>
> > The problem is not on my ISP, or at least not solely on my ISP. Doing a=
 `wget` from `github.com`:
>
> [...]
>
> > As can be seen above, I get 9.34MB/s elsewhere, which is better than th=
e >60Mbit/s promised by my ISP.
>
> Where are you located? I mean,ci.guix.gnu.org is in Berlin, so if you
> are far, say in Alaska or in Puerto Williams[*], you get a poor
> downloading rate. However, github.com probably uses CDN or something
> like that, so obviously the rate becomes much better.
>
> *Puerto Williams, the World Southest town with an Internet
> connection. :-)

I would rather not say, since I am a very private person (otherwise I would=
n't be using the "raid5atemyhomework" moniker).

What I **do** find strange is that ***Tor is faster***.  Surely connecting =
directly from my ISP to ci.guix.gnu.org should be, in principle, faster tha=
n connecting to my ISP to a random node, which connects to another random n=
ode, which connects to another random node, which finally connects to Berli=
n, should be ***slower***?

Here are a few `ping`s to some places:

```
$ ping gnu.org
PING gnu.org (209.51.188.148) 56(84) bytes of data.
64 bytes from wildebeest.gnu.org (209.51.188.148): icmp_seq=3D1 ttl=3D50 ti=
me=3D301 ms
64 bytes from wildebeest.gnu.org (209.51.188.148): icmp_seq=3D2 ttl=3D50 ti=
me=3D306 ms
64 bytes from wildebeest.gnu.org (209.51.188.148): icmp_seq=3D3 ttl=3D50 ti=
me=3D335 ms
64 bytes from wildebeest.gnu.org (209.51.188.148): icmp_seq=3D4 ttl=3D50 ti=
me=3D257 ms
64 bytes from wildebeest.gnu.org (209.51.188.148): icmp_seq=3D5 ttl=3D50 ti=
me=3D234 ms
^C
--- gnu.org ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4226ms
rtt min/avg/max/mdev =3D 233.804/286.626/335.242/36.261 ms

$ ping www.vikings.net
PING www.vikings.net (168.119.169.112) 56(84) bytes of data.
64 bytes from v0.h.vkgs.io (168.119.169.112): icmp_seq=3D1 ttl=3D48 time=3D=
190 ms
64 bytes from v0.h.vkgs.io (168.119.169.112): icmp_seq=3D2 ttl=3D48 time=3D=
190 ms
64 bytes from v0.h.vkgs.io (168.119.169.112): icmp_seq=3D3 ttl=3D48 time=3D=
220 ms
64 bytes from v0.h.vkgs.io (168.119.169.112): icmp_seq=3D4 ttl=3D48 time=3D=
241 ms
64 bytes from v0.h.vkgs.io (168.119.169.112): icmp_seq=3D5 ttl=3D48 time=3D=
264 ms
^C
--- www.vikings.net ping statistics ---
5 packets transmitted, 5 received, 0% packet loss, time 4413ms
rtt min/avg/max/mdev =3D 189.767/220.941/264.326/29.054 ms

$ ping www.raptorcs.com
PING www.raptorcs.com (23.155.224.44) 56(84) bytes of data.
64 bytes from websvc.rptsys.com (23.155.224.44): icmp_seq=3D1 ttl=3D55 time=
=3D294 ms
64 bytes from websvc.rptsys.com (23.155.224.44): icmp_seq=3D2 ttl=3D55 time=
=3D307 ms
64 bytes from websvc.rptsys.com (23.155.224.44): icmp_seq=3D3 ttl=3D55 time=
=3D227 ms
^C
--- www.raptorcs.com ping statistics ---
3 packets transmitted, 3 received, 0% packet loss, time 2627ms
rtt min/avg/max/mdev =3D 226.868/275.933/306.748/35.071 ms
```

And here's a few select `wget`s:

```
$ wget https://store.vikings.net/image/cache/catalog/kcmad8-1088x816.jpeg
--2021-03-05 20:50:37--  https://store.vikings.net/image/cache/catalog/kcma=
d8-1088x816.jpeg
Resolving store.vikings.net (store.vikings.net)... 185.199.141.17
Connecting to store.vikings.net (store.vikings.net)|185.199.141.17|:443... =
connected.
HTTP request sent, awaiting response... 200 OK
Length: 246991 (241K) [image/jpeg]
Saving to: =E2=80=98kcmad8-1088x816.jpeg=E2=80=99

kcmad8-1088x816.jpeg                            100%[=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>] 241.20K  19.2KB=
/s    in 13s

2021-03-05 20:50:51 (19.2 KB/s) - =E2=80=98kcmad8-1088x816.jpeg=E2=80=99 sa=
ved [246991/246991]

$ torify wget https://store.vikings.net/image/cache/catalog/kcmad8-1088x816=
.jpeg
--2021-03-05 20:51:22--  https://store.vikings.net/image/cache/catalog/kcma=
d8-1088x816.jpeg
Resolving store.vikings.net (store.vikings.net)... 185.199.141.17
Connecting to store.vikings.net (store.vikings.net)|185.199.141.17|:443... =
connected.
HTTP request sent, awaiting response... 200 OK
Length: 246991 (241K) [image/jpeg]
Saving to: =E2=80=98kcmad8-1088x816.jpeg.1=E2=80=99

kcmad8-1088x816.jpeg.1                          100%[=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>] 241.20K   293KB=
/s    in 0.8s

2021-03-05 20:51:25 (293 KB/s) - =E2=80=98kcmad8-1088x816.jpeg.1=E2=80=
=99 saved [246991/246991]

$ wget https://static.fsf.org/nosvn/videos/fight-to-repair/videos/Fight-to-=
Repair-720p.webm
--2021-03-05 20:54:03--  https://static.fsf.org/nosvn/videos/fight-to-repai=
r/videos/Fight-to-Repair-720p.webm
Resolving static.fsf.org (static.fsf.org)... 209.51.188.233, 2001:470:142:5=
::233
Connecting to static.fsf.org (static.fsf.org)|209.51.188.233|:443... connec=
ted.
HTTP request sent, awaiting response... 200 OK
Length: 40191351 (38M) [video/webm]
Saving to: =E2=80=98Fight-to-Repair-720p.webm=E2=80=99

Fight-to-Repair-720p.webm                         2%[=3D>                  =
                                                                           =
       ] 856.00K   146KB/s    eta 4m 32s ^C

$ torify wget https://static.fsf.org/nosvn/videos/fight-to-repair/videos/Fi=
ght-to-Repair-720p.webm
--2021-03-05 20:54:13--  https://static.fsf.org/nosvn/videos/fight-to-repai=
r/videos/Fight-to-Repair-720p.webm
Resolving static.fsf.org (static.fsf.org)... 209.51.188.233
Connecting to static.fsf.org (static.fsf.org)|209.51.188.233|:443... connec=
ted.
HTTP request sent, awaiting response... 200 OK
Length: 40191351 (38M) [video/webm]
Saving to: =E2=80=98Fight-to-Repair-720p.webm.1=E2=80=99

Fight-to-Repair-720p.webm.1                       6%[=3D=3D=3D=3D=3D>      =
                                                                           =
               ]   2.55M   498KB/s    eta 92s    ^C

$ wget https://static.raptorcs.com/TL2WK2/images/boardlarge.png
--2021-03-05 20:57:19--  https://static.raptorcs.com/TL2WK2/images/boardlar=
ge.png
Resolving static.raptorcs.com (static.raptorcs.com)... 23.155.224.44
Connecting to static.raptorcs.com (static.raptorcs.com)|23.155.224.44|:443.=
.. connected.
HTTP request sent, awaiting response... 200 OK
Length: 5398922 (5.1M) [image/png]
Saving to: =E2=80=98boardlarge.png=E2=80=99

boardlarge.png                                  100%[=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>]   5.15M   505KB=
/s    in 9.4s

2021-03-05 20:57:30 (559 KB/s) - =E2=80=98boardlarge.png=E2=80=99 saved [53=
98922/5398922]

$ torify wget https://static.raptorcs.com/TL2WK2/images/boardlarge.png
--2021-03-05 20:57:32--  https://static.raptorcs.com/TL2WK2/images/boardlar=
ge.png
Resolving static.raptorcs.com (static.raptorcs.com)... 23.155.224.44
Connecting to static.raptorcs.com (static.raptorcs.com)|23.155.224.44|:443.=
.. connected.
HTTP request sent, awaiting response... 200 OK
Length: 5398922 (5.1M) [image/png]
Saving to: =E2=80=98boardlarge.png.1=E2=80=99

boardlarge.png.1                                100%[=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D>]   5.15M   534KB=
/s    in 10s

2021-03-05 20:57:45 (515 KB/s) - =E2=80=98boardlarge.png.1=E2=80=99 saved [=
5398922/5398922]

```

I know Vikings is based in Germany, so it looks like my ISP does not like c=
onnecting to German sites --- again I am seeing this phenomenon where using=
 Tor is faster than connecting directly, but it certainly now looks a whole=
 lot more like a problem with my ISP.

On the other hand the `fsf.org` site has better speed when connected direct=
ly, but still the one via Tor is about 3x faster.

And finally RaptorCS is about the same speed both directly and over Tor.  A=
gain, this is still a surprise as I expect Tor to be slower than direct con=
nection.

Lemme go poke at my ISP.

Thanks
raid5atemyhomework

Last modified: Fri, 5 Mar 2021 13:15:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.