GNU bug report logs - #34090
URLs / ftp servers the ftp client can't handle well

Message received at submit <at> debbugs.gnu.org:

Received: (at submit) by debbugs.gnu.org; 16 Jan 2019 00:41:41 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Jan 15 19:41:40 2019
Received: from localhost ([127.0.0.1]:60463 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1gjZH2-0002HJ-JD
	for submit <at> debbugs.gnu.org; Tue, 15 Jan 2019 19:41:40 -0500
Received: from eggs.gnu.org ([209.51.188.92]:52712)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <caleb.ristvedt@HIDDEN>) id 1gjZGy-0002H4-Ps
 for submit <at> debbugs.gnu.org; Tue, 15 Jan 2019 19:41:40 -0500
Received: from lists.gnu.org ([209.51.188.17]:39919)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <caleb.ristvedt@HIDDEN>)
 id 1gjZGf-000205-1Z
 for submit <at> debbugs.gnu.org; Tue, 15 Jan 2019 19:41:17 -0500
Received: from eggs.gnu.org ([209.51.188.92]:34526)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <caleb.ristvedt@HIDDEN>) id 1gjZGe-0005po-1R
 for bug-guix@HIDDEN; Tue, 15 Jan 2019 19:41:16 -0500
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=0.8 required=5.0 tests=BAYES_50 autolearn=disabled
 version=3.3.2
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <caleb.ristvedt@HIDDEN>) id 1gjZGc-0001xF-Nb
 for bug-guix@HIDDEN; Tue, 15 Jan 2019 19:41:15 -0500
Received: from mail-yb1-xb2f.google.com ([2607:f8b0:4864:20::b2f]:44010)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16)
 (Exim 4.71) (envelope-from <caleb.ristvedt@HIDDEN>)
 id 1gjZGc-0001rP-96
 for bug-guix@HIDDEN; Tue, 15 Jan 2019 19:41:14 -0500
Received: by mail-yb1-xb2f.google.com with SMTP id t16so1822869ybk.10
 for <bug-guix@HIDDEN>; Tue, 15 Jan 2019 16:41:10 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=cune-org.20150623.gappssmtp.com; s=20150623;
 h=from:to:subject:date:message-id:mime-version;
 bh=7YlEH0zjXQdWCgn6IJmiN1RtnHZxcVp9SH+Ss3ldkjk=;
 b=jCypZXOY1vEtqioZPFSICVSQefqBKao/qOFlx5mtPB1PlKadGFc7pEEQ7m0uIwnWuY
 oIiT4NblR53ZA9hIDxowZ7rQUax/4KKDCVVdBD0wrS6A2NkG8vH7VDHItRNSey4dnMoj
 Tgwsc2WjJBg+9gm7eASRYogej4EgxnJwD8aponFjjE7awuweALssYyJmzUaVBS0fcjnh
 hMU2W2NE6RBM/jc6WrcCPZDUNZGnG81Rdi1WS86X3svRCLKh8K1eqFEAzH2p98hq7YHJ
 rwGRqVKkOwI+rgwAHlWzx6XSn/XAj7G0/W5rUFvH/x4vKHY/pzHlMak8eGJUENjFYyuD
 GsVA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=1e100.net; s=20161025;
 h=x-gm-message-state:from:to:subject:date:message-id:mime-version;
 bh=7YlEH0zjXQdWCgn6IJmiN1RtnHZxcVp9SH+Ss3ldkjk=;
 b=ucYLsk3oaWaIxi+Gd5je72t/vrrzIZPFblRYE/kpGJk/sedLLfXtgUAiGsJWE4G34v
 D2jiTPBdRlpV2aThDp5tLb3H+zOM7B/6/0mdeyunasBBbM0fcgsvYrgw5so48+Wn5qmY
 BWUxy5u22IVfNo5rZYURw7IGUk31ga8xX4rQmBhr7DUAVmDnW0W0i66EL4AsIi4jBKs7
 WJ5JPxthMp8qbAToY7J4flJsqoIdWLeDxyBOpMg273o62Cn1JXLwrJMK5HvvoWldKd+f
 Ll9HWiWNrAkavU8Nx0TqalW62BwzZ9V7NuTsN+WTp006Y+3sT+Z79R5HOnnKl2EGXOYP
 OsCw==
X-Gm-Message-State: AJcUukel8LF0McnGUvSLueTZfyfS/Mr5znCxin3a7uQfGx/G7+sCq0CY
 PduSkFEJoimyVRaptwlimdwZHl7eQ6x6ug==
X-Google-Smtp-Source: ALg8bN48dOi+vfppwHI0nF1FUYFLg36FywWPC+12YYhN59cP7+QEgh24y7vlXXsF9nkMF+ClmHCDVg==
X-Received: by 2002:a25:b51:: with SMTP id 78mr5289076ybl.93.1547599269146;
 Tue, 15 Jan 2019 16:41:09 -0800 (PST)
Received: from GuixPotato ([208.89.170.250])
 by smtp.gmail.com with ESMTPSA id j12sm1717547ywk.43.2019.01.15.16.41.08
 for <bug-guix@HIDDEN>
 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256);
 Tue, 15 Jan 2019 16:41:08 -0800 (PST)
From: Caleb Ristvedt <caleb.ristvedt@HIDDEN>
To: bug-guix@HIDDEN
Subject: URLs / ftp servers the ftp client can't handle well
Date: Tue, 15 Jan 2019 18:41:03 -0600
Message-ID: <87r2ddfn8g.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-detected-operating-system: by eggs.gnu.org: Genre and OS details not
 recognized.
X-Received-From: 2607:f8b0:4864:20::b2f
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x
X-Spam-Score: 0.9 (/)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.1 (/)

"guix download ftp://tug.org/historic/systems/texlive/2018/texlive-20180414-texmf.tar.xz"

gets stuck when the progress reporter reports 100%. Strace reveals it's
stuck reading from a socket. Some manual print-statement debugging
confirmed that it's trying to read from the FTP RETR port created by
FTP-RETR in (guix ftp-client), which in turn is trying to read from the
ftp data transfer socket. Initially I thought it was somehow failing to
detect EOF (guile bug or something) because wget managed to download it
just fine, but it actually turns out the EOF isn't being sent at all,
even though the standard pretty clearly states it must be.

Thankfully wget has a --debug flag, so I used that and got this output:
https://paste.debian.net/1060773/

It turns out wget actually gives up on downloading it once, but then
re-opens both control and data connections and resumes where it left off
using the REST ftp command, and that somehow works (it finishes
downloading another 204 bytes and does get EOF).

It seems that our options are either to not try getting stuff from weird
servers like that, or to make our ftp client more robust. For what it's
worth, I remember getting this problem on a smaller download as well
(tens of MB), but don't remember what it was. Anyone have any other URLs
to try from this server?

- reepca