GNU logs - #22745, boring messages

Message sent to bug-guix@HIDDEN:

Subject: bug#22745: guix http downloads don't resume
Resent-From: Danny Milosavljevic <dannym@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Sat, 20 Feb 2016 08:36:01 +0000
Resent-Message-ID: <handler.22745.B.145595730721831 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: 22745 <at> debbugs.gnu.org
Date: Sat, 20 Feb 2016 09:34:45 +0100
From: Danny Milosavljevic <dannym@HIDDEN>
Message-ID: <20160220093445.45cd64d2@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

Package: guix

By now, guix reconfigure has tried to download the same texlive binary from hydra at least 5 times to the same machine, unsuccessfully breaking after about 1 GB each, for a total of 5 GB, always starting from the beginning.

Would it be possible to just resume?

Additionally, it doesn't seem like it checks the Content-Length in order to find out whether the connection broke before the file was done. Why doesn't it?

The http-client seems to handle chunked encoding - so not sure whether it's a problem with hydra or with guix.

Message sent:

Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.505 (Entity 5.505)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Danny Milosavljevic <dannym@HIDDEN>
Subject: bug#22745: Acknowledgement (guix http downloads don't resume)
Message-ID: <handler.22745.B.145595730721831.ack <at> debbugs.gnu.org>
References: <20160220093445.45cd64d2@HIDDEN>
X-Gnu-PR-Message: ack 22745
X-Gnu-PR-Package: guix
Reply-To: 22745 <at> debbugs.gnu.org
Date: Sat, 20 Feb 2016 08:36:01 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 bug-guix@HIDDEN

If you wish to submit further information on this problem, please
send it to 22745 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
22745: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D22745
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems

Message sent to bug-guix@HIDDEN:

Subject: bug#22745: error messages
References: <20160220093445.45cd64d2@HIDDEN>
In-Reply-To: <20160220093445.45cd64d2@HIDDEN>
Resent-From: Danny Milosavljevic <dannym@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Sat, 20 Feb 2016 08:45:01 +0000
Resent-Message-ID: <handler.22745.B22745.145595789022673 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: 22745 <at> debbugs.gnu.org
Date: Sat, 20 Feb 2016 09:44:42 +0100
From: Danny Milosavljevic <dannym@HIDDEN>
Message-ID: <20160220094442.6033b960@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: quoted-printable
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

----
Found valid signature for /gnu/store/36wqhbch45x055wj6gfsng00zkwfqg6n-texli=
ve-20150523-texmf.tar.xz
=46rom http://hydra.gnu.org/nar/36wqhbch45x055wj6gfsng00zkwfqg6n-texlive-2015=
0523-texmf.tar.xz
Downloading 36wqhb...-texlive-20150523-texmf.tar.xz (1.76GiB installed)...
 http://hydra.gnu.org/nar/36wqhbch45x055wj6gfsng00zkwfqg6n-texlive-20150523=
-texmf.tar.xz 1.1MiB/s 13:24 | 893.9MiB transferred
bzip2: Data integrity error when decompressing.
 http://Input file =3D (stdin), output file =3D (stdout)wfqg6n-texlive-2015=
0523-texmf.tar.xz 1.1MiB/s 13:24 | 893.9MiB transferred

It is possible that the compressed file(s) have become corrupted.
You can use the -tvv option to test integrity of such files.

You can use the `bzip2recover' program to attempt to recover
data from undamaged sections of corrupted files.

guix substitute: error: corrupt input while restoring '/gnu/store/36wqhbch4=
5x055wj6gfsng00zkwfqg6n-texlive-20150523-texmf.tar.xz' from #{read pipe}#
killing process 3867g/nar/36wqhbch45x055wj6gfsng00zkwfqg6n-texlive-20150523=
-texmf.tar.xz 1.1MiB/s 13:24 | 893.9MiB transferred
guix system: error: build failed: some substitutes for the outputs of deriv=
ation `/gnu/store/83nkdyp9wl6zwflcm416xf1imppp7v9f-texlive-20150523-texmf.t=
ar.xz.drv' failed (usually happens due to networking issues); try `--fallba=
ck' to build derivation from source=20
---

Also, downloading it by wget right afterwards, it works just fine, all 1.77=
 GB of it. Wtf?

Message sent to bug-guix@HIDDEN:

Subject: bug#22745: guix http downloads don't resume
Resent-From: ludo@HIDDEN (Ludovic =?UTF-8?Q?Court=C3=A8s?=)
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Fri, 25 Mar 2016 08:36:02 +0000
Resent-Message-ID: <handler.22745.B22745.145889492825031 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Danny Milosavljevic <dannym@HIDDEN>
Cc: 22745 <at> debbugs.gnu.org
From: ludo@HIDDEN (Ludovic =?UTF-8?Q?Court=C3=A8s?=)
References: <20160220093445.45cd64d2@HIDDEN>
Date: Fri, 25 Mar 2016 09:35:12 +0100
In-Reply-To: <20160220093445.45cd64d2@HIDDEN> (Danny Milosavljevic's
 message of "Sat, 20 Feb 2016 09:34:45 +0100")
Message-ID: <87poujt0ov.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/24.5 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

Danny Milosavljevic <dannym@HIDDEN> skribis:

> By now, guix reconfigure has tried to download the same texlive binary fr=
om hydra at least 5 times to the same machine, unsuccessfully breaking afte=
r about 1 GB each, for a total of 5 GB, always starting from the beginning.
>
> Would it be possible to just resume?

There does not seem to be an easy way to achieve this.

> Additionally, it doesn't seem like it checks the Content-Length in order =
to find out whether the connection broke before the file was done. Why does=
n't it?

For archives (the /nar/foo URLs), there is currently no =E2=80=98Content-Le=
ngth=E2=80=99
header at all (this is because Hydra, the software, generates those
files on the fly; we should tweak nginx to add a =E2=80=98Content-Length=E2=
=80=99
header, but this seems to require an external nginx plugin.)

However, the {mirror.,}hydra.gnu.org use chunked encoding, indeed, which
allows the HTTP client to detect truncated transfers.

Ludo=E2=80=99.

Message received at control <at> debbugs.gnu.org:

Received: (at control) by debbugs.gnu.org; 26 Apr 2016 09:55:40 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Apr 26 05:55:39 2016
Received: from localhost ([127.0.0.1]:47486 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1auziV-0005Nc-Mv
	for submit <at> debbugs.gnu.org; Tue, 26 Apr 2016 05:55:39 -0400
Received: from eggs.gnu.org ([208.118.235.92]:50478)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1auziU-0005NP-63
 for control <at> debbugs.gnu.org; Tue, 26 Apr 2016 05:55:38 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <ludo@HIDDEN>) id 1auziJ-0002rd-MT
 for control <at> debbugs.gnu.org; Tue, 26 Apr 2016 05:55:32 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-2.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD
 autolearn=disabled version=3.3.2
Received: from fencepost.gnu.org ([2001:4830:134:3::e]:45547)
 by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <ludo@HIDDEN>)
 id 1auziJ-0002rZ-JY
 for control <at> debbugs.gnu.org; Tue, 26 Apr 2016 05:55:27 -0400
Received: from pluto.bordeaux.inria.fr ([193.50.110.57]:37092 helo=pluto)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_128_CBC_SHA1:128)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>) id 1auziI-0000r0-JM
 for control <at> debbugs.gnu.org; Tue, 26 Apr 2016 05:55:27 -0400
Date: Tue, 26 Apr 2016 11:55:24 +0200
Message-Id: <87inz4wv77.fsf@HIDDEN>
To: control <at> debbugs.gnu.org
From: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
Subject: control message for bug #22745
MIME-version: 1.0
Content-type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Received-From: 2001:4830:134:3::e
X-Spam-Score: -4.4 (----)
X-Debbugs-Envelope-To: control
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -4.4 (----)

severity 22745 wishlist

Message sent to bug-guix@HIDDEN:

X-Loop: help-debbugs@HIDDEN
Subject: bug#22745: guix http downloads don't resume
References: <20160220093445.45cd64d2@HIDDEN>
In-Reply-To: <20160220093445.45cd64d2@HIDDEN>
Resent-From: swedebugia@HIDDEN
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Mon, 17 Dec 2018 09:26:02 +0000
Resent-Message-ID: <handler.22745.B22745.154503876015180 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
X-GNU-PR-Message: followup 22745
X-GNU-PR-Package: guix
X-GNU-PR-Keywords: 
To: 22745 <at> debbugs.gnu.org
Received: via spool by 22745-submit <at> debbugs.gnu.org id=B22745.154503876015180
          (code B ref 22745); Mon, 17 Dec 2018 09:26:02 +0000
Received: (at 22745) by debbugs.gnu.org; 17 Dec 2018 09:26:00 +0000
Received: from localhost ([127.0.0.1]:50832 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1gYp9z-0003wm-Us
	for submit <at> debbugs.gnu.org; Mon, 17 Dec 2018 04:26:00 -0500
Received: from mx1.riseup.net ([198.252.153.129]:37391)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <swedebugia@HIDDEN>) id 1gYp9y-0003we-Fr
 for 22745 <at> debbugs.gnu.org; Mon, 17 Dec 2018 04:25:58 -0500
Received: from cotinga.riseup.net (cotinga-pn.riseup.net [10.0.1.164])
 (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits))
 (Client CN "*.riseup.net",
 Issuer "COMODO RSA Domain Validation Secure Server CA" (verified OK))
 by mx1.riseup.net (Postfix) with ESMTPS id 0C4B41A36D1
 for <22745 <at> debbugs.gnu.org>; Mon, 17 Dec 2018 01:25:58 -0800 (PST)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=riseup.net; s=squak;
 t=1545038758; bh=AA6FZLhKDDp6/9ZGIEFtQudcHEHFXk5n1+G4O/9V1UE=;
 h=Date:From:To:Subject:From;
 b=gwJy/027ZWBTw2f5ksBl+iOhrQ8vh0vy6/mAwhOBJYm/cllfNGlMi7nJ++QpAa0eG
 beWh7OIkEibmV1rtZcdgEmz2WmAoiXuNeY2Ulz7WyJ4GCbxryPWGFWlzjfIZpuv+Y+
 fPU79vabfUphja4xCo8OynksvlO12w7FbwT7fYUs=
X-Riseup-User-ID: 15272CF1F25E9AC50F47F4A2A7F60C35F5AB635B985B05539B157BE8CC7AD7EC
Received: from [127.0.0.1] (localhost [127.0.0.1])
 by cotinga.riseup.net with ESMTPSA id 89126EB398
 for <22745 <at> debbugs.gnu.org>; Mon, 17 Dec 2018 01:25:57 -0800 (PST)
MIME-Version: 1.0
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: 7bit
Date: Mon, 17 Dec 2018 01:25:57 -0800
From: swedebugia@HIDDEN
Message-ID: <d92eb9eef33bfffee3a710404b6577f9@HIDDEN>
X-Spam-Score: -0.7 (/)
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.7 (-)

Hi

Is this still a problem after Pierres work on texlive and when using the
mirror?

-- 
Cheers 
Swedebugia

Last modified: Mon, 25 Nov 2019 12:00:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.