GNU bug report logs - #35139
Rust builds systematically time out

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Severity: important; Reported by: Ludovic Courtès <ludo@HIDDEN>; dated Thu, 4 Apr 2019 09:01:02 UTC; Maintainer for guix is bug-guix@HIDDEN.
Severity set to 'important' from 'normal' Request was from Ludovic Courtès <ludo@HIDDEN> to control <at> debbugs.gnu.org. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 4 Apr 2019 09:29:13 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Apr 04 05:29:13 2019
Received: from localhost ([127.0.0.1]:43700 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1hBygL-0000Ew-El
	for submit <at> debbugs.gnu.org; Thu, 04 Apr 2019 05:29:13 -0400
Received: from eggs.gnu.org ([209.51.188.92]:54775)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <pierre.langlois@HIDDEN>) id 1hBygJ-0000Ek-Qt
 for submit <at> debbugs.gnu.org; Thu, 04 Apr 2019 05:29:12 -0400
Received: from lists.gnu.org ([209.51.188.17]:48783)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <pierre.langlois@HIDDEN>)
 id 1hBygE-0000ti-In
 for submit <at> debbugs.gnu.org; Thu, 04 Apr 2019 05:29:06 -0400
Received: from eggs.gnu.org ([209.51.188.92]:40910)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <pierre.langlois@HIDDEN>) id 1hBygD-0007qA-Bw
 for bug-guix@HIDDEN; Thu, 04 Apr 2019 05:29:06 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-0.7 required=5.0 tests=BAYES_20,FREEMAIL_FROM,
 RCVD_IN_DNSWL_LOW,URIBL_BLOCKED autolearn=disabled version=3.3.2
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <pierre.langlois@HIDDEN>) id 1hBygC-0000p1-4K
 for bug-guix@HIDDEN; Thu, 04 Apr 2019 05:29:05 -0400
Received: from mout.gmx.net ([212.227.17.21]:49051)
 by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_128_CBC_SHA1:16)
 (Exim 4.71) (envelope-from <pierre.langlois@HIDDEN>)
 id 1hBygB-0000ni-OI
 for bug-guix@HIDDEN; Thu, 04 Apr 2019 05:29:04 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=gmx.net;
 s=badeba3b8450; t=1554370140;
 bh=2F+xOZlgA7l2FgYpsu2IxvNCAZvRms9/V+ZvZxtB564=;
 h=X-UI-Sender-Class:References:From:To:Cc:Subject:In-reply-to:Date;
 b=BP3WQWJdPwGVWmgt7kFeeb4fH7dtNgpyCLXH5CMECM9vwrtVMemZKZaggThHgLf0Y
 4KTvJ+glcbEVxRnilSepplQ7VQIJ7CHU89tK8FDESF6GitadyKqfmxhs3YZ/G5v7Lh
 34xvPGN1CEwEAfYJujK29DtDFyFzeOoevYdJ5e24=
X-UI-Sender-Class: 01bb95c1-4bf8-414a-932a-4f6e2808ef9c
Received: from labiere ([92.6.236.193]) by mail.gmx.com (mrgmx103
 [212.227.17.174]) with ESMTPSA (Nemesis) id 0McUnM-1hTVWu1Wqm-00Hen6; Thu, 04
 Apr 2019 11:29:00 +0200
References: <878swqtabb.fsf@HIDDEN>
User-agent: mu4e 1.1.0; emacs 26.1
From: Pierre Langlois <pierre.langlois@HIDDEN>
To: bug-guix@HIDDEN
Subject: Re: bug#35139: Rust builds systematically time out
In-reply-to: <878swqtabb.fsf@HIDDEN>
Date: Thu, 04 Apr 2019 10:28:59 +0100
Message-ID: <87bm1mglus.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Provags-ID: V03:K1:MPlsQxbnXnN4pgftVRa8QRk1fTdsNqYrx7+q4BPn6ZfyDBqs05o
 DvJ1ET1cLd+RI1nqwWWz5ke/emgaj06wms6IGZ4HrYLg9qr2MbNRzZ2Un0Sgd04y9IC1/7h
 2bqYZqFq8zie76l9BvNrfvnPnxlwFlTnBlAleZkz9euqTqmbM3QqpOEHNouanK36NBIk5ZD
 /tn9W9fHBvDOJ9oN0S2KQ==
X-UI-Out-Filterresults: notjunk:1;V03:K0:zL9DeqYpU20=:AsKPeA11YpHOVpIt6BYAps
 8TDJ+x/zxKGXTR01QpZ/QOxaKGtuczAhLrSC8HOlXS0jRP3aPuS+lDGdoQ/X7OAt33Bjqrmjv
 f0gueuoBItIg4vRfA+ziRTbH1KquL8udCIQQ1lHNDU1SSFhlXjycxNy9Oc3HbwruTCCJDVIvm
 O71t0o9xFBKqYWEmVItR8imfGkdK7i34gOMTcJZF09GVtDOKpSEKnjztwV+hCGQ0pVZd4qwBm
 zGg3m8TOESlp0l5sikLVMC47tAZ7bcoC+SOev19rdZOonk+fos5MBfEczb09vQF7NgAPreChN
 vFeK5UyKoW+s9R6NbYunk45RrGH9NqbbvbO+7u3rvzbvszBIpiR/d6UTSNOBI2HJn9y57QV7S
 hpstLiqpifBLFU7nDqDLverEmSuLpLRufO6apNgMSIdgYuxWUjbXHD9h1iKid5PNbjvLWZjiW
 9phVvjIe96r9IB69vmUUS4UqH/VGUkknezIp+BjSjK1luuxGlN+M0fZP46TbgRLXQCEy2Cp83
 DljPrNwH6DV1w9MR/0QlaFjXzTdL9r+Fg3eRfpq8eBMQRybqXjtyi7C9QYGwshi3VYvitQADm
 1qvFeGql7A69p2LcLjcZ3ucG22V/Ei84AEbX6Un36VSviZ6jwLxGN3v8Ug7EJFFGSpNKPvyNa
 MqP7lGDyCqIOB0p4Iy2ucn8v+kdlV0A9n0MSXOiAUpPSKu7D2sl2Y4Op15ciT/BLBUCNK0UZY
 Ru0ZD6d3fO3VppAiu2iu6UmmkGOMj7C5wEFkPKllimUcveIsV+lNjlwY+Tzrd9gE7+AJLSsup
 JZL0iVl8z1necauQeboEd61kpxk+qOaGf+5ENyJuopsh3Y4av+/COrEprjRKw2ZWUhyUKZfuu
 OI3iYqXwmiC+6WYhXjrAkrFCQUA5UcgToXK934u7cHCHnGQDFpV8hNsaee8/OFl12TM4deElE
 iqg0bz5cE9A==
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Received-From: 212.227.17.21
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x
X-Spam-Score: 0.9 (/)
X-Debbugs-Envelope-To: submit
Cc: Ivan Petkov <ivanppetkov@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.1 (/)

Hello!

Ludovic Court=C3=A8s writes:

> Hello,
>
> On berlin, Rust 1.24.1 builds systematically exceed the timeout:
>
> --8<---------------cut here---------------start------------->8---
> Building stage1 compiler artifacts (x86_64-unknown-linux-gnu -> x86_64-un=
known-linux-gnu)
>    Compiling arena v0.0.0 (file:///tmp/guix-build-rust-1.24.1.drv-0/rustc=
-1.24.1-src/src/libarena)
>    Compiling rustc_driver v0.0.0 (file:///tmp/guix-build-rust-1.24.1.drv-=
0/rustc-1.24.1-src/src/librustc_driver)
>
> [...]
>
>    Compiling rls-data v0.14.0
>    Compiling rustc_data_structures v0.0.0 (file:///tmp/guix-build-rust-1.=
24.1.drv-0/rustc-1.24.1-src/src/librustc_data_structures)
>    Compiling flate2 v1.0.1
>    Compiling syntax_pos v0.0.0 (file:///tmp/guix-build-rust-1.24.1.drv-0/=
rustc-1.24.1-src/src/libsyntax_pos)
>    Compiling rustc_errors v0.0.0 (file:///tmp/guix-build-rust-1.24.1.drv-=
0/rustc-1.24.1-src/src/librustc_errors)
>    Compiling backtrace v0.3.4
> guix offload: error: timeout expired while offloading '/gnu/store/61bd22d=
9mg3xl260jwddisiahh3kmanj-rust-1.24.1.drv'
> --8<---------------cut here---------------end--------------->8---
>
> Strangely, the build lasts ~9000 seconds (2.5 hours) on the front-end
> node of berlin=C2=B9, and the timeout for guix-daemon on berlin is 6h (see
> guix-maintenance.git) while the max-silent-time is 1h.
>
> The build nodes may be slower than the front-end, but still, it seems
> unlikely that it would take more than 6h there.  (That could happen if
> the test suite, which lasts 2.1h, were =E2=80=9Cembarrassingly parallel=
=E2=80=9D, but
> we=E2=80=99re running tests with =E2=80=98-j1=E2=80=99.)
>
> To summarize, there are two problems:
>
>   1. Rust takes too long to build.  What can we do about it?  Enable
>      parallel builds?

One thing I suggested in the past was to remove the check phase *only*
for rust packages used for bootstrapping. This way we still run the
tests for the final rust but not at every step in the chain.

Although, I wonder if we're more likely to miss a bug if we do this, I'm
not sure.

For reference: https://lists.gnu.org/archive/html/guix-patches/2018-11/msg0=
0453.html

Thanks,
Pierre




Information forwarded to bug-guix@HIDDEN:
bug#35139; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 4 Apr 2019 09:00:06 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Apr 04 05:00:05 2019
Received: from localhost ([127.0.0.1]:43680 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1hByE9-0007yu-FN
	for submit <at> debbugs.gnu.org; Thu, 04 Apr 2019 05:00:05 -0400
Received: from eggs.gnu.org ([209.51.188.92]:48961)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1hByE7-0007xt-GI
 for submit <at> debbugs.gnu.org; Thu, 04 Apr 2019 05:00:03 -0400
Received: from lists.gnu.org ([209.51.188.17]:55526)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <ludo@HIDDEN>) id 1hByE2-00015D-8g
 for submit <at> debbugs.gnu.org; Thu, 04 Apr 2019 04:59:58 -0400
Received: from eggs.gnu.org ([209.51.188.92]:35104)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <ludo@HIDDEN>) id 1hByE1-0000Uu-1B
 for bug-Guix@HIDDEN; Thu, 04 Apr 2019 04:59:58 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-2.9 required=5.0 tests=ALL_TRUSTED,BAYES_00,
 URIBL_BLOCKED autolearn=disabled version=3.3.2
Received: from fencepost.gnu.org ([2001:470:142:3::e]:41689)
 by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <ludo@HIDDEN>)
 id 1hByE0-00010N-7D; Thu, 04 Apr 2019 04:59:56 -0400
Received: from [2001:660:6102:320:e120:2c8f:8909:cdfe] (port=57276 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1hByDz-0003ZA-61; Thu, 04 Apr 2019 04:59:55 -0400
From: =?utf-8?Q?Ludovic_Court=C3=A8s?= <ludo@HIDDEN>
To: bug-Guix@HIDDEN
Subject: Rust builds systematically time out
X-URL: http://www.fdn.fr/~lcourtes/
X-Revolutionary-Date: 15 Germinal an 227 de la =?utf-8?Q?R=C3=A9volution?=
X-PGP-Key-ID: 0x090B11993D9AEBB5
X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc
X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4  0CFB 090B 1199 3D9A EBB5
X-OS: x86_64-pc-linux-gnu
Date: Thu, 04 Apr 2019 10:59:52 +0200
Message-ID: <878swqtabb.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/26.1 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: submit
Cc: Danny Milosavljevic <dannym@HIDDEN>,
 Ivan Petkov <ivanppetkov@HIDDEN>
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Hello,

On berlin, Rust 1.24.1 builds systematically exceed the timeout:

--8<---------------cut here---------------start------------->8---
Building stage1 compiler artifacts (x86_64-unknown-linux-gnu -> x86_64-unkn=
own-linux-gnu)
   Compiling arena v0.0.0 (file:///tmp/guix-build-rust-1.24.1.drv-0/rustc-1=
.24.1-src/src/libarena)
   Compiling rustc_driver v0.0.0 (file:///tmp/guix-build-rust-1.24.1.drv-0/=
rustc-1.24.1-src/src/librustc_driver)

[...]

   Compiling rls-data v0.14.0
   Compiling rustc_data_structures v0.0.0 (file:///tmp/guix-build-rust-1.24=
.1.drv-0/rustc-1.24.1-src/src/librustc_data_structures)
   Compiling flate2 v1.0.1
   Compiling syntax_pos v0.0.0 (file:///tmp/guix-build-rust-1.24.1.drv-0/ru=
stc-1.24.1-src/src/libsyntax_pos)
   Compiling rustc_errors v0.0.0 (file:///tmp/guix-build-rust-1.24.1.drv-0/=
rustc-1.24.1-src/src/librustc_errors)
   Compiling backtrace v0.3.4
guix offload: error: timeout expired while offloading '/gnu/store/61bd22d9m=
g3xl260jwddisiahh3kmanj-rust-1.24.1.drv'
--8<---------------cut here---------------end--------------->8---

Strangely, the build lasts ~9000 seconds (2.5 hours) on the front-end
node of berlin=C2=B9, and the timeout for guix-daemon on berlin is 6h (see
guix-maintenance.git) while the max-silent-time is 1h.

The build nodes may be slower than the front-end, but still, it seems
unlikely that it would take more than 6h there.  (That could happen if
the test suite, which lasts 2.1h, were =E2=80=9Cembarrassingly parallel=E2=
=80=9D, but
we=E2=80=99re running tests with =E2=80=98-j1=E2=80=99.)

To summarize, there are two problems:

  1. Rust takes too long to build.  What can we do about it?  Enable
     parallel builds?

  2. Offloaded builds seem to time out prematurely or something.

Thoughts?

Ludo=E2=80=99.

=C2=B9 See <https://ci.guix.info/log/rkrnm3rr7g6fhr17160vn1mz5rdzh9lv-rust-=
1.24.1>
  for timings.




Acknowledgement sent to Ludovic Courtès <ludo@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#35139; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Thu, 4 Apr 2019 11:30:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.