GNU bug report logs - #27476
Multi-threaded compilation of 'syntax-parameterize' forms crashes

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Severity: serious; Reported by: Leo Famulari <leo@HIDDEN>; merged with #27652, #31740; dated Sat, 24 Jun 2017 16:33:01 UTC; Maintainer for guix is bug-guix@HIDDEN.
Merged 27476 27652 31740. Request was from ludo@HIDDEN (Ludovic Courtès) to control <at> debbugs.gnu.org. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 9 May 2018 10:18:17 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed May 09 06:18:17 2018
Received: from localhost ([127.0.0.1]:54832 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1fGMAp-0006UR-D6
	for submit <at> debbugs.gnu.org; Wed, 09 May 2018 06:18:15 -0400
Received: from pb-sasl2.pobox.com ([64.147.108.67]:51913
 helo=sasl.smtp.pobox.com) by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <wingo@HIDDEN>) id 1fGMAl-0006UH-9l
 for 27476 <at> debbugs.gnu.org; Wed, 09 May 2018 06:18:12 -0400
Received: from sasl.smtp.pobox.com (unknown [127.0.0.1])
 by pb-sasl2.pobox.com (Postfix) with ESMTP id D93A5B847A;
 Wed,  9 May 2018 06:18:10 -0400 (EDT)
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=pobox.com; h=from:to:cc
 :subject:references:date:in-reply-to:message-id:mime-version
 :content-type:content-transfer-encoding; s=sasl; bh=zGdMsaDhFSkP
 zBcVuW0yKK5rc74=; b=F11l5uCrCvP+fZoZvwvSnVzVgeQby1eYyL7DBVzZ6YTM
 fknn4rATVhFaB1/0v9o3yM+iuBu1wf+VbGCXop43W+AqPhdHWl4+E1QzzHhCA59w
 Ir+ybx5/XKVs0qiNPJyUXh9Bv8C5wdhkuqVszuZxiTzi8XKhGlmnYMvWeIsJzbg=
Received: from pb-sasl2.nyi.icgroup.com (unknown [127.0.0.1])
 by pb-sasl2.pobox.com (Postfix) with ESMTP id D04CBB8479;
 Wed,  9 May 2018 06:18:10 -0400 (EDT)
Received: from sparrow (unknown [151.127.12.20])
 (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by pb-sasl2.pobox.com (Postfix) with ESMTPSA id C7054B8478;
 Wed,  9 May 2018 06:18:08 -0400 (EDT)
From: Andy Wingo <wingo@HIDDEN>
To: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
Subject: Re: libguile/memoize.c is not thread safe,
 so syntax parameter expansion is not thread-safe
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
 <878tfi9x15.fsf@HIDDEN> <87h8nstms1.fsf@HIDDEN>
 <874ljstlvq.fsf_-_@HIDDEN> <87603x6x1f.fsf@HIDDEN>
 <878t8tyyfk.fsf@HIDDEN>
Date: Wed, 09 May 2018 12:18:01 +0200
In-Reply-To: <878t8tyyfk.fsf@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?=
 =?utf-8?Q?s?= message of "Wed, 09 May 2018 11:23:59 +0200")
Message-ID: <87lgct5e06.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Pobox-Relay-ID: 456357DC-5372-11E8-866F-B479894C8D7C-02397024!pb-sasl2.pobox.com
X-Spam-Score: 0.7 (/)
X-Debbugs-Envelope-To: 27476
Cc: Ricardo Wurmus <rekado@HIDDEN>, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.3 (/)

On Wed 09 May 2018 11:23, ludo@HIDDEN (Ludovic Court=C3=A8s) writes:

>> Is the memoization you are referring to the "set!" in the "lazy" form in
>> ice-9/eval.scm ?  Or something else?  FWIW I would not think the "set!"
>> could be the issue, at least on x86, but who knows.
>
> Actually I=E2=80=99m not sure exactly.  =E2=80=98memoize-expression=E2=80=
=99 itself is
> side-effect-free, right?

As far as I know (and I had a look this morning), yes.  It takes a
Tree-IL input and returns a memoized output.  The internal mutation that
exists in the evaluator is just the lazy "compilation" (see the
invocations of the "lazy" form).

Of course the function being evaluated could mutate shared state as
well!

Andy




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 9 May 2018 09:24:09 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed May 09 05:24:09 2018
Received: from localhost ([127.0.0.1]:54816 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1fGLKS-00059y-PI
	for submit <at> debbugs.gnu.org; Wed, 09 May 2018 05:24:08 -0400
Received: from eggs.gnu.org ([208.118.235.92]:41362)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1fGLKR-00059k-D9
 for 27476 <at> debbugs.gnu.org; Wed, 09 May 2018 05:24:07 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <ludo@HIDDEN>) id 1fGLKL-0008WR-At
 for 27476 <at> debbugs.gnu.org; Wed, 09 May 2018 05:24:02 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00 autolearn=disabled
 version=3.3.2
Received: from fencepost.gnu.org ([2001:4830:134:3::e]:35636)
 by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <ludo@HIDDEN>)
 id 1fGLKL-0008WF-6Y; Wed, 09 May 2018 05:24:01 -0400
Received: from [2a01:e0a:1d:7270:af76:b9b:ca24:c465] (port=48424 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1fGLKK-0008Te-Or; Wed, 09 May 2018 05:24:01 -0400
From: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
To: Andy Wingo <wingo@HIDDEN>
Subject: Re: libguile/memoize.c is not thread safe,
 so syntax parameter expansion is not thread-safe
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
 <878tfi9x15.fsf@HIDDEN> <87h8nstms1.fsf@HIDDEN>
 <874ljstlvq.fsf_-_@HIDDEN> <87603x6x1f.fsf@HIDDEN>
X-URL: http://www.fdn.fr/~lcourtes/
X-Revolutionary-Date: 20 =?utf-8?Q?Flor=C3=A9al?= an 226 de la =?utf-8?Q?R?=
 =?utf-8?Q?=C3=A9volution?=
X-PGP-Key-ID: 0x090B11993D9AEBB5
X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc
X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4  0CFB 090B 1199 3D9A EBB5
X-OS: x86_64-pc-linux-gnu
Date: Wed, 09 May 2018 11:23:59 +0200
In-Reply-To: <87603x6x1f.fsf@HIDDEN> (Andy Wingo's message of "Wed, 09 May
 2018 10:41:32 +0200")
Message-ID: <878t8tyyfk.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Received-From: 2001:4830:134:3::e
X-Spam-Score: -5.0 (-----)
X-Debbugs-Envelope-To: 27476
Cc: Ricardo Wurmus <rekado@HIDDEN>, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -6.0 (------)

Hello Andy!

Andy Wingo <wingo@HIDDEN> skribis:

> On Mon 30 Apr 2018 23:39, ludo@HIDDEN (Ludovic Court=C3=A8s) writes:
>
>> So the problem, AIUI, is that psyntax evaluates syntax parameters using
>> =E2=80=98primitive-eval=E2=80=99 (via =E2=80=98eval-local-transformer=E2=
=80=99), but memoization in
>> (ice-9 eval) is not thread-safe, hence the random crashes.
>
> Sorry I've been a bit AWOL here... if this diagnosis is correct, then
> the problem is ultimately the memoization that needs to be thread-safe,
> right?

It looks like it, yes.

> Is the memoization you are referring to the "set!" in the "lazy" form in
> ice-9/eval.scm ?  Or something else?  FWIW I would not think the "set!"
> could be the issue, at least on x86, but who knows.

Actually I=E2=80=99m not sure exactly.  =E2=80=98memoize-expression=E2=80=
=99 itself is
side-effect-free, right?

Thanks for your feedback,
Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 9 May 2018 08:41:44 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed May 09 04:41:44 2018
Received: from localhost ([127.0.0.1]:54769 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1fGKfO-0002Cg-OZ
	for submit <at> debbugs.gnu.org; Wed, 09 May 2018 04:41:44 -0400
Received: from pb-sasl2.pobox.com ([64.147.108.67]:63284
 helo=sasl.smtp.pobox.com) by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <wingo@HIDDEN>) id 1fGKfN-0002CY-1j
 for 27476 <at> debbugs.gnu.org; Wed, 09 May 2018 04:41:41 -0400
Received: from sasl.smtp.pobox.com (unknown [127.0.0.1])
 by pb-sasl2.pobox.com (Postfix) with ESMTP id 7F876B8072;
 Wed,  9 May 2018 04:41:40 -0400 (EDT)
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=pobox.com; h=from:to:cc
 :subject:references:date:in-reply-to:message-id:mime-version
 :content-type:content-transfer-encoding; s=sasl; bh=tbt4oV6dQOaa
 GBFmBdiJW5SCkGE=; b=pOD8qP6IGR+NZ1N5bVks41PxPvpaM4ffrpo7lDaqF6ST
 0EDnyQlUBK1QIQnvhc8BA0i7A1afGJnsPCc63kctX1neFzT8q3ad9hN9yTTb+4lf
 wpTDssVSRNZhJ8jaQTtoBzxvX59vm93DVE7NHCa3bcRYauigIZuQQYMcYqDxn2o=
Received: from pb-sasl2.nyi.icgroup.com (unknown [127.0.0.1])
 by pb-sasl2.pobox.com (Postfix) with ESMTP id 66964B806E;
 Wed,  9 May 2018 04:41:40 -0400 (EDT)
Received: from sparrow (unknown [151.127.12.20])
 (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by pb-sasl2.pobox.com (Postfix) with ESMTPSA id 455D9B806D;
 Wed,  9 May 2018 04:41:39 -0400 (EDT)
From: Andy Wingo <wingo@HIDDEN>
To: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
Subject: Re: libguile/memoize.c is not thread safe,
 so syntax parameter expansion is not thread-safe
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
 <878tfi9x15.fsf@HIDDEN> <87h8nstms1.fsf@HIDDEN>
 <874ljstlvq.fsf_-_@HIDDEN>
Date: Wed, 09 May 2018 10:41:32 +0200
In-Reply-To: <874ljstlvq.fsf_-_@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s?=
 =?utf-8?Q?=22's?= message of "Mon, 30 Apr 2018 23:39:05 +0200")
Message-ID: <87603x6x1f.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Pobox-Relay-ID: CA8AD0F6-5364-11E8-A467-B479894C8D7C-02397024!pb-sasl2.pobox.com
X-Spam-Score: 0.7 (/)
X-Debbugs-Envelope-To: 27476
Cc: Ricardo Wurmus <rekado@HIDDEN>, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.3 (/)

Hi,

On Mon 30 Apr 2018 23:39, ludo@HIDDEN (Ludovic Court=C3=A8s) writes:

> So the problem, AIUI, is that psyntax evaluates syntax parameters using
> =E2=80=98primitive-eval=E2=80=99 (via =E2=80=98eval-local-transformer=E2=
=80=99), but memoization in
> (ice-9 eval) is not thread-safe, hence the random crashes.

Sorry I've been a bit AWOL here... if this diagnosis is correct, then
the problem is ultimately the memoization that needs to be thread-safe,
right?

Is the memoization you are referring to the "set!" in the "lazy" form in
ice-9/eval.scm ?  Or something else?  FWIW I would not think the "set!"
could be the issue, at least on x86, but who knows.

A




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.
Severity set to 'serious' from 'important' Request was from ludo@HIDDEN (Ludovic Courtès) to control <at> debbugs.gnu.org. Full text available.
Changed bug title to 'Multi-threaded compilation of 'syntax-parameterize' forms crashes' from 'Compilation with 'guix pull' crashes non-deterministically on many-core machines' Request was from ludo@HIDDEN (Ludovic Courtès) to control <at> debbugs.gnu.org. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 30 Apr 2018 21:39:09 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Apr 30 17:39:09 2018
Received: from localhost ([127.0.0.1]:44401 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1fDGVp-0001QN-D9
	for submit <at> debbugs.gnu.org; Mon, 30 Apr 2018 17:39:09 -0400
Received: from hera.aquilenet.fr ([185.233.100.1]:41284)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1fDGVo-0001QG-8q
 for 27476 <at> debbugs.gnu.org; Mon, 30 Apr 2018 17:39:08 -0400
Received: from localhost (localhost [127.0.0.1])
 by hera.aquilenet.fr (Postfix) with ESMTP id ACA15131BE;
 Mon, 30 Apr 2018 23:39:07 +0200 (CEST)
X-Virus-Scanned: Debian amavisd-new at aquilenet.fr
Received: from hera.aquilenet.fr ([127.0.0.1])
 by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id Fp973NHZgvD4; Mon, 30 Apr 2018 23:39:06 +0200 (CEST)
Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465])
 by hera.aquilenet.fr (Postfix) with ESMTPSA id 568F812FC4;
 Mon, 30 Apr 2018 23:39:06 +0200 (CEST)
From: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
To: Ricardo Wurmus <rekado@HIDDEN>
Subject: libguile/memoize.c is not thread safe,
 so syntax parameter expansion is not thread-safe
In-Reply-To: <87h8nstms1.fsf@HIDDEN> ("Ludovic
 \=\?utf-8\?Q\?Court\=C3\=A8s\=22'\?\=
 \=\?utf-8\?Q\?s\?\= message of "Mon, 30 Apr 2018 23:19:42 +0200")
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
 <878tfi9x15.fsf@HIDDEN> <87h8nstms1.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
Date: Mon, 30 Apr 2018 23:39:05 +0200
Message-ID: <874ljstlvq.fsf_-_@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)

ludo@HIDDEN (Ludovic Court=C3=A8s) skribis:

> With Guile 2.2.3 a similar program triggers a crash very quickly:

Even simpler:

--8<---------------cut here---------------start------------->8---
$ guile ../guile-debugging/syntax-parms.scm=20
;;; note: source file /home/ludo/src/guix/../guile-debugging/syntax-parms.s=
cm
;;;       newer than compiled /home/ludo/.cache/guile/ccache/2.2-LE-8-3.A/h=
ome/ludo/src/guile-debugging/syntax-parms.scm.go
;;; note: auto-compilation is enabled, set GUILE_AUTO_COMPILE=3D0
;;;       or pass the --no-auto-compile argument to disable.
;;; compiling /home/ludo/src/guix/../guile-debugging/syntax-parms.scm
;;; compiled /home/ludo/.cache/guile/ccache/2.2-LE-8-3.A/home/ludo/src/guil=
e-debugging/syntax-parms.scm.go
In /home/ludo/src/guix/../guile-debugging/syntax-parms.scm:
    37:17 13 (_)
In system/base/compile.scm:
    255:6 12 (compile _ #:from _ #:to _ #:env _ #:opts _)
   183:32 11 (compile-fold (#f syntax-violation (#<tree-il (const #f)> #<tr=
ee-il (const "source expression failed to match any pattern")> #<tree-il (l=
exical tmp tmp-1dff1b=E2=80=A6>)) # =E2=80=A6)
In ice-9/boot-9.scm:
   2312:4 10 (save-module-excursion #<procedure 57dd920 at ice-9/psyntax.sc=
m:1774:12 (a b)>)
In language/scheme/compile-tree-il.scm:
    31:15  9 (_)
In ice-9/psyntax.scm:
  1234:22  8 (expand-top-sequence (#<tree-il (primcall syntax-violation (co=
nst #f) (const "source expression failed to match any pattern") (lexical tm=
p tmp-1dff1b83541ce327-2=E2=80=A6>) =E2=80=A6)
In ice-9/boot-9.scm:
   222:29  7 (map1 ((10 (3 #((0 . 0)) 2 (1 (11 0 . 0) (7 (3 #() 2 (10 (13 1=
5 5 (guile) list . #f) (5 . #<syntax ->) (11 0 . 0) (11 0 . 1)) () 2) (11 0=
 . 0)) 10 (. #) =E2=80=A6) =E2=80=A6) #) =E2=80=A6))
   222:17  6 (map1 (10 (3 #((0 . 0)) 2 (1 (11 0 . 0) (7 (3 #() 2 (10 (13 15=
 5 (guile) list . #f) (5 . #<syntax ->) (11 0 . 0) (11 0 . 1)) () 2) (11 0 =
. 0)) 10 (13 # . #) =E2=80=A6) =E2=80=A6) =E2=80=A6))
In ice-9/psyntax.scm:
  2054:19  5 (_ _ (#<tree-il (const (_ any any))>) (param 1 2) ())
In ice-9/boot-9.scm:
   222:17  4 (map1 (#<tree-il (const (_ any any))>))
In ice-9/psyntax.scm:
  2057:27  3 (_ _)
   289:10  2 (eval-local-transformer _ _)
In ice-9/eval.scm:
   718:15  1 (primitive-eval _)
In unknown file:
           0 (memoize-expression #<tree-il (lambda () (lambda-case (((() 1)=
 #f #f #f () ((11 0 . 0))) (call (lambda () (lambda-case ((((#f . #(tmp-1df=
f1b83541ce327-248119)) (#t=E2=80=A6>)
ERROR: In procedure memoize-expression:
In procedure vector: Wrong type argument in position 1: #(#<directory (guil=
e-user) cd8140>)
  C-c C-c
$ cat ../guile-debugging/syntax-parms.scm=20
(use-modules (ice-9 threads)
             (srfi srfi-1)
             (system base compile))

(compile #f)                                      ;load modules

(define-syntax-parameter param
  (lambda (s)
    (syntax-case s ()
      ((_ a b) #'(+ a b)))))

(define threads
  (unfold (lambda (x) (> x 100))
          (lambda (x)
            (call-with-new-thread
             (lambda ()
               (while #t
                 (compile '(begin
                             (param 1 2)
                             (syntax-parameterize ((param (lambda (s)
                                                            (syntax-case s =
()
                                                              ((_ a b)
                                                               #'(- a b))))=
))
                               (param 1 2)))
                          #:env (current-module)
                          #:from 'scheme
                          #:to 'tree-il)))))
          1+
          0))

(for-each join-thread threads)
--8<---------------cut here---------------end--------------->8---

So the problem, AIUI, is that psyntax evaluates syntax parameters using
=E2=80=98primitive-eval=E2=80=99 (via =E2=80=98eval-local-transformer=E2=80=
=99), but memoization in
(ice-9 eval) is not thread-safe, hence the random crashes.

Not sure what can be done.  Thoughts?

Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 30 Apr 2018 21:19:46 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Apr 30 17:19:46 2018
Received: from localhost ([127.0.0.1]:44391 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1fDGD3-0000w2-Vn
	for submit <at> debbugs.gnu.org; Mon, 30 Apr 2018 17:19:46 -0400
Received: from hera.aquilenet.fr ([185.233.100.1]:41094)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1fDGD2-0000vu-Kc
 for 27476 <at> debbugs.gnu.org; Mon, 30 Apr 2018 17:19:45 -0400
Received: from localhost (localhost [127.0.0.1])
 by hera.aquilenet.fr (Postfix) with ESMTP id 1649B12021;
 Mon, 30 Apr 2018 23:19:44 +0200 (CEST)
X-Virus-Scanned: Debian amavisd-new at aquilenet.fr
Received: from hera.aquilenet.fr ([127.0.0.1])
 by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id uX4Uh2nlo7-R; Mon, 30 Apr 2018 23:19:43 +0200 (CEST)
Received: from ribbon (unknown [IPv6:2a01:e0a:1d:7270:af76:b9b:ca24:c465])
 by hera.aquilenet.fr (Postfix) with ESMTPSA id B118311FB5;
 Mon, 30 Apr 2018 23:19:42 +0200 (CEST)
From: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
To: Ricardo Wurmus <rekado@HIDDEN>
Subject: Re: bug#27476: guix pull fails on powerful server
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
 <878tfi9x15.fsf@HIDDEN>
Date: Mon, 30 Apr 2018 23:19:42 +0200
In-Reply-To: <878tfi9x15.fsf@HIDDEN> ("Ludovic
 \=\?utf-8\?Q\?Court\=C3\=A8s\=22'\?\=
 \=\?utf-8\?Q\?s\?\= message of "Tue, 07 Nov 2017 11:57:10 +0100")
Message-ID: <87h8nstms1.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>, help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)

ludo@HIDDEN (Ludovic Court=C3=A8s) skribis:

> I can=E2=80=99t reproduce this with current Guile =E2=80=98stable-2.2=E2=
=80=99, following Andy=E2=80=99s
> weak-table rewrite=C2=B9, so this might have been a weak-table bug showin=
g up
> under memory pressure.

With Guile 2.2.3 a similar program triggers a crash very quickly:

--8<---------------cut here---------------start------------->8---
$ cat ../guile-debugging/syntax-parms.scm=20
(use-modules (ice-9 threads)
             (srfi srfi-1)
             (guix monads)
             (guix store)
             (system base compile))

(compile #f)                                      ;load modules

(define threads
  (unfold (lambda (x) (> x 100))
          (lambda (x)
            (call-with-new-thread
             (lambda ()
               (while #t
                 (compile
                  '(mlet %store-monad ((x y))
                     (mbegin %store-monad
                       (return x)
                       (return y)))
                  #:env (current-module)
                  #:from 'scheme
                  #:to 'tree-il)))))
          1+
          0))

(for-each join-thread threads)
$ guile --version
guile (GNU Guile) 2.2.3
Copyright (C) 2017 Free Software Foundation, Inc.

License LGPLv3+: GNU LGPL 3 or later <http://gnu.org/licenses/lgpl.html>.
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
$ guile ../guile-debugging/syntax-parms.scm=20
In ice-9/psyntax.scm:
  2338:44 19 (expand-let _ _ _ #f _ #<procedure build-let (src ids vars val=
-exps body-exp)> _ _ _)
  1679:45 18 (parse _ _ _ _ _ _ _)
In ice-9/boot-9.scm:
   222:17 17 (map1 ("-" "1dff1b83541ce327" "-" "2ad70"))
In ice-9/psyntax.scm:
  1679:45 16 (parse _ _ _ _ _ _ _)
In ice-9/boot-9.scm:
   222:17 15 (map1 ((#(ribcage () () ()) #(ribcage () () ()) #(ribcage #(un=
used-value) #((m-1dff1b83541ce327-29a7a top)) #("l-1dff1b83541ce327-2bce9")=
) #(ribcage () () ()) # =E2=80=A6)))
In ice-9/psyntax.scm:
  1484:23 14 (_ _ _)
In ice-9/boot-9.scm:
   222:29 13 (map1 _)
   222:17 12 (map1 ("-" "2bd28"))
In ice-9/psyntax.scm:
  1789:11 11 (lp _ ())
  1679:45 10 (parse _ _ _ _ _ _ _)
In ice-9/boot-9.scm:
   222:17  9 (map1 ((expand-1dff1b83541ce327-2bd31) (#<tree-il (lambda ((na=
me . expand)) (lambda-case (((body) #f #f #f () (body-1dff1b83541ce327-2bd3=
5)) (call (lambda () (=E2=80=A6>) =E2=80=A6))
In ice-9/psyntax.scm:
  1679:45  8 (parse _ _ _ _ _ _ _)
In ice-9/boot-9.scm:
   222:17  7 (map1 ((m-1dff1b83541ce327-2bcf4 top)))
In ice-9/psyntax.scm:
  1484:23  6 (_ _ _)
In ice-9/boot-9.scm:
   222:17  5 (map1 (#<syntax %store-monad>))
In ice-9/psyntax.scm:
  1407:23  4 (_ _)
  1317:39  3 (syntax-type y (shift #(ribcage #(e) #((top)) #("l-680b775fb37=
a463-1343")) #(ribcage () () ()) #(ribcage #(xx) #((top)) #("l-680b775fb37a=
463-1340")) #(ribcage =E2=80=A6)) # =E2=80=A6)
   916:15  2 (resolve-identifier y (#<syntax >>=3D> #<syntax (#<syntax mval=
> #<syntax mproc0>)>) (shift #(ribcage #(e) #((top)) #("l-680b775fb37a463-1=
343")) #(ribcage () () #) =E2=80=A6) =E2=80=A6)
   833:21  1 (id-var-name y _ _)
    669:4  0 (search y (() #(ribcage () () ()) #(ribcage () () ()) #(ribcag=
e () () ()) #(ribcage () () ())) (top) (hygiene guile-user))
ice-9/psyntax.scm:669:4: In procedure search:
In procedure vector-ref: Wrong type argument in position 1 (expecting vecto=
r): ()
In ice-9/boot-9.scm:
   222:29 19 (map1 _)
   222:17 18 (map1 (#f))
In ice-9/psyntax.scm:
  1789:11 17 (lp _ ())
  1679:45 16 (parse _ _ _ _ _ _ _)
In ice-9/boot-9.scm:
   222:17 15 (map1 (() (m-1dff1b83541ce327-8f24e top)))
In ice-9/psyntax.scm:
  1679:45 14 (parse _ _ _ _ _ _ _)
In ice-9/boot-9.scm:
   222:17 13 (map1 ((m-1dff1b83541ce327-8fe71 top) shift #(ribcage #(e) #((=
top)) #("l-680b775fb37a463-1343")) #(ribcage () () ()) #(ribcage #(xx) #((t=
op)) #("l-680b775fb3=E2=80=A6")) #))
In ice-9/psyntax.scm:
  1409:12 12 (expand-expr _ _ _ (shift #(ribcage #(e) #((top)) #("l-680b775=
fb37a463-1343")) #(ribcage () () ()) #(ribcage #(xx) #((top)) #("l-680b775f=
b37a463-1340")) #(# # =E2=80=A6)) # =E2=80=A6)
  2054:19 11 (_ _ _ (m-1dff1b83541ce327-8fe71 top) ())
In ice-9/boot-9.scm:
   222:17 10 (map1 (#<syntax identifier?> (#<syntax syntax> #<syntax id>)))
In ice-9/psyntax.scm:
  1409:12  9 (_ _)
  1789:11  8 (lp _ (#(ribcage () () ()) #(ribcage #(x) #((m-1dff1b83541ce32=
7-8f383 top)) #("l-1dff1b83541ce327-8f40b")) #(ribcage () () ()) #(ribcage =
() () ()) #(ribcage # =E2=80=A6) =E2=80=A6))
  1679:45  7 (parse _ _ _ _ _ _ _)
In ice-9/boot-9.scm:
   222:17  6 (map1 (#(ribcage #(x) #((m-1dff1b83541ce327-8f383 top)) #("l-1=
dff1b83541ce327-8f40b")) #(ribcage () () ()) shift #(ribcage #(monad body) =
#((top) (top)) #("=E2=80=A6" =E2=80=A6)) =E2=80=A6))
In ice-9/psyntax.scm:
  2702:67  5 (_ tmp-1dff1b83541ce327-8fa7a _ _)
 2646:111  4 (gen-clause #<tree-il (lexical tmp tmp-1dff1b83541ce327-8db88)=
> () (#(ribcage () () ()) #(ribcage #(x) #((m-1dff1b83541ce327-8f383 top)) =
#("l-1dff1b83541ce3=E2=80=A6")) =E2=80=A6) =E2=80=A6)
  2607:69  3 (build-dispatch-call (("8fa7c" . 0)) "1dff1b83541ce327" #<tree=
-il (lexical tmp tmp-1dff1b83541ce327-8e71d)> #((m-1dff1b83541ce327-8f383 t=
op)) (#f #f () (#) #<tr=E2=80=A6> =E2=80=A6))
In ice-9/boot-9.scm:
   222:17  2 (map1 ("8fa7c"))
In ice-9/psyntax.scm:
  2004:10  1 (gen-var _)
In unknown file:
           0 (symbol->string "8fa7c")
ERROR: In procedure symbol->string:
In procedure symbol->string: Wrong type argument in position 1 (expecting s=
ymbol): "8fa7c"
--8<---------------cut here---------------end--------------->8---

Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 7 Nov 2017 10:57:16 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Nov 07 05:57:16 2017
Received: from localhost ([127.0.0.1]:55228 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1eC1ZD-0003gU-SB
	for submit <at> debbugs.gnu.org; Tue, 07 Nov 2017 05:57:16 -0500
Received: from hera.aquilenet.fr ([141.255.128.1]:37512)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1eC1ZB-0003gL-B0
 for 27476 <at> debbugs.gnu.org; Tue, 07 Nov 2017 05:57:13 -0500
Received: from localhost (localhost [127.0.0.1])
 by hera.aquilenet.fr (Postfix) with ESMTP id 3A007F6BA;
 Tue,  7 Nov 2017 11:57:14 +0100 (CET)
X-Virus-Scanned: Debian amavisd-new at aquilenet.fr
Received: from hera.aquilenet.fr ([127.0.0.1])
 by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id lXLJIigpgCkE; Tue,  7 Nov 2017 11:57:13 +0100 (CET)
Received: from ribbon (unknown [193.50.110.150])
 by hera.aquilenet.fr (Postfix) with ESMTPSA id ED623F6B6;
 Tue,  7 Nov 2017 11:57:12 +0100 (CET)
From: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
To: Ricardo Wurmus <rekado@HIDDEN>
Subject: Re: bug#27476: guix pull fails on powerful server
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
Date: Tue, 07 Nov 2017 11:57:10 +0100
In-Reply-To: <87shf44ny0.fsf@HIDDEN> (Ricardo Wurmus's message of "Sat,
 30 Sep 2017 09:59:03 +0200")
Message-ID: <878tfi9x15.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>, help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 1.0 (+)

Hi,

Ricardo Wurmus <rekado@HIDDEN> skribis:

> After limiting memory with =E2=80=9Culimit -Sv 5000000=E2=80=9D:
>
> ice-9/threads.scm:289:22: In procedure loop:
> ice-9/threads.scm:289:22: Syntax error:
> guix/scripts/pull.scm:192:8: >>=3D: >>=3D (bind) used outside of 'with-mo=
nad' in form (>>=3D (indirect-root-added latest) (lambda (done) (mlet* %sto=
re-monad () (if (and (file-exists? latest) (string=3D? (readlink latest) so=
urce-dir)) (begin (display (G_ "Guix already up to date\n")) (return #t)) (=
begin (switch-symlinks latest source-dir) (format #t (G_ "updated ~a succes=
sfully deployed under `~a'~%") %guix-package-name latest) (return #t))))))
>
> Some deprecated features have been used.  Set the environment
> variable GUILE_WARN_DEPRECATED to "detailed" and rerun the
> program to get more information.  Set it to "no" to suppress
> this message.
> builder for `/gnu/store/afji58647yzz7cr9dvlj87sd3ad36lbk-guix-latest.drv'=
 failed with exit code 1
> guix pull: error: build failed: build of `/gnu/store/afji58647yzz7cr9dvlj=
87sd3ad36lbk-guix-latest.drv' failed
>
> It always crashes at around 69%.

This gave me an idea.  With this program:

--8<---------------cut here---------------start------------->8---
(use-modules (ice-9 threads)
             (srfi srfi-1)
             (guix monads)
             (guix store)
             (system base compile))

(compile #f)                                      ;load modules

(define threads
  (unfold (lambda (x) (> x 100))
          (lambda (x)
            (call-with-new-thread
             (lambda ()
               (while #t
                 (compile
                  '(begin
                     (with-monad %store-monad
                       (>>=3D foo bar
                            (return 3)))
                     (mlet %store-monad ((x y))
                       (mbegin %store-monad
                         (return x)
                         (return y))))
                  #:env (current-module)
                  #:from 'scheme
                  #:to 'tree-il)))))
          1+
          0))

(for-each join-thread threads)
--8<---------------cut here---------------end--------------->8---

I can reproduce the error:

--8<---------------cut here---------------start------------->8---
$ ulimit -Sv 2000000
$ guile syntax-parms.scm
In ice-9/psyntax.scm:
  1678:45 19 (parse _ _ _ _ _ _ _)
In ice-9/boot-9.scm:
   230:17 18 (map1 (((("placeholder" placeholder) ((#<procedure 7fe06eb8423=
0 at guix/monads.scm:283=E2=80=A6>) . #) =E2=80=A6) =E2=80=A6)))
In ice-9/psyntax.scm:
  1483:23 17 (_ _ _)
In ice-9/boot-9.scm:
   230:29 16 (map1 (#<syntax y> #<syntax (#<syntax lambda> (#<syntax t-1dff=
1b83541ce327-679d05c>) (#<syntax ml=E2=80=A6>))
   230:17 15 (map1 (#<syntax (#<syntax lambda> (#<syntax t-1dff1b83541ce327=
-679d05c>) (#<syntax mlet*> #<syntax=E2=80=A6>))
In ice-9/psyntax.scm:
  1788:11 14 (lp ((#<syntax mlet*> #<syntax %store-monad> () #<syntax (#<sy=
ntax let> ((#<syntax x> #<syntax =E2=80=A6>)) #)
  1678:45 13 (parse _ _ _ _ _ _ _)
In ice-9/boot-9.scm:
   230:17 12 (map1 (((("placeholder" placeholder) ("l-1dff1b83541ce327-67a3=
671" lexical . #) ("placeho=E2=80=A6" =E2=80=A6) =E2=80=A6) =E2=80=A6)))
In ice-9/psyntax.scm:
  1678:45 11 (parse _ _ _ _ _ _ _)
In ice-9/boot-9.scm:
   230:17 10 (map1 (((("placeholder" placeholder) ((#<procedure 7fe06eb8423=
0 at guix/monads.scm:2=E2=80=A6>) . #) =E2=80=A6) . #)))
In ice-9/psyntax.scm:
  2337:44  9 (expand-let _ _ _ #f (hygiene guile-user) #<procedure build-le=
t (src ids vars val-exps body-exp)> _ =E2=80=A6)
  1678:45  8 (parse _ _ _ _ _ _ _)
In ice-9/boot-9.scm:
   230:17  7 (map1 (((("placeholder" placeholder) ("l-1dff1b83541ce327-67a3=
7b2" lexical . #) ("placeho=E2=80=A6" =E2=80=A6) =E2=80=A6) =E2=80=A6)))
In ice-9/psyntax.scm:
  1678:45  6 (parse _ _ _ _ _ _ _)
In ice-9/boot-9.scm:
   230:17  5 (map1 (((("placeholder" placeholder) ((#<procedure 7fe06eb8423=
0 at guix/monads.scm:283=E2=80=A6>) . #) =E2=80=A6) =E2=80=A6)))
In ice-9/psyntax.scm:
  1483:23  4 (_ _ _)
In ice-9/boot-9.scm:
   230:17  3 (map1 (#<syntax (return x)> #<syntax (#<syntax lambda> (#<synt=
ax unused-value>) (#<syntax mbegin>=E2=80=A6>))
In ice-9/psyntax.scm:
  1406:23  2 (_ _)
  1347:32  1 (syntax-type ((#<syntax %store-monad> #<syntax %return>)) (("p=
laceholder" placeholder) ((#) . #) =E2=80=A6) =E2=80=A6)
  1558:32  0 (expand-macro #<procedure 7fe06eb87198 at guix/monads.scm:538:=
0 (x)> _ _ _ _ _ _)
ice-9/psyntax.scm:1558:32: In procedure expand-macro:
ice-9/psyntax.scm:1558:32: Syntax error:
unknown location: state-return: Wrong number of arguments in form ((%store-=
monad %return))
In syntax-parms.scm:
    15:17  9 (_)
In system/base/compile.scm:
    255:6  8 (compile _ #:from _ #:to _ #:env _ #:opts _)
   183:32  7 (compile-fold (#<procedure compile-tree-il (x e opts)>) (begin=
 (with-monad %store-monad (>>=3D =E2=80=A6)) #) =E2=80=A6)
In ice-9/boot-9.scm:
   2316:4  6 (save-module-excursion #<procedure 30a63560 at language/scheme=
/compile-tree-il.scm:29:3 ()>)
In language/scheme/compile-tree-il.scm:
    31:15  5 (_)
In ice-9/psyntax.scm:
  1233:22  4 (expand-top-sequence ((begin (with-monad %store-monad (>>=3D f=
oo bar (return 3))) (mlet # ((=E2=80=A6)) #))) _ =E2=80=A6)
In ice-9/boot-9.scm:
   230:17  3 (map1 (#<procedure 2b188c00 at ice-9/psyntax.scm:1231:24 ()> #=
<procedure 2b188a80 at ice-9/psynta=E2=80=A6>))
In ice-9/psyntax.scm:
  1611:33  2 (parse (((("placeholder" placeholder) ((#<procedure 7fe06eb842=
30 at guix/monads.scm=E2=80=A6>) . #) =E2=80=A6) . #)) =E2=80=A6)
  1347:32  1 (syntax-type (>>=3D foo bar (return 3)) (("placeholder" placeh=
older) ((#<procedure 7fe06eb8=E2=80=A6>) . #) =E2=80=A6) =E2=80=A6)
  1558:32  0 (expand-macro #<procedure 30a63200 at ice-9/eval.scm:333:13 (a=
)> _ _ _ _ _ _)
ice-9/psyntax.scm:1558:32: In procedure expand-macro:
ice-9/psyntax.scm:1558:32: Syntax error:
unknown location: source expression failed to match any pattern
GC Warning: Failed to expand heap by 28770304 bytes
GC Warning: Failed to expand heap by 28770304 bytes
GC Warning: Failed to expand heap by 14385152 bytes
GC Warning: Out of Memory! Heap size: 919 MiB. Returning NULL!
Warning: Unwind-only `out-of-memory' exception; skipping pre-unwind handler.
--8<---------------cut here---------------end--------------->8---

So it looks like Guile failing badly in ENOMEM conditions.

I can=E2=80=99t reproduce this with current Guile =E2=80=98stable-2.2=E2=80=
=99, following Andy=E2=80=99s
weak-table rewrite=C2=B9, so this might have been a weak-table bug showing =
up
under memory pressure.

With =E2=80=98guix pull=E2=80=99 this was more likely to happen on your man=
y-core server
than on my laptop because you have more threads and thus much higher
memory usage.

Ludo=E2=80=99.

=C2=B9 https://lists.gnu.org/archive/html/guile-devel/2017-10/msg00051.html
  https://git.savannah.gnu.org/cgit/guile.git/commit/?h=3Dstable-2.2&id=3Da=
053c0510c4a644f9453166b7b385cf30f6d3a21




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 13 Oct 2017 21:12:00 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Oct 13 17:12:00 2017
Received: from localhost ([127.0.0.1]:38515 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1e37FP-00050z-RG
	for submit <at> debbugs.gnu.org; Fri, 13 Oct 2017 17:12:00 -0400
Received: from sender-of-o51.zoho.com ([135.84.80.216]:21042)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <rekado@HIDDEN>) id 1e37FN-00050r-Hb
 for 27476 <at> debbugs.gnu.org; Fri, 13 Oct 2017 17:11:57 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1507929032; 
 s=zoho; d=elephly.net; i=rekado@HIDDEN;
 h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type;
 l=1753; bh=yiHEZcTfo4uf58iXU+LVxcbko86T4H6quSkflfr2efc=;
 b=ShsCfXyrY2lDUIxD7hGkDJlvXtZZPsn0oT/S9kUb43B9CmMxUhomp6vEqtO1za/F
 ZmvPVDFk01MoKlYFMePT2igh96TeojOZJ3Xc2NfAB01o9jhU8sRUsy9pqX/bJ53NgN/
 w1QJ1hqfGvNjq1092Ds1j57uGsmZ3631+BDadI9k=
Received: from localhost (port-92-200-64-181.dynamic.qsc.de [92.200.64.181])
 by mx.zohomail.com with SMTPS id 1507929032860550.6813183971276;
 Fri, 13 Oct 2017 14:10:32 -0700 (PDT)
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
 <877ew0o5br.fsf@HIDDEN> <874lr2u5cw.fsf@HIDDEN>
User-agent: mu4e 0.9.18; emacs 25.3.1
From: Ricardo Wurmus <rekado@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: bug#27476: guix pull fails on powerful server
In-reply-to: <874lr2u5cw.fsf@HIDDEN>
X-URL: https://elephly.net
X-PGP-Key: https://elephly.net/rekado.pubkey
X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
Date: Fri, 13 Oct 2017 23:10:29 +0200
Message-ID: <87376mu52y.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-ZohoMailClient: External
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>, help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)


I tried it again after unsetting GUIX_PACKAGE_PATH, but the results are
just as bad:

--8<---------------cut here---------------start------------->8---
[rwurmus@murphy:~/guix] (338) $ unset GUIX_PACKAGE_PATH
[rwurmus@murphy:~/guix] (339) $ time ./pre-inst-env guix pull --url=$PWD
guile: warning: failed to install locale
warning: failed to install locale: Invalid argument
Updating from Git repository at '/home/rwurmus/guix'...
Building from Git commit d24c69d86670bfad0c6bb147162c918e9fcdccc2...
substitute: guile: warning: failed to install locale
substitute: warning: failed to install locale: Invalid argument
substitute: updating list of substitutes from 'https://mirror.hydra.gnu.org'... 100.0%
The following derivation will be built:
   /gnu/store/q5sh4c1mfk396kixqdq8j0wdfwin4dsx-guix-latest.drv
copying and compiling to '/gnu/store/jzq053lg77shnysmhj4i2f2bngz2rr5b-guix-latest' with Guile 2.2.2...
loading...       25.8% of 640 filesrandom seed for tests: 1507928738
loading...       99.8% of 640 files
compiling...     14.4% of 640 filesIn thread:
ERROR: In procedure >>=: >>= (bind) used outside of 'with-monad'Error while printing exception.
compiling...     14.5% of 640 filesIn thread:
ERROR: In procedure return: return used outside of 'with-monad'Error while printing exception.
compiling...     17.3% of 640 filesIn thread:
ERROR: In procedure return: return used outside of 'with-monad'Error while printing exception.
compiling...     70.0% of 640 filesGC Warning: Repeated allocation of very large block (appr. size 28766208):
        May lead to memory leak and poor performance
--8<---------------cut here---------------end--------------->8---

-- 
Ricardo

GPG: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
https://elephly.net





Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 13 Oct 2017 21:05:29 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Oct 13 17:05:29 2017
Received: from localhost ([127.0.0.1]:38495 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1e3797-0004pu-Bq
	for submit <at> debbugs.gnu.org; Fri, 13 Oct 2017 17:05:29 -0400
Received: from sender-of-o51.zoho.com ([135.84.80.216]:21112)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <rekado@HIDDEN>) id 1e3796-0004pk-0i
 for 27476 <at> debbugs.gnu.org; Fri, 13 Oct 2017 17:05:28 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1507928674; 
 s=zoho; d=elephly.net; i=rekado@HIDDEN;
 h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding;
 l=2142; bh=w21Zy0WU5P59C90GK0KoGIVZ8QD0DfZFHerY1G1OWeQ=;
 b=XdjZ77TmrTTaB9IO0kR+Y3WTx+EZKLXZyy9K56DEp9MZA9p35cALTqBwq67ZBHnO
 EFwTTB7M7Msghz7DhcANJacN82sStgCVX+K+2CORYz38Lg7AE7X6b0OXNfUeLhuTCuc
 qeNqC18WRXwrXbZ24DM58zdDb8MDwhk2+HNQrHjI=
Received: from localhost (port-92-200-64-181.dynamic.qsc.de [92.200.64.181])
 by mx.zohomail.com with SMTPS id 1507928674501780.0834283052844;
 Fri, 13 Oct 2017 14:04:34 -0700 (PDT)
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
 <877ew0o5br.fsf@HIDDEN>
User-agent: mu4e 0.9.18; emacs 25.3.1
From: Ricardo Wurmus <rekado@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: bug#27476: guix pull fails on powerful server
In-reply-to: <877ew0o5br.fsf@HIDDEN>
X-URL: https://elephly.net
X-PGP-Key: https://elephly.net/rekado.pubkey
X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
Date: Fri, 13 Oct 2017 23:04:31 +0200
Message-ID: <874lr2u5cw.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
X-ZohoMailClient: External
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>, help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)


Hi Ludo,

> The patch below seems to fix the problem: (guix monads) has shared state
> (hash tables) used both at expansion-time and run-time, and it wasn’t
> protected.
>
> My hypothesis is that this was causing random memory corruption.  The
> weird thing, though, is that the errors we were getting were not so
> random.  Also, the load phase of ‘guix pull’ is sequential.
>
> Could you test it and report back?

This doesn’t seem to be enough to fix the problem.  I patched ~/guix and
ran “guix pull --url=$PWD” from ~/guix:

--8<---------------cut here---------------start------------->8---
[rwurmus@murphy:~/guix] (335) $ time ./pre-inst-env guix pull --url=$PWD
guile: warning: failed to install locale
warning: failed to install locale: Invalid argument
Updating from Git repository at '/home/rwurmus/guix'...
Building from Git commit d24c69d86670bfad0c6bb147162c918e9fcdccc2...
substitute: guile: warning: failed to install locale
substitute: warning: failed to install locale: Invalid argument
guix pull: warning: failed to load '(bimsb packages bioinformatics-nonfree)':
ERROR: no code for module (gnu packages zip)
guix pull: warning: failed to load '(bimsb packages staging)':
ERROR: no code for module (gnu packages zip)
substitute: updating list of substitutes from 'https://mirror.hydra.gnu.org'... 100.0%
The following derivation will be built:
   /gnu/store/y54b92jj44li36743fgxzy0iagi6gb9n-guix-latest.drv
copying and compiling to '/gnu/store/p5zlw7fas26bickkqz4d68g8bxnjr14z-guix-latest' with Guile 2.2.2...
loading...       25.8% of 640 filesrandom seed for tests: 1507927861
loading...       99.8% of 640 files
compiling...     18.6% of 640 filesIn thread:
ERROR: In procedure return: return used outside of 'with-monad'Error while printing exception.
compiling...     70.0% of 640 files
--8<---------------cut here---------------end--------------->8---

The higher the percentage of completion, the slower this all gets.  It
hasn’t actually finished yet, even though it has been running for over
13 minutes.

--
Ricardo

GPG: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
https://elephly.net





Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 13 Oct 2017 20:30:44 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Oct 13 16:30:44 2017
Received: from localhost ([127.0.0.1]:38472 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1e36bU-0003wo-Aw
	for submit <at> debbugs.gnu.org; Fri, 13 Oct 2017 16:30:44 -0400
Received: from sender-of-o51.zoho.com ([135.84.80.216]:21050)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <rekado@HIDDEN>) id 1e36bS-0003wf-E5
 for 27476 <at> debbugs.gnu.org; Fri, 13 Oct 2017 16:30:42 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1507926553; 
 s=zoho; d=elephly.net; i=rekado@HIDDEN;
 h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding;
 l=3373; bh=yOCOPcztF8G4xfvWyAboFit0jwiom82hoHIcr4XHKYI=;
 b=dgb0Q3Q0zSnESK8JEp8VtY45ZZK4KvtKKYKVZ6mv9c+q8LCCfEgPVfysG/wbqYRg
 wXBGwVYOoBHfMfGKa1WfoMQ8RulXQfJq0YGyue6llppMOEN8wr1CFIPpWf8o9jaT6yu
 MI1yFqlYjPLQjqgzB9+FwhhDy2Li7MSMNioP0zJw=
Received: from localhost (port-92-200-64-181.dynamic.qsc.de [92.200.64.181])
 by mx.zohomail.com with SMTPS id 1507926553099313.6016282841433;
 Fri, 13 Oct 2017 13:29:13 -0700 (PDT)
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
 <877ew0o5br.fsf@HIDDEN>
User-agent: mu4e 0.9.18; emacs 25.3.1
From: Ricardo Wurmus <rekado@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: bug#27476: guix pull fails on powerful server
In-reply-to: <877ew0o5br.fsf@HIDDEN>
X-URL: https://elephly.net
X-PGP-Key: https://elephly.net/rekado.pubkey
X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
Date: Fri, 13 Oct 2017 22:29:09 +0200
Message-ID: <877evyu6zu.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
X-ZohoMailClient: External
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>, help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)


Hi Ludo,

> Ricardo Wurmus <rekado@HIDDEN> skribis:
>
>> The following derivation will be built:
>>    /gnu/store/z5bhk17nxmdhvj0g4cy038p25mzh1gys-guix-latest.drv
>> copying and compiling to '/gnu/store/s3s7xlqa10mvf8v0ypxz8gzw3lcf1x5z-guix-latest' with Guile 2.2.2...
>> loading...       25.7% of 635 filesrandom seed for tests: 1506720257
>> loading...       99.8% of 635 files
>> compiling...     69.1% of 635 filesice-9/threads.scm:289:22: In procedure loop:
>> ice-9/threads.scm:289:22: Syntax error:
>> guix/scripts/graph.scm:103:10: return: return used outside of 'with-monad' in form (return (package-node-edges a))
>
> The program below crashes with completely surreal backtraces in less
> than a minute on my 4-thread laptop:
>
> --8<---------------cut here---------------start------------->8---
> (use-modules (ice-9 threads)
>              (srfi srfi-1)
>              (guix monads)
>              (guix store))
>
> (define threads
>   (unfold (lambda (x) (> x 100))
>           (lambda (x)
>             (call-with-new-thread
>              (lambda ()
>                (define monad
>                  (symbol-append 'foo-monad
>                                 (string->symbol (number->string x))))
>
>                (while #t
>                  (macroexpand
>                   `(begin
>                      (define-monad ,monad
>                        (bind +)
>                        (return -))
>                      (with-monad ,monad
>                        (return 3))
>                      (mapm ,monad + '(1 2 3))))))))
>           1+
>           0))
>
> (for-each join-thread threads)
> --8<---------------cut here---------------end--------------->8---
>
> Can you check if that also happens on your many-core machine?

It does not crash.  I left it running for more than an hour (without
compiling) and it printed things like this:

--8<---------------cut here---------------start------------->8---
…
GC Warning: Repeated allocation of very large block (appr. size 57528320):
        May lead to memory leak and poor performance
GC Warning: Repeated allocation of very large block (appr. size 57528320):
        May lead to memory leak and poor performance
GC Warning: Repeated allocation of very large block (appr. size 57528320):
        May lead to memory leak and poor performance
GC Warning: Repeated allocation of very large block (appr. size 57528320):
        May lead to memory leak and poor performance
GC Warning: Repeated allocation of very large block (appr. size 14385152):
        May lead to memory leak and poor performance
GC Warning: Repeated allocation of very large block (appr. size 14385152):
        May lead to memory leak and poor performance
GC Warning: Repeated allocation of very large block (appr. size 57528320):
        May lead to memory leak and poor performance
GC Warning: Repeated allocation of very large block (appr. size 28766208):
        May lead to memory leak and poor performance
…
--8<---------------cut here---------------end--------------->8---

That’s on the machine with 1.5T RAM and 192 cores.  Then I ran it again
for 10 minutes after compiling it.  It did not crash.

> The patch below seems to fix the problem: (guix monads) has shared state
> (hash tables) used both at expansion-time and run-time, and it wasn’t
> protected.
>
> My hypothesis is that this was causing random memory corruption.  The
> weird thing, though, is that the errors we were getting were not so
> random.  Also, the load phase of ‘guix pull’ is sequential.
>
> Could you test it and report back?

I’m trying the patch right now with “guix pull”.

--
Ricardo

GPG: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
https://elephly.net





Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 12 Oct 2017 13:37:18 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Oct 12 09:37:18 2017
Received: from localhost ([127.0.0.1]:35039 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1e2dfq-0007fz-BQ
	for submit <at> debbugs.gnu.org; Thu, 12 Oct 2017 09:37:18 -0400
Received: from hera.aquilenet.fr ([141.255.128.1]:49548)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1e2dfm-0007fn-Kj
 for 27476 <at> debbugs.gnu.org; Thu, 12 Oct 2017 09:37:15 -0400
Received: from localhost (localhost [127.0.0.1])
 by hera.aquilenet.fr (Postfix) with ESMTP id AA8FFE97D;
 Thu, 12 Oct 2017 15:37:14 +0200 (CEST)
X-Virus-Scanned: Debian amavisd-new at aquilenet.fr
Received: from hera.aquilenet.fr ([127.0.0.1])
 by localhost (hera.aquilenet.fr [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id bVzYlVwNXFkB; Thu, 12 Oct 2017 15:37:13 +0200 (CEST)
Received: from ribbon (unknown [193.50.110.214])
 by hera.aquilenet.fr (Postfix) with ESMTPSA id 82C66E0A1;
 Thu, 12 Oct 2017 15:37:13 +0200 (CEST)
From: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
To: Ricardo Wurmus <rekado@HIDDEN>
Subject: Re: bug#27476: guix pull fails on powerful server
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
Date: Thu, 12 Oct 2017 15:37:12 +0200
In-Reply-To: <87shf44ny0.fsf@HIDDEN> (Ricardo Wurmus's message of "Sat,
 30 Sep 2017 09:59:03 +0200")
Message-ID: <877ew0o5br.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="=-=-="
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>, help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 1.0 (+)

--=-=-=
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable

Hi!

Ricardo Wurmus <rekado@HIDDEN> skribis:

> The following derivation will be built:
>    /gnu/store/z5bhk17nxmdhvj0g4cy038p25mzh1gys-guix-latest.drv
> copying and compiling to '/gnu/store/s3s7xlqa10mvf8v0ypxz8gzw3lcf1x5z-gui=
x-latest' with Guile 2.2.2...
> loading...       25.7% of 635 filesrandom seed for tests: 1506720257
> loading...       99.8% of 635 files
> compiling...     69.1% of 635 filesice-9/threads.scm:289:22: In procedure=
 loop:
> ice-9/threads.scm:289:22: Syntax error:
> guix/scripts/graph.scm:103:10: return: return used outside of 'with-monad=
' in form (return (package-node-edges a))

The program below crashes with completely surreal backtraces in less
than a minute on my 4-thread laptop:

--8<---------------cut here---------------start------------->8---
(use-modules (ice-9 threads)
             (srfi srfi-1)
             (guix monads)
             (guix store))

(define threads
  (unfold (lambda (x) (> x 100))
          (lambda (x)
            (call-with-new-thread
             (lambda ()
               (define monad
                 (symbol-append 'foo-monad
                                (string->symbol (number->string x))))

               (while #t
                 (macroexpand
                  `(begin
                     (define-monad ,monad
                       (bind +)
                       (return -))
                     (with-monad ,monad
                       (return 3))
                     (mapm ,monad + '(1 2 3))))))))
          1+
          0))

(for-each join-thread threads)
--8<---------------cut here---------------end--------------->8---

Can you check if that also happens on your many-core machine?

The patch below seems to fix the problem: (guix monads) has shared state
(hash tables) used both at expansion-time and run-time, and it wasn=E2=80=
=99t
protected.

My hypothesis is that this was causing random memory corruption.  The
weird thing, though, is that the errors we were getting were not so
random.  Also, the load phase of =E2=80=98guix pull=E2=80=99 is sequential.

Could you test it and report back?

Thanks,
Ludo=E2=80=99.


--=-=-=
Content-Type: text/x-patch
Content-Disposition: inline

diff --git a/guix/monads.scm b/guix/monads.scm
index 6ae616aca..c9c5da3bb 100644
--- a/guix/monads.scm
+++ b/guix/monads.scm
@@ -20,6 +20,7 @@
   #:use-module ((system syntax)
                 #:select (syntax-local-binding))
   #:use-module (ice-9 match)
+  #:use-module (ice-9 threads)
   #:use-module (srfi srfi-1)
   #:use-module (srfi srfi-9)
   #:use-module (srfi srfi-26)
@@ -117,6 +118,7 @@
   ;; the syntax object of the parameter over which it is templated, and (2)
   ;; the syntax of its body.
   (define-once %templates (make-hash-table))
+  (define-once %template-lock (make-mutex))
 
   (define (register-template! name param body)
     (hash-set! %templates name (cons param body)))
@@ -139,8 +141,9 @@ template instances."
       (syntax-source s))
 
     (define current-info-port
-      ;; Port for debugging info.
-      (const (%make-void-port "w")))
+      ;; Port for debugging info.  Return a fresh port at each call to make
+      ;; sure we're thread-safe.
+      (lambda () (%make-void-port "w")))
 
     (define location-string
       (format #f "~a:~a:~a"
@@ -204,12 +207,14 @@ template instances."
        ;; Search for an instance of template NAME for this ACTUAL parameter.
        ;; On success, expand to the identifier of the instance; otherwise
        ;; expand to #f.
-       (any (matching-instance? #'name #'actual) %template-instances))
+       (with-mutex %template-lock
+         (any (matching-instance? #'name #'actual) %template-instances)))
       ((_ exists? name actual)
        ;; Likewise, but return a Boolean.
        (let ((result (->bool
-                      (any (matching-instance? #'name #'actual)
-                           %template-instances))))
+                      (with-mutex %template-lock
+                        (any (matching-instance? #'name #'actual)
+                             %template-instances)))))
          (unless result
            (format (current-warning-port)
                    "~a: warning: no specialization of template '~a' for '~a'~%"
@@ -220,8 +225,9 @@ template instances."
        ;; Expand to the definitions of all the existing templates
        ;; specialized for ACTUAL.
        #`(begin
-           #,@(hash-map->list (cut instance-definition <> <> #'actual)
-                              %templates))))))
+           #,@(with-mutex %template-lock
+                (hash-map->list (cut instance-definition <> <> #'actual)
+                                %templates)))))))
 
 (define-syntax define-template
   (lambda (s)

--=-=-=--




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 10 Oct 2017 11:32:45 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Oct 10 07:32:45 2017
Received: from localhost ([127.0.0.1]:59321 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1e1smD-00079L-5K
	for submit <at> debbugs.gnu.org; Tue, 10 Oct 2017 07:32:45 -0400
Received: from eggs.gnu.org ([208.118.235.92]:60135)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1e1smA-000796-9F
 for 27476 <at> debbugs.gnu.org; Tue, 10 Oct 2017 07:32:42 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <ludo@HIDDEN>) id 1e1sm1-0006dQ-4f
 for 27476 <at> debbugs.gnu.org; Tue, 10 Oct 2017 07:32:37 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD
 autolearn=disabled version=3.3.2
Received: from fencepost.gnu.org ([2001:4830:134:3::e]:51854)
 by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <ludo@HIDDEN>)
 id 1e1sm1-0006dJ-0s; Tue, 10 Oct 2017 07:32:33 -0400
Received: from [193.50.110.208] (port=34410 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1e1sm0-0006Aq-Kh; Tue, 10 Oct 2017 07:32:32 -0400
From: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
To: Ricardo Wurmus <rekado@HIDDEN>
Subject: Re: guix pull fails on powerful server
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
 <87po9zj8lt.fsf@HIDDEN> <878tgjmpz6.fsf@HIDDEN>
X-URL: http://www.fdn.fr/~lcourtes/
X-Revolutionary-Date: 19 =?utf-8?Q?Vend=C3=A9miaire?= an 226 de la
 =?utf-8?Q?R=C3=A9volution?=
X-PGP-Key-ID: 0x090B11993D9AEBB5
X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc
X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4  0CFB 090B 1199 3D9A EBB5
X-OS: x86_64-pc-linux-gnu
Date: Tue, 10 Oct 2017 13:32:30 +0200
In-Reply-To: <878tgjmpz6.fsf@HIDDEN> (Ricardo Wurmus's message of "Tue,
 10 Oct 2017 09:17:17 +0200")
Message-ID: <87wp43nsq9.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Received-From: 2001:4830:134:3::e
X-Spam-Score: -5.0 (-----)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>, help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -5.0 (-----)

Ricardo Wurmus <rekado@HIDDEN> skribis:

> Ludovic Court=C3=A8s <ludo@HIDDEN> writes:
>
>> Ricardo Wurmus <rekado@HIDDEN> skribis:
>>
>>> I=E2=80=99ve tried =E2=80=9Cguix pull=E2=80=9D on the same server again=
, this time limiting CPUs
>>> with =E2=80=9Ctaskset -c 0 guix pull=E2=80=9D:
>>
>> As a stopgap, commit aba219af0fed6a349af930f19c913fb87e6a69dd ensures
>> that =E2=80=98--cores=E2=80=99 is honored.  So if you run =E2=80=9Cguix =
pull --cores=3D1=E2=80=9D, it will
>> build things sequentially.
>>
>> Now, to take advantage of that, you first need to update to the current
>> Guix=E2=80=A6
>
> Thank you, this worked!
>
> On that server I built Guix from source and then let the users pull with
> =E2=80=9C--cores=3D1=E2=80=9D to update their own Guix.

You could also run guix-daemon with --cores=3D4 or similar, so that it
uses 4 cores by default (few package builds scale beyond that anyway),
and then maybe --max-jobs=3D4 so you don=E2=80=99t waste the other cores.  =
;-)

Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 10 Oct 2017 07:18:41 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Oct 10 03:18:41 2017
Received: from localhost ([127.0.0.1]:59037 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1e1ooL-0005DU-De
	for submit <at> debbugs.gnu.org; Tue, 10 Oct 2017 03:18:41 -0400
Received: from sender-of-o51.zoho.com ([135.84.80.216]:21130)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <rekado@HIDDEN>) id 1e1ooJ-0005DL-Pd
 for 27476 <at> debbugs.gnu.org; Tue, 10 Oct 2017 03:18:40 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1507619840; 
 s=zoho; d=elephly.net; i=rekado@HIDDEN;
 h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding;
 l=711; bh=Ntw8eQ4TRlku79p3bSYsPU6yjEefN8gcrBW1ub7+zKY=;
 b=g8EAeVMgd+HT/eCA6uGWsfnz4vno+oey8IAZNGm1z/8XI4Go8pM2SMhs3kDb+ve6
 Nj72GRu8e6qpODRZbZEzTSQ+tnVWWftbqr5x2vzgDDL7af5vKon39OBEyxacUix+WV3
 4x2G7Fgm1Q8y7CtM+YXRJJL5pk3lJd/VG84RAfK0=
Received: from localhost (port-92-200-153-247.dynamic.qsc.de [92.200.153.247])
 by mx.zohomail.com with SMTPS id 1507619840784727.3355523311205;
 Tue, 10 Oct 2017 00:17:20 -0700 (PDT)
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
 <87po9zj8lt.fsf@HIDDEN>
User-agent: mu4e 0.9.18; emacs 25.3.1
From: Ricardo Wurmus <rekado@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: guix pull fails on powerful server
In-reply-to: <87po9zj8lt.fsf@HIDDEN>
X-URL: https://elephly.net
X-PGP-Key: https://elephly.net/rekado.pubkey
X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
Date: Tue, 10 Oct 2017 09:17:17 +0200
Message-ID: <878tgjmpz6.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
X-ZohoMailClient: External
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>, help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)


Ludovic Courtès <ludo@HIDDEN> writes:

> Ricardo Wurmus <rekado@HIDDEN> skribis:
>
>> I’ve tried “guix pull” on the same server again, this time limiting CPUs
>> with “taskset -c 0 guix pull”:
>
> As a stopgap, commit aba219af0fed6a349af930f19c913fb87e6a69dd ensures
> that ‘--cores’ is honored.  So if you run “guix pull --cores=1”, it will
> build things sequentially.
>
> Now, to take advantage of that, you first need to update to the current
> Guix…

Thank you, this worked!

On that server I built Guix from source and then let the users pull with
“--cores=1” to update their own Guix.

-- 
Ricardo

GPG: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
https://elephly.net





Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 7 Oct 2017 15:11:52 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Oct 07 11:11:52 2017
Received: from localhost ([127.0.0.1]:54848 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1e0qlc-00036O-6k
	for submit <at> debbugs.gnu.org; Sat, 07 Oct 2017 11:11:52 -0400
Received: from eggs.gnu.org ([208.118.235.92]:60232)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1e0qla-000369-Ll
 for 27476 <at> debbugs.gnu.org; Sat, 07 Oct 2017 11:11:50 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <ludo@HIDDEN>) id 1e0qlU-0000gL-Oo
 for 27476 <at> debbugs.gnu.org; Sat, 07 Oct 2017 11:11:45 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD
 autolearn=disabled version=3.3.2
Received: from fencepost.gnu.org ([2001:4830:134:3::e]:49160)
 by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <ludo@HIDDEN>)
 id 1e0qlU-0000gF-LJ; Sat, 07 Oct 2017 11:11:44 -0400
Received: from [2a01:e0a:1d:7270:6a6c:dc17:fc02:cfda] (port=46188 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1e0qlU-0004Vm-8j; Sat, 07 Oct 2017 11:11:44 -0400
From: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
To: Ricardo Wurmus <rekado@HIDDEN>
Subject: Re: guix pull fails on powerful server
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
X-URL: http://www.fdn.fr/~lcourtes/
X-Revolutionary-Date: 16 =?utf-8?Q?Vend=C3=A9miaire?= an 226 de la
 =?utf-8?Q?R=C3=A9volution?=
X-PGP-Key-ID: 0x090B11993D9AEBB5
X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc
X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4  0CFB 090B 1199 3D9A EBB5
X-OS: x86_64-pc-linux-gnu
Date: Sat, 07 Oct 2017 17:11:42 +0200
In-Reply-To: <87shf44ny0.fsf@HIDDEN> (Ricardo Wurmus's message of "Sat,
 30 Sep 2017 09:59:03 +0200")
Message-ID: <87po9zj8lt.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Received-From: 2001:4830:134:3::e
X-Spam-Score: -5.0 (-----)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>, help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -5.0 (-----)

Ricardo Wurmus <rekado@HIDDEN> skribis:

> I=E2=80=99ve tried =E2=80=9Cguix pull=E2=80=9D on the same server again, =
this time limiting CPUs
> with =E2=80=9Ctaskset -c 0 guix pull=E2=80=9D:

As a stopgap, commit aba219af0fed6a349af930f19c913fb87e6a69dd ensures
that =E2=80=98--cores=E2=80=99 is honored.  So if you run =E2=80=9Cguix pul=
l --cores=3D1=E2=80=9D, it will
build things sequentially.

Now, to take advantage of that, you first need to update to the current
Guix=E2=80=A6

Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 4 Oct 2017 16:18:28 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Oct 04 12:18:28 2017
Received: from localhost ([127.0.0.1]:49109 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dzmNP-0006E8-Qf
	for submit <at> debbugs.gnu.org; Wed, 04 Oct 2017 12:18:27 -0400
Received: from sender-of-o51.zoho.com ([135.84.80.216]:21048)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <rekado@HIDDEN>) id 1dzmNN-0006Dz-F1
 for 27476 <at> debbugs.gnu.org; Wed, 04 Oct 2017 12:18:26 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1507133882; 
 s=zoho; d=elephly.net; i=rekado@HIDDEN;
 h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding;
 l=459; bh=thI38TFYp2IGodm7Sw1YkN6K+beqczm1B3KcGl+TkdE=;
 b=Uao9h2EAPFawNohZ5zuTsXkheYY4Z/RGohBQGUeN+Rk9K447os8yjfqWVGzlOzfV
 Ndb1mYr249k7wrB7y8sBh4fZ5Cixcp69V25VpbGQuO2yuZ/w0QT6Be+lnFNVjqWILHf
 oPcY2JGW0PUWb3Ojqxzu6hICXfg1FG/V5xHfFnLE=
Received: from localhost (port-92-200-27-32.dynamic.qsc.de [92.200.27.32]) by
 mx.zohomail.com with SMTPS id 1507133882651491.0298546665814;
 Wed, 4 Oct 2017 09:18:02 -0700 (PDT)
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
 <87o9pnt0ei.fsf@HIDDEN>
User-agent: mu4e 0.9.18; emacs 25.3.1
From: Ricardo Wurmus <rekado@HIDDEN>
To: =?utf-8?Q?Cl=C3=A9ment?= Lassieur <clement@HIDDEN>
Subject: Re: guix pull fails on powerful server
In-reply-to: <87o9pnt0ei.fsf@HIDDEN>
X-URL: https://elephly.net
X-PGP-Key: https://elephly.net/rekado.pubkey
X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
Date: Wed, 04 Oct 2017 18:17:57 +0200
Message-ID: <874lre51l6.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
X-ZohoMailClient: External
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>,
 Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>, help-guix@HIDDEN,
 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)


Clément Lassieur <clement@HIDDEN> writes:

> Ricardo Wurmus <rekado@HIDDEN> writes:
>
>> Is there another work-around I could try on this machine?
>
> My workaround was to build Guix from sources.  But I'm sure you thought
> about it.

Yes, that works, but I was looking for something that a user can do who
wouldn’t like to fiddle with git.

-- 
Ricardo

GPG: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
https://elephly.net





Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 4 Oct 2017 15:09:45 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Oct 04 11:09:45 2017
Received: from localhost ([127.0.0.1]:49057 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dzlIv-0004Yt-8H
	for submit <at> debbugs.gnu.org; Wed, 04 Oct 2017 11:09:45 -0400
Received: from mail.lassieur.org ([83.152.10.219]:36850)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <clement@HIDDEN>) id 1dzlIt-0004Yj-RA
 for 27476 <at> debbugs.gnu.org; Wed, 04 Oct 2017 11:09:44 -0400
Received: from newt (46.218.109.88 [46.218.109.88])
 by mail.lassieur.org (OpenSMTPD) with ESMTPSA id ef620fad
 (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO); 
 Wed, 4 Oct 2017 15:09:42 +0000 (UTC)
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
User-agent: mu4e 0.9.18; emacs 25.3.1
From: =?utf-8?Q?Cl=C3=A9ment?= Lassieur <clement@HIDDEN>
To: Ricardo Wurmus <rekado@HIDDEN>
Subject: Re: guix pull fails on powerful server
In-reply-to: <87shf44ny0.fsf@HIDDEN>
Date: Wed, 04 Oct 2017 17:09:41 +0200
Message-ID: <87o9pnt0ei.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>,
 Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>, help-guix@HIDDEN,
 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)

Ricardo Wurmus <rekado@HIDDEN> writes:

> Is there another work-around I could try on this machine?

My workaround was to build Guix from sources.  But I'm sure you thought
about it.




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 4 Oct 2017 13:17:09 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Wed Oct 04 09:17:09 2017
Received: from localhost ([127.0.0.1]:47737 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dzjXx-0006CR-7X
	for submit <at> debbugs.gnu.org; Wed, 04 Oct 2017 09:17:09 -0400
Received: from sender-of-o51.zoho.com ([135.84.80.216]:21039)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <rekado@HIDDEN>) id 1dzjXu-0006CI-Pc
 for 27476 <at> debbugs.gnu.org; Wed, 04 Oct 2017 09:17:08 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1507122962; 
 s=zoho; d=elephly.net; i=rekado@HIDDEN;
 h=References:From:To:Cc:Subject:In-reply-to:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding;
 l=2250; bh=ybw58W3m83AL66xSg8xY9xZegKQU1NB38Npyl05hiXg=;
 b=Ty+I4EYoC81FHoqRHaUXskpnuneSRaD7ECF3PmFb4q/EBBO3dsKBqpddKyQRP1pc
 E88gxZFCcKBXODdwHKVedNf5tUq4HW2UQ/67B60LpECZFf4qjKU4JPoyvoz+5Pli7ze
 Lay3LfOqsr/RzmU3g/6/kdabirDsWKyvXnzsFvd0=
Received: from localhost (141.80.193.171 [141.80.193.171]) by mx.zohomail.com
 with SMTPS id 1507122962713381.53358242131094;
 Wed, 4 Oct 2017 06:16:02 -0700 (PDT)
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
 <87a818dlgz.fsf@HIDDEN>
User-agent: mu4e 0.9.18; emacs 25.3.1
From: Ricardo Wurmus <rekado@HIDDEN>
To: Marius Bakke <mbakke@HIDDEN>
Subject: Re: guix pull fails on powerful server
In-reply-to: <87a818dlgz.fsf@HIDDEN>
X-URL: https://elephly.net
X-PGP-Key: https://elephly.net/rekado.pubkey
X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
Date: Wed, 04 Oct 2017 15:15:58 +0200
Message-ID: <877ewb3vg1.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
X-ZohoMailClient: External
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>,
 Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>, help-guix@HIDDEN,
 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)


Marius Bakke <mbakke@HIDDEN> writes:

> Ricardo Wurmus <rekado@HIDDEN> writes:
>
>> Is there another work-around I could try on this machine?
>
> Using Guile 2.0 worked for me:
>
> guix package -r guix guile-git -i guile2.0-guix guile2.0-git

Unfortunately, this didn’t work for me.  I tried this:

   guix package -i guile2.0-guix --with-source=/path/to/guix/checkout

This printed a lot of repetitions of “warning: unknown warning type
`macro-use-before-definition'” and eventually failed with this
backtrace:

--8<---------------cut here---------------start------------->8---
Backtrace:
In ice-9/boot-9.scm:
 160: 9 [catch #t #<catch-closure 8c6c00> ...]
In unknown file:
   ?: 8 [apply-smob/1 #<catch-closure 8c6c00>]
In ice-9/boot-9.scm:
  66: 7 [call-with-prompt prompt0 ...]
In ice-9/eval.scm:
 432: 6 [eval # #]
In ice-9/boot-9.scm:
2412: 5 [save-module-excursion #<procedure 9057c0 at ice-9/boot-9.scm:4084:3 ()>]
4091: 4 [#<procedure 9057c0 at ice-9/boot-9.scm:4084:3 ()>]
1734: 3 [%start-stack load-stack #<procedure 916b60 at ice-9/boot-9.scm:4080:10 ()>]
1739: 2 [#<procedure 9176c0 ()>]
In unknown file:
   ?: 1 [primitive-load "/tmp/guix-build-guile2.0-guix-0.13.0-4.f1ddfe4.drv-0/source/./build-aux/compile-all.scm"]
In ice-9/threads.scm:
  99: 0 [loop (("guix/base16.scm" "guix/base32.scm" "guix/base64.scm" ...))]

ice-9/threads.scm:99:22: In procedure loop:
ice-9/threads.scm:99:22: In procedure fport_write: Bad address
make[2]: *** [Makefile:5252: make-go] Error 1
make[2]: Leaving directory '/tmp/guix-build-guile2.0-guix-0.13.0-4.f1ddfe4.drv-0/source'
make[1]: *** [Makefile:4383: all-recursive] Error 1
make[1]: Leaving directory '/tmp/guix-build-guile2.0-guix-0.13.0-4.f1ddfe4.drv-0/source'
make: *** [Makefile:2973: all] Error 2
phase `build' failed after 149.5 seconds
builder for `/gnu/store/aqz4d2bbihvdmxqb6rlb71c853jb4dp3-guile2.0-guix-0.13.0-4.f1ddfe4.drv' failed with exit code 1
guix package: error: build failed: build of `/gnu/store/aqz4d2bbihvdmxqb6rlb71c853jb4dp3-guile2.0-guix-0.13.0-4.f1ddfe4.drv
--8<---------------cut here---------------end--------------->8---

--
Ricardo

GPG: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
https://elephly.net





Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 3 Oct 2017 20:29:05 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Oct 03 16:29:05 2017
Received: from localhost ([127.0.0.1]:46875 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dzToP-00088A-EE
	for submit <at> debbugs.gnu.org; Tue, 03 Oct 2017 16:29:05 -0400
Received: from out1-smtp.messagingengine.com ([66.111.4.25]:53851)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <mbakke@HIDDEN>) id 1dzToM-000881-Ka
 for 27476 <at> debbugs.gnu.org; Tue, 03 Oct 2017 16:29:04 -0400
Received: from compute5.internal (compute5.nyi.internal [10.202.2.45])
 by mailout.nyi.internal (Postfix) with ESMTP id 0ABF220BF7;
 Tue,  3 Oct 2017 16:29:02 -0400 (EDT)
Received: from frontend1 ([10.202.2.160])
 by compute5.internal (MEProxy); Tue, 03 Oct 2017 16:29:02 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fastmail.com; h=
 cc:content-type:date:from:in-reply-to:message-id:mime-version
 :references:subject:to:x-me-sender:x-me-sender:x-sasl-enc
 :x-sasl-enc; s=fm1; bh=dtB8YIfc4qPdKOptablEZaKKG7bIX0K3ijIIaML3E
 BM=; b=jqEEKkm+EVOM+AfhywJp3zjRZ4k7y3tfOwm/lZtGB1/X5PIqhQ6/sCQ7M
 wJuYO3nBjuDLZfXnuYl2bGm88XizTfPtvZGXKTtSiP8QdrXhWQJiuA0xa7R950hi
 sWoUCU7GUn6C1k/OwmHQ+/JzF2qO4rZid13K1q65cRnJ/lYXmv7xQn6XXFelJRJl
 f/DBsuIIZsHcTVerUpEjIZSAL8QInswnNwKh1G4yOnBqJy9X4FCqBze1ew4vFL39
 pFl5HmWbhSIJtyuHdJqotKdHxOZas0fFUxCDUF6leXjup7rrmjmgjAARJiFUZyR5
 5p7Fc7mFPJ/Jsmg52X+H/J2rwkORQ==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=cc:content-type:date:from:in-reply-to
 :message-id:mime-version:references:subject:to:x-me-sender
 :x-me-sender:x-sasl-enc:x-sasl-enc; s=fm1; bh=dtB8YIfc4qPdKOptab
 lEZaKKG7bIX0K3ijIIaML3EBM=; b=kN4UgXq20B3UQVQHeL81MIxRmrWD8H53Ra
 uOG8Eme40b3vpogXOHl4XuG22o+CjPrI2IO09M0DDYZl/LQsXD6c4yasPb6hSfd0
 7bLunLA3OX7/G5Q3sSKR5Ar0qPOryz/ZJZM+uja7JAT/h7z4SA4mPOy+pO6KheXm
 PxFLHE+NIDEoxwofHMjXor9p0P6iHXOiNIZPcOaX3pzxcoDh29BfMylT5SjXjxgq
 H1VE30D1eoldv8k8p7Q2Y5X9wODIC5lx2D7lxaBXpqOdXzlTniCCIU78iq3HhtW5
 bD15CDhukV4JjHMozWyU00JYs6x1rp+g5HebilYujHStPkPd9RFg==
X-ME-Sender: <xms:DfPTWfaVQcTSLRD4wV0blYqWRx9XBMrCBRMb_B8NaXp6Rur0sKeDGg>
X-Sasl-enc: RbPF4YcoyC8JP9SspC5o7qzi8kTJoO+ZXadow9/zxTO1 1507062541
Received: from localhost (cm-84.214.173.174.getinternet.no [84.214.173.174])
 by mail.messagingengine.com (Postfix) with ESMTPA id 7D7347F927;
 Tue,  3 Oct 2017 16:29:01 -0400 (EDT)
From: Marius Bakke <mbakke@HIDDEN>
To: Ricardo Wurmus <rekado@HIDDEN>, Ludovic =?utf-8?Q?Court=C3=A8s?=
 <ludo@HIDDEN>
Subject: Re: guix pull fails on powerful server
In-Reply-To: <87shf44ny0.fsf@HIDDEN>
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN> <87shf44ny0.fsf@HIDDEN>
User-Agent: Notmuch/0.25.1 (https://notmuchmail.org) Emacs/25.2.1
 (x86_64-unknown-linux-gnu)
Date: Tue, 03 Oct 2017 22:29:00 +0200
Message-ID: <87a818dlgz.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
 micalg=pgp-sha512; protocol="application/pgp-signature"
X-Spam-Score: -0.7 (/)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>, help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.7 (/)

--=-=-=
Content-Type: text/plain

Ricardo Wurmus <rekado@HIDDEN> writes:

> Is there another work-around I could try on this machine?

Using Guile 2.0 worked for me:

guix package -r guix guile-git -i guile2.0-guix guile2.0-git

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQEzBAEBCgAdFiEEu7At3yzq9qgNHeZDoqBt8qM6VPoFAlnT8wwACgkQoqBt8qM6
VPr7wQgAl78ceQ9rCYxUbent9nvxNXu6qQuHYnPqK4LHIgR3yQ3QV407vM5hjb7A
rBTw6dQYqzOuCTdiEXDxolBvvS0tQabBnlkrURp6LpkLtEiiXOjd+0ahHXEP+y+B
BFc0n+VkA5B6DuAlSbTVt/c1MKux2YGLUoYMIlvKFZgx+iSyUzRhWKoHkwYwtedp
OJYuKREmz7aWw/W3ce9noI+IdD3qPfkSAPxpiHQy21DXm5/grg/SbQ0VCajXP4vL
c3wkPqdwRMnwp677Dl7hKuiF3xu/k1SkzSmhFtU4KUlQyOTNPRjxG2IhqLeDrtkp
Jjr58BrNgCV+7XBoxSL59+LrrEH70Q==
=95WG
-----END PGP SIGNATURE-----
--=-=-=--




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 30 Sep 2017 08:00:21 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Sep 30 04:00:21 2017
Received: from localhost ([127.0.0.1]:39922 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dyChB-00009H-5M
	for submit <at> debbugs.gnu.org; Sat, 30 Sep 2017 04:00:21 -0400
Received: from sender-of-o51.zoho.com ([135.84.80.216]:21084)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <rekado@HIDDEN>) id 1dyCh9-000099-LU
 for 27476 <at> debbugs.gnu.org; Sat, 30 Sep 2017 04:00:20 -0400
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1506758347; 
 s=zoho; d=elephly.net; i=rekado@HIDDEN;
 h=References:From:To:Cc:Subject:In-reply-to:Date:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-ID;
 l=3106; bh=z5hRJpafsL4XwurybfnJaYSJwZZ7TGKmWGM309OnDKs=;
 b=gr4r5A3f8K9B/oInIQdG7+9RV9p6hkywmhhM9rd/kEpX28VaNLy7iWdZhX6MC9fw
 G3NDbKnAhPgHmp8T75mgQ2zugtuqyzc6nxJTxtq6IGBNljNGWcocIh04pDEiKNn5TKG
 YeFvv8KiSwfocpEhgEBDeoCsubiYRyuUpLwn1TXs=
Received: from mail.zoho.com by mx.zohomail.com
 with SMTP id 1506758347763647.6839451815042;
 Sat, 30 Sep 2017 00:59:07 -0700 (PDT)
Received: from localhost (port-92-200-5-175.dynamic.qsc.de [92.200.5.175]) by
 mx.zohomail.com with SMTPS id 1506758347686916.7135800001489;
 Sat, 30 Sep 2017 00:59:07 -0700 (PDT)
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
 <87bmlyzxj7.fsf@HIDDEN>
User-agent: mu4e 0.9.18; emacs 25.3.1
From: Ricardo Wurmus <rekado@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: guix pull fails on powerful server
In-reply-to: <87bmlyzxj7.fsf@HIDDEN>
X-URL: https://elephly.net
X-PGP-Key: https://elephly.net/rekado.pubkey
X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
Date: Sat, 30 Sep 2017 09:59:03 +0200
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
Message-ID: <87shf44ny0.fsf@HIDDEN>
X-ZohoMailClient: External
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>, help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)


I=E2=80=99ve tried =E2=80=9Cguix pull=E2=80=9D on the same server again, th=
is time limiting CPUs
with =E2=80=9Ctaskset -c 0 guix pull=E2=80=9D:

--8<---------------cut here---------------start------------->8---
$ taskset -c 0 guix pull
guile: warning: failed to install locale
warning: failed to install locale: Invalid argument
substitute: guile: warning: failed to install locale
substitute: warning: failed to install locale: Invalid argument

Starting download of /tmp/guix-file.QleIQR
From https://git.savannah.gnu.org/cgit/guix.git/snapshot/master.tar.gz...
 ....tar.gz                                 1.6MiB/s 00:09 | 13.6MiB transf=
erred
unpacking '/gnu/store/g5246hzsj9vv1fmigdd7fh0060fybnbd-guix-latest.tar.gz'.=
..
The following derivation will be built:
   /gnu/store/z5bhk17nxmdhvj0g4cy038p25mzh1gys-guix-latest.drv
copying and compiling to '/gnu/store/s3s7xlqa10mvf8v0ypxz8gzw3lcf1x5z-guix-=
latest' with Guile 2.2.2...
loading...       25.7% of 635 filesrandom seed for tests: 1506720257
loading...       99.8% of 635 files
compiling...     69.1% of 635 filesice-9/threads.scm:289:22: In procedure l=
oop:
ice-9/threads.scm:289:22: Syntax error:
guix/scripts/graph.scm:103:10: return: return used outside of 'with-monad' =
in form (return (package-node-edges a))

Some deprecated features have been used.  Set the environment
variable GUILE_WARN_DEPRECATED to "detailed" and rerun the
program to get more information.  Set it to "no" to suppress
this message.
builder for `/gnu/store/z5bhk17nxmdhvj0g4cy038p25mzh1gys-guix-latest.drv' f=
ailed with exit code 1
guix pull: error: build failed: build of `/gnu/store/z5bhk17nxmdhvj0g4cy038=
p25mzh1gys-guix-latest.drv' failed
--8<---------------cut here---------------end--------------->8---

After limiting memory with =E2=80=9Culimit -Sv 5000000=E2=80=9D:

--8<---------------cut here---------------start------------->8---
ice-9/threads.scm:289:22: In procedure loop:
ice-9/threads.scm:289:22: Syntax error:
guix/scripts/pull.scm:192:8: >>=3D: >>=3D (bind) used outside of 'with-mona=
d' in form (>>=3D (indirect-root-added latest) (lambda (done) (mlet* %store=
-monad () (if (and (file-exists? latest) (string=3D? (readlink latest) sour=
ce-dir)) (begin (display (G_ "Guix already up to date\n")) (return #t)) (be=
gin (switch-symlinks latest source-dir) (format #t (G_ "updated ~a successf=
ully deployed under `~a'~%") %guix-package-name latest) (return #t))))))

Some deprecated features have been used.  Set the environment
variable GUILE_WARN_DEPRECATED to "detailed" and rerun the
program to get more information.  Set it to "no" to suppress
this message.
builder for `/gnu/store/afji58647yzz7cr9dvlj87sd3ad36lbk-guix-latest.drv' f=
ailed with exit code 1
guix pull: error: build failed: build of `/gnu/store/afji58647yzz7cr9dvlj87=
sd3ad36lbk-guix-latest.drv' failed
--8<---------------cut here---------------end--------------->8---

It always crashes at around 69%.

Is there another work-around I could try on this machine?

--
Ricardo

GPG: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
https://elephly.net






Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 25 Sep 2017 14:03:58 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Sep 25 10:03:58 2017
Received: from localhost ([127.0.0.1]:58507 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dwTzJ-0008Ou-Q8
	for submit <at> debbugs.gnu.org; Mon, 25 Sep 2017 10:03:57 -0400
Received: from sender-of-o51.zoho.com ([135.84.80.216]:21030)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <rekado@HIDDEN>) id 1dwTzI-0008Om-N7
 for 27476 <at> debbugs.gnu.org; Mon, 25 Sep 2017 10:03:57 -0400
Received: from localhost (141.80.193.136 [141.80.193.136]) by mx.zohomail.com
 with SMTPS id 1506348159380560.9028820360278;
 Mon, 25 Sep 2017 07:02:39 -0700 (PDT)
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN> <87a81jj5gg.fsf@HIDDEN>
User-agent: mu4e 0.9.18; emacs 25.3.1
From: Ricardo Wurmus <rekado@HIDDEN>
To: Ludovic =?utf-8?Q?Court=C3=A8s?= <ludo@HIDDEN>
Subject: Re: guix pull fails on powerful server
In-reply-to: <87a81jj5gg.fsf@HIDDEN>
X-URL: https://elephly.net
X-PGP-Key: https://elephly.net/rekado.pubkey
X-PGP-Fingerprint: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
Date: Mon, 25 Sep 2017 16:02:36 +0200
Message-ID: <87bmlyzxj7.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: 8bit
X-ZohoMailClient: External
X-Spam-Score: 1.0 (+)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>, help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 1.0 (+)


Ludovic Courtès <ludo@HIDDEN> writes:

> With this program:
>
> --8<---------------cut here---------------start------------->8---
> (use-modules (ice-9 threads)
>              (srfi srfi-1))
>
> (define-syntax-parameter foo
>   (identifier-syntax +))
>
> (define threads
>   (unfold (lambda (x) (> x 100))
>           (lambda (x)
>             (call-with-new-thread
>              (lambda ()
>                (while #t
>                  (macroexpand
>                   '(syntax-parameterize ((foo (identifier-syntax -)))
>                      (foo y z)))))))
>           1+
>           0))
>
> (for-each join-thread threads)
> --8<---------------cut here---------------end--------------->8---

I have tried this programme on my 16 core 32G workstation, and on the
192 core 1.5T server, but could not get it to segfault.

-- 
Ricardo

GPG: BCA6 89B6 3655 3801 C3C6  2150 197A 5888 235F ACAC
https://elephly.net





Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 25 Sep 2017 13:03:40 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Sep 25 09:03:40 2017
Received: from localhost ([127.0.0.1]:57476 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dwT2y-0002xS-88
	for submit <at> debbugs.gnu.org; Mon, 25 Sep 2017 09:03:40 -0400
Received: from eggs.gnu.org ([208.118.235.92]:36062)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1dwT2w-0002xG-7i
 for 27476 <at> debbugs.gnu.org; Mon, 25 Sep 2017 09:03:38 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <ludo@HIDDEN>) id 1dwT2n-0004k8-SI
 for 27476 <at> debbugs.gnu.org; Mon, 25 Sep 2017 09:03:33 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-0.0 required=5.0 tests=BAYES_40,RP_MATCHES_RCVD
 autolearn=disabled version=3.3.2
Received: from fencepost.gnu.org ([2001:4830:134:3::e]:38352)
 by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <ludo@HIDDEN>)
 id 1dwT2n-0004k1-OY; Mon, 25 Sep 2017 09:03:29 -0400
Received: from [193.50.110.164] (port=44370 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1dwT2n-0006eA-BB; Mon, 25 Sep 2017 09:03:29 -0400
From: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
To: Andy Wingo <wingo@HIDDEN>
Subject: Re: guix pull fails on powerful server
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
 <87k20nz18u.fsf@HIDDEN>
X-URL: http://www.fdn.fr/~lcourtes/
X-Revolutionary-Date: 4 =?utf-8?Q?Vend=C3=A9miaire?= an 226 de la
 =?utf-8?Q?R=C3=A9volution?=
X-PGP-Key-ID: 0x090B11993D9AEBB5
X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc
X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4  0CFB 090B 1199 3D9A EBB5
X-OS: x86_64-pc-linux-gnu
Date: Mon, 25 Sep 2017 15:03:27 +0200
In-Reply-To: <87k20nz18u.fsf@HIDDEN> (Andy Wingo's message of "Mon, 25 Sep
 2017 09:27:45 +0200")
Message-ID: <87a81jj5gg.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.3 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Received-From: 2001:4830:134:3::e
X-Spam-Score: -5.0 (-----)
X-Debbugs-Envelope-To: 27476
Cc: Ricardo Wurmus <rekado@HIDDEN>, help-guix@HIDDEN,
 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -5.0 (-----)

Hi,

Andy Wingo <wingo@HIDDEN> skribis:

> On Fri 22 Sep 2017 16:10, ludo@HIDDEN (Ludovic Court=C3=A8s) writes:
>
>> Hi Ricardo,
>>
>> Ricardo Wurmus <rekado@HIDDEN> skribis:
>>
>>> The following derivation will be built:
>>>    /gnu/store/yvyfkns3w3vm7ynwbr7mvxcmin4gd2a0-guix-latest.drv
>>> copying and compiling to '/gnu/store/7m52dkr98nhwgpsx20mmpwyw2yzj58d3-g=
uix-latest' with Guile 2.2.2...
>>> loading...       25.4% of 629 filesrandom seed for tests: 1506066913
>>> loading...       99.8% of 629 files
>>> compiling...     69.2% of 629 filesice-9/threads.scm:289:22: In procedu=
re loop:
>>> ice-9/threads.scm:289:22: Syntax error:
>>> guix/scripts.scm:130:2: >>=3D: >>=3D (bind) used outside of 'with-monad=
' in form (>>=3D (apply set-build-options* #:use-substitutes
>>> ptions)) (lambda (unused-value) (mbegin %store-monad (mlet %store-monad=
 ((derivation (origin->derivation (package-source pack
>>> tutes? use-substitutes? #:dry-run? dry-run?) (return (show-derivation-o=
utputs derivation)))))))
>>
>> This was reported at <https://bugs.gnu.org/27476>, and I suspect a
>> thread-safety issue.  However, syntax parameters are purely functional
>> AFAICS, so I fail to see why multithreading could be a problem.
>>
>> Andy, any idea what could be causing this?
>
> I have heard of but not seen a number of similar bugs: errors that
> "can't happen" but which appear under multiple threads.  I don't know
> what underlying pattern is.  Has anyone found a test case that reliably
> reproduces?

With this program:

--8<---------------cut here---------------start------------->8---
(use-modules (ice-9 threads)
             (srfi srfi-1))

(define-syntax-parameter foo
  (identifier-syntax +))

(define threads
  (unfold (lambda (x) (> x 100))
          (lambda (x)
            (call-with-new-thread
             (lambda ()
               (while #t
                 (macroexpand
                  '(syntax-parameterize ((foo (identifier-syntax -)))
                     (foo y z)))))))
          1+
          0))

(for-each join-thread threads)
--8<---------------cut here---------------end--------------->8---

I managed to get a segfault:

--8<---------------cut here---------------start------------->8---
$ guile syntax-parms.scm
;;; note: source file /home/ludo/src/guix/syntax-parms.scm
;;;       newer than compiled /home/ludo/.cache/guile/ccache/2.2-LE-8-3.A/h=
ome/ludo/src/guix/syntax-parms.scm.go
;;; note: auto-compilation is enabled, set GUILE_AUTO_COMPILE=3D0
;;;       or pass the --no-auto-compile argument to disable.
;;; compiling /home/ludo/src/guix/syntax-parms.scm
;;; compiled /home/ludo/.cache/guile/ccache/2.2-LE-8-3.A/home/ludo/src/guix=
/syntax-parms.scm.go
In /home/ludo/src/guix/syntax-parms.scm:
    13:17 13 (_)
In ice-9/psyntax.scm:
  1233:22 12 (expand-top-sequence (#(ribcage #(x) #((m-1dff1b83541ce327-7f9=
7c #)) #) # =E2=80=A6) =E2=80=A6)
In ice-9/boot-9.scm:
   230:17 11 (map1 (#<tree-il (lambda-case (((id) #f #f #f () (id-1dff1b835=
41ce327-7fb4=E2=80=A6>))
In ice-9/psyntax.scm:
  2053:19 10 (_ _ #() (foo y z) ())
In ice-9/boot-9.scm:
   230:17  9 (map1 #())
In ice-9/psyntax.scm:
  1408:12  8 (_ _)
  1788:11  7 (lp (1) (11 0 . 0))
  1678:45  6 (parse _ _ _ _ _ _ _)
In ice-9/boot-9.scm:
   230:17  5 (map1 ((tmp-1dff1b83541ce327-7f98b 0 . 0)))
In ice-9/psyntax.scm:
  2701:67  4 Adres-eraro
--8<---------------cut here---------------end--------------->8---

=E2=80=A6 but then I failed to reproduce it again (that was on my 4-thread
laptop).

Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 25 Sep 2017 08:43:23 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Sep 25 04:43:23 2017
Received: from localhost ([127.0.0.1]:57242 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dwOz5-000830-8s
	for submit <at> debbugs.gnu.org; Mon, 25 Sep 2017 04:43:23 -0400
Received: from mail.lassieur.org ([83.152.10.219]:33158)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <clement@HIDDEN>) id 1dwOz3-00082r-M2
 for 27476 <at> debbugs.gnu.org; Mon, 25 Sep 2017 04:43:22 -0400
Received: from newt (46.218.109.88 [46.218.109.88])
 by mail.lassieur.org (OpenSMTPD) with ESMTPSA id 2ed02151
 (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO); 
 Mon, 25 Sep 2017 08:42:35 +0000 (UTC)
References: <87h8vvp1q7.fsf@HIDDEN>
User-agent: mu4e 0.9.18; emacs 25.2.1
From: =?utf-8?Q?Cl=C3=A9ment?= Lassieur <clement@HIDDEN>
To: Ricardo Wurmus <rekado@HIDDEN>
Subject: Re: guix pull fails on powerful server
In-reply-to: <87h8vvp1q7.fsf@HIDDEN>
Date: Mon, 25 Sep 2017 10:43:16 +0200
Message-ID: <87k20nrwwr.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -0.0 (/)
X-Debbugs-Envelope-To: 27476
Cc: Andy Wingo <wingo@HIDDEN>,
 Ludovic =?utf-8?Q?Court?= =?utf-8?Q?=C3=A8s?= <ludo@HIDDEN>,
 help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.0 (/)

I got it too for the first time yesterday on my 128G RAM and 32 CPU
cores server:

--8<---------------cut here---------------start------------->8---
substitute: updating list of substitutes from [...]
Updating from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
Building from Git commit 3140844e33254316348135b03762eaeb04764544...
substitute: updating list of substitutes from [...]
The following derivation will be built:
   /gnu/store/7143x1dd2r5kch8dldyylz1ljhp3nird-guix-latest.drv
copying and compiling to '/gnu/store/8a42yc4yxslrr1hf7wk5x5mddbs76yqm-guix-latest' with Guile 2.2.2...
loading...       25.3% of 632 filesrandom seed for tests: 1506279202
loading...       99.8% of 632 files
compiling...     94.8% of 632 filesice-9/threads.scm:289:22: In procedure loop:
ice-9/threads.scm:289:22: Syntax error:
guix/gexp.scm:530:8: return: return used outside of 'with-monad' in form (return output)

Some deprecated features have been used.  Set the environment
variable GUILE_WARN_DEPRECATED to "detailed" and rerun the
program to get more information.  Set it to "no" to suppress
this message.
builder for `/gnu/store/7143x1dd2r5kch8dldyylz1ljhp3nird-guix-latest.drv' failed with exit code 1
guix pull: error: build failed: build of `/gnu/store/7143x1dd2r5kch8dldyylz1ljhp3nird-guix-latest.drv' failed
--8<---------------cut here---------------end--------------->8---

And then, today, again:

--8<---------------cut here---------------start------------->8---
substitute: updating list of substitutes from [...]
Updating from Git repository at 'https://git.savannah.gnu.org/git/guix.git'...
Building from Git commit 66660960ba75233ae5b6c539f43d97d06d64e9ad...
substitute: updating list of substitutes from [...]
The following derivation will be built:
   /gnu/store/dmv64icdan1fqrl00czgwx1an923fzda-guix-latest.drv
copying and compiling to '/gnu/store/slqcrr5gwhi1zqv21wjp0l973zs3dywc-guix-latest' with Guile 2.2.2...
loading...       25.3% of 632 filesrandom seed for tests: 1506327995
loading...       99.8% of 632 files
compiling...     94.8% of 632 filesice-9/threads.scm:289:22: In procedure loop:
ice-9/threads.scm:289:22: Syntax error:
guix/gexp.scm:539:10: return: return used outside of 'with-monad' in form (return (derivation->output-path drv))

Some deprecated features have been used.  Set the environment
variable GUILE_WARN_DEPRECATED to "detailed" and rerun the
program to get more information.  Set it to "no" to suppress
this message.
builder for `/gnu/store/dmv64icdan1fqrl00czgwx1an923fzda-guix-latest.drv' failed with exit code 1
guix pull: error: build failed: build of `/gnu/store/dmv64icdan1fqrl00czgwx1an923fzda-guix-latest.drv' failed
--8<---------------cut here---------------end--------------->8---




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 25 Sep 2017 07:27:39 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Mon Sep 25 03:27:39 2017
Received: from localhost ([127.0.0.1]:57167 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dwNnn-0006KR-Gh
	for submit <at> debbugs.gnu.org; Mon, 25 Sep 2017 03:27:39 -0400
Received: from pb-sasl1.pobox.com ([64.147.108.66]:61507
 helo=sasl.smtp.pobox.com) by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <wingo@HIDDEN>) id 1dwNnl-0006KJ-P3
 for 27476 <at> debbugs.gnu.org; Mon, 25 Sep 2017 03:27:38 -0400
Received: from sasl.smtp.pobox.com (unknown [127.0.0.1])
 by pb-sasl1.pobox.com (Postfix) with ESMTP id 3D206A6035;
 Mon, 25 Sep 2017 03:27:37 -0400 (EDT)
DKIM-Signature: v=1; a=rsa-sha1; c=relaxed; d=pobox.com; h=from:to:cc
 :subject:references:date:in-reply-to:message-id:mime-version
 :content-type:content-transfer-encoding; s=sasl; bh=DVt3EzsOBV7u
 Z5AhEO4A3g+dHgc=; b=N/aY3d/Sio6KhGb+NViqJoKOqNwBDwRUdIH6eGR3zjun
 mC4w38eGGrNjwNfE7WMyOeFETs9RpWgki+uo0f/SHUx7VAroGsVGmfYCw9r6BVZp
 FO689FuP/on39tRJxfGbbZeOIm+YhrJczb6xeR2xLFIhkpo8/+e80xEaYbqRcjA=
Received: from pb-sasl1.nyi.icgroup.com (unknown [127.0.0.1])
 by pb-sasl1.pobox.com (Postfix) with ESMTP id 27477A6034;
 Mon, 25 Sep 2017 03:27:37 -0400 (EDT)
Received: from rusty (unknown [88.160.190.192])
 (using TLSv1 with cipher ECDHE-RSA-AES256-SHA (256/256 bits))
 (No client certificate requested)
 by pb-sasl1.pobox.com (Postfix) with ESMTPSA id 566AEA6033;
 Mon, 25 Sep 2017 03:27:36 -0400 (EDT)
From: Andy Wingo <wingo@HIDDEN>
To: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
Subject: Re: guix pull fails on powerful server
References: <87h8vvp1q7.fsf@HIDDEN> <87377esu1a.fsf@HIDDEN>
Date: Mon, 25 Sep 2017 09:27:45 +0200
In-Reply-To: <87377esu1a.fsf@HIDDEN> ("Ludovic =?utf-8?Q?Court=C3=A8s=22'?=
 =?utf-8?Q?s?= message of "Fri, 22 Sep 2017 16:10:57 +0200")
Message-ID: <87k20nz18u.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Pobox-Relay-ID: 00F48708-A1C3-11E7-9348-2C49D6707B88-02397024!pb-sasl1.pobox.com
X-Spam-Score: 0.7 (/)
X-Debbugs-Envelope-To: 27476
Cc: Ricardo Wurmus <rekado@HIDDEN>, help-guix@HIDDEN,
 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: 0.7 (/)

On Fri 22 Sep 2017 16:10, ludo@HIDDEN (Ludovic Court=C3=A8s) writes:

> Hi Ricardo,
>
> Ricardo Wurmus <rekado@HIDDEN> skribis:
>
>> The following derivation will be built:
>>    /gnu/store/yvyfkns3w3vm7ynwbr7mvxcmin4gd2a0-guix-latest.drv
>> copying and compiling to '/gnu/store/7m52dkr98nhwgpsx20mmpwyw2yzj58d3-gu=
ix-latest' with Guile 2.2.2...
>> loading...       25.4% of 629 filesrandom seed for tests: 1506066913
>> loading...       99.8% of 629 files
>> compiling...     69.2% of 629 filesice-9/threads.scm:289:22: In procedur=
e loop:
>> ice-9/threads.scm:289:22: Syntax error:
>> guix/scripts.scm:130:2: >>=3D: >>=3D (bind) used outside of 'with-monad'=
 in form (>>=3D (apply set-build-options* #:use-substitutes
>> ptions)) (lambda (unused-value) (mbegin %store-monad (mlet %store-monad =
((derivation (origin->derivation (package-source pack
>> tutes? use-substitutes? #:dry-run? dry-run?) (return (show-derivation-ou=
tputs derivation)))))))
>
> This was reported at <https://bugs.gnu.org/27476>, and I suspect a
> thread-safety issue.  However, syntax parameters are purely functional
> AFAICS, so I fail to see why multithreading could be a problem.
>
> Andy, any idea what could be causing this?

I have heard of but not seen a number of similar bugs: errors that
"can't happen" but which appear under multiple threads.  I don't know
what underlying pattern is.  Has anyone found a test case that reliably
reproduces?

Andy




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 22 Sep 2017 14:11:13 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Fri Sep 22 10:11:13 2017
Received: from localhost ([127.0.0.1]:52955 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dvOfh-00012Y-2p
	for submit <at> debbugs.gnu.org; Fri, 22 Sep 2017 10:11:13 -0400
Received: from eggs.gnu.org ([208.118.235.92]:38308)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <ludo@HIDDEN>) id 1dvOff-00012K-TZ
 for 27476 <at> debbugs.gnu.org; Fri, 22 Sep 2017 10:11:12 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <ludo@HIDDEN>) id 1dvOfU-0005nS-Bu
 for 27476 <at> debbugs.gnu.org; Fri, 22 Sep 2017 10:11:06 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,RP_MATCHES_RCVD,
 URIBL_BLOCKED autolearn=disabled version=3.3.2
Received: from fencepost.gnu.org ([2001:4830:134:3::e]:38451)
 by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from <ludo@HIDDEN>)
 id 1dvOfU-0005nN-6x; Fri, 22 Sep 2017 10:11:00 -0400
Received: from [193.50.110.164] (port=54698 helo=ribbon)
 by fencepost.gnu.org with esmtpsa (TLS1.2:RSA_AES_256_CBC_SHA1:256)
 (Exim 4.82) (envelope-from <ludo@HIDDEN>)
 id 1dvOfT-00015R-Po; Fri, 22 Sep 2017 10:11:00 -0400
From: ludo@HIDDEN (Ludovic =?utf-8?Q?Court=C3=A8s?=)
To: Ricardo Wurmus <rekado@HIDDEN>, Andy Wingo <wingo@HIDDEN>
Subject: Re: guix pull fails on powerful server
References: <87h8vvp1q7.fsf@HIDDEN>
X-URL: http://www.fdn.fr/~lcourtes/
X-Revolutionary-Date: 1 =?utf-8?Q?Vend=C3=A9miaire?= an 226 de la
 =?utf-8?Q?R=C3=A9volution?=
X-PGP-Key-ID: 0x090B11993D9AEBB5
X-PGP-Key: http://www.fdn.fr/~lcourtes/ludovic.asc
X-PGP-Fingerprint: 3CE4 6455 8A84 FDC6 9DB4  0CFB 090B 1199 3D9A EBB5
X-OS: x86_64-unknown-linux-gnu
Date: Fri, 22 Sep 2017 16:10:57 +0200
In-Reply-To: <87h8vvp1q7.fsf@HIDDEN> (Ricardo Wurmus's message of "Fri,
 22 Sep 2017 10:38:24 +0200")
Message-ID: <87377esu1a.fsf@HIDDEN>
User-Agent: Gnus/5.13 (Gnus v5.13) Emacs/25.2 (gnu/linux)
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
X-Received-From: 2001:4830:134:3::e
X-Spam-Score: -5.0 (-----)
X-Debbugs-Envelope-To: 27476
Cc: help-guix@HIDDEN, 27476 <at> debbugs.gnu.org
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -5.0 (-----)

Hi Ricardo,

Ricardo Wurmus <rekado@HIDDEN> skribis:

> The following derivation will be built:
>    /gnu/store/yvyfkns3w3vm7ynwbr7mvxcmin4gd2a0-guix-latest.drv
> copying and compiling to '/gnu/store/7m52dkr98nhwgpsx20mmpwyw2yzj58d3-gui=
x-latest' with Guile 2.2.2...
> loading...       25.4% of 629 filesrandom seed for tests: 1506066913
> loading...       99.8% of 629 files
> compiling...     69.2% of 629 filesice-9/threads.scm:289:22: In procedure=
 loop:
> ice-9/threads.scm:289:22: Syntax error:
> guix/scripts.scm:130:2: >>=3D: >>=3D (bind) used outside of 'with-monad' =
in form (>>=3D (apply set-build-options* #:use-substitutes
> ptions)) (lambda (unused-value) (mbegin %store-monad (mlet %store-monad (=
(derivation (origin->derivation (package-source pack
> tutes? use-substitutes? #:dry-run? dry-run?) (return (show-derivation-out=
puts derivation)))))))

This was reported at <https://bugs.gnu.org/27476>, and I suspect a
thread-safety issue.  However, syntax parameters are purely functional
AFAICS, so I fail to see why multithreading could be a problem.

Andy, any idea what could be causing this?

Thanks,
Ludo=E2=80=99.




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.
Changed bug title to 'Compilation with 'guix pull' crashes non-deterministically on many-core machines' from 'Wrong type (expecting mutex)' Request was from ludo@HIDDEN (Ludovic Courtès) to control <at> debbugs.gnu.org. Full text available.
Merged 27476 27652. Request was from ludo@HIDDEN (Ludovic Courtès) to control <at> debbugs.gnu.org. Full text available.
Severity set to 'important' from 'normal' Request was from ludo@HIDDEN (Ludovic Courtès) to control <at> debbugs.gnu.org. Full text available.

Message received at 27476 <at> debbugs.gnu.org:


Received: (at 27476) by debbugs.gnu.org; 24 Jun 2017 16:55:14 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Jun 24 12:55:14 2017
Received: from localhost ([127.0.0.1]:35877 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dOoL3-00051t-Vx
	for submit <at> debbugs.gnu.org; Sat, 24 Jun 2017 12:55:14 -0400
Received: from out3-smtp.messagingengine.com ([66.111.4.27]:49635)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <leo@HIDDEN>) id 1dOoL1-00051k-Ux
 for 27476 <at> debbugs.gnu.org; Sat, 24 Jun 2017 12:55:12 -0400
Received: from compute4.internal (compute4.nyi.internal [10.202.2.44])
 by mailout.nyi.internal (Postfix) with ESMTP id 4735020866;
 Sat, 24 Jun 2017 12:55:11 -0400 (EDT)
Received: from frontend2 ([10.202.2.161])
 by compute4.internal (MEProxy); Sat, 24 Jun 2017 12:55:11 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=famulari.name;
 h=content-type:date:from:in-reply-to:message-id:mime-version
 :references:subject:to:x-me-sender:x-me-sender:x-sasl-enc
 :x-sasl-enc; s=mesmtp; bh=vg0TAYwFuAYu2KpWb8qVJAm8Bfh2oc2k2in2ib
 S5qUI=; b=BloIgDCZm0RQvyeGXUZY/WfTnLAKGtGoxEdksetNkaSBbCBf9IoVyk
 mePWwo+EfyBDEl6maGaUNv00DAwFYs5n6dzIas7BnNkXH+jEOI0EQZUxQbDqfj7A
 U/2oe4pgb207SP2653stYIK5D+t9xvSU7YUxqQfvnzEDvhU16odZ0=
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=content-type:date:from:in-reply-to
 :message-id:mime-version:references:subject:to:x-me-sender
 :x-me-sender:x-sasl-enc:x-sasl-enc; s=fm1; bh=vg0TAYwFuAYu2KpWb8
 qVJAm8Bfh2oc2k2in2ibS5qUI=; b=J4fei6NYxb4qZ3uvNjVe/GQ30s+ZP/RmcJ
 SC4fvGeb59UzNTX2yKRszAdFKsiDjAZd0NkIzXxY8SvlRWgoFKujnbJ+7dfqSuFp
 ImJ5v3LfwPcrFFfOVZHhTdqzPw0q+izdw6Fg8sEdbGfbuDtrEARTsb+jS3yc1MeL
 qIkGGFWFuTMSfMscAwBXzIcJELbt323PvitdWWXrcArrYV1NLyr77Qhv2htNlxvP
 39n7c+QWy33bcxHcmVDe6nzG6ZYUKZdW8olvP/92oFp9ImGsoZvhTEtc0lO3BrZm
 ypv6cbm55yQ7HgymeS+haIuLlYJXWxgRT6ZeUEbemeYIkDATfhhA==
X-ME-Sender: <xms:b5lOWRDzbax_62on4nlc13ArLmu2sJZSorZJTPuMacygRtD7tZC5pA>
X-Sasl-enc: BSQNPRyhX9t4n5ZenGSRHuoYfLsKbbK5mRo+Kx/FtQKO 1498323311
Received: from localhost (unknown [128.64.129.7])
 by mail.messagingengine.com (Postfix) with ESMTPA id 085C224232
 for <27476 <at> debbugs.gnu.org>; Sat, 24 Jun 2017 12:55:11 -0400 (EDT)
Date: Sat, 24 Jun 2017 12:55:08 -0400
From: Leo Famulari <leo@HIDDEN>
To: 27476 <at> debbugs.gnu.org
Subject: Re: Wrong type (expecting mutex)
Message-ID: <20170624165508.GA21063@HIDDEN>
References: <20170624163212.GA22546@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256;
 protocol="application/pgp-signature"; boundary="a8Wt8u1KmwUX3Y2C"
Content-Disposition: inline
In-Reply-To: <20170624163212.GA22546@HIDDEN>
User-Agent: Mutt/1.8.3 (2017-05-23)
X-Spam-Score: -0.7 (/)
X-Debbugs-Envelope-To: 27476
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -0.7 (/)


--a8Wt8u1KmwUX3Y2C
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable

On Sat, Jun 24, 2017 at 12:32:12PM -0400, Leo Famulari wrote:
> compiling...	 99.2% of 606 filesBacktrace:
>            2 (primitive-load "/gnu/store/v9a9cqzh41qg4sixl2mk5kndglp?")
> In ./guix/build/pull.scm:
>     181:8  1 (build-guix _ _ #:system _ #:storedir _ #:localstatedir ?)
> In ice-9/threads.scm:
>    289:22  0 (loop _)
>=20
> ice-9/threads.scm:289:22: In procedure loop:
> ice-9/threads.scm:289:22: Wrong type (expecting mutex): (3556 . #<procedu=
re intset-add (bs i)>)

It didn't happen when I re-ran the command.

--a8Wt8u1KmwUX3Y2C
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEsFFZSPHn08G5gDigJkb6MLrKfwgFAllOmWwACgkQJkb6MLrK
fwjyww//V0K5yStbzjftvKHeMnTSPBUTU2/utmx9lnfKRznSPQ3ldl7Ic5Vpiw6U
B9nL6A+Akm3Ev4D0FSd5j7gQqrkIsfcS46NpPvSINUgBz8iTi4qpRzGtpLp6cyuD
fGkI6w09UpdFndYus3gJN6xpCGzsvOT1lLKI9eUkB8H4lFbKVapHsOeDwNRda+7H
EEABtkbygcd/vtc9MpioT8d2rN0rMuTEe/yKxZ+me+3+L/wwYoH0DKlvnGTy0zwj
LbErBC8zh09UtvDJiHfmDKXFoU3Pgpf87fX0KjcDC/SpcHl7lfq071U1FMleUDdS
6h34eB5anXrZHDoPifIDXOZKl1B/w5fpPrYPzCN/jjGs10IFCkGRFeag1ZRNYhh9
5FSpSGiiAvnKdCvz4LJzXH60KAzIrsTCXpC97OMsp3dbL7/N4vMTwErH8P3KhiVP
A36tHV8tVbAYhueM68YGFZ5nl+9ZQd+GTwCA6D3WEgrfA5s707cgBIefzgm9wahl
VRHvWS+b16yTjEuc8ZXGk5KsuqBoT7PzYBAzC9vByFCE/lIEieXcijvJyPcGSb3Z
hJqUKfSN1Q1H0EzRn2La+fxxAU1dzN6cNAvuIL3ur6UPo3zBGvHKlSIdIkBBKoDA
DvDBNjKtpNh7s2z9RTfPetxkiF24lYvbqzbNCWItYWy92dWpTKM=
=YvSI
-----END PGP SIGNATURE-----

--a8Wt8u1KmwUX3Y2C--




Information forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 24 Jun 2017 16:32:28 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Sat Jun 24 12:32:28 2017
Received: from localhost ([127.0.0.1]:35867 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1dOnz1-0004V4-Uh
	for submit <at> debbugs.gnu.org; Sat, 24 Jun 2017 12:32:28 -0400
Received: from eggs.gnu.org ([208.118.235.92]:41134)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <leo@HIDDEN>) id 1dOnz0-0004Ur-61
 for submit <at> debbugs.gnu.org; Sat, 24 Jun 2017 12:32:26 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <leo@HIDDEN>) id 1dOnyt-00004u-Sh
 for submit <at> debbugs.gnu.org; Sat, 24 Jun 2017 12:32:20 -0400
X-Spam-Checker-Version: SpamAssassin 3.3.2 (2011-06-06) on eggs.gnu.org
X-Spam-Level: 
X-Spam-Status: No, score=-1.9 required=5.0 tests=BAYES_00,T_DKIM_INVALID
 autolearn=disabled version=3.3.2
Received: from lists.gnu.org ([2001:4830:134:3::11]:37608)
 by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <leo@HIDDEN>) id 1dOnyt-0008W9-Pj
 for submit <at> debbugs.gnu.org; Sat, 24 Jun 2017 12:32:19 -0400
Received: from eggs.gnu.org ([2001:4830:134:3::10]:60336)
 by lists.gnu.org with esmtp (Exim 4.71)
 (envelope-from <leo@HIDDEN>) id 1dOnys-0004B9-IE
 for bug-guix@HIDDEN; Sat, 24 Jun 2017 12:32:19 -0400
Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71)
 (envelope-from <leo@HIDDEN>) id 1dOnyp-0008KK-FH
 for bug-guix@HIDDEN; Sat, 24 Jun 2017 12:32:18 -0400
Received: from out3-smtp.messagingengine.com ([66.111.4.27]:35579)
 by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32)
 (Exim 4.71) (envelope-from <leo@HIDDEN>) id 1dOnyp-0008HW-6s
 for bug-guix@HIDDEN; Sat, 24 Jun 2017 12:32:15 -0400
Received: from compute4.internal (compute4.nyi.internal [10.202.2.44])
 by mailout.nyi.internal (Postfix) with ESMTP id 5A65D20743;
 Sat, 24 Jun 2017 12:32:14 -0400 (EDT)
Received: from frontend2 ([10.202.2.161])
 by compute4.internal (MEProxy); Sat, 24 Jun 2017 12:32:14 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=famulari.name;
 h=content-type:date:from:message-id:mime-version:subject:to
 :x-me-sender:x-me-sender:x-sasl-enc:x-sasl-enc; s=mesmtp; bh=lGw
 WMq0oGBldgub/mhfeEAi1MTPVdDh2xgyWVWVhrb8=; b=lvjS4aqqlypmLeA88Yc
 GArBH7PsDyk3TV3Cz5G7cFDCuk0u5LZ9OB4JlpYC8yj0Wbv5yRkMVr+tfQ7xUFxa
 JFik4hv2oE1VRRDZGNLMsB4ndbyZsxX/o+8mQfIC7uVa3RX3bESejMjlWVZG1THp
 fkrigoy1/oEYqehqJ522rDzE=
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=content-type:date:from:message-id
 :mime-version:subject:to:x-me-sender:x-me-sender:x-sasl-enc
 :x-sasl-enc; s=fm1; bh=lGwWMq0oGBldgub/mhfeEAi1MTPVdDh2xgyWVWVhr
 b8=; b=KBIkzGmugT6XvHzla7XVCZYpVkq7exLUayTYzOSDjrWUEW3f97jGPWv5v
 Ucx5qz/q44+y7e/jyxLOkS2AGNCJ2uqeqTnjdTX2CQj30TWlklXYLCnjYnCVMTKT
 t2VEMOpPO21lci30tJ0E09eygUQ/zcZxfO1mH4MlO2jPNKmdGruf/BpJTA/Xr9Df
 jR2glS925xPSHVr8HnxRP//UYaXuK3VOWjLdkAsFrUq4nI+S8QHKL5LP31otzQim
 lcWO7DKVk0FRzfKBzQzzf+CtKFwtdXLEsAHfcD4DS7fp/0e5c5eSaP3CiwiHjQ4m
 6NiqEV6lkArHNqW6aY+B1fGPb8BXg==
X-ME-Sender: <xms:DpROWaolpAy1bVpxsae-9jyCajAkpm50R3u-jTDrChKrb-YmVPtGlw>
X-Sasl-enc: InmPQHiHxwtl6QDVyPPdi5PwM1AWH0Q+4AbZ66mUsJdu 1498321934
Received: from localhost (unknown [128.64.129.7])
 by mail.messagingengine.com (Postfix) with ESMTPA id 20118245EF
 for <bug-guix@HIDDEN>; Sat, 24 Jun 2017 12:32:14 -0400 (EDT)
Date: Sat, 24 Jun 2017 12:32:12 -0400
From: Leo Famulari <leo@HIDDEN>
To: bug-guix@HIDDEN
Subject: Wrong type (expecting mutex)
Message-ID: <20170624163212.GA22546@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha256;
 protocol="application/pgp-signature"; boundary="IJpNTDwzlM2Ie8A6"
Content-Disposition: inline
User-Agent: Mutt/1.8.3 (2017-05-23)
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.2.x-3.x [generic]
 [fuzzy]
X-detected-operating-system: by eggs.gnu.org: GNU/Linux 2.6.x
X-Received-From: 2001:4830:134:3::11
X-Spam-Score: -4.1 (----)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -4.1 (----)


--IJpNTDwzlM2Ie8A6
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline

I just got this from `guix pull`:

guix pull --url=file:///gnu/store/l552m9iavw3amq5c8vaifqlxvw09r2nz-guix-latest.tar.gz
unpacking '/gnu/store/l552m9iavw3amq5c8vaifqlxvw09r2nz-guix-latest.tar.gz'...
updating list of substitutes from 'https://4606.nsupdate.info'... 100.0%o'...   0.0%
The following derivation will be built:
   /gnu/store/xxy7l4jfjx6n62anfqlw4gbmafypqgrs-guix-latest.drv
updating list of substitutes from 'https://4606.nsupdate.info'... 100.0%o'...   0.0%
substitute: updating list of substitutes from 'https://mirror.hydra.gnu.org'... 100.0%
copying and compiling to '/gnu/store/r1z6nbkrl99hxppcvcprc8vgbzakv632-guix-latest' with Guile 2.2.2...
loading...	 25.4% of 606 filesrandom seed for tests: 1498319917
loading...	 99.8% of 606 files
compiling...	 99.2% of 606 filesBacktrace:
           2 (primitive-load "/gnu/store/v9a9cqzh41qg4sixl2mk5kndglp?")
In ./guix/build/pull.scm:
    181:8  1 (build-guix _ _ #:system _ #:storedir _ #:localstatedir ?)
In ice-9/threads.scm:
   289:22  0 (loop _)

ice-9/threads.scm:289:22: In procedure loop:
ice-9/threads.scm:289:22: Wrong type (expecting mutex): (3556 . #<procedure intset-add (bs i)>)

Some deprecated features have been used.  Set the environment
variable GUILE_WARN_DEPRECATED to "detailed" and rerun the
program to get more information.  Set it to "no" to suppress
this message.
builder for `/gnu/store/xxy7l4jfjx6n62anfqlw4gbmafypqgrs-guix-latest.drv' failed with exit code 1
guix pull: error: build failed: build of `/gnu/store/xxy7l4jfjx6n62anfqlw4gbmafypqgrs-guix-latest.drv' failed

--IJpNTDwzlM2Ie8A6
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQIzBAABCAAdFiEEsFFZSPHn08G5gDigJkb6MLrKfwgFAllOlAsACgkQJkb6MLrK
fwiEhg/+I/BbkX/UecS4mGQoAR++PP5UGQXPSEV40QYQJrkfQjlSYnOQl29P+V7c
VPKzt6jaFmimT6NrxM5cxRh4OB6AG72LzFSZtsBQIYqEh/p62h9ACUHGMhzyt/2j
fqipI0JjoEq4nHOrcFWgid4Vgymx+9clQ1eXFxvg6ifSACpKe/2bQdUZrU7JUjHe
APntKfcfO9BHx9g7giBr2X0ExDdfnvYkwyKdQYQPu73kwnb/MzoLygrf5A3Cekmc
Q+fX3N3SfgsTjhum9+2q+PYLwY1aBFzY6ZB45LAv/jC1NRJgePvGwS6FhMaQ7Tbe
SZS75Ws4OlPElMdplUX/BjPf2YOlqyu2nh1FTpEBMaInEqPOEIuj6Hv+C9550PbL
Rk5SHNy14DqfJ9q9Q3EUsxi9KUXwflg6R0ERE5xAoXJT+SELaZa4hb6aeyHw7JPf
KN9/M6unLJPF0Eta9ISmq3SbwkpdSGCTWqhFXKUiSZVfBulhfhYUAA9dx8tAsl0B
gplUV4EbqGsKjvufV9dR4VzkXPzApIoYWnjdGaH5Bzoy35N3iAuusafmxk1L1zMS
9+sBklIyhgwV1pVM92XtlMVEwE1rmud6JP1xAWMOKMdvX/mBDIiu8Edmfo9KXfTp
Trhj/feFkc6DqP2kO7XxvWV7EtLOmCZNNLNvTrDLvspYnK20jAA=
=0Tn+
-----END PGP SIGNATURE-----

--IJpNTDwzlM2Ie8A6--




Acknowledgement sent to Leo Famulari <leo@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#27476; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Thu, 7 Jun 2018 16:30:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.