GNU bug report logs - #41394
java-testng: again nondeterministic test-failures?

Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.

Package: guix; Reported by: Björn Höfling <bjoern.hoefling@HIDDEN>; dated Tue, 19 May 2020 09:28:02 UTC; Maintainer for guix is bug-guix@HIDDEN.

Message received at 41394 <at> debbugs.gnu.org:


Received: (at 41394) by debbugs.gnu.org; 24 Aug 2023 11:26:04 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Thu Aug 24 07:26:04 2023
Received: from localhost ([127.0.0.1]:36276 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1qZ8TU-0008Iz-1l
	for submit <at> debbugs.gnu.org; Thu, 24 Aug 2023 07:26:04 -0400
Received: from out5-smtp.messagingengine.com ([66.111.4.29]:46923)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <konrad.hinsen@HIDDEN>) id 1qZ8TR-0008IU-Nk
 for 41394 <at> debbugs.gnu.org; Thu, 24 Aug 2023 07:26:02 -0400
Received: from compute2.internal (compute2.nyi.internal [10.202.2.46])
 by mailout.nyi.internal (Postfix) with ESMTP id 632315C00AF;
 Thu, 24 Aug 2023 07:25:52 -0400 (EDT)
Received: from mailfrontend2 ([10.202.2.163])
 by compute2.internal (MEProxy); Thu, 24 Aug 2023 07:25:52 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fastmail.net; h=
 cc:content-type:content-type:date:date:from:from:in-reply-to
 :message-id:mime-version:reply-to:sender:subject:subject:to:to;
 s=fm1; t=1692876352; x=1692962752; bh=3Z/u2oA5UIAdcZ6hlh6A+v+MN
 FsBpxEZIFzvEkRHfYk=; b=bhZSwLea3SD1z5pdddR3gS+u+OBsnUoqdZmfpRs5C
 M8DI9sxbOP8+aCV9qRz+v6P90Vq/g9t59Z/wk2Q3vzPkYMztgqHsgC8c1RHd48D5
 S62DyjTnYmfENsWT7OGQwgXP9xlL2ftNUEjg5t2Ky6P4uPcQAdmfM4xCzUzaJ0gD
 V9ZzrmlYo5zUaaFxRNet/OqE0nOECmx/F80OfluBB/0T9waY64tn1mkFzYAjjxcB
 A64/mbVUomxuF+4LrKQ4pd4boftjIw5L0MAjfEmvQTpbKi33mN640dX1vBlMbvvR
 q2bhJUEhKGAfDugYCGRMuMuq4E531CGhSyFdUgeSzmrsg==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=cc:content-type:content-type:date:date
 :feedback-id:feedback-id:from:from:in-reply-to:message-id
 :mime-version:reply-to:sender:subject:subject:to:to:x-me-proxy
 :x-me-proxy:x-me-sender:x-me-sender:x-sasl-enc; s=fm1; t=
 1692876352; x=1692962752; bh=3Z/u2oA5UIAdcZ6hlh6A+v+MNFsBpxEZIFz
 vEkRHfYk=; b=VSJHImkD8vFNkK3Bs0T7NK2JpGM0RXaUOL9GZnGNT9i4D5/OL5g
 sLp6qM4CRp2btj7/QKwBhgbuY1yD9lIrzunno/sgKk97TwYISdTS4CKK8O4BKgmy
 MrJ9X9YB/pA2pYeN1JUkY0+s67QRCJR5N1chvPKZ4cqEnlpcmGUtVZEONdxAFlDu
 Ok8yydj1wc7uLE88Voz80ispi9veNUM4GQ146CUAMZ4JjgGXmQMC8INftnOGOMAG
 tRq60Ccb8TWvomWDU4xpb9ORzuol3qfBX8dk7plpKPlFARs2r38BmdPePut7zriq
 Uel1yp1Dk64Es+QIQF+4X9ig7MRcv8Qk2vA==
X-ME-Sender: <xms:QD7nZH0Vr9z16U68R8XGO6m34kU166L06y_mC5EFyPY1-HPFA2SYQw>
 <xme:QD7nZGGQDMGOYvlxYd0_niB4sg-s77X-dNMWwORmiV3NG4XJLovp06JEFPGBaFpYY
 2u1sfK6cY6sYBVN>
X-ME-Received: <xmr:QD7nZH733Ko0c19E1lkULzoqDkHhHBXooAAL7_qynyedK7pTH-K1PVdfGtpNYFZTowZHhDC-U1E>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedviedruddviedgfeelucetufdoteggodetrfdotf
 fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen
 uceurghilhhouhhtmecufedttdenucenucfjughrpefhvffufffkgggtsehttdertddttd
 dtnecuhfhrohhmpefmohhnrhgrugcujfhinhhsvghnuceokhhonhhrrggurdhhihhnshgv
 nhesfhgrshhtmhgrihhlrdhnvghtqeenucggtffrrghtthgvrhhnpeevfeevuedtiedtte
 etgfeghedvudeileekgfehkeehudetveehgeeuteeuveejheenucevlhhushhtvghrufhi
 iigvpedtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehkohhnrhgrugdrhhhinhhsvghnse
 hfrghsthhmrghilhdrnhgvth
X-ME-Proxy: <xmx:QD7nZM0AfPfP1oERbA718juK5tul4VqRICkc5n21AW7G8NRH1F0MJA>
 <xmx:QD7nZKFJxIc9OvaHZuarnbqy1Cq-J9kVhJTapGnHrZorT_0JRaA4Yg>
 <xmx:QD7nZN-bDCgs719AFcvEz2Ivo2oESmmCrKJtUVjGWGduiuETFfYSYw>
 <xmx:QD7nZFNGtnMok5_jd117xhc6Ji7h30cNYbG_1IFDw_iW8W4yqW9d0w>
Feedback-ID: i184641e2:Fastmail
Received: by mail.messagingengine.com (Postfix) with ESMTPA; Thu,
 24 Aug 2023 07:25:51 -0400 (EDT)
From: Konrad Hinsen <konrad.hinsen@HIDDEN>
To: 41394 <at> debbugs.gnu.org
Subject: Re: java-testng: again nondeterministic test-failures?
Date: Thu, 24 Aug 2023 13:25:50 +0200
Message-ID: <m1lee0k7gh.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain
X-Spam-Score: -0.7 (/)
X-Debbugs-Envelope-To: 41394
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.7 (-)

During today's regular "guix pull", I ran into this problem: java-testng
failed to build twice (the failures comes from the test suite), but
built correctly the third time. That's for commit:
39fa1ef033fda82cb1d122e0d1675b51acb1db34

Cheers,
  Konrad.




Information forwarded to bug-guix@HIDDEN:
bug#41394; Package guix. Full text available.

Message received at 41394 <at> debbugs.gnu.org:


Received: (at 41394) by debbugs.gnu.org; 19 May 2020 12:08:43 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue May 19 08:08:42 2020
Received: from localhost ([127.0.0.1]:49449 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1jb134-0006xG-Mr
	for submit <at> debbugs.gnu.org; Tue, 19 May 2020 08:08:42 -0400
Received: from lepiller.eu ([89.234.186.109]:44480)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <julien@HIDDEN>) id 1jb132-0006x6-Kx
 for 41394 <at> debbugs.gnu.org; Tue, 19 May 2020 08:08:41 -0400
Received: from lepiller.eu (localhost [127.0.0.1])
 by lepiller.eu (OpenSMTPD) with ESMTP id 3cc544b4;
 Tue, 19 May 2020 12:08:38 +0000 (UTC)
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed; d=lepiller.eu; h=date
 :in-reply-to:references:mime-version:content-type
 :content-transfer-encoding:subject:to:from:message-id; s=dkim;
 bh=b2l1THFQBBDIW0eHJTjx2IuWwZ1QzNi0UXaVuVS0Ezk=; b=X4EamCuYh0bC
 w3Py9FM9Sf+TqXQ0SYwTRtY5FlzCvP0qyLlgpqNUdDHNROdUtObuA3cdO4h1xA+h
 on4BMNI4m5vrgA6pfz8d8qgE7J4M6OAmIKrStXtGaPnltBTi7VMWGYo+jUS5a6xF
 8/slelre4jfTWmGpdr6u1DSIryiJzQR1uOJHFVmmJHhlgqwQkfb/4xvyVOY9HuqH
 0Q9GxCfvhUaolNH17cb3wNZOD6IxGJUsDlXqzi4jzzjJAmtSwA+3GWxPh5xa31iq
 1o4YgcFougw6Fkzsuj+iVC+vIvhzrPfHdqnHMG7Z+qooUYfg2QB2RBsekXKzlGrO
 EhH/QOiOhw==
Received: by lepiller.eu (OpenSMTPD) with ESMTPSA id cbdf0a37
 (TLSv1.2:ECDHE-RSA-AES256-GCM-SHA384:256:NO); 
 Tue, 19 May 2020 12:08:37 +0000 (UTC)
Date: Tue, 19 May 2020 08:08:16 -0400
User-Agent: K-9 Mail for Android
In-Reply-To: <20200519112745.6971271b@alma-ubu>
References: <20200519112745.6971271b@alma-ubu>
MIME-Version: 1.0
Content-Type: text/plain;
 charset=utf-8
Content-Transfer-Encoding: quoted-printable
Subject: Re: bug#41394: java-testng: again nondeterministic test-failures?
To: =?ISO-8859-1?Q?Bj=F6rn_H=F6fling?= <bjoern.hoefling@HIDDEN>,
 41394 <at> debbugs.gnu.org
From: Julien Lepiller <julien@HIDDEN>
Message-ID: <F14629F3-C125-4D86-B7DE-FF4D899E3C6D@HIDDEN>
X-Spam-Score: 0.0 (/)
X-Debbugs-Envelope-To: 41394
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

Le 19 mai 2020 05:27:45 GMT-04:00, "Bj=C3=B6rn H=C3=B6fling" <bjoern=2Ehoef=
ling@bjoernhoefling=2Ede> a =C3=A9crit :
>Does anyone else have the same problems?
>
>On my system java-testng sometimes fails nondeterministically within
>the check phase:
>
>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>TestNG
>Total tests run: 1633, Failures: 2, Skips: 0
>=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
>
>Failures in <suite> :TestNG, <test> :Regression2
>test=2Ethread=2EParallelTestTest=2EverifyParallel()
>StackTrace:
> java=2Elang=2EAssertionError:=20
>Expected size:<4> but was:<3> in:
><{59L=3D59L, 60L=3D60L, 62L=3D62L}>
>	at test=2Ethread=2EParallelTestTest=2EverifyExpected(Unknown Source)
>	at test=2Ethread=2EParallelTestTest=2EverifyParallel(Unknown Source)
>=2E=2E=2E Removed 24 stack frames=20
>
>test=2Ethread=2EParallelTestTest=2EverifyParallel()
>StackTrace:
> java=2Elang=2EAssertionError:=20
>Expected size:<4> but was:<3> in:
><{55L=3D55L, 56L=3D56L, 58L=3D58L}>
>	at test=2Ethread=2EParallelTestTest=2EverifyExpected(Unknown Source)
>	at test=2Ethread=2EParallelTestTest=2EverifyParallel(Unknown Source)
>=2E=2E=2E Removed 24 stack frames=20
>
>
>Do others experience this too, or is it just my machine?
>
>On berlin, everything looks fine, that makes we wonder:
>
>https://ci=2Eguix=2Egnu=2Eorg/search?query=3D%5Ejava-testng
>
>We had some problems in the past with other parallel tests:
>
>https://debbugs=2Egnu=2Eorg/cgi/bugreport=2Ecgi?bug=3D30526
>
>I also tried to update java-testng but that was not possible quickly,
>because of new/updated dependency-graph=2E
>
>Bj=C3=B6rn

During my work on getting a maven-build-system, I recently rebuilt testng =
multiple times, with no issue at all=2E




Information forwarded to bug-guix@HIDDEN:
bug#41394; Package guix. Full text available.

Message received at submit <at> debbugs.gnu.org:


Received: (at submit) by debbugs.gnu.org; 19 May 2020 09:27:54 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue May 19 05:27:54 2020
Received: from localhost ([127.0.0.1]:49186 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1jayXR-0006ut-UL
	for submit <at> debbugs.gnu.org; Tue, 19 May 2020 05:27:54 -0400
Received: from lists.gnu.org ([209.51.188.17]:44510)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <bjoern.hoefling@HIDDEN>)
 id 1jayXQ-0006um-Va
 for submit <at> debbugs.gnu.org; Tue, 19 May 2020 05:27:53 -0400
Received: from eggs.gnu.org ([2001:470:142:3::10]:59196)
 by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256)
 (Exim 4.90_1) (envelope-from <bjoern.hoefling@HIDDEN>)
 id 1jayXQ-00023R-O1
 for bug-guix@HIDDEN; Tue, 19 May 2020 05:27:52 -0400
Received: from m4s11.vlinux.de ([83.151.27.109]:60098 helo=bjoernhoefling.de)
 by eggs.gnu.org with esmtp (Exim 4.90_1)
 (envelope-from <bjoern.hoefling@HIDDEN>)
 id 1jayXP-0005BD-Oa
 for bug-guix@HIDDEN; Tue, 19 May 2020 05:27:52 -0400
Received: from alma-ubu (p508acbaa.dip0.t-ipconnect.de [80.138.203.170])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (No client certificate requested)
 by bjoernhoefling.de (Postfix) with ESMTPSA id 6C6E83F9B4
 for <bug-guix@HIDDEN>; Tue, 19 May 2020 11:27:47 +0200 (CEST)
Date: Tue, 19 May 2020 11:27:45 +0200
From: =?UTF-8?B?QmrDtnJuIEjDtmZsaW5n?= <bjoern.hoefling@HIDDEN>
To: <bug-guix@HIDDEN>
Subject: java-testng: again nondeterministic test-failures?
Message-ID: <20200519112745.6971271b@alma-ubu>
X-Mailer: Claws Mail 3.16.0 (GTK+ 2.24.32; x86_64-pc-linux-gnu)
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha512;
 boundary="Sig_/=0E=kGoxj4SSeyNrFn0BDXy"; protocol="application/pgp-signature"
Received-SPF: none client-ip=83.151.27.109;
 envelope-from=bjoern.hoefling@HIDDEN; helo=bjoernhoefling.de
X-detected-operating-system: by eggs.gnu.org: First seen = 2020/05/19 05:27:47
X-ACL-Warn: Detected OS   = Linux 2.2.x-3.x [generic]
X-Spam_score_int: -8
X-Spam_score: -0.9
X-Spam_bar: /
X-Spam_report: (-0.9 / 5.0 requ) BAYES_00=-1.9, FROM_EXCESS_BASE64=0.979,
 URIBL_BLOCKED=0.001 autolearn=_AUTOLEARN
X-Spam_action: no action
X-Spam-Score: -2.3 (--)
X-Debbugs-Envelope-To: submit
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -3.3 (---)

--Sig_/=0E=kGoxj4SSeyNrFn0BDXy
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

Does anyone else have the same problems?

On my system java-testng sometimes fails nondeterministically within
the check phase:

=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
TestNG
Total tests run: 1633, Failures: 2, Skips: 0
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

Failures in <suite> :TestNG, <test> :Regression2
test.thread.ParallelTestTest.verifyParallel()
StackTrace:
 java.lang.AssertionError:=20
Expected size:<4> but was:<3> in:
<{59L=3D59L, 60L=3D60L, 62L=3D62L}>
	at test.thread.ParallelTestTest.verifyExpected(Unknown Source)
	at test.thread.ParallelTestTest.verifyParallel(Unknown Source)
... Removed 24 stack frames=20

test.thread.ParallelTestTest.verifyParallel()
StackTrace:
 java.lang.AssertionError:=20
Expected size:<4> but was:<3> in:
<{55L=3D55L, 56L=3D56L, 58L=3D58L}>
	at test.thread.ParallelTestTest.verifyExpected(Unknown Source)
	at test.thread.ParallelTestTest.verifyParallel(Unknown Source)
... Removed 24 stack frames=20


Do others experience this too, or is it just my machine?

On berlin, everything looks fine, that makes we wonder:

https://ci.guix.gnu.org/search?query=3D%5Ejava-testng

We had some problems in the past with other parallel tests:

https://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D30526

I also tried to update java-testng but that was not possible quickly,
because of new/updated dependency-graph.

Bj=C3=B6rn


--Sig_/=0E=kGoxj4SSeyNrFn0BDXy
Content-Type: application/pgp-signature
Content-Description: OpenPGP digital signature

-----BEGIN PGP SIGNATURE-----

iF0EAREKAB0WIQQiGUP0np8nb5SZM4K/KGy2WT5f/QUCXsOmkQAKCRC/KGy2WT5f
/WhtAJ0aCtxiA8F+Ted9WjJ75cU4YwkMNgCfa2pIUlhBKQmbsg81hsTldNiFALA=
=2B67
-----END PGP SIGNATURE-----

--Sig_/=0E=kGoxj4SSeyNrFn0BDXy--




Acknowledgement sent to Björn Höfling <bjoern.hoefling@HIDDEN>:
New bug report received and forwarded. Copy sent to bug-guix@HIDDEN. Full text available.
Report forwarded to bug-guix@HIDDEN:
bug#41394; Package guix. Full text available.
Please note: This is a static page, with minimal formatting, updated once a day.
Click here to see this page with the latest information and nicer formatting.
Last modified: Thu, 24 Aug 2023 11:30:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.