GNU logs - #40718, boring messages

Message sent to bug-guix@HIDDEN:

Subject: bug#40718: java-kafka-clients fails test on CI
Resent-From: Marius Bakke <mbakke@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Sun, 19 Apr 2020 16:23:02 +0000
Resent-Message-ID: <handler.40718.B.15873133587908 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: 40718 <at> debbugs.gnu.org
From: Marius Bakke <mbakke@HIDDEN>
User-Agent: Notmuch/0.29.3 (https://notmuchmail.org) Emacs/26.3
 (x86_64-pc-linux-gnu)
Date: Sun, 19 Apr 2020 18:22:31 +0200
Message-ID: <875zdvh2d4.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; boundary="=-=-=";
 micalg=pgp-sha512; protocol="application/pgp-signature"
Received-SPF: pass client-ip=64.147.123.24; envelope-from=mbakke@HIDDEN;
 helo=wout1-smtp.messagingengine.com
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

--=-=-=
Content-Type: text/plain

Hello,

'java-kafka-clients' fails to build on Berlin:

https://ci.guix.gnu.org/log/9ky8skd03p7yvik2dms2h6d7l7fsc6cv-java-kafka-clients-1.0.0

The failing test is
"org.apache.kafka.common.memory.GarbageCollectedMemoryPoolTest",
possibly because of the large amount of memory on the CI machines.

--=-=-=
Content-Type: application/pgp-signature; name="signature.asc"

-----BEGIN PGP SIGNATURE-----

iQEzBAEBCgAdFiEEu7At3yzq9qgNHeZDoqBt8qM6VPoFAl6cescACgkQoqBt8qM6
VPoVvwgAmUKWYSbg8z4EUbVXaE2Dy3YCbRM0g7iwlDxda2Xa3tZF/pJtvUS6eb9v
TkwV8P1sHG3Zfp7agZ7TImqyOyi4KVBftuy/8VkmI1bYi4buEe9jmfTtr/cjF+1q
yaEMtR1q0OhgnX5tYOKymeP8oKQE1Dt6w1pdJw22tSg2J1LB2twm5HKkII2kiA1l
TnlGA+FsVaqb2ZWa7idTLDgt7BJkR8on6VyngQ0GefrRKiAzF2DOcWyY48DiKYrG
y528ioJD146Rk0AH8bYprzcAkiWFmkEMnx1bB0SaGCWOAS9wb+oyFtKMxK9v9WcK
dkmjNIEkJeoWx1Qqtoj0Pm7Kk4ylsg==
=ZKla
-----END PGP SIGNATURE-----
--=-=-=--

Message sent:

Content-Disposition: inline
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-Mailer: MIME-tools 5.505 (Entity 5.505)
Content-Type: text/plain; charset=utf-8
X-Loop: help-debbugs@HIDDEN
From: help-debbugs@HIDDEN (GNU bug Tracking System)
To: Marius Bakke <mbakke@HIDDEN>
Subject: bug#40718: Acknowledgement (java-kafka-clients fails test on CI)
Message-ID: <handler.40718.B.15873133587908.ack <at> debbugs.gnu.org>
References: <875zdvh2d4.fsf@HIDDEN>
X-Gnu-PR-Message: ack 40718
X-Gnu-PR-Package: guix
Reply-To: 40718 <at> debbugs.gnu.org
Date: Sun, 19 Apr 2020 16:23:02 +0000

Thank you for filing a new bug report with debbugs.gnu.org.

This is an automatically generated reply to let you know your message
has been received.

Your message is being forwarded to the package maintainers and other
interested parties for their attention; they will reply in due course.

Your message has been sent to the package maintainer(s):
 bug-guix@HIDDEN

If you wish to submit further information on this problem, please
send it to 40718 <at> debbugs.gnu.org.

Please do not send mail to help-debbugs@HIDDEN unless you wish
to report a problem with the Bug-tracking system.

--=20
40718: http://debbugs.gnu.org/cgi/bugreport.cgi?bug=3D40718
GNU Bug Tracking System
Contact help-debbugs@HIDDEN with problems

Message received at control <at> debbugs.gnu.org:

Received: (at control) by debbugs.gnu.org; 28 Apr 2020 17:58:39 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue Apr 28 13:58:39 2020
Received: from localhost ([127.0.0.1]:41395 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1jTUVD-0001aq-Dd
	for submit <at> debbugs.gnu.org; Tue, 28 Apr 2020 13:58:39 -0400
Received: from m4s11.vlinux.de ([83.151.27.109]:59018 helo=bjoernhoefling.de)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <bjoern.hoefling@HIDDEN>)
 id 1jTUVB-0001ag-7E
 for control <at> debbugs.gnu.org; Tue, 28 Apr 2020 13:58:37 -0400
Received: from alma-ubu (p508ACA3F.dip0.t-ipconnect.de [80.138.202.63])
 (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits))
 (No client certificate requested)
 by bjoernhoefling.de (Postfix) with ESMTPSA id A43A73F861
 for <control <at> debbugs.gnu.org>; Tue, 28 Apr 2020 19:58:35 +0200 (CEST)
Date: Tue, 28 Apr 2020 19:58:35 +0200
From: =?UTF-8?B?QmrDtnJuIEjDtmZsaW5n?= <bjoern.hoefling@HIDDEN>
To: <control <at> debbugs.gnu.org>
Subject: merge 40554 40718
Message-ID: <20200428195835.12c2a421@alma-ubu>
X-Mailer: Claws Mail 3.16.0 (GTK+ 2.24.32; x86_64-pc-linux-gnu)
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha1;
 boundary="Sig_/qHnU9KXHaW1HFvsL6QLtXhd"; protocol="application/pgp-signature"
X-Spam-Score: 0.4 (/)
X-Debbugs-Envelope-To: control
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.0 (-)

--Sig_/qHnU9KXHaW1HFvsL6QLtXhd
Content-Type: text/plain; charset=US-ASCII
Content-Transfer-Encoding: quoted-printable

merge 40554 40718
end

--Sig_/qHnU9KXHaW1HFvsL6QLtXhd
Content-Type: application/pgp-signature
Content-Description: OpenPGP digital signature

-----BEGIN PGP SIGNATURE-----

iF0EARECAB0WIQQiGUP0np8nb5SZM4K/KGy2WT5f/QUCXqhuywAKCRC/KGy2WT5f
/ZEhAJ0TpkyDSNS+vo3jfpzYY+X924FKeACfephLgWRRkIraxCle2em19OBVXRk=
=xA5x
-----END PGP SIGNATURE-----

--Sig_/qHnU9KXHaW1HFvsL6QLtXhd--

Message sent to bug-guix@HIDDEN:

Subject: bug#40718: java-kafka-clients fails test on CI
Resent-From: =?UTF-8?Q?Bj=C3=B6rn_?= =?UTF-8?Q?H=C3=B6fling?= <bjoern.hoefling@HIDDEN>
Original-Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
Resent-CC: bug-guix@HIDDEN
Resent-Date: Wed, 29 Apr 2020 22:48:02 +0000
Resent-Message-ID: <handler.40718.B40718.15882004414953 <at> debbugs.gnu.org>
Resent-Sender: help-debbugs@HIDDEN
To: Marius Bakke <mbakke@HIDDEN>
Cc: 40718 <at> debbugs.gnu.org
Date: Thu, 30 Apr 2020 00:47:16 +0200
From: =?UTF-8?Q?Bj=C3=B6rn_?= =?UTF-8?Q?H=C3=B6fling?= <bjoern.hoefling@HIDDEN>
Message-ID: <20200430004716.30b8dd82@alma-ubu>
In-Reply-To: <875zdvh2d4.fsf@HIDDEN>
References: <875zdvh2d4.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: multipart/signed; micalg=pgp-sha1;
 boundary="Sig_/1ygI_vyaR9ysUItgqdn.Mzo"; protocol="application/pgp-signature"
Precedence: list
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>

--Sig_/1ygI_vyaR9ysUItgqdn.Mzo
Content-Type: text/plain; charset=UTF-8
Content-Transfer-Encoding: quoted-printable

On Sun, 19 Apr 2020 18:22:31 +0200
Marius Bakke <mbakke@HIDDEN> wrote:

> Hello,
>=20
> 'java-kafka-clients' fails to build on Berlin:
>=20
> https://ci.guix.gnu.org/log/9ky8skd03p7yvik2dms2h6d7l7fsc6cv-java-kafka-c=
lients-1.0.0
>=20
> The failing test is
> "org.apache.kafka.common.memory.GarbageCollectedMemoryPoolTest",
> possibly because of the large amount of memory on the CI machines.

Hi Marius,

I merged your 40554 and 40718 which stated the same bug within a week.
Or did I miss a difference?

The easiest thing probably would be to just turn off the failing
test.Instead I tried to investigate this bug, but with little success
yet. Here are my findings:

Locally it always built fine.

Due to #40966 my trust in CI results faded a bit away.

When searching for java-kafka-clients, I sometimes see also successful
builds:

https://ci.guix.gnu.org/search?query=3Djava-kafka-clients++system%3Ax86_64-=
linux+spec%3Aguix-master

(Hit reload several times)
Yesterday I thought I saw it going red only 3 weeks ago, but now I
don't have that clear picture any more. The search results are strange.

LOGGING:

On the JUnit output, I saw lines like this:

    [junit] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder".
    [junit] SLF4J: Defaulting to no-operation (NOP) logger implementation
    [junit] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder f=
or further details.

In order to get logging, I added a logger implementation as native
input:

++       ("java-sl4fj-simple" ,java-slf4j-simple)

That showed some output on the console. Maybe that could help find the
issue?

Unfortunately, java-slf4j-simple fails to build on berlin, too
(locally, it built fine)...

MEMORY SIZE:

I modified the sources of the JUnit test to print out the actual memory
usage during test execution, and built that with the "--sources=3D..."
option. But that's nothing we can do on berlin. Or would there be an
administrator trying it out on their local account?

I wanted to change the heap size during tests on my computer with the
"ANT_OPTS" environment variable, where you could pass a "-Xmx=3D16G"
option or something. That did not have any effect on the reported heap
size. Problem is, that our generated build.xml file has a=20

<junit fork=3D"yes" ...>

line, which is in general a good idea, but meaning that tests are
executed under a new JVM other than ANT. We either need to say
fork=3D"no" (I'm currently rebuilding the JVM-world with that) or we have
to give here an additional option "maxmemory".

BUILD GRAPH:

When looking at the reverse-dependency graph, you notice that only
java-log4j-core is using it directly. Can we get rid of that edge?
On the master of log4j, there is a separate module for the
Kafka-Appender, but it is not in any stabl release.

Bj=C3=B6rn

--Sig_/1ygI_vyaR9ysUItgqdn.Mzo
Content-Type: application/pgp-signature
Content-Description: OpenPGP digital signature

-----BEGIN PGP SIGNATURE-----

iF0EARECAB0WIQQiGUP0np8nb5SZM4K/KGy2WT5f/QUCXqoD9AAKCRC/KGy2WT5f
/e86AJ9zKJ/AMFPRnttU7xU+YoAWhYIczwCfeF5uxYcQ8wv9IE8izS+36zrMmVw=
=yzwZ
-----END PGP SIGNATURE-----

--Sig_/1ygI_vyaR9ysUItgqdn.Mzo--

Message received at control <at> debbugs.gnu.org:

Received: (at control) by debbugs.gnu.org; 19 May 2020 18:17:50 +0000
From debbugs-submit-bounces <at> debbugs.gnu.org Tue May 19 14:17:50 2020
Received: from localhost ([127.0.0.1]:50903 helo=debbugs.gnu.org)
	by debbugs.gnu.org with esmtp (Exim 4.84_2)
	(envelope-from <debbugs-submit-bounces <at> debbugs.gnu.org>)
	id 1jb6oI-0001r7-EL
	for submit <at> debbugs.gnu.org; Tue, 19 May 2020 14:17:50 -0400
Received: from out4-smtp.messagingengine.com ([66.111.4.28]:36433)
 by debbugs.gnu.org with esmtp (Exim 4.84_2)
 (envelope-from <mbakke@HIDDEN>)
 id 1jb6o9-0001qd-Kz; Tue, 19 May 2020 14:17:45 -0400
Received: from compute4.internal (compute4.nyi.internal [10.202.2.44])
 by mailout.nyi.internal (Postfix) with ESMTP id 7F2E15C01A3;
 Tue, 19 May 2020 14:17:36 -0400 (EDT)
Received: from mailfrontend1 ([10.202.2.162])
 by compute4.internal (MEProxy); Tue, 19 May 2020 14:17:36 -0400
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=fastmail.com; h=
 from:to:subject:in-reply-to:references:date:message-id
 :mime-version:content-type:content-transfer-encoding; s=fm2; bh=
 M43psECVaQ3VPUWAS1tTc2CREvAFwAKpvoLafV1LSt4=; b=Hi2gcZUO6IxHU23O
 0c1LKOYwZB5vpPx6/fqoI6tY77tciEMXpKTLPDHQwUyosscOTcTB69istuErT/cN
 tTl2bd2ePbvQlqiRsYZYf5VbC33Bhb1TPTuKnuqcystY2Fjx6fvYK05dW6VhuLDD
 P0qMvbofs57XSjjc1p586uZ9vKLSNkZcrACXeyi5+NAwk8H0R1HypGw4k8srd0Ma
 halgETh0prmvZYkdkVzSwYyKW5daz1nlBKTeNzelgGSQoOJiDTFJoN9Rx5oXLdDl
 wPOj43KXmuGYJUtjPFTBXOng0O26c84ZSVRem7PCXCmaho4xhM36pmhEiAex+4di
 oI68iA==
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=
 messagingengine.com; h=content-transfer-encoding:content-type
 :date:from:in-reply-to:message-id:mime-version:references
 :subject:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender
 :x-sasl-enc; s=fm2; bh=M43psECVaQ3VPUWAS1tTc2CREvAFwAKpvoLafV1LS
 t4=; b=gb4XglFxtWF+FO1ycwiIMPpGzs8TAdxVpmFg/hVhbq7UXcrpIEhjgH/aJ
 5nNBQfA0kdPIMle0S0IoXTJn6UwosRjkXkJ8n/0PA9N08w+dnot78+0kBQkluAaS
 D5/lq5ENu0IKkpcfDNKVXoOZ7+frcRiNDoLg6bNScAcrkcfGy1npTDSrxJ/w8Wps
 EdVZHXnv3k1QxFY++fyy0tPhz/qSztIEJMY2SadMAD19lfxeykj+24UpuROtjaqQ
 mVpR5FTkr705ZrU7LbYZRPmlriRUa1cdyK41+6YTLFlQLvRpkY7bUZOeTQVnhm4d
 IzoPxophg5i9M5GlHyB5CANTA4ZdA==
X-ME-Sender: <xms:wCLEXoiT04E7FCgt2B4c3iekT2XjGgvGB5AtkZ9u9-0DQRPEjv0q4g>
X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgeduhedruddtjedguddvvdcutefuodetggdotefrod
 ftvfcurfhrohhfihhlvgemucfhrghsthforghilhdpqfgfvfdpuffrtefokffrpgfnqfgh
 necuuegrihhlohhuthemuceftddtnecunecujfgurhephffvufgjfhffkfggtgfgsehtqh
 ertddttdejnecuhfhrohhmpeforghrihhushcuuegrkhhkvgcuoehmsggrkhhkvgesfhgr
 shhtmhgrihhlrdgtohhmqeenucggtffrrghtthgvrhhnpeeiffduvddvjefggfdtuddvue
 elteefheefhfdtieeihfelheehtdeihffhkeekveenucffohhmrghinheptghomhhmohhn
 rdhnvghtfihorhhkpdhslhhfgehjrdhorhhgpdhgnhhurdhorhhgnecukfhppeekvddrud
 egkedrudeluddrudeknecuvehluhhsthgvrhfuihiivgeptdenucfrrghrrghmpehmrghi
 lhhfrhhomhepmhgsrghkkhgvsehfrghsthhmrghilhdrtghomh
X-ME-Proxy: <xmx:wCLEXhAd-JYBn4jtXeCscAR70l4z7ZN0UV-fvt3waPrIfHeh5jKKsA>
 <xmx:wCLEXgEY4dNOeoaPSuYzu1o0VFsUPKdpeDLynhVynk_kQXs490cDnQ>
 <xmx:wCLEXpSKN7YIpfGhZ2v9qQy5QO_DDRU6mbtAbhA7I175d11kBkneLA>
 <xmx:wCLEXuvhHCNH2rBDoIDgirWuPV-FXZEQewzlm1HxCYTTP4ra-OAvBQ>
Received: from localhost (ip82-148-191-18.breiband.no [82.148.191.18])
 by mail.messagingengine.com (Postfix) with ESMTPA id A65ED3280063;
 Tue, 19 May 2020 14:17:35 -0400 (EDT)
From: Marius Bakke <mbakke@HIDDEN>
To: Ricardo Wurmus <rekado@HIDDEN>, 41396 <at> debbugs.gnu.org
Subject: Re: bug#41396: java-kafka-clients fails tests
In-Reply-To: <87v9ksfc24.fsf@HIDDEN>
References: <87v9ksfc24.fsf@HIDDEN>
Date: Tue, 19 May 2020 20:17:33 +0200
Message-ID: <87pnazrdqa.fsf@HIDDEN>
MIME-Version: 1.0
Content-Type: text/plain; charset=utf-8
Content-Transfer-Encoding: quoted-printable
X-Spam-Score: -0.7 (/)
X-Debbugs-Envelope-To: control
X-BeenThere: debbugs-submit <at> debbugs.gnu.org
X-Mailman-Version: 2.1.18
Precedence: list
List-Id: <debbugs-submit.debbugs.gnu.org>
List-Unsubscribe: <https://debbugs.gnu.org/cgi-bin/mailman/options/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=unsubscribe>
List-Archive: <https://debbugs.gnu.org/cgi-bin/mailman/private/debbugs-submit/>
List-Post: <mailto:debbugs-submit <at> debbugs.gnu.org>
List-Help: <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=help>
List-Subscribe: <https://debbugs.gnu.org/cgi-bin/mailman/listinfo/debbugs-submit>, 
 <mailto:debbugs-submit-request <at> debbugs.gnu.org?subject=subscribe>
Errors-To: debbugs-submit-bounces <at> debbugs.gnu.org
Sender: "Debbugs-submit" <debbugs-submit-bounces <at> debbugs.gnu.org>
X-Spam-Score: -1.7 (-)

merge 41396 40718
thanks

Ricardo Wurmus <rekado@HIDDEN> writes:

> java-kafka-clients has a failing test:
>
>     [junit] Running org.apache.kafka.common.network.SslTransportLayerTest
>     [junit] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinde=
r".
>     [junit] SLF4J: Defaulting to no-operation (NOP) logger implementation
>     [junit] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder=
 for further details.
>     [junit] Tests run: 31, Failures: 0, Errors: 1, Skipped: 0, Time elaps=
ed: 8.072 sec
>
> The SLF4J failure seems to be unrelated (other tests also have this warni=
ng).

It only seems to happen on big-memory systems (but consistently so).
Bj=C3=B6rn did some investigation here:

  https://issues.guix.gnu.org/40718#2

If you can reproduce it, please help!  :-)

Last modified: Tue, 19 May 2020 18:30:02 UTC

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997 nCipher Corporation Ltd, 1994-97 Ian Jackson.