From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0 ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms11 with LMTPS id sPuOECUEql69aQAA0tVLHw (envelope-from ) for ; Wed, 29 Apr 2020 22:48:05 +0000 Received: from aspmx1.migadu.com ([2001:41d0:2:4a6f::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0 with LMTPS id OI+iLC0Eql7DOwAA1q6Kng (envelope-from ) for ; Wed, 29 Apr 2020 22:48:13 +0000 Received: from lists.gnu.org (lists.gnu.org [IPv6:2001:470:142::17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id 0D52E94370A for ; Wed, 29 Apr 2020 22:48:11 +0000 (UTC) Received: from localhost ([::1]:38544 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jTvUw-00054F-Mi for larch@yhetil.org; Wed, 29 Apr 2020 18:48:10 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:39554) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1jTvUp-000543-Oz for bug-guix@gnu.org; Wed, 29 Apr 2020 18:48:04 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.90_1) (envelope-from ) id 1jTvUo-0004oZ-TO for bug-guix@gnu.org; Wed, 29 Apr 2020 18:48:03 -0400 Received: from debbugs.gnu.org ([209.51.188.43]:33306) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1jTvUo-0004oS-Hn for bug-guix@gnu.org; Wed, 29 Apr 2020 18:48:02 -0400 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1jTvUo-0001Ir-Fp for bug-guix@gnu.org; Wed, 29 Apr 2020 18:48:02 -0400 X-Loop: help-debbugs@gnu.org Subject: bug#40718: java-kafka-clients fails test on CI Resent-From: =?UTF-8?Q?Bj=C3=B6rn_?= =?UTF-8?Q?H=C3=B6fling?= Original-Sender: "Debbugs-submit" Resent-CC: bug-guix@gnu.org Resent-Date: Wed, 29 Apr 2020 22:48:02 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 40718 X-GNU-PR-Package: guix X-GNU-PR-Keywords: To: Marius Bakke Received: via spool by 40718-submit@debbugs.gnu.org id=B40718.15882004414953 (code B ref 40718); Wed, 29 Apr 2020 22:48:02 +0000 Received: (at 40718) by debbugs.gnu.org; 29 Apr 2020 22:47:21 +0000 Received: from localhost ([127.0.0.1]:44852 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jTvU9-0001Hp-Gl for submit@debbugs.gnu.org; Wed, 29 Apr 2020 18:47:21 -0400 Received: from m4s11.vlinux.de ([83.151.27.109]:59076 helo=bjoernhoefling.de) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1jTvU7-0001Hf-DY for 40718@debbugs.gnu.org; Wed, 29 Apr 2020 18:47:20 -0400 Received: from alma-ubu (p508ACF57.dip0.t-ipconnect.de [80.138.207.87]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by bjoernhoefling.de (Postfix) with ESMTPSA id 779A83F861; Thu, 30 Apr 2020 00:47:17 +0200 (CEST) Date: Thu, 30 Apr 2020 00:47:16 +0200 From: =?UTF-8?Q?Bj=C3=B6rn_?= =?UTF-8?Q?H=C3=B6fling?= Message-ID: <20200430004716.30b8dd82@alma-ubu> In-Reply-To: <875zdvh2d4.fsf@devup.no> References: <875zdvh2d4.fsf@devup.no> X-Mailer: Claws Mail 3.16.0 (GTK+ 2.24.32; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: multipart/signed; micalg=pgp-sha1; boundary="Sig_/1ygI_vyaR9ysUItgqdn.Mzo"; protocol="application/pgp-signature" X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-Received-From: 209.51.188.43 X-BeenThere: bug-guix@gnu.org List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: 40718@debbugs.gnu.org Errors-To: bug-guix-bounces+larch=yhetil.org@gnu.org Sender: "bug-Guix" X-Scanner: scn0 X-Spam-Score: 0.30 Authentication-Results: aspmx1.migadu.com; dkim=none; dmarc=none; spf=pass (aspmx1.migadu.com: domain of bug-guix-bounces@gnu.org designates 2001:470:142::17 as permitted sender) smtp.mailfrom=bug-guix-bounces@gnu.org X-Scan-Result: default: False [0.30 / 13.00]; RCVD_VIA_SMTP_AUTH(0.00)[]; GENERIC_REPUTATION(0.00)[-0.49354763180769]; TO_DN_SOME(0.00)[]; R_SPF_ALLOW(-0.20)[+ip6:2001:470:142::/48:c]; IP_REPUTATION_HAM(0.00)[asn: 22989(0.17), country: US(-0.00), ip: 2001:470:142::17(-0.49)]; DWL_DNSWL_BLOCKED(0.00)[2001:470:142::17:from]; MX_GOOD(-0.50)[cached: eggs.gnu.org]; RCPT_COUNT_TWO(0.00)[2]; MAILLIST(-0.20)[mailman]; FREEMAIL_TO(0.00)[fastmail.com]; RCVD_IN_DNSWL_FAIL(0.00)[2001:470:142::17:server fail]; MIME_TRACE(0.00)[0:+,1:+,2:~]; R_MIXED_CHARSET(0.91)[subject]; ASN(0.00)[asn:22989, ipnet:2001:470:142::/48, country:US]; R_DKIM_NA(0.00)[]; TAGGED_FROM(0.00)[larch=yhetil.org]; ARC_NA(0.00)[]; FORGED_RECIPIENTS_MAILLIST(0.00)[]; FROM_NEQ_ENVFROM(0.00)[bjoern.hoefling@bjoernhoefling.de,bug-guix-bounces@gnu.org]; FROM_HAS_DN(0.00)[]; URIBL_BLOCKED(0.00)[slf4j.org:url,gnu.org:url,fastmail.com:email]; MIME_GOOD(-0.20)[multipart/signed,text/plain]; RCVD_TLS_LAST(0.00)[]; DMARC_NA(0.00)[bjoernhoefling.de]; HAS_LIST_UNSUB(-0.01)[]; RECEIVED_SPAMHAUS_PBL(0.00)[80.138.207.87:received]; MID_RHS_NOT_FQDN(0.50)[]; RCVD_COUNT_SEVEN(0.00)[9]; FORGED_SENDER_MAILLIST(0.00)[] X-TUID: Smy6dOEhyNYS --Sig_/1ygI_vyaR9ysUItgqdn.Mzo Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable On Sun, 19 Apr 2020 18:22:31 +0200 Marius Bakke wrote: > Hello, >=20 > 'java-kafka-clients' fails to build on Berlin: >=20 > https://ci.guix.gnu.org/log/9ky8skd03p7yvik2dms2h6d7l7fsc6cv-java-kafka-c= lients-1.0.0 >=20 > The failing test is > "org.apache.kafka.common.memory.GarbageCollectedMemoryPoolTest", > possibly because of the large amount of memory on the CI machines. Hi Marius, I merged your 40554 and 40718 which stated the same bug within a week. Or did I miss a difference? The easiest thing probably would be to just turn off the failing test.Instead I tried to investigate this bug, but with little success yet. Here are my findings: Locally it always built fine. Due to #40966 my trust in CI results faded a bit away. When searching for java-kafka-clients, I sometimes see also successful builds: https://ci.guix.gnu.org/search?query=3Djava-kafka-clients++system%3Ax86_64-= linux+spec%3Aguix-master (Hit reload several times) Yesterday I thought I saw it going red only 3 weeks ago, but now I don't have that clear picture any more. The search results are strange. LOGGING: On the JUnit output, I saw lines like this: [junit] SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". [junit] SLF4J: Defaulting to no-operation (NOP) logger implementation [junit] SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder f= or further details. In order to get logging, I added a logger implementation as native input: ++ ("java-sl4fj-simple" ,java-slf4j-simple) That showed some output on the console. Maybe that could help find the issue? Unfortunately, java-slf4j-simple fails to build on berlin, too (locally, it built fine)... MEMORY SIZE: I modified the sources of the JUnit test to print out the actual memory usage during test execution, and built that with the "--sources=3D..." option. But that's nothing we can do on berlin. Or would there be an administrator trying it out on their local account? I wanted to change the heap size during tests on my computer with the "ANT_OPTS" environment variable, where you could pass a "-Xmx=3D16G" option or something. That did not have any effect on the reported heap size. Problem is, that our generated build.xml file has a=20 line, which is in general a good idea, but meaning that tests are executed under a new JVM other than ANT. We either need to say fork=3D"no" (I'm currently rebuilding the JVM-world with that) or we have to give here an additional option "maxmemory". BUILD GRAPH: When looking at the reverse-dependency graph, you notice that only java-log4j-core is using it directly. Can we get rid of that edge? On the master of log4j, there is a separate module for the Kafka-Appender, but it is not in any stabl release. Bj=C3=B6rn --Sig_/1ygI_vyaR9ysUItgqdn.Mzo Content-Type: application/pgp-signature Content-Description: OpenPGP digital signature -----BEGIN PGP SIGNATURE----- iF0EARECAB0WIQQiGUP0np8nb5SZM4K/KGy2WT5f/QUCXqoD9AAKCRC/KGy2WT5f /e86AJ9zKJ/AMFPRnttU7xU+YoAWhYIczwCfeF5uxYcQ8wv9IE8izS+36zrMmVw= =yzwZ -----END PGP SIGNATURE----- --Sig_/1ygI_vyaR9ysUItgqdn.Mzo--