From mboxrd@z Thu Jan 1 00:00:00 1970 From: =?UTF-8?Q?G=C3=A1bor?= Boskovits Subject: bug#30526: java-testng: non-deterministic test failures Date: Wed, 21 Feb 2018 10:20:09 +0100 Message-ID: References: <87606tjd8n.fsf@elephly.net> Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="94eb2c088ff80dd22a0565b56f3e" Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:40065) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1eoQaJ-0006Mi-2l for bug-guix@gnu.org; Wed, 21 Feb 2018 04:21:08 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1eoQaE-0004sL-KE for bug-guix@gnu.org; Wed, 21 Feb 2018 04:21:06 -0500 Received: from debbugs.gnu.org ([208.118.235.43]:45710) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1eoQaE-0004rv-F8 for bug-guix@gnu.org; Wed, 21 Feb 2018 04:21:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1eoQaE-0007m7-3F for bug-guix@gnu.org; Wed, 21 Feb 2018 04:21:02 -0500 Sender: "Debbugs-submit" Resent-Message-ID: In-Reply-To: List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org Sender: "bug-Guix" To: Ricardo Wurmus Cc: 30526@debbugs.gnu.org --94eb2c088ff80dd22a0565b56f3e Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable 2018-02-21 10:07 GMT+01:00 G=C3=A1bor Boskovits : > 2018-02-19 14:55 GMT+01:00 Ricardo Wurmus : > >> Sometimes I get this error when building java-testng 6.14.2: >> >> --8<---------------cut here---------------start------------->8--- >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> TestNG >> Total tests run: 1630, Failures: 1, Skips: 0 >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D >> >> Failures in :TestNG, :Regression2 >> test.testng387.TestNG387.testInvocationCounterIsCorrectForMe >> thodWithDataProvider() >> StackTrace: >> java.lang.AssertionError: Arrays do not have the same size:3 !=3D 4 >> at test.testng387.TestNG387.testInvocationCounterIsCorrectForMet= hodWithDataProvider(Unknown >> Source) >> ... Removed 27 stack frames >> >> phase `check' failed after 297.3 seconds >> --8<---------------cut here---------------end--------------->8--- >> >> >> > This actually seems to be known upstream, I consider reopening this bug: > https://github.com/cbeust/testng/issues/582. > It seems they just disabled the failing tests. I guess we should do the > same. > I contacted upstream, and asked the status of this. I will report back when they say something. > > >> -- >> Ricardo >> >> GPG: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC >> https://elephly.net >> >> >> >> >> > --94eb2c088ff80dd22a0565b56f3e Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
2018= -02-21 10:07 GMT+01:00 G=C3=A1bor Boskovits <boskovits@gmail.com&g= t;:
2018-02-19 14:55 = GMT+01:00 Ricardo Wurmus <rekado@elephly.net>:
Sometimes I get this error when bu= ilding java-testng 6.14.2:

--8<---------------cut here---------------start------------->8--= -
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
TestNG
Total tests run: 1630, Failures: 1, Skips: 0
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

Failures in <suite> :TestNG, <test> :Regression2
test.testng387.TestNG387.testInvocationCounterIsCorrectForMethodW= ithDataProvider()
StackTrace:
=C2=A0java.lang.AssertionError: Arrays do not have the same size:3 !=3D 4 =C2=A0 =C2=A0 =C2=A0 =C2=A0 at test.testng387.TestNG387.testInvocation= CounterIsCorrectForMethodWithDataProvider(Unknown Source)
... Removed 27 stack frames

phase `check' failed after 297.3 seconds
--8<---------------cut here---------------end--------------->8--= -
=


This actually see= ms to be known upstream, I consider reopening this bug:=C2=A0https://github.= com/cbeust/testng/issues/582.
It seems they just disable= d the failing tests. I guess we should do the same.
<= div>

I conta= cted upstream, and asked the status of this. I will report back when they s= ay something.
=C2=A0
=C2=A0
--
Ricardo

GPG: BCA6 89B6 3655 3801 C3C6=C2=A0 2150 197A 5888 235F ACAC
https:= //elephly.net






--94eb2c088ff80dd22a0565b56f3e--