From mboxrd@z Thu Jan 1 00:00:00 1970 From: =?UTF-8?Q?G=C3=A1bor?= Boskovits Subject: bug#30526: java-testng: non-deterministic test failures Date: Wed, 21 Feb 2018 10:07:33 +0100 Message-ID: References: <87606tjd8n.fsf@elephly.net> Mime-Version: 1.0 Content-Type: multipart/alternative; boundary="001a1144a158f826b20565b54103" Return-path: Received: from eggs.gnu.org ([2001:4830:134:3::10]:37775) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1eoQNi-0002yS-Bg for bug-guix@gnu.org; Wed, 21 Feb 2018 04:08:10 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1eoQNe-0006wI-5i for bug-guix@gnu.org; Wed, 21 Feb 2018 04:08:06 -0500 Received: from debbugs.gnu.org ([208.118.235.43]:45699) by eggs.gnu.org with esmtps (TLS1.0:RSA_AES_128_CBC_SHA1:16) (Exim 4.71) (envelope-from ) id 1eoQNe-0006wA-2A for bug-guix@gnu.org; Wed, 21 Feb 2018 04:08:02 -0500 Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1eoQNd-0007Nj-Pe for bug-guix@gnu.org; Wed, 21 Feb 2018 04:08:01 -0500 Sender: "Debbugs-submit" Resent-Message-ID: In-Reply-To: <87606tjd8n.fsf@elephly.net> List-Id: Bug reports for GNU Guix List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: bug-guix-bounces+gcggb-bug-guix=m.gmane.org@gnu.org Sender: "bug-Guix" To: Ricardo Wurmus Cc: 30526@debbugs.gnu.org --001a1144a158f826b20565b54103 Content-Type: text/plain; charset="UTF-8" 2018-02-19 14:55 GMT+01:00 Ricardo Wurmus : > Sometimes I get this error when building java-testng 6.14.2: > > --8<---------------cut here---------------start------------->8--- > =============================================== > TestNG > Total tests run: 1630, Failures: 1, Skips: 0 > =============================================== > > Failures in :TestNG, :Regression2 > test.testng387.TestNG387.testInvocationCounterIsCorrect > ForMethodWithDataProvider() > StackTrace: > java.lang.AssertionError: Arrays do not have the same size:3 != 4 > at test.testng387.TestNG387.testInvocationCounterIsCorrect > ForMethodWithDataProvider(Unknown Source) > ... Removed 27 stack frames > > phase `check' failed after 297.3 seconds > --8<---------------cut here---------------end--------------->8--- > > > This actually seems to be known upstream, I consider reopening this bug: https://github.com/cbeust/testng/issues/582. It seems they just disabled the failing tests. I guess we should do the same. > -- > Ricardo > > GPG: BCA6 89B6 3655 3801 C3C6 2150 197A 5888 235F ACAC > https://elephly.net > > > > > --001a1144a158f826b20565b54103 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
2018= -02-19 14:55 GMT+01:00 Ricardo Wurmus <rekado@elephly.net>:=
Sometimes I get this = error when building java-testng 6.14.2:

--8<---------------cut here---------------start------------->8--= -
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D
TestNG
Total tests run: 1630, Failures: 1, Skips: 0
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D

Failures in <suite> :TestNG, <test> :Regression2
test.testng387.TestNG387.testInvocationCounterIsCorrectForMethodW= ithDataProvider()
StackTrace:
=C2=A0java.lang.AssertionError: Arrays do not have the same size:3 !=3D 4 =C2=A0 =C2=A0 =C2=A0 =C2=A0 at test.testng387.TestNG387.testInvocation= CounterIsCorrectForMethodWithDataProvider(Unknown Source)
... Removed 27 stack frames

phase `check' failed after 297.3 seconds
--8<---------------cut here---------------end--------------->8--= -



This actually seems to b= e known upstream, I consider reopening this bug:=C2=A0https://github.com/cbeust/testng/issues/= 582.
It seems they just disabled the failing tests. I guess w= e should do the same.
=C2=A0
--
Ricardo

GPG: BCA6 89B6 3655 3801 C3C6=C2=A0 2150 197A 5888 235F ACAC
https:= //elephly.net





--001a1144a158f826b20565b54103--