Build/test passes locally but fails on hydra?

Build/test passes locally but fails on hydra?

[Hartmut Goebel]

Hi,

I wonder how it can happen that a build resp. test passes locally but
fails on hydra. I'd assume on both machines the containers are set up
the same. Any ideas?

Specific it is kdelibs4support-5.49.0 master@{2018-12-28 05:28:26}
<https://hydra.gnu.org/build/3296401> where the test shown below fails
at hydra. The test passes on my local machine.

33/37 Test #33: kglobalsettingstest ......................***Failed   10.14 sec
QStandardPaths: XDG_RUNTIME_DIR not set, defaulting to '/tmp/guix-build-kdelibs4support-5.49.0.drv-0/runtime-nixbld'
********* Start testing of KGlobalSettingsTest *********
Config: Using QtTest library 5.11.2, Qt 5.11.2 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 5.5.0)
PASS   : KGlobalSettingsTest::initTestCase()
FAIL!  : KGlobalSettingsTest::testPaletteChange() 'spy.wait(5000)' returned FALSE. ()
   Loc: [/tmp/guix-build-kdelibs4support-5.49.0.drv-0/kdelibs4support-5.49.0/autotests/kglobalsettingstest.cpp(88)]
FAIL!  : KGlobalSettingsTest::testPaletteChange() Compared values are not the same
   Actual   (palette_spy.size()): 0
   Expected (1)                 : 1
   Loc: [/tmp/guix-build-kdelibs4support-5.49.0.drv-0/kdelibs4support-5.49.0/autotests/kglobalsettingstest.cpp(95)]
FAIL!  : KGlobalSettingsTest::testFontChange() 'spy.wait(5000)' returned FALSE. ()
   Loc: [/tmp/guix-build-kdelibs4support-5.49.0.drv-0/kdelibs4support-5.49.0/autotests/kglobalsettingstest.cpp(88)]
FAIL!  : KGlobalSettingsTest::testFontChange() Compared values are not the same
   Actual   (font_spy.size()): 0
   Expected (1)              : 1
   Loc: [/tmp/guix-build-kdelibs4support-5.49.0.drv-0/kdelibs4support-5.49.0/autotests/kglobalsettingstest.cpp(107)]
PASS   : KGlobalSettingsTest::testSettingsChange()
PASS   : KGlobalSettingsTest::cleanupTestCase()
Totals: 3 passed, 4 failed, 0 skipped, 0 blacklisted, 10090ms
********* Finished testing of KGlobalSettingsTest *********

-- 
Regards
Hartmut Goebel

| Hartmut Goebel          | h.goebel@crazy-compilers.com               |
| www.crazy-compilers.com | compilers which you thought are impossible |

Re: Build/test passes locally but fails on hydra?

[Mark H Weaver]

Hi Hartmut,

Hartmut Goebel <h.goebel@crazy-compilers.com> writes:

> I wonder how it can happen that a build resp. test passes locally but
> fails on hydra. I'd assume on both machines the containers are set up
> the same. Any ideas?

One notable difference is the kernel.  Hydra.gnunet.org, the build slave
that performed the failed build below, and currently the only functional
Intel build slave on Hydra, is running a 3.16.x kernel.  Perhaps QtTest
is depending on functionality that's only available in newer kernels?

> Specific it is kdelibs4support-5.49.0 master@{2018-12-28 05:28:26}
> <https://hydra.gnu.org/build/3296401> where the test shown below fails
> at hydra. The test passes on my local machine.
>
> 33/37 Test #33: kglobalsettingstest ......................***Failed   10.14 sec
> QStandardPaths: XDG_RUNTIME_DIR not set, defaulting to '/tmp/guix-build-kdelibs4support-5.49.0.drv-0/runtime-nixbld'
> ********* Start testing of KGlobalSettingsTest *********
> Config: Using QtTest library 5.11.2, Qt 5.11.2 (x86_64-little_endian-lp64 shared (dynamic) release build; by GCC 5.5.0)
> PASS   : KGlobalSettingsTest::initTestCase()
> FAIL!  : KGlobalSettingsTest::testPaletteChange() 'spy.wait(5000)' returned FALSE. ()

I would start by investigating what 'spy.wait' does, and how it works.

    Regards,
      Mark