unofficial mirror of bug-guix@gnu.org 
 help / color / mirror / code / Atom feed
* bug#30015: WebKitGTK nondeterministic build failures
       [not found]     ` <87incedvgv.fsf@netris.org>
@ 2018-01-07 21:23       ` Mark H Weaver
  2018-01-09 20:14         ` Efraim Flashner
  2018-01-10  5:49         ` Leo Famulari
  0 siblings, 2 replies; 4+ messages in thread
From: Mark H Weaver @ 2018-01-07 21:23 UTC (permalink / raw)
  To: 30015

I recently wrote on guix-devel:

> I just followed this up with a Spectre mitigation for WebKitGTK+
> backported from upstream WebKit:
>
>   https://git.savannah.gnu.org/cgit/guix.git/commit/?id=56804398a94bea941183ae4ed29d2a9f82069a6f

Unfortunately, this seems to have introduced non-deterministic build
failures on Hydra.  On the first attempt, WebKitGTK+ failed to build on
both x86_64 and i686.  On the second attempt, it succeeded on x86_64 but
failed again on i686.  Hydra is currently working on the third build
attempt on i686.

I find it very unlikely that this problem is related to the content of
the patch itself.  My best guess is that it's caused by the fact that
our 'patch-and-repack' mechanism, which generates the patched tarball,
resets all the timestamps to 0, whereas previously we built the upstream
tarball directly with non-zero timestamps.

I guess that the build system contains a race condition that is much
more likely to occur when the timestamps are 0.  It did happen once in
December 2015 on i686, but the other three failures happened today.

I suppose the issue could be solved by disabling parallelism in the
build, but that would be a shame given that WebKitGTK+ already takes a
very long time to build: almost 5 hours on my X200 and about 2 hours on
hydra.gnunet.org.

It's also inconvenient that the build log is so large (around 70 MB)
that Hydra's web interface refuses to display it.

The failure is always the same:

--8<---------------cut here---------------start------------->8---
Traceback (most recent call last):
  File "/tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py", line 28, in <module>
    import webkit.messages
EOFError: EOF read where object expected
--8<---------------cut here---------------end--------------->8---

although the specific target being built when this error occurs varies.
The targets that I've seen fail are:

1. make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:745: DerivedSources/WebKit2/WebRTCSocketMessageReceiver.cpp] Error 1
2. make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:722: DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp] Error 1
3. make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:457: DerivedSources/WebKit2/WebFullScreenManagerProxyMessageReceiver.cpp] Error 1
4. GNUmakefile:82826: recipe for target 'DerivedSources/WebKit2/CustomProtocolManagerProxyMessages.h' failed

That last one (4) occurred with webkitgtk-2.4.9 on i686-linux in
December 2015.

Here's a longer tail of the failed build log from today on x86_64:

--8<---------------cut here---------------start------------->8---
[ 83%] Generating ../../DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/WebResourceLoadStatisticsStore.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessageReceiver.cpp
[ 83%] Generating ../../DerivedSources/WebKit2/WebAutomationSessionMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebAutomationSessionMessages.h
[ 83%] Generating ../../DerivedSources/WebKit2/DownloadProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/DownloadProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/WebResourceLoadStatisticsStore.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Automation/WebAutomationSession.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Downloads/DownloadProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/DownloadProxyMessageReceiver.cpp
[ 83%] Generating ../../DerivedSources/WebKit2/NetworkProcessProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/NetworkProcessProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Network/NetworkProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessProxyMessageReceiver.cpp
[ 83%] Generating ../../DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Network/CustomProtocols/LegacyCustomProtocolManagerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Network/NetworkProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Downloads/DownloadProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/DownloadProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Automation/WebAutomationSession.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionMessages.h
[ 83%] Generating ../../DerivedSources/WebKit2/PluginProcessProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/PluginProcessProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Plugins/PluginProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/PluginProcessProxyMessageReceiver.cpp
[ 84%] Generating ../../DerivedSources/WebKit2/StorageProcessProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/StorageProcessProxyMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/WebUserContentControllerProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebUserContentControllerProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Storage/StorageProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageProcessProxyMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/UserContent/WebUserContentControllerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebUserContentControllerProxyMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Network/CustomProtocols/LegacyCustomProtocolManagerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Plugins/PluginProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/PluginProcessProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Storage/StorageProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageProcessProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/UserContent/WebUserContentControllerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebUserContentControllerProxyMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/StorageManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/StorageManagerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/WebStorage/StorageManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageManagerMessageReceiver.cpp
[ 84%] Generating ../../DerivedSources/WebKit2/WebProcessMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebProcessMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/WebProcess.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebProcessMessageReceiver.cpp
[ 84%] Generating ../../DerivedSources/WebKit2/WebAutomationSessionProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebAutomationSessionProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Automation/WebAutomationSessionProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionProxyMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/WebStorage/StorageManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageManagerMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/WebCookieManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebCookieManagerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Cookies/WebCookieManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebCookieManagerMessageReceiver.cpp
[ 84%] Generating ../../DerivedSources/WebKit2/WebIDBConnectionToServerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebIDBConnectionToServerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/WebProcess.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebProcessMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Automation/WebAutomationSessionProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Cookies/WebCookieManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebCookieManagerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Databases/IndexedDB/WebIDBConnectionToServer.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebIDBConnectionToServerMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Databases/IndexedDB/WebIDBConnectionToServer.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebIDBConnectionToServerMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/WebFullScreenManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebFullScreenManagerMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/WebGeolocationManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebGeolocationManagerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/FullScreen/WebFullScreenManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebFullScreenManagerMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Geolocation/WebGeolocationManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebGeolocationManagerMessageReceiver.cpp
[ 84%] Generating ../../DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebRTCMonitorMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/WebRTCResolverMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebRTCResolverMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/webrtc/WebRTCMonitor.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/webrtc/WebRTCResolver.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCResolverMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/FullScreen/WebFullScreenManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebFullScreenManagerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Geolocation/WebGeolocationManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebGeolocationManagerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/webrtc/WebRTCMonitor.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCMonitorMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/webrtc/WebRTCResolver.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCResolverMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/WebRTCSocketMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebRTCSocketMessages.h
Traceback (most recent call last):
  File "/tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py", line 28, in <module>
    import webkit.messages
EOFError: EOF read where object expected
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/webrtc/WebRTCSocket.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCSocketMessageReceiver.cpp
make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:722: DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp] Error 1
make[2]: *** Deleting file 'DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp'
make[2]: *** Waiting for unfinished jobs....
[ 84%] Generating ../../DerivedSources/WebKit2/NetworkProcessConnectionMessageReceiver.cpp, ../../DerivedSources/WebKit2/NetworkProcessConnectionMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/NetworkProcessConnection.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessConnectionMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/webrtc/WebRTCSocket.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCSocketMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/NetworkProcessConnection.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessConnectionMessages.h
make[2]: Leaving directory '/tmp/guix-build-webkitgtk-2.18.4.drv-0/build'
make[1]: *** [CMakeFiles/Makefile2:1581: Source/WebKit/CMakeFiles/WebKit2.dir/all] Error 2
make[1]: Leaving directory '/tmp/guix-build-webkitgtk-2.18.4.drv-0/build'
make: *** [Makefile:153: all] Error 2
phase `build' failed after 5645.4 seconds
builder for `/gnu/store/hp17k74lrlbm62gg5321dqf2r99m5d3q-webkitgtk-2.18.4.drv' failed with exit code 1
@ build-failed /gnu/store/hp17k74lrlbm62gg5321dqf2r99m5d3q-webkitgtk-2.18.4.drv - 1 builder for `/gnu/store/hp17k74lrlbm62gg5321dqf2r99m5d3q-webkitgtk-2.18.4.drv' failed with exit code 1
--8<---------------cut here---------------end--------------->8---

On my X200, the build succeeded on my first try.

Would someone like to investigate further?

       Mark

^ permalink raw reply	[flat|nested] 4+ messages in thread

* bug#30015: WebKitGTK nondeterministic build failures
  2018-01-07 21:23       ` bug#30015: WebKitGTK nondeterministic build failures Mark H Weaver
@ 2018-01-09 20:14         ` Efraim Flashner
  2018-01-10  5:49         ` Leo Famulari
  1 sibling, 0 replies; 4+ messages in thread
From: Efraim Flashner @ 2018-01-09 20:14 UTC (permalink / raw)
  To: Mark H Weaver; +Cc: 30015

[-- Attachment #1: Type: text/plain, Size: 23348 bytes --]

On Sun, Jan 07, 2018 at 04:23:31PM -0500, Mark H Weaver wrote:
> I recently wrote on guix-devel:
> 
> > I just followed this up with a Spectre mitigation for WebKitGTK+
> > backported from upstream WebKit:
> >
> >   https://git.savannah.gnu.org/cgit/guix.git/commit/?id=56804398a94bea941183ae4ed29d2a9f82069a6f
> 
> Unfortunately, this seems to have introduced non-deterministic build
> failures on Hydra.  On the first attempt, WebKitGTK+ failed to build on
> both x86_64 and i686.  On the second attempt, it succeeded on x86_64 but
> failed again on i686.  Hydra is currently working on the third build
> attempt on i686.
> 
> I find it very unlikely that this problem is related to the content of
> the patch itself.  My best guess is that it's caused by the fact that
> our 'patch-and-repack' mechanism, which generates the patched tarball,
> resets all the timestamps to 0, whereas previously we built the upstream
> tarball directly with non-zero timestamps.
> 
> I guess that the build system contains a race condition that is much
> more likely to occur when the timestamps are 0.  It did happen once in
> December 2015 on i686, but the other three failures happened today.
> 
> I suppose the issue could be solved by disabling parallelism in the
> build, but that would be a shame given that WebKitGTK+ already takes a
> very long time to build: almost 5 hours on my X200 and about 2 hours on
> hydra.gnunet.org.
> 
> It's also inconvenient that the build log is so large (around 70 MB)
> that Hydra's web interface refuses to display it.
> 
> The failure is always the same:
> 
> --8<---------------cut here---------------start------------->8---
> Traceback (most recent call last):
>   File "/tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py", line 28, in <module>
>     import webkit.messages
> EOFError: EOF read where object expected
> --8<---------------cut here---------------end--------------->8---
> 
> although the specific target being built when this error occurs varies.
> The targets that I've seen fail are:
> 
> 1. make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:745: DerivedSources/WebKit2/WebRTCSocketMessageReceiver.cpp] Error 1
> 2. make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:722: DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp] Error 1
> 3. make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:457: DerivedSources/WebKit2/WebFullScreenManagerProxyMessageReceiver.cpp] Error 1
> 4. GNUmakefile:82826: recipe for target 'DerivedSources/WebKit2/CustomProtocolManagerProxyMessages.h' failed
> 
> That last one (4) occurred with webkitgtk-2.4.9 on i686-linux in
> December 2015.
> 
> Here's a longer tail of the failed build log from today on x86_64:
> 
> --8<---------------cut here---------------start------------->8---
> [ 83%] Generating ../../DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/WebResourceLoadStatisticsStore.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessageReceiver.cpp
> [ 83%] Generating ../../DerivedSources/WebKit2/WebAutomationSessionMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebAutomationSessionMessages.h
> [ 83%] Generating ../../DerivedSources/WebKit2/DownloadProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/DownloadProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/WebResourceLoadStatisticsStore.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Automation/WebAutomationSession.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Downloads/DownloadProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/DownloadProxyMessageReceiver.cpp
> [ 83%] Generating ../../DerivedSources/WebKit2/NetworkProcessProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/NetworkProcessProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Network/NetworkProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessProxyMessageReceiver.cpp
> [ 83%] Generating ../../DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Network/CustomProtocols/LegacyCustomProtocolManagerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Network/NetworkProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Downloads/DownloadProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/DownloadProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Automation/WebAutomationSession.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionMessages.h
> [ 83%] Generating ../../DerivedSources/WebKit2/PluginProcessProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/PluginProcessProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Plugins/PluginProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/PluginProcessProxyMessageReceiver.cpp
> [ 84%] Generating ../../DerivedSources/WebKit2/StorageProcessProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/StorageProcessProxyMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/WebUserContentControllerProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebUserContentControllerProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Storage/StorageProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageProcessProxyMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/UserContent/WebUserContentControllerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebUserContentControllerProxyMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Network/CustomProtocols/LegacyCustomProtocolManagerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Plugins/PluginProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/PluginProcessProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Storage/StorageProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageProcessProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/UserContent/WebUserContentControllerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebUserContentControllerProxyMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/StorageManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/StorageManagerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/WebStorage/StorageManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageManagerMessageReceiver.cpp
> [ 84%] Generating ../../DerivedSources/WebKit2/WebProcessMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebProcessMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/WebProcess.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebProcessMessageReceiver.cpp
> [ 84%] Generating ../../DerivedSources/WebKit2/WebAutomationSessionProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebAutomationSessionProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Automation/WebAutomationSessionProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionProxyMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/WebStorage/StorageManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageManagerMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/WebCookieManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebCookieManagerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Cookies/WebCookieManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebCookieManagerMessageReceiver.cpp
> [ 84%] Generating ../../DerivedSources/WebKit2/WebIDBConnectionToServerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebIDBConnectionToServerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/WebProcess.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebProcessMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Automation/WebAutomationSessionProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Cookies/WebCookieManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebCookieManagerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Databases/IndexedDB/WebIDBConnectionToServer.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebIDBConnectionToServerMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Databases/IndexedDB/WebIDBConnectionToServer.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebIDBConnectionToServerMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/WebFullScreenManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebFullScreenManagerMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/WebGeolocationManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebGeolocationManagerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/FullScreen/WebFullScreenManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebFullScreenManagerMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Geolocation/WebGeolocationManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebGeolocationManagerMessageReceiver.cpp
> [ 84%] Generating ../../DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebRTCMonitorMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/WebRTCResolverMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebRTCResolverMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/webrtc/WebRTCMonitor.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/webrtc/WebRTCResolver.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCResolverMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/FullScreen/WebFullScreenManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebFullScreenManagerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Geolocation/WebGeolocationManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebGeolocationManagerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/webrtc/WebRTCMonitor.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCMonitorMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/webrtc/WebRTCResolver.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCResolverMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/WebRTCSocketMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebRTCSocketMessages.h
> Traceback (most recent call last):
>   File "/tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py", line 28, in <module>
>     import webkit.messages
> EOFError: EOF read where object expected
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/webrtc/WebRTCSocket.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCSocketMessageReceiver.cpp
> make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:722: DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp] Error 1
> make[2]: *** Deleting file 'DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp'
> make[2]: *** Waiting for unfinished jobs....
> [ 84%] Generating ../../DerivedSources/WebKit2/NetworkProcessConnectionMessageReceiver.cpp, ../../DerivedSources/WebKit2/NetworkProcessConnectionMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/NetworkProcessConnection.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessConnectionMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/webrtc/WebRTCSocket.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCSocketMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/NetworkProcessConnection.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessConnectionMessages.h
> make[2]: Leaving directory '/tmp/guix-build-webkitgtk-2.18.4.drv-0/build'
> make[1]: *** [CMakeFiles/Makefile2:1581: Source/WebKit/CMakeFiles/WebKit2.dir/all] Error 2
> make[1]: Leaving directory '/tmp/guix-build-webkitgtk-2.18.4.drv-0/build'
> make: *** [Makefile:153: all] Error 2
> phase `build' failed after 5645.4 seconds
> builder for `/gnu/store/hp17k74lrlbm62gg5321dqf2r99m5d3q-webkitgtk-2.18.4.drv' failed with exit code 1
> @ build-failed /gnu/store/hp17k74lrlbm62gg5321dqf2r99m5d3q-webkitgtk-2.18.4.drv - 1 builder for `/gnu/store/hp17k74lrlbm62gg5321dqf2r99m5d3q-webkitgtk-2.18.4.drv' failed with exit code 1
> --8<---------------cut here---------------end--------------->8---
> 
> On my X200, the build succeeded on my first try.
> 
> Would someone like to investigate further?
> 
>        Mark
> 

Not sure where to trim this to make it shorter so I've just left the
whole message. I had to build webkitgtk twice on aarch64 for it to build
sucessfully, also with the EOF error.

-- 
Efraim Flashner   <efraim@flashner.co.il>   אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

^ permalink raw reply	[flat|nested] 4+ messages in thread

* bug#30015: WebKitGTK nondeterministic build failures
  2018-01-07 21:23       ` bug#30015: WebKitGTK nondeterministic build failures Mark H Weaver
  2018-01-09 20:14         ` Efraim Flashner
@ 2018-01-10  5:49         ` Leo Famulari
  2020-03-22 20:40           ` Leo Famulari
  1 sibling, 1 reply; 4+ messages in thread
From: Leo Famulari @ 2018-01-10  5:49 UTC (permalink / raw)
  To: Mark H Weaver; +Cc: 30015

[-- Attachment #1: Type: text/plain, Size: 932 bytes --]

On Sun, Jan 07, 2018 at 04:23:31PM -0500, Mark H Weaver wrote:
> My best guess is that it's caused by the fact that
> our 'patch-and-repack' mechanism, which generates the patched tarball,
> resets all the timestamps to 0, whereas previously we built the upstream
> tarball directly with non-zero timestamps.
> 
> I guess that the build system contains a race condition that is much
> more likely to occur when the timestamps are 0.  It did happen once in
> December 2015 on i686, but the other three failures happened today.

It seems the builds eventually succeeded on x86_64 and i686.

It's a hacky workaround but, if we still need to patch the source the
next time we build WebKitGTK+, we could apply the patch in a build phase
after unpacking the WebKitGTK+ source. That should preserve most of the
source timestamps.

This idea assumes that the handful of changed timestamps would not also
expose the race.

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 833 bytes --]

^ permalink raw reply	[flat|nested] 4+ messages in thread

* bug#30015: WebKitGTK nondeterministic build failures
  2018-01-10  5:49         ` Leo Famulari
@ 2020-03-22 20:40           ` Leo Famulari
  0 siblings, 0 replies; 4+ messages in thread
From: Leo Famulari @ 2020-03-22 20:40 UTC (permalink / raw)
  To: Mark H Weaver; +Cc: 30015-done

I'm closing since we aren't currently patching webkitgtk and 2 years
have passed.

^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2020-03-22 20:41 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
     [not found] <874lnzcedp.fsf@gmail.com>
     [not found] ` <20180106174358.GA28436@jasmine.lan>
     [not found]   ` <87vageeobi.fsf@netris.org>
     [not found]     ` <87incedvgv.fsf@netris.org>
2018-01-07 21:23       ` bug#30015: WebKitGTK nondeterministic build failures Mark H Weaver
2018-01-09 20:14         ` Efraim Flashner
2018-01-10  5:49         ` Leo Famulari
2020-03-22 20:40           ` Leo Famulari

Code repositories for project(s) associated with this public inbox

	https://git.savannah.gnu.org/cgit/guix.git

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for read-only IMAP folder(s) and NNTP newsgroup(s).