GNU bug report logs - #30015
WebKitGTK nondeterministic build failures

Previous Next

Package: guix;

Reported by: Mark H Weaver <mhw <at> netris.org>

Date: Sun, 7 Jan 2018 21:25:02 UTC

Severity: normal

Done: Leo Famulari <leo <at> famulari.name>

Bug is archived. No further changes may be made.

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 30015 in the body.
You can then email your comments to 30015 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

View this report as an mbox folder, status mbox, maintainer mbox


Report forwarded to bug-guix <at> gnu.org:
bug#30015; Package guix. (Sun, 07 Jan 2018 21:25:02 GMT) Full text and rfc822 format available.

Acknowledgement sent to Mark H Weaver <mhw <at> netris.org>:
New bug report received and forwarded. Copy sent to bug-guix <at> gnu.org. (Sun, 07 Jan 2018 21:25:02 GMT) Full text and rfc822 format available.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Mark H Weaver <mhw <at> netris.org>
To: bug-guix <at> gnu.org
Subject: WebKitGTK nondeterministic build failures
Date: Sun, 07 Jan 2018 16:23:31 -0500
I recently wrote on guix-devel:

> I just followed this up with a Spectre mitigation for WebKitGTK+
> backported from upstream WebKit:
>
>   https://git.savannah.gnu.org/cgit/guix.git/commit/?id=56804398a94bea941183ae4ed29d2a9f82069a6f

Unfortunately, this seems to have introduced non-deterministic build
failures on Hydra.  On the first attempt, WebKitGTK+ failed to build on
both x86_64 and i686.  On the second attempt, it succeeded on x86_64 but
failed again on i686.  Hydra is currently working on the third build
attempt on i686.

I find it very unlikely that this problem is related to the content of
the patch itself.  My best guess is that it's caused by the fact that
our 'patch-and-repack' mechanism, which generates the patched tarball,
resets all the timestamps to 0, whereas previously we built the upstream
tarball directly with non-zero timestamps.

I guess that the build system contains a race condition that is much
more likely to occur when the timestamps are 0.  It did happen once in
December 2015 on i686, but the other three failures happened today.

I suppose the issue could be solved by disabling parallelism in the
build, but that would be a shame given that WebKitGTK+ already takes a
very long time to build: almost 5 hours on my X200 and about 2 hours on
hydra.gnunet.org.

It's also inconvenient that the build log is so large (around 70 MB)
that Hydra's web interface refuses to display it.

The failure is always the same:

--8<---------------cut here---------------start------------->8---
Traceback (most recent call last):
  File "/tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py", line 28, in <module>
    import webkit.messages
EOFError: EOF read where object expected
--8<---------------cut here---------------end--------------->8---

although the specific target being built when this error occurs varies.
The targets that I've seen fail are:

1. make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:745: DerivedSources/WebKit2/WebRTCSocketMessageReceiver.cpp] Error 1
2. make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:722: DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp] Error 1
3. make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:457: DerivedSources/WebKit2/WebFullScreenManagerProxyMessageReceiver.cpp] Error 1
4. GNUmakefile:82826: recipe for target 'DerivedSources/WebKit2/CustomProtocolManagerProxyMessages.h' failed

That last one (4) occurred with webkitgtk-2.4.9 on i686-linux in
December 2015.

Here's a longer tail of the failed build log from today on x86_64:

--8<---------------cut here---------------start------------->8---
[ 83%] Generating ../../DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/WebResourceLoadStatisticsStore.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessageReceiver.cpp
[ 83%] Generating ../../DerivedSources/WebKit2/WebAutomationSessionMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebAutomationSessionMessages.h
[ 83%] Generating ../../DerivedSources/WebKit2/DownloadProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/DownloadProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/WebResourceLoadStatisticsStore.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Automation/WebAutomationSession.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Downloads/DownloadProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/DownloadProxyMessageReceiver.cpp
[ 83%] Generating ../../DerivedSources/WebKit2/NetworkProcessProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/NetworkProcessProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Network/NetworkProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessProxyMessageReceiver.cpp
[ 83%] Generating ../../DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Network/CustomProtocols/LegacyCustomProtocolManagerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Network/NetworkProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Downloads/DownloadProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/DownloadProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Automation/WebAutomationSession.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionMessages.h
[ 83%] Generating ../../DerivedSources/WebKit2/PluginProcessProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/PluginProcessProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Plugins/PluginProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/PluginProcessProxyMessageReceiver.cpp
[ 84%] Generating ../../DerivedSources/WebKit2/StorageProcessProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/StorageProcessProxyMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/WebUserContentControllerProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebUserContentControllerProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Storage/StorageProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageProcessProxyMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/UserContent/WebUserContentControllerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebUserContentControllerProxyMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Network/CustomProtocols/LegacyCustomProtocolManagerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Plugins/PluginProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/PluginProcessProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Storage/StorageProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageProcessProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/UserContent/WebUserContentControllerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebUserContentControllerProxyMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/StorageManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/StorageManagerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/WebStorage/StorageManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageManagerMessageReceiver.cpp
[ 84%] Generating ../../DerivedSources/WebKit2/WebProcessMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebProcessMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/WebProcess.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebProcessMessageReceiver.cpp
[ 84%] Generating ../../DerivedSources/WebKit2/WebAutomationSessionProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebAutomationSessionProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Automation/WebAutomationSessionProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionProxyMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/WebStorage/StorageManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageManagerMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/WebCookieManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebCookieManagerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Cookies/WebCookieManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebCookieManagerMessageReceiver.cpp
[ 84%] Generating ../../DerivedSources/WebKit2/WebIDBConnectionToServerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebIDBConnectionToServerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/WebProcess.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebProcessMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Automation/WebAutomationSessionProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionProxyMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Cookies/WebCookieManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebCookieManagerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Databases/IndexedDB/WebIDBConnectionToServer.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebIDBConnectionToServerMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Databases/IndexedDB/WebIDBConnectionToServer.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebIDBConnectionToServerMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/WebFullScreenManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebFullScreenManagerMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/WebGeolocationManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebGeolocationManagerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/FullScreen/WebFullScreenManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebFullScreenManagerMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Geolocation/WebGeolocationManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebGeolocationManagerMessageReceiver.cpp
[ 84%] Generating ../../DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebRTCMonitorMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/WebRTCResolverMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebRTCResolverMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/webrtc/WebRTCMonitor.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/webrtc/WebRTCResolver.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCResolverMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/FullScreen/WebFullScreenManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebFullScreenManagerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Geolocation/WebGeolocationManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebGeolocationManagerMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/webrtc/WebRTCMonitor.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCMonitorMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/webrtc/WebRTCResolver.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCResolverMessages.h
[ 84%] Generating ../../DerivedSources/WebKit2/WebRTCSocketMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebRTCSocketMessages.h
Traceback (most recent call last):
  File "/tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py", line 28, in <module>
    import webkit.messages
EOFError: EOF read where object expected
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/webrtc/WebRTCSocket.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCSocketMessageReceiver.cpp
make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:722: DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp] Error 1
make[2]: *** Deleting file 'DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp'
make[2]: *** Waiting for unfinished jobs....
[ 84%] Generating ../../DerivedSources/WebKit2/NetworkProcessConnectionMessageReceiver.cpp, ../../DerivedSources/WebKit2/NetworkProcessConnectionMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/NetworkProcessConnection.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessConnectionMessageReceiver.cpp
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/webrtc/WebRTCSocket.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCSocketMessages.h
cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/NetworkProcessConnection.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessConnectionMessages.h
make[2]: Leaving directory '/tmp/guix-build-webkitgtk-2.18.4.drv-0/build'
make[1]: *** [CMakeFiles/Makefile2:1581: Source/WebKit/CMakeFiles/WebKit2.dir/all] Error 2
make[1]: Leaving directory '/tmp/guix-build-webkitgtk-2.18.4.drv-0/build'
make: *** [Makefile:153: all] Error 2
phase `build' failed after 5645.4 seconds
builder for `/gnu/store/hp17k74lrlbm62gg5321dqf2r99m5d3q-webkitgtk-2.18.4.drv' failed with exit code 1
@ build-failed /gnu/store/hp17k74lrlbm62gg5321dqf2r99m5d3q-webkitgtk-2.18.4.drv - 1 builder for `/gnu/store/hp17k74lrlbm62gg5321dqf2r99m5d3q-webkitgtk-2.18.4.drv' failed with exit code 1
--8<---------------cut here---------------end--------------->8---

On my X200, the build succeeded on my first try.

Would someone like to investigate further?

       Mark




Information forwarded to bug-guix <at> gnu.org:
bug#30015; Package guix. (Tue, 09 Jan 2018 20:15:02 GMT) Full text and rfc822 format available.

Message #8 received at 30015 <at> debbugs.gnu.org (full text, mbox):

From: Efraim Flashner <efraim <at> flashner.co.il>
To: Mark H Weaver <mhw <at> netris.org>
Cc: 30015 <at> debbugs.gnu.org
Subject: Re: bug#30015: WebKitGTK nondeterministic build failures
Date: Tue, 9 Jan 2018 22:14:29 +0200
[Message part 1 (text/plain, inline)]
On Sun, Jan 07, 2018 at 04:23:31PM -0500, Mark H Weaver wrote:
> I recently wrote on guix-devel:
> 
> > I just followed this up with a Spectre mitigation for WebKitGTK+
> > backported from upstream WebKit:
> >
> >   https://git.savannah.gnu.org/cgit/guix.git/commit/?id=56804398a94bea941183ae4ed29d2a9f82069a6f
> 
> Unfortunately, this seems to have introduced non-deterministic build
> failures on Hydra.  On the first attempt, WebKitGTK+ failed to build on
> both x86_64 and i686.  On the second attempt, it succeeded on x86_64 but
> failed again on i686.  Hydra is currently working on the third build
> attempt on i686.
> 
> I find it very unlikely that this problem is related to the content of
> the patch itself.  My best guess is that it's caused by the fact that
> our 'patch-and-repack' mechanism, which generates the patched tarball,
> resets all the timestamps to 0, whereas previously we built the upstream
> tarball directly with non-zero timestamps.
> 
> I guess that the build system contains a race condition that is much
> more likely to occur when the timestamps are 0.  It did happen once in
> December 2015 on i686, but the other three failures happened today.
> 
> I suppose the issue could be solved by disabling parallelism in the
> build, but that would be a shame given that WebKitGTK+ already takes a
> very long time to build: almost 5 hours on my X200 and about 2 hours on
> hydra.gnunet.org.
> 
> It's also inconvenient that the build log is so large (around 70 MB)
> that Hydra's web interface refuses to display it.
> 
> The failure is always the same:
> 
> --8<---------------cut here---------------start------------->8---
> Traceback (most recent call last):
>   File "/tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py", line 28, in <module>
>     import webkit.messages
> EOFError: EOF read where object expected
> --8<---------------cut here---------------end--------------->8---
> 
> although the specific target being built when this error occurs varies.
> The targets that I've seen fail are:
> 
> 1. make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:745: DerivedSources/WebKit2/WebRTCSocketMessageReceiver.cpp] Error 1
> 2. make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:722: DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp] Error 1
> 3. make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:457: DerivedSources/WebKit2/WebFullScreenManagerProxyMessageReceiver.cpp] Error 1
> 4. GNUmakefile:82826: recipe for target 'DerivedSources/WebKit2/CustomProtocolManagerProxyMessages.h' failed
> 
> That last one (4) occurred with webkitgtk-2.4.9 on i686-linux in
> December 2015.
> 
> Here's a longer tail of the failed build log from today on x86_64:
> 
> --8<---------------cut here---------------start------------->8---
> [ 83%] Generating ../../DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/WebResourceLoadStatisticsStore.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessageReceiver.cpp
> [ 83%] Generating ../../DerivedSources/WebKit2/WebAutomationSessionMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebAutomationSessionMessages.h
> [ 83%] Generating ../../DerivedSources/WebKit2/DownloadProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/DownloadProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/WebResourceLoadStatisticsStore.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebResourceLoadStatisticsStoreMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Automation/WebAutomationSession.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Downloads/DownloadProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/DownloadProxyMessageReceiver.cpp
> [ 83%] Generating ../../DerivedSources/WebKit2/NetworkProcessProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/NetworkProcessProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Network/NetworkProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessProxyMessageReceiver.cpp
> [ 83%] Generating ../../DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Network/CustomProtocols/LegacyCustomProtocolManagerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Network/NetworkProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Downloads/DownloadProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/DownloadProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Automation/WebAutomationSession.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionMessages.h
> [ 83%] Generating ../../DerivedSources/WebKit2/PluginProcessProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/PluginProcessProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Plugins/PluginProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/PluginProcessProxyMessageReceiver.cpp
> [ 84%] Generating ../../DerivedSources/WebKit2/StorageProcessProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/StorageProcessProxyMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/WebUserContentControllerProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebUserContentControllerProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/Storage/StorageProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageProcessProxyMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/UserContent/WebUserContentControllerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebUserContentControllerProxyMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Network/CustomProtocols/LegacyCustomProtocolManagerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/LegacyCustomProtocolManagerProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Plugins/PluginProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/PluginProcessProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/Storage/StorageProcessProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageProcessProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/UserContent/WebUserContentControllerProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebUserContentControllerProxyMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/StorageManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/StorageManagerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py UIProcess/WebStorage/StorageManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageManagerMessageReceiver.cpp
> [ 84%] Generating ../../DerivedSources/WebKit2/WebProcessMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebProcessMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/WebProcess.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebProcessMessageReceiver.cpp
> [ 84%] Generating ../../DerivedSources/WebKit2/WebAutomationSessionProxyMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebAutomationSessionProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Automation/WebAutomationSessionProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionProxyMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py UIProcess/WebStorage/StorageManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/StorageManagerMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/WebCookieManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebCookieManagerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Cookies/WebCookieManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebCookieManagerMessageReceiver.cpp
> [ 84%] Generating ../../DerivedSources/WebKit2/WebIDBConnectionToServerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebIDBConnectionToServerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/WebProcess.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebProcessMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Automation/WebAutomationSessionProxy.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebAutomationSessionProxyMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Cookies/WebCookieManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebCookieManagerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Databases/IndexedDB/WebIDBConnectionToServer.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebIDBConnectionToServerMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Databases/IndexedDB/WebIDBConnectionToServer.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebIDBConnectionToServerMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/WebFullScreenManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebFullScreenManagerMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/WebGeolocationManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebGeolocationManagerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/FullScreen/WebFullScreenManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebFullScreenManagerMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Geolocation/WebGeolocationManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebGeolocationManagerMessageReceiver.cpp
> [ 84%] Generating ../../DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebRTCMonitorMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/WebRTCResolverMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebRTCResolverMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/webrtc/WebRTCMonitor.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/webrtc/WebRTCResolver.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCResolverMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/FullScreen/WebFullScreenManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebFullScreenManagerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Geolocation/WebGeolocationManager.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebGeolocationManagerMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/webrtc/WebRTCMonitor.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCMonitorMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/webrtc/WebRTCResolver.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCResolverMessages.h
> [ 84%] Generating ../../DerivedSources/WebKit2/WebRTCSocketMessageReceiver.cpp, ../../DerivedSources/WebKit2/WebRTCSocketMessages.h
> Traceback (most recent call last):
>   File "/tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py", line 28, in <module>
>     import webkit.messages
> EOFError: EOF read where object expected
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/webrtc/WebRTCSocket.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCSocketMessageReceiver.cpp
> make[2]: *** [Source/WebKit/CMakeFiles/WebKit2.dir/build.make:722: DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp] Error 1
> make[2]: *** Deleting file 'DerivedSources/WebKit2/WebRTCMonitorMessageReceiver.cpp'
> make[2]: *** Waiting for unfinished jobs....
> [ 84%] Generating ../../DerivedSources/WebKit2/NetworkProcessConnectionMessageReceiver.cpp, ../../DerivedSources/WebKit2/NetworkProcessConnectionMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-message-receiver.py WebProcess/Network/NetworkProcessConnection.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessConnectionMessageReceiver.cpp
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/webrtc/WebRTCSocket.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/WebRTCSocketMessages.h
> cd /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit && /gnu/store/zlbbayv8rv6z7gnhz435gjq8pzjm06v6-python-2.7.13/bin/python2.7 /tmp/guix-build-webkitgtk-2.18.4.drv-0/webkitgtk-2.18.4/Source/WebKit/Scripts/generate-messages-header.py WebProcess/Network/NetworkProcessConnection.messages.in > /tmp/guix-build-webkitgtk-2.18.4.drv-0/build/DerivedSources/WebKit2/NetworkProcessConnectionMessages.h
> make[2]: Leaving directory '/tmp/guix-build-webkitgtk-2.18.4.drv-0/build'
> make[1]: *** [CMakeFiles/Makefile2:1581: Source/WebKit/CMakeFiles/WebKit2.dir/all] Error 2
> make[1]: Leaving directory '/tmp/guix-build-webkitgtk-2.18.4.drv-0/build'
> make: *** [Makefile:153: all] Error 2
> phase `build' failed after 5645.4 seconds
> builder for `/gnu/store/hp17k74lrlbm62gg5321dqf2r99m5d3q-webkitgtk-2.18.4.drv' failed with exit code 1
> @ build-failed /gnu/store/hp17k74lrlbm62gg5321dqf2r99m5d3q-webkitgtk-2.18.4.drv - 1 builder for `/gnu/store/hp17k74lrlbm62gg5321dqf2r99m5d3q-webkitgtk-2.18.4.drv' failed with exit code 1
> --8<---------------cut here---------------end--------------->8---
> 
> On my X200, the build succeeded on my first try.
> 
> Would someone like to investigate further?
> 
>        Mark
> 

Not sure where to trim this to make it shorter so I've just left the
whole message. I had to build webkitgtk twice on aarch64 for it to build
sucessfully, also with the EOF error.

-- 
Efraim Flashner   <efraim <at> flashner.co.il>   אפרים פלשנר
GPG key = A28B F40C 3E55 1372 662D  14F7 41AA E7DC CA3D 8351
Confidentiality cannot be guaranteed on emails sent or received unencrypted
[signature.asc (application/pgp-signature, inline)]

Information forwarded to bug-guix <at> gnu.org:
bug#30015; Package guix. (Wed, 10 Jan 2018 05:51:01 GMT) Full text and rfc822 format available.

Message #11 received at 30015 <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: Mark H Weaver <mhw <at> netris.org>
Cc: 30015 <at> debbugs.gnu.org
Subject: Re: bug#30015: WebKitGTK nondeterministic build failures
Date: Wed, 10 Jan 2018 00:49:30 -0500
[Message part 1 (text/plain, inline)]
On Sun, Jan 07, 2018 at 04:23:31PM -0500, Mark H Weaver wrote:
> My best guess is that it's caused by the fact that
> our 'patch-and-repack' mechanism, which generates the patched tarball,
> resets all the timestamps to 0, whereas previously we built the upstream
> tarball directly with non-zero timestamps.
> 
> I guess that the build system contains a race condition that is much
> more likely to occur when the timestamps are 0.  It did happen once in
> December 2015 on i686, but the other three failures happened today.

It seems the builds eventually succeeded on x86_64 and i686.

It's a hacky workaround but, if we still need to patch the source the
next time we build WebKitGTK+, we could apply the patch in a build phase
after unpacking the WebKitGTK+ source. That should preserve most of the
source timestamps.

This idea assumes that the handful of changed timestamps would not also
expose the race.
[signature.asc (application/pgp-signature, inline)]

Information forwarded to bug-guix <at> gnu.org:
bug#30015; Package guix. (Sat, 09 Feb 2019 22:35:01 GMT) Full text and rfc822 format available.

Message #14 received at 30015 <at> debbugs.gnu.org (full text, mbox):

From: Ludovic Courtès <ludo <at> gnu.org>
To: 34062 <at> debbugs.gnu.org, 30015 <at> debbugs.gnu.org
Subject: Re: bug#34062: qtwebkit-5.212.0-alpha2 parallel build failure
Date: Sat, 09 Feb 2019 23:34:30 +0100
Or sometimes like this:

--8<---------------cut here---------------start------------->8---
[ 81%] Generating ../../DerivedSources/WebKit2/AuthenticationManagerMessageReceiver.cpp, ../../DerivedSources/WebKit2/AuthenticationManagerMessages.h
cd /tmp/guix-build-qtwebkit-5.212.0-alpha2.drv-0/qtwebkit-5.212.0-alpha2/Source/WebKit2 && /gnu/store/g87hamjyipk1j6dfq5pjfzfnfb64spbv-python2-2.7.15/bin/python2.7 /tmp/guix-build-qtwebkit-5.212.0-alpha2.drv-0/qtwebkit-5.212.0-alpha2/Source/WebKit2/Scripts/generate-message-receiver.py Shared/Authentication/AuthenticationManager.messages.in > /tmp/guix-build-qtwebkit-5.212.0-alpha2.drv-0/build/DerivedSources/WebKit2/AuthenticationManagerMessageReceiver.cpp
Traceback (most recent call last):
  File "/tmp/guix-build-qtwebkit-5.212.0-alpha2.drv-0/qtwebkit-5.212.0-alpha2/Source/WebKit2/Scripts/generate-message-receiver.py", line 28, in <module>
    import webkit.messages
EOFError: EOF read where object expected
cd /tmp/guix-build-qtwebkit-5.212.0-alpha2.drv-0/qtwebkit-5.212.0-alpha2/Source/WebKit2 && /gnu/store/g87hamjyipk1j6dfq5pjfzfnfb64spbv-python2-2.7.15/bin/python2.7 /tmp/guix-build-qtwebkit-5.212.0-alpha2.drv-0/qtwebkit-5.212.0-alpha2/Source/WebKit2/Scripts/generate-messages-header.py NetworkProcess/NetworkResourceLoader.messages.in > /tmp/guix-build-qtwebkit-5.212.0-alpha2.drv-0/build/DerivedSources/WebKit2/NetworkResourceLoaderMessages.h
make[2]: *** [Source/WebKit2/CMakeFiles/WebKit2.dir/build.make:194: DerivedSources/WebKit2/ChildProcessMessageReceiver.cpp] Error 1
--8<---------------cut here---------------end--------------->8---

See
<https://ci.guix.info/log/901miwpk9srhwq3646v6bm7zni3qda8m-qtwebkit-5.212.0-alpha2>.

Interestingly this was first reported here for WebkitGTK:
<https://issues.guix.info/issue/30015>.

Did the issue vanish for WebkitGTK?  Qtwebkit is older so it may well
miss an upstream fix.

Thanks,
Ludo’.




Reply sent to Leo Famulari <leo <at> famulari.name>:
You have taken responsibility. (Sun, 22 Mar 2020 20:41:01 GMT) Full text and rfc822 format available.

Notification sent to Mark H Weaver <mhw <at> netris.org>:
bug acknowledged by developer. (Sun, 22 Mar 2020 20:41:02 GMT) Full text and rfc822 format available.

Message #19 received at 30015-done <at> debbugs.gnu.org (full text, mbox):

From: Leo Famulari <leo <at> famulari.name>
To: Mark H Weaver <mhw <at> netris.org>
Cc: 30015-done <at> debbugs.gnu.org
Subject: Re: bug#30015: WebKitGTK nondeterministic build failures
Date: Sun, 22 Mar 2020 16:40:08 -0400
I'm closing since we aren't currently patching webkitgtk and 2 years
have passed.




bug archived. Request was from Debbugs Internal Request <help-debbugs <at> gnu.org> to internal_control <at> debbugs.gnu.org. (Mon, 20 Apr 2020 11:24:05 GMT) Full text and rfc822 format available.

This bug report was last modified 3 years and 343 days ago.

Previous Next


GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.