GNU bug report logs - #43534
qemu-minimal-5.2.0 fails to build during test phase on aarch64

Previous Next

To add a comment to this bug, you must first unarchive it, by sending
a message to control AT debbugs.gnu.org, with unarchive 43534 in the body.
You can then email your comments to 43534 AT debbugs.gnu.org in the normal way.

Toggle the display of automated, internal messages from the tracker.

Message #5 received at submit <at> debbugs.gnu.org (full text, mbox):

From: Stefan <stefan-guix <at> vodafonemail.de>
To: bug-guix <at> gnu.org
Cc: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
Subject: qemu-minimal-5.1.0 fails to build during test phase on aarch64
Date: Sun, 20 Sep 2020 17:43:00 +0200

[Message part 1 (text/plain, inline)]

Hi!

Building qemu-minimal-5.1.0 based on commit 4d82e8e5c5f7e43dbaf5d009697915717d15b155 fails during testing on aarch64, allthough I don’t find a failing test in the log.


Bye

Stefan

[26n2f9ab5fmmfxjdds7qca4gl3ii6l-qemu-minimal-5.1.0.drv.bz2 (application/x-bzip2, attachment)]

Message #8 received at 43534 <at> debbugs.gnu.org (full text, mbox):

From: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
To: Stefan <stefan-guix <at> vodafonemail.de>
Cc: 43534 <at> debbugs.gnu.org
Subject: Re: bug#43534: qemu-minimal-5.1.0 fails to build during test phase
 on aarch64
Date: Sun, 20 Sep 2020 14:12:39 -0400

Hello Stefan!

Stefan <stefan-guix <at> vodafonemail.de> writes:

> Hi!
>
> Building qemu-minimal-5.1.0 based on commit 4d82e8e5c5f7e43dbaf5d009697915717d15b155 fails during testing on aarch64, allthough I don’t find a failing test in the log.

Do you think this is a regression?  I doubt so, because even before
pushing the update to 5.1.0, the test suite of qemu (not qemu-minimal)
was failing on master.

The error in the log you posted appear to be:

ERROR:tests/qtest/arm-cpu-features.c:508:test_query_cpu_model_expansion_kvm: assertion failed: (resp_has_props(_resp))
ERROR arm-cpu-features - Bail out! ERROR:tests/qtest/arm-cpu-features.c:508:test_query_cpu_model_expansion_kvm: assertion failed: (resp_has_props(_resp))

You could try commenting out the "check-qtest-aarch64-y +=
arm-cpu-features" line in tests/qtest/Makefile.include, as was done for
bios-tables-test in commit afeed71ae447ea18f7bc1b0b331e73e995308251.

Maxim

Message #11 received at 43534 <at> debbugs.gnu.org (full text, mbox):

From: Stefan <stefan-guix <at> vodafonemail.de>
To: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
Cc: 43534 <at> debbugs.gnu.org
Subject: Re: bug#43534: qemu-minimal-5.1.0 fails to build during test phase on
 aarch64
Date: Sun, 20 Sep 2020 23:36:36 +0200

Hi Maxim!

> Do you think this is a regression?  I doubt so, because even before
> pushing the update to 5.1.0, the test suite of qemu (not qemu-minimal)
> was failing on master.

I don’t know. Until today I always got a substitute. There was at least a successful build in late August.

http://ci.guix.gnu.org/search?query=system%3Aaarch64-linux+spec%3Aguix-master+qemu-minimal-5

> The error in the log you posted appear to be:
> 
> ERROR:tests/qtest/arm-cpu-features.c:508:test_query_cpu_model_expansion_kvm: assertion failed: (resp_has_props(_resp))
> ERROR arm-cpu-features - Bail out! ERROR:tests/qtest/arm-cpu-features.c:508:test_query_cpu_model_expansion_kvm: assertion failed: (resp_has_props(_resp))

I only searched for “FAIL”. :-)

The same test was passing in August.

http://ci.guix.gnu.org/log/391wav2qcfd1wkss2ssv408zhbgcxhq7-qemu-minimal-5.0.0

MALLOC_PERTURB_=${MALLOC_PERTURB_:-$(( ${RANDOM:-0} % 255 + 1))}  QTEST_QEMU_BINARY=arm-softmmu/qemu-system-arm QTEST_QEMU_IMG=qemu-img tests/qtest/arm-cpu-features -m=quick -k --tap < /dev/null | ./scripts/tap-driver.pl --test-name="arm-cpu-features" 
PASS 1 arm-cpu-features /arm/arm/query-cpu-model-expansion
…
MALLOC_PERTURB_=${MALLOC_PERTURB_:-$(( ${RANDOM:-0} % 255 + 1))}  QTEST_QEMU_BINARY=aarch64-softmmu/qemu-system-aarch64 QTEST_QEMU_IMG=qemu-img tests/qtest/arm-cpu-features -m=quick -k --tap < /dev/null | ./scripts/tap-driver.pl --test-name="arm-cpu-features" 
PASS 1 arm-cpu-features /aarch64/arm/query-cpu-model-expansion
PASS 2 arm-cpu-features /aarch64/arm/kvm/query-cpu-model-expansion
PASS 3 arm-cpu-features /aarch64/arm/kvm/query-cpu-model-expansion/sve-off
PASS 4 arm-cpu-features /aarch64/arm/max/query-cpu-model-expansion/sve-max-vq-8
PASS 5 arm-cpu-features /aarch64/arm/max/query-cpu-model-expansion/sve-off


Bye

Stefan

Message #14 received at 43534 <at> debbugs.gnu.org (full text, mbox):

From: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
To: Stefan <stefan-guix <at> vodafonemail.de>
Cc: 43534 <at> debbugs.gnu.org
Subject: Re: bug#43534: qemu-minimal-5.1.0 fails to build during test phase
 on aarch64
Date: Sat, 26 Sep 2020 02:05:11 -0400

Hello,

Stefan <stefan-guix <at> vodafonemail.de> writes:

> Hi Maxim!
>
>> Do you think this is a regression?  I doubt so, because even before
>> pushing the update to 5.1.0, the test suite of qemu (not qemu-minimal)
>> was failing on master.
>
> I don’t know. Until today I always got a substitute. There was at least a successful build in late August.
>
> http://ci.guix.gnu.org/search?query=system%3Aaarch64-linux+spec%3Aguix-master+qemu-minimal-5
>
>> The error in the log you posted appear to be:
>> 
>> ERROR:tests/qtest/arm-cpu-features.c:508:test_query_cpu_model_expansion_kvm: assertion failed: (resp_has_props(_resp))
>> ERROR arm-cpu-features - Bail out! ERROR:tests/qtest/arm-cpu-features.c:508:test_query_cpu_model_expansion_kvm: assertion failed: (resp_has_props(_resp))
>
> I only searched for “FAIL”. :-)
>
> The same test was passing in August.
>
> http://ci.guix.gnu.org/log/391wav2qcfd1wkss2ssv408zhbgcxhq7-qemu-minimal-5.0.0

OK!

> MALLOC_PERTURB_=${MALLOC_PERTURB_:-$(( ${RANDOM:-0} % 255 + 1))}
> QTEST_QEMU_BINARY=arm-softmmu/qemu-system-arm QTEST_QEMU_IMG=qemu-img
> tests/qtest/arm-cpu-features -m=quick -k --tap < /dev/null |
> ./scripts/tap-driver.pl --test-name="arm-cpu-features"
> PASS 1 arm-cpu-features /arm/arm/query-cpu-model-expansion
> …
> MALLOC_PERTURB_=${MALLOC_PERTURB_:-$(( ${RANDOM:-0} % 255 + 1))}
> QTEST_QEMU_BINARY=aarch64-softmmu/qemu-system-aarch64
> QTEST_QEMU_IMG=qemu-img tests/qtest/arm-cpu-features -m=quick -k --tap
> < /dev/null | ./scripts/tap-driver.pl --test-name="arm-cpu-features"
> PASS 1 arm-cpu-features /aarch64/arm/query-cpu-model-expansion
> PASS 2 arm-cpu-features /aarch64/arm/kvm/query-cpu-model-expansion
> PASS 3 arm-cpu-features /aarch64/arm/kvm/query-cpu-model-expansion/sve-off
> PASS 4 arm-cpu-features /aarch64/arm/max/query-cpu-model-expansion/sve-max-vq-8
> PASS 5 arm-cpu-features /aarch64/arm/max/query-cpu-model-expansion/sve-off

Is this reproducible on your side?

Here, I couldn't reproduce this exact failure, but I'm getting another
one trying to build with --linux-aarch64:

ERROR:tests/qtest/qos-test.c:186:subprocess_run_one_test: child process (/arm/virt/virtio-mmio/virtio-bus/virtio-net-device/virtio-net/virtio-net-tests/vhost-user/migrate/subprocess [22034]) failed unexpectedly
ERROR qos-test - Bail out! ERROR:tests/qtest/qos-test.c:186:subprocess_run_one_test: child process (/arm/virt/virtio-mmio/virtio-bus/virtio-net-device/virtio-net/virtio-net-tests/vhost-user/migrate/subprocess [22034]) failed unexpectedly
qemu: uncaught target signal 6 (Aborted) - core dumped
make: *** [/tmp/guix-build-qemu-minimal-5.1.0.drv-0/qemu-5.1.0/tests/Makefile.include:650: check-qtest-arm] Error 

I'll go back to the previous version and see if I can reproduce or not.

Thanks,

Maxim

Message #17 received at 43534 <at> debbugs.gnu.org (full text, mbox):

From: Stefan <stefan-guix <at> vodafonemail.de>
To: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
Cc: 43534 <at> debbugs.gnu.org
Subject: Re: bug#43534: qemu-minimal-5.1.0 fails to build during test phase on
 aarch64
Date: Sat, 26 Sep 2020 13:14:04 +0200

Hi Maxim!

> Is this reproducible on your side?

Retrying my previous command it found a substitute this time.

stefan <at> guix ~/development/guix$ sudo -E -b ./pre-inst-env guix system reconfigure -L /home/stefan/guix/ /home/stefan/guix-system.scm &> nohup.out && tail -f nohup.out
Passwort: 
guix system: warning: cannot determine provenance for current system
substitute: Liste der Substitute von „https://ci.guix.gnu.org“ wird aktualisiert … 100.0%
The following derivations will be built:
   /gnu/store/rgpllviv84cfhhd3bnnkmjpa1ndph8wh-package-collection-grub-efi-raspberrypi-firmware-u-boot-rpi-3-2.04.drv
   /gnu/store/12balhwfp2lzqyvy246j9zgh0zif16pn-grub-efi-2.04.drv

18,7 MB will be downloaded
downloading from https://ci.guix.gnu.org/nar/lzip/6da0v0yb0ikw348y8rm431nnd947mla7-qemu-minimal-5.1.0 ...
 qemu-minimal-5.1.0  17.8MiB          533KiB/s 00:34 [##################] 100.0%

building /gnu/store/12balhwfp2lzqyvy246j9zgh0zif16pn-grub-efi-2.04.drv…


Is it possible, that the test is somehow picky about the exact type of processor in use?


By the way, I also tried this command:

guix build --rounds=2 qemu-minimal --no-substitutes

But (probably because I got a substitute) it did not compile anything – I’m a bit clueless how to compile it again.


Bye

Stefan

Message #20 received at 43534 <at> debbugs.gnu.org (full text, mbox):

From: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
To: Stefan <stefan-guix <at> vodafonemail.de>
Cc: 43534 <at> debbugs.gnu.org
Subject: Re: bug#43534: qemu-minimal-5.1.0 fails to build during test phase
 on aarch64
Date: Sat, 26 Sep 2020 20:31:04 -0400

Hi Stefan,

Stefan <stefan-guix <at> vodafonemail.de> writes:

> Hi Maxim!
>
>> Is this reproducible on your side?
>
> Retrying my previous command it found a substitute this time.

[...]

> By the way, I also tried this command:
>
> guix build --rounds=2 qemu-minimal --no-substitutes

Possibly, or it could be a non-deterministic failure.

> But (probably because I got a substitute) it did not compile anything – I’m a bit clueless how to compile it again.

The following command:

--8<---------------cut here---------------start------------->8---
$ guix build --no-grafts --check qemu-minimal
--8<---------------cut here---------------end--------------->8---

Should do it.

Thanks!

Maxim

Message #23 received at 43534 <at> debbugs.gnu.org (full text, mbox):

From: Stefan <stefan-guix <at> vodafonemail.de>
To: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
Cc: 43534 <at> debbugs.gnu.org
Subject: Re: bug#43534: qemu-minimal-5.1.0 fails to build during test phase on
 aarch64
Date: Sun, 27 Sep 2020 14:38:10 +0200

[Message part 1 (text/plain, inline)]

Hi Maxim!

> The following command:
> 
> --8<---------------cut here---------------start------------->8---
> $ guix build --no-grafts --check qemu-minimal
> --8<---------------cut here---------------end--------------->8---
> 
> Should do it.

Yes, thanks, that was the trick.

It seems to be reproducible:

ERROR:tests/qtest/arm-cpu-features.c:508:test_query_cpu_model_expansion_kvm: assertion failed: (resp_has_props(_resp))
ERROR arm-cpu-features - Bail out! ERROR:tests/qtest/arm-cpu-features.c:508:test_query_cpu_model_expansion_kvm: assertion failed: (resp_has_props(_resp))


Bye

Stefan

[26n2f9ab5fmmfxjdds7qca4gl3ii6l-qemu-minimal-5.1.0.drv.bz2 (application/x-bzip2, attachment)]

Message #28 received at 43534 <at> debbugs.gnu.org (full text, mbox):

From: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
To: Stefan <stefan-guix <at> vodafonemail.de>
Cc: 43534 <at> debbugs.gnu.org
Subject: Re: bug#43534: qemu-minimal-5.1.0 fails to build during test phase
 on aarch64
Date: Mon, 15 Mar 2021 21:36:59 -0400

Hi Stefan,

Stefan <stefan-guix <at> vodafonemail.de> writes:

> Hi Maxim!
>
>> The following command:
>> 
>> --8<---------------cut here---------------start------------->8---
>> $ guix build --no-grafts --check qemu-minimal
>> --8<---------------cut here---------------end--------------->8---
>> 
>> Should do it.
>
> Yes, thanks, that was the trick.
>
> It seems to be reproducible:
>
> ERROR:tests/qtest/arm-cpu-features.c:508:test_query_cpu_model_expansion_kvm:
> assertion failed: (resp_has_props(_resp))
> ERROR arm-cpu-features - Bail out!
> ERROR:tests/qtest/arm-cpu-features.c:508:test_query_cpu_model_expansion_kvm:
> assertion failed: (resp_has_props(_resp))

Would you be able to try to reproduce, now that our QEMU package has
been bumped to version 5.2.0?

Thank you,

Maxim

Message #35 received at 43534-done <at> debbugs.gnu.org (full text, mbox):

From: Maxim Cournoyer <maxim.cournoyer <at> gmail.com>
To: Stefan <stefan-guix <at> vodafonemail.de>
Cc: 43500-done <at> debbugs.gnu.org, 43534-done <at> debbugs.gnu.org
Subject: Re: bug#43500: qemu-minimal test suite crashes on armhf-linux,
 aarch64-linux
Date: Fri, 28 May 2021 14:08:01 -0400

Hello,

Maxim Cournoyer <maxim.cournoyer <at> gmail.com> writes:

> Hi Stefan,
>
> Stefan <stefan-guix <at> vodafonemail.de> writes:
>
>> Hi Maxim!
>>
>>> The following command:
>>> 
>>> --8<---------------cut here---------------start------------->8---
>>> $ guix build --no-grafts --check qemu-minimal
>>> --8<---------------cut here---------------end--------------->8---
>>> 
>>> Should do it.
>>
>> Yes, thanks, that was the trick.
>>
>> It seems to be reproducible:
>>
>> ERROR:tests/qtest/arm-cpu-features.c:508:test_query_cpu_model_expansion_kvm:
>> assertion failed: (resp_has_props(_resp))
>> ERROR arm-cpu-features - Bail out!
>> ERROR:tests/qtest/arm-cpu-features.c:508:test_query_cpu_model_expansion_kvm:
>> assertion failed: (resp_has_props(_resp))
>
> Would you be able to try to reproduce, now that our QEMU package has
> been bumped to version 5.2.0?

QEMU 5.2.0 minimal was built twice without any problem on real hardware (the Softiron
ARMv8 machines we have available -- overdrive1 and dover).

Closing.  Feel free to reopen if you still encounter issues.

Thanks,

Maxim

Previous Next

GNU bug tracking system
Copyright (C) 1999 Darren O. Benham, 1997,2003 nCipher Corporation Ltd, 1994-97 Ian Jackson.