Test Report

Build: 20230705.0115 / Release: v2022

Images: Fixed function AMD64, Fixed function ARM64 (rpi64), Fixed function ARM64 (uboot), Fixed function ARMhf (uboot), HMI AMD64, HMI ARMhf (uboot)

Low Medium High Critical a - automated m - manual
Summary
type defined executed pass skip fail incomplete
automated 32 148 140 0 1 7
manual 22 54 28 0 26 0
Results
ID Fixed function ARMhf (uboot) (edit) Fixed function ARM64 (uboot) (edit) Fixed function ARM64 (rpi64) (edit) Fixed function AMD64 (edit) HMI ARMhf (uboot) (edit) HMI AMD64 (edit) Notes
apertis-update-manager-usb-unplug (m) PASS PASS NOT TESTED FAIL N/A N/A
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
apparmor (a) PASS PASS PASS PASS PASS PASS
apparmor-basic-profiles (a) PASS PASS PASS PASS PASS PASS
apparmor-bluez (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
apparmor-bluez-setup (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
apparmor-chaiwala-system (a) PASS PASS PASS PASS PASS PASS
apparmor-dbus (a) PASS PASS PASS PASS PASS PASS
apparmor-gstreamer1-0 (a) N/A N/A N/A N/A PASS PASS
apparmor-ofono (a) N/A N/A N/A N/A PASS PASS
apparmor-pipewire (a) N/A N/A N/A N/A PASS PASS
aum-api (a) PASS PASS PASS PASS N/A N/A
aum-offline-upgrade (a) PASS PASS PASS N/A N/A N/A
aum-offline-upgrade-branch (a) INCOMPLETE INCOMPLETE INCOMPLETE INCOMPLETE N/A N/A
aum-offline-upgrade-collection_id (a) PASS PASS PASS PASS PASS PASS
aum-offline-upgrade-signed (a) PASS PASS PASS PASS N/A N/A
aum-ota-api (a) PASS FAIL PASS INCOMPLETE N/A N/A
aum-ota-auto (a) PASS PASS PASS N/A N/A N/A
aum-ota-out-of-space (a) PASS PASS PASS PASS N/A N/A
aum-ota-rollback-blacklist (a) PASS PASS PASS N/A N/A N/A
aum-ota-signed (a) PASS PASS PASS PASS N/A N/A
aum-out-of-space (a) PASS PASS PASS PASS N/A N/A
aum-power-cut (a) PASS PASS PASS PASS N/A N/A
aum-rollback-blacklist (a) PASS PASS PASS N/A N/A N/A
bluez-file-transfer (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
bluez-phone (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
bluez-setup (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
boot-no-crashes (a) PASS PASS PASS PASS PASS PASS
boot-performance (a) PASS PASS PASS PASS PASS PASS
cgroups-resource-control (a) N/A N/A N/A N/A PASS PASS
connman (a) PASS PASS PASS PASS PASS PASS
connman-new-supplicant (a) PASS PASS PASS PASS PASS PASS
connman-services (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
connman-services-reboot (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
connman-services-switchover (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
disk-rootfs-fsck (a) PASS PASS PASS PASS PASS PASS
glib-gio-fs (a) PASS PASS PASS PASS PASS PASS
gstreamer1-0-decode (a) N/A N/A N/A N/A PASS PASS
gupnp-services (a) N/A N/A N/A N/A PASS PASS
hmi-audio-play-pause (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-audio-policy (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-audio-skip-start-end (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-audio-volume-control (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-flatpak-rhythmbox-app-launch (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-flatpak-rhythmbox-uninstall (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-video-load (m) N/A N/A N/A N/A FAIL FAIL
Imported from v2022pre/20211201.1511/ostree: https://phabricator.apertis.org/T8288
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 Imported from v2022pre/20211201.1511/ostree: https://phabricator.apertis.org/T8288
hmi-video-play-pause (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
image-bootable (m) PASS PASS NOT TESTED FAIL PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
image-gui-start (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
iptables-basic (a) PASS PASS PASS PASS PASS PASS
licensing-summary-availability (m) PASS PASS NOT TESTED FAIL PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
ostree-collection-id (a) PASS PASS PASS PASS PASS PASS
sanity-check (a) PASS PASS PASS PASS PASS PASS
sanity-check-manual (m) PASS PASS NOT TESTED FAIL PASS FAIL
video-animation-on-boot (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388