Test Report

Build: 20230621.1604 / Release: v2024dev2

Images: Fixed function AMD64, Fixed function ARM64 (rpi64), Fixed function ARM64 (uboot), Fixed function ARMhf (uboot), HMI AMD64, HMI ARMhf (uboot)

Low Medium High Critical a - automated m - manual
Summary
type defined executed pass skip fail incomplete
automated 34 154 140 0 11 3
manual 30 63 32 0 31 0
Results
ID Fixed function ARMhf (uboot) (edit) Fixed function ARM64 (uboot) (edit) Fixed function ARM64 (rpi64) (edit) Fixed function AMD64 (edit) HMI ARMhf (uboot) (edit) HMI AMD64 (edit) Notes
apertis-update-manager-ota-api-switch-network (m) NOT TESTED NOT TESTED FAIL NOT TESTED N/A N/A
apertis-update-manager-ota-check-network-failure (m) NOT TESTED NOT TESTED FAIL NOT TESTED N/A N/A
apertis-update-manager-ota-rollback (m) NOT TESTED NOT TESTED FAIL NOT TESTED N/A N/A
apertis-update-manager-rollback (m) NOT TESTED NOT TESTED FAIL NOT TESTED N/A N/A
apertis-update-manager-usb-unplug (m) PASS NOT TESTED PASS FAIL N/A N/A
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
apparmor (a) PASS PASS PASS PASS PASS PASS
apparmor-basic-profiles (a) PASS PASS PASS PASS PASS PASS
apparmor-bluez (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
apparmor-bluez-setup (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
apparmor-chaiwala-system (a) PASS PASS PASS PASS PASS PASS
apparmor-dbus (a) PASS PASS PASS PASS PASS PASS
apparmor-gstreamer1-0 (a) N/A N/A N/A N/A PASS PASS
apparmor-ofono (a) N/A N/A N/A N/A PASS PASS
apparmor-pipewire (a) N/A N/A N/A N/A PASS PASS
aum-api (a) PASS PASS PASS PASS N/A N/A
aum-offline-upgrade (a) PASS PASS PASS PASS N/A N/A
aum-offline-upgrade-branch (a) FAIL FAIL INCOMPLETE INCOMPLETE N/A N/A
aum-offline-upgrade-collection_id (a) PASS PASS PASS PASS N/A N/A
aum-offline-upgrade-signed (a) PASS PASS PASS PASS N/A N/A
aum-ota-api (a) PASS PASS PASS PASS N/A N/A
aum-ota-auto (a) PASS PASS PASS FAIL N/A N/A
aum-ota-out-of-space (a) PASS PASS PASS INCOMPLETE N/A N/A
aum-ota-rollback-blacklist (a) FAIL FAIL FAIL N/A N/A N/A
aum-ota-signed (a) PASS FAIL FAIL INCOMPLETE N/A N/A
aum-out-of-space (a) PASS PASS PASS PASS N/A N/A
aum-power-cut (a) PASS PASS PASS PASS N/A N/A
aum-rollback-blacklist (a) FAIL FAIL FAIL N/A N/A N/A
bluez-file-transfer (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
bluez-phone (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
bluez-setup (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
boot-no-crashes (a) PASS PASS PASS PASS PASS PASS
boot-performance (a) PASS PASS PASS PASS PASS PASS
cgroups-resource-control (a) N/A N/A N/A N/A PASS PASS
connman (a) PASS PASS PASS PASS PASS PASS
connman-new-supplicant (a) PASS PASS PASS PASS PASS PASS
connman-services (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
connman-services-reboot (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
connman-services-switchover (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
disk-rootfs-fsck (a) PASS PASS PASS PASS PASS PASS
glib-gio-fs (a) PASS PASS PASS PASS PASS PASS
gstreamer1-0-decode (a) N/A N/A N/A N/A PASS PASS
gupnp-services (a) N/A N/A N/A N/A PASS PASS
hmi-audio-play-pause (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-audio-policy (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-audio-skip-start-end (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-audio-volume-control (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-flatpak-rhythmbox-app-launch (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-flatpak-rhythmbox-uninstall (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-switch-graphical-applications (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-video-load (m) N/A N/A N/A N/A FAIL FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-video-play-pause (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
image-bootable (m) PASS NOT TESTED PASS FAIL PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
image-gui-start (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
iptables-basic (a) PASS PASS PASS PASS PASS PASS
iptables-nmap (a) N/A N/A N/A N/A INCOMPLETE INCOMPLETE
licensing-summary-availability (m) PASS NOT TESTED PASS FAIL PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
openssl (a) PASS PASS PASS PASS PASS PASS
ostree-collection-id (a) PASS PASS PASS PASS PASS PASS
sanity-check (a) PASS PASS PASS PASS PASS PASS
sanity-check-manual (m) PASS NOT TESTED PASS FAIL PASS FAIL
video-animation-on-boot (m) N/A N/A N/A N/A PASS FAIL
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
wifi-wpa2-psk-accesspoint-setup (m) N/A N/A N/A N/A PASS N/A
wifi-wpa3-sae-accesspoint-setup (m) N/A N/A N/A N/A PASS N/A
wifi-wpa3-transition-mode-accesspoint-setup (m) N/A N/A N/A N/A PASS N/A