Test Report

Build: 20211201.1511 / Release: v2022pre

Images: Fixed function AMD64, Fixed function ARM64 (uboot), Fixed function ARMhf (uboot), HMI AMD64, HMI ARMhf (uboot)

Low Medium High Critical a - automated m - manual

This report omits test cases that have not been executed. Please check the full version of the report page for the complete list of test cases.

Summary

type	defined	executed	pass	skip	fail	incomplete
automated	35	128	104	0	11	13
manual	36	54	48	0	6	0

Results

ID	Fixed function ARMhf (uboot) (edit)	Fixed function ARM64 (uboot) (edit)	Fixed function ARM64 (rpi64) (edit)	Fixed function AMD64 (edit)	HMI ARMhf (uboot) (edit)	HMI ARM64 (rpi64) (edit)	HMI AMD64 (edit)	Notes
apertis-update-manager-ota-api-switch-network (m)	PASS	PASS	NOT TESTED	N/A	N/A	N/A	N/A
apertis-update-manager-ota-check-network-failure (m)	PASS	PASS	NOT TESTED	N/A	N/A	N/A	N/A
apertis-update-manager-ota-rollback (m)	FAIL	FAIL	NOT TESTED	N/A	N/A	N/A	N/A	https://phabricator.apertis.org/T7964 https://phabricator.apertis.org/T7964
apertis-update-manager-rollback (m)	N/A	N/A	N/A	N/A	PASS	NOT TESTED	N/A
apertis-update-manager-usb-unplug (m)	N/A	N/A	N/A	N/A	PASS	NOT TESTED	N/A
apparmor (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
apparmor-basic-profiles (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
apparmor-bluez (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
apparmor-bluez-avrcp-volume (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
apparmor-bluez-setup (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
apparmor-chaiwala-system (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
apparmor-dbus (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
apparmor-gstreamer1-0 (a)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
apparmor-pipewire (a)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
apparmor-tumbler (a)	N/A	N/A	N/A	N/A	FAIL	N/A	FAIL
aum-api (a)	N/A	N/A	N/A	N/A	INCOMPLETE	N/A	N/A
aum-offline-upgrade (a)	N/A	N/A	N/A	N/A	INCOMPLETE	N/A	N/A
aum-offline-upgrade-branch (a)	N/A	N/A	N/A	N/A	INCOMPLETE	N/A	N/A
aum-offline-upgrade-collection_id (a)	N/A	N/A	N/A	N/A	INCOMPLETE	N/A	PASS
aum-offline-upgrade-signed (a)	N/A	N/A	N/A	N/A	INCOMPLETE	N/A	N/A
aum-ota-api (a)	PASS	INCOMPLETE	NOT TESTED	N/A	N/A	N/A	N/A
aum-ota-auto (a)	PASS	INCOMPLETE	NOT TESTED	N/A	N/A	N/A	N/A
aum-ota-out-of-space (a)	INCOMPLETE	PASS	NOT TESTED	N/A	N/A	N/A	N/A
aum-ota-rollback-blacklist (a)	INCOMPLETE	PASS	NOT TESTED	N/A	N/A	N/A	N/A
aum-ota-signed (a)	PASS	PASS	NOT TESTED	N/A	N/A	N/A	N/A
aum-out-of-space (a)	N/A	N/A	N/A	N/A	INCOMPLETE	N/A	N/A
aum-power-cut (a)	N/A	N/A	N/A	N/A	INCOMPLETE	N/A	N/A
aum-rollback-blacklist (a)	N/A	N/A	N/A	N/A	PASS	N/A	N/A
bluez-avrcp-volume (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
bluez-file-transfer (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
bluez-hfp (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
bluez-hfp-call-hold (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
bluez-hfp-incoming-call-notification (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
bluez-phone (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
bluez-setup (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
boot-no-crashes (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
boot-performance (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
cgroups-resource-control (a)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
connman (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
connman-new-supplicant (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
connman-pan-network-access (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
connman-pan-tethering (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
connman-services (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
connman-services-reboot (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
connman-services-switchover (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
dbus-dos-reply-time (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
disk-rootfs-fsck (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
fixedfunction-webserver (m)	PASS	PASS	NOT TESTED	PASS	N/A	N/A	N/A
gettext-i18n (a)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
glib-gio-fs (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
gstreamer1-0-decode (a)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
gupnp-services (a)	N/A	N/A	N/A	N/A	FAIL	N/A	FAIL
hmi-audio-play-pause (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
hmi-audio-policy (m)	N/A	N/A	N/A	N/A	FAIL	N/A	NOT TESTED	https://phabricator.apertis.org/T8288
hmi-audio-skip-start-end (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
hmi-audio-volume-control (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
hmi-flatpak-rhythmbox-app-launch (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
hmi-flatpak-rhythmbox-uninstall (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
hmi-video-load (m)	N/A	N/A	N/A	N/A	FAIL	N/A	NOT TESTED	https://phabricator.apertis.org/T8288
hmi-video-play-pause (m)	N/A	N/A	N/A	N/A	FAIL	N/A	NOT TESTED	https://phabricator.apertis.org/T8288
image-bootable (m)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	NOT TESTED
image-gui-start (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
iptables-basic (a)	FAIL	FAIL	NOT TESTED	PASS	FAIL	N/A	PASS
iptables-nmap (a)	N/A	N/A	N/A	N/A	PASS	N/A	PASS
licensing-summary-availability (m)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	NOT TESTED
ostree-collection-id (a)	PASS	PASS	NOT TESTED	PASS	INCOMPLETE	N/A	PASS
rfkill-toggle (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED
sanity-check (a)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	PASS
sanity-check-manual (m)	PASS	PASS	NOT TESTED	PASS	PASS	N/A	NOT TESTED
secure-boot-imx6 (m)	FAIL	N/A	N/A	N/A	N/A	N/A	N/A	https://phabricator.apertis.org/T8470
video-animation-on-boot (m)	N/A	N/A	N/A	N/A	PASS	N/A	NOT TESTED