Test Report

Build: 20210621.2349 / Release: v2022dev2

Images: Minimal AMD64, Minimal ARM64 (uboot), Minimal ARMhf (uboot), Target AMD64, Target ARMhf (uboot)

Low Medium High Critical a - automated m - manual

This report omits test cases that have not been executed. Please check the full version of the report page for the complete list of test cases.

Summary

type	defined	executed	pass	skip	fail	incomplete
automated	36	133	93	2	30	8
manual	22	51	21	0	30	0

Results

ID	Minimal ARMhf (uboot) (edit)	Minimal ARM64 (uboot) (edit)	Minimal AMD64 (edit)	Target ARMhf (uboot) (edit)	Target AMD64 (edit)	Notes
apertis-update-manager-amd64-rollback (m)	N/A	N/A	FAIL	N/A	N/A	https://phabricator.apertis.org/T7966
apertis-update-manager-ota-api-switch-network (m)	PASS	PASS	N/A	N/A	N/A
apertis-update-manager-ota-check-network-failure (m)	PASS	PASS	N/A	N/A	N/A
apertis-update-manager-ota-rollback (m)	FAIL	FAIL	N/A	N/A	N/A	https://phabricator.apertis.org/T7964 https://phabricator.apertis.org/T7964
apertis-update-manager-rollback (m)	FAIL	FAIL	N/A	N/A	N/A	https://phabricator.apertis.org/T7962 https://phabricator.apertis.org/T7962
apertis-update-manager-usb-unplug (m)	FAIL	FAIL	N/A	N/A	N/A	https://phabricator.apertis.org/T7963 https://phabricator.apertis.org/T7963
apparmor (a)	PASS	PASS	PASS	PASS	PASS
apparmor-basic-profiles (a)	PASS	PASS	PASS	PASS	PASS
apparmor-bluez (m)	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T7938 https://phabricator.apertis.org/T7938
apparmor-bluez-avrcp-volume (m)	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T7939 https://phabricator.apertis.org/T7939
apparmor-bluez-setup (m)	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T7936 https://phabricator.apertis.org/T7936
apparmor-chaiwala-system (a)	PASS	PASS	PASS	PASS	PASS
apparmor-dbus (a)	PASS	PASS	PASS	PASS	PASS
apparmor-gstreamer1-0 (a)	N/A	N/A	N/A	PASS	PASS
apparmor-pulseaudio (a)	N/A	N/A	N/A	FAIL	FAIL
apparmor-tumbler (a)	N/A	N/A	N/A	FAIL	FAIL
aum-api (a)	FAIL	FAIL	N/A	N/A	N/A
aum-offline-upgrade (a)	FAIL	INCOMPLETE	N/A	N/A	N/A
aum-offline-upgrade-branch (a)	PASS	PASS	N/A	NOT TESTED	N/A
aum-offline-upgrade-collection_id (a)	PASS	INCOMPLETE	PASS	PASS	PASS
aum-offline-upgrade-signed (a)	INCOMPLETE	INCOMPLETE	N/A	N/A	N/A
aum-ota-api (a)	FAIL	FAIL	N/A	N/A	N/A
aum-ota-auto (a)	FAIL	FAIL	N/A	N/A	N/A
aum-ota-out-of-space (a)	FAIL	FAIL	N/A	N/A	N/A
aum-ota-rollback-blacklist (a)	FAIL	INCOMPLETE	N/A	N/A	N/A
aum-ota-signed (a)	PASS	INCOMPLETE	N/A	N/A	N/A
aum-out-of-space (a)	INCOMPLETE	PASS	N/A	N/A	N/A
aum-power-cut (a)	FAIL	FAIL	N/A	N/A	N/A
aum-rollback-blacklist (a)	PASS	PASS	N/A	N/A	N/A
bluez-avrcp-volume (m)	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T7939 https://phabricator.apertis.org/T7939
bluez-hfp (m)	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T7940 https://phabricator.apertis.org/T7940
bluez-phone (m)	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T7937 https://phabricator.apertis.org/T7937
bluez-setup (m)	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T7936 https://phabricator.apertis.org/T7936
boot-no-crashes (a)	PASS	PASS	PASS	PASS	PASS
boot-performance (a)	PASS	PASS	PASS	PASS	PASS
canterbury (a)	N/A	N/A	N/A	FAIL	FAIL
cgroups-resource-control (a)	N/A	N/A	N/A	PASS	PASS
connman (a)	FAIL	FAIL	FAIL	FAIL	FAIL
connman-new-supplicant (a)	PASS	PASS	PASS	PASS	PASS
connman-services (m)	N/A	N/A	N/A	PASS	PASS
dbus-dos-reply-time (a)	PASS	PASS	PASS	PASS	PASS
disk-rootfs-fsck (a)	PASS	PASS	PASS	PASS	PASS
gettext-i18n (a)	N/A	N/A	N/A	UNKNOWN	UNKNOWN
glib-gio-fs (a)	PASS	PASS	PASS	PASS	PASS
gstreamer1-0-decode (a)	N/A	N/A	N/A	PASS	PASS
gupnp-services (a)	PASS	PASS	PASS	PASS	PASS
hmi-audio-play-pause (m)	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T8060 https://phabricator.apertis.org/T8028
image-bootable (m)	PASS	PASS	PASS	PASS	PASS
image-gui-start (m)	N/A	N/A	N/A	PASS	PASS
iptables-basic (a)	PASS	PASS	PASS	PASS	PASS
iptables-nmap (a)	N/A	N/A	N/A	PASS	PASS
licensing-summary-availability (m)	PASS	PASS	PASS	PASS	PASS
ostree-collection-id (a)	PASS	INCOMPLETE	PASS	PASS	PASS
rfkill-toggle (m)	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T8053 https://phabricator.apertis.org/T8053
sanity-check (a)	FAIL	FAIL	FAIL	FAIL	FAIL
sanity-check-manual (m)	FAIL	FAIL	FAIL	FAIL	FAIL	https://phabricator.apertis.org/T7899 https://phabricator.apertis.org/T7899 https://phabricator.apertis.org/T7899 https://phabricator.apertis.org/T7899 https://phabricator.apertis.org/T7899
secure-boot-imx6 (m)	PASS	N/A	N/A	N/A	N/A
video-animation-on-boot (m)	N/A	N/A	N/A	PASS	PASS