Test Report

Build: 20210621.2349 / Release: v2022dev2

Images: Minimal AMD64, Minimal ARM64 (uboot), Minimal ARMhf (uboot), Target AMD64, Target ARMhf (uboot)

Low Medium High Critical a - automated m - manual
Summary
type defined executed pass skip fail incomplete
automated 38 133 95 2 27 9
manual 28 51 21 0 30 0
Results
ID Minimal ARMhf (uboot) (edit) Minimal ARM64 (uboot) (edit) Minimal AMD64 (edit) Target ARMhf (uboot) (edit) Target AMD64 (edit) Notes
apertis-update-manager-amd64-rollback (m) N/A N/A FAIL N/A N/A
apertis-update-manager-ota-api-switch-network (m) PASS PASS N/A N/A N/A
apertis-update-manager-ota-check-network-failure (m) PASS PASS N/A N/A N/A
apertis-update-manager-ota-rollback (m) FAIL FAIL N/A N/A N/A
apertis-update-manager-rollback (m) FAIL FAIL N/A N/A N/A
apertis-update-manager-usb-unplug (m) FAIL FAIL N/A N/A N/A
apparmor (a) PASS PASS PASS PASS PASS
apparmor-basic-profiles (a) PASS PASS PASS PASS PASS
apparmor-bluez (m) N/A N/A N/A FAIL FAIL
apparmor-bluez-avrcp-volume (m) N/A N/A N/A FAIL FAIL
apparmor-bluez-setup (m) N/A N/A N/A FAIL FAIL
apparmor-chaiwala-system (a) PASS PASS PASS PASS PASS
apparmor-dbus (a) PASS PASS PASS PASS PASS
apparmor-gstreamer1-0 (a) N/A N/A N/A PASS PASS
apparmor-ofono (m) N/A N/A N/A NOT TESTED NOT TESTED
Ofono dongle not available
Ofono dongle not available
apparmor-pipewire 1.0" (a) N/A N/A N/A NOT TESTED NOT TESTED
apparmor-pulseaudio (a) N/A N/A N/A FAIL FAIL
apparmor-tumbler (a) N/A N/A N/A FAIL FAIL
aum-api (a) FAIL FAIL N/A N/A N/A
aum-offline-upgrade (a) FAIL INCOMPLETE N/A N/A N/A
aum-offline-upgrade-branch (a) PASS PASS N/A NOT TESTED N/A
aum-offline-upgrade-collection_id (a) PASS INCOMPLETE PASS PASS PASS
aum-offline-upgrade-signed (a) INCOMPLETE INCOMPLETE N/A N/A N/A
aum-ota-api (a) FAIL FAIL N/A N/A N/A
aum-ota-auto (a) FAIL FAIL N/A N/A N/A
aum-ota-out-of-space (a) FAIL FAIL N/A N/A N/A
aum-ota-rollback-blacklist (a) FAIL INCOMPLETE N/A N/A N/A
aum-ota-signed (a) PASS INCOMPLETE N/A N/A N/A
aum-out-of-space (a) INCOMPLETE PASS N/A N/A N/A
aum-power-cut (a) FAIL FAIL N/A N/A N/A
aum-rollback-blacklist (a) PASS PASS N/A N/A N/A
bluez-avrcp-volume (m) N/A N/A N/A FAIL FAIL
bluez-hfp (m) N/A N/A N/A FAIL FAIL
bluez-phone (m) N/A N/A N/A FAIL FAIL
bluez-setup (m) N/A N/A N/A FAIL FAIL
boot-no-crashes (a) PASS PASS PASS PASS PASS
boot-performance (a) PASS PASS PASS PASS PASS
canterbury (a) N/A N/A N/A FAIL FAIL
cgroups-resource-control (a) N/A N/A N/A PASS PASS
connman (a) FAIL FAIL FAIL FAIL FAIL
connman-new-supplicant (a) PASS PASS PASS PASS PASS
connman-services (m) N/A N/A N/A PASS PASS
dbus-dos-reply-time (a) PASS PASS PASS PASS PASS
disk-rootfs-fsck (a) PASS PASS PASS PASS PASS
gettext-i18n (a) N/A N/A N/A UNKNOWN UNKNOWN
glib-gio-fs (a) PASS PASS PASS PASS PASS
gstreamer1-0-decode (a) N/A N/A N/A PASS PASS
gupnp-services (a) PASS PASS PASS PASS PASS
hmi-audio-play-pause (m) N/A N/A N/A FAIL FAIL
hmi-video-load (m) N/A N/A N/A NOT TESTED NOT TESTED
NOT tested as there is no app to play video
NOT tested as there is no app to play video
hmi-video-play-pause (m) N/A N/A N/A NOT TESTED NOT TESTED
NOT tested as there is no app to play video
NOT tested as there is no app to play video
image-bootable (m) PASS PASS PASS PASS PASS
image-gui-start (m) N/A N/A N/A PASS PASS
iptables-basic (a) PASS PASS PASS PASS PASS
iptables-nmap (a) N/A N/A N/A PASS PASS
licensing-summary-availability (m) PASS PASS PASS PASS PASS
ofono-sms-receive (m) N/A N/A N/A NOT TESTED NOT TESTED
Ofono dongle not available
Ofono dongle not available
ofono-sms-send (m) N/A N/A N/A NOT TESTED NOT TESTED
Ofono dongle not available
Ofono dongle not available
ostree-collection-id (a) PASS INCOMPLETE PASS PASS PASS
rfkill-toggle (m) N/A N/A N/A FAIL FAIL
robotframework (m) NOT TESTED NOT TESTED NOT TESTED NOT TESTED NOT TESTED
sanity-check (a) FAIL FAIL FAIL FAIL FAIL
sanity-check-manual (m) FAIL FAIL FAIL FAIL FAIL
secure-boot-imx6 (m) PASS N/A N/A N/A N/A
tumbler-thumbnailing (a) N/A N/A N/A N/A N/A
video-animation-on-boot (m) N/A N/A N/A PASS PASS