Test Report

Build: 20210915.0019 / Release: v2022dev3

Images: BaseSDK AMD64, Fixed function AMD64, Fixed function ARM64 (uboot), Fixed function ARMhf (uboot), HMI AMD64, HMI ARMhf (uboot), SDK AMD64

Low Medium High Critical a - automated m - manual

This report omits test cases that have not been executed. Please check the full version of the report page for the complete list of test cases.

Summary

type	defined	executed	pass	skip	fail	incomplete
automated	43	196	130	1	32	33
manual	47	159	134	0	25	0

Results

ID	Fixed function ARMhf (uboot) (edit)	Fixed function ARM64 (uboot) (edit)	Fixed function ARM64 (rpi64) (edit)	Fixed function AMD64 (edit)	HMI ARMhf (uboot) (edit)	HMI AMD64 (edit)	BaseSDK AMD64 (edit)	SDK AMD64 (edit)	Notes
ade-commands (a)	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	FAIL
agl-compositor (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
apparmor (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
apparmor-basic-profiles (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
apparmor-bluez (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	N/A
apparmor-bluez-avrcp-volume (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	N/A
apparmor-bluez-setup (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	N/A
apparmor-chaiwala-system (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
apparmor-dbus (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
apparmor-functional-demo (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
apparmor-geoclue (a)	FAIL	FAIL	NOT TESTED	FAIL	FAIL	FAIL	FAIL	FAIL
apparmor-gstreamer1-0 (a)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
apparmor-pipewire (a)	N/A	N/A	N/A	N/A	FAIL	FAIL	FAIL	FAIL
apparmor-session-lockdown-no-deny (a)	N/A	N/A	N/A	N/A	FAIL	FAIL	FAIL	FAIL
apparmor-tumbler (a)	N/A	N/A	N/A	N/A	FAIL	FAIL	FAIL	FAIL
apparmor-utils (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
bluez-avrcp-volume (m)	N/A	N/A	N/A	N/A	PASS	NOT TESTED	PASS	PASS
bluez-file-transfer (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
bluez-hfp (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
bluez-hfp-call-hold (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
bluez-hfp-incoming-call-notification (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
bluez-phone (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
bluez-setup (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
boot-no-crashes (a)	PASS	NOT TESTED	NOT TESTED	PASS	PASS	PASS	INCOMPLETE	INCOMPLETE
boot-performance (a)	PASS	NOT TESTED	NOT TESTED	PASS	PASS	PASS	INCOMPLETE	INCOMPLETE
cgroups-resource-control (a)	N/A	N/A	N/A	N/A	PASS	PASS	INCOMPLETE	INCOMPLETE
connman (a)	PASS	NOT TESTED	NOT TESTED	PASS	PASS	PASS	INCOMPLETE	INCOMPLETE
connman-new-supplicant (a)	PASS	NOT TESTED	NOT TESTED	PASS	PASS	PASS	INCOMPLETE	INCOMPLETE
connman-pan-network-access (m)	N/A	N/A	N/A	N/A	FAIL	FAIL	FAIL	FAIL	https://phabricator.apertis.org/T8288 https://phabricator.apertis.org/T8280 https://phabricator.apertis.org/T8288 https://phabricator.apertis.org/T8288
connman-pan-network-access-reconnect (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
connman-pan-tethering (m)	N/A	N/A	N/A	N/A	FAIL	FAIL	FAIL	FAIL	https://phabricator.apertis.org/T8288 https://phabricator.apertis.org/T8280 https://phabricator.apertis.org/T8288 https://phabricator.apertis.org/T8288
connman-pan-tethering-reboot (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
connman-services (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
connman-services-reboot (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
connman-services-switchover (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
connman-usb-tethering (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
dbus-dos-reply-time (a)	FAIL	NOT TESTED	NOT TESTED	FAIL	FAIL	FAIL	INCOMPLETE	INCOMPLETE
dbus-installed-tests (a)	N/A	N/A	N/A	N/A	PASS	PASS	INCOMPLETE	INCOMPLETE
devroot-manual-arm64 (m)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
disk-rootfs-fsck (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
evolution-sync-bluetooth (m)	N/A	N/A	N/A	N/A	FAIL	FAIL	N/A	FAIL	https://phabricator.apertis.org/T7945 https://phabricator.apertis.org/T7945 https://phabricator.apertis.org/T7945
fixedfunction-webserver (m)	PASS	PASS	NOT TESTED	PASS	N/A	N/A	N/A	N/A
flatdeb-demo (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
gettext-i18n (a)	N/A	N/A	N/A	N/A	FAIL	UNKNOWN	INCOMPLETE	INCOMPLETE
glib-gio-fs (a)	PASS	NOT TESTED	NOT TESTED	PASS	PASS	PASS	INCOMPLETE	INCOMPLETE
grilo (a)	N/A	N/A	N/A	N/A	PASS	PASS	INCOMPLETE	INCOMPLETE
gstreamer1-0-decode (a)	N/A	N/A	N/A	N/A	PASS	PASS	INCOMPLETE	INCOMPLETE
gupnp-services (a)	N/A	N/A	N/A	N/A	PASS	PASS	INCOMPLETE	INCOMPLETE
hmi-audio-play-pause (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
hmi-audio-skip-start-end (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
hmi-audio-volume-control (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
hmi-flatpak-rhythmbox-app-launch (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
hmi-flatpak-rhythmbox-uninstall (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
hmi-video-load (m)	N/A	N/A	N/A	N/A	FAIL	PASS	N/A	PASS	https://phabricator.apertis.org/T8288
hmi-video-play-pause (m)	N/A	N/A	N/A	N/A	FAIL	PASS	N/A	PASS	https://phabricator.apertis.org/T8288
image-bootable (m)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
image-gui-start (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
iptables-basic (a)	PASS	NOT TESTED	NOT TESTED	PASS	PASS	PASS	INCOMPLETE	INCOMPLETE
iptables-nmap (a)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
licensing-summary-availability (m)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	N/A	N/A
newport (a)	N/A	N/A	N/A	N/A	INCOMPLETE	INCOMPLETE	N/A	INCOMPLETE
polkit-parsing (a)	N/A	N/A	N/A	N/A	PASS	PASS	INCOMPLETE	INCOMPLETE
rfkill-toggle (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	N/A
robotframework (m)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
sanity-check (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
sanity-check-manual (m)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
sdk-ade-remote-debugging (m)	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T8179 https://phabricator.apertis.org/T8179
sdk-code-analysis-tools-gcov (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-code-analysis-tools-splint (a)	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	PASS
sdk-cross-compilation (a)	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	FAIL
sdk-dbus-tools-bustle (m)	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T5896 https://phabricator.apertis.org/T5896
sdk-dbus-tools-d-feet (m)	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T6024 https://phabricator.apertis.org/T6024
sdk-debos-image-building (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-debug-tools-gdb (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-debug-tools-strace (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-debug-tools-valgrind (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-docker (a)	N/A	N/A	N/A	N/A	N/A	N/A	N/A	PASS
sdk-flatpak-build-helloworld-app (m)	N/A	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	https://phabricator.apertis.org/T8009
sdk-flatpak-demo (a)	N/A	N/A	N/A	N/A	N/A	N/A	N/A	FAIL
sdk-flatpak-helloworld-app (m)	N/A	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	https://phabricator.apertis.org/T8009
sdk-performance-tools-gprof (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-performance-tools-sysprof (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-vb-fullscreen (m)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
traprain (a)	N/A	N/A	N/A	N/A	N/A	N/A	N/A	PASS
tumbler-thumbnailing (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
video-animation-on-boot (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
webkit2gtk-ac-3d-rendering (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
webkit2gtk-gstreamer1.0 (m)	N/A	N/A	N/A	N/A	FAIL	FAIL	FAIL	FAIL	https://phabricator.apertis.org/T8069 https://phabricator.apertis.org/T8069 https://phabricator.apertis.org/T8069 https://phabricator.apertis.org/T8069
webkit2gtk-mt-touch-events (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
x-hw-accelerated (m)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS