Test Report

Build: 20211201.1511 / Release: v2022pre

Images: BaseSDK AMD64, Fixed function AMD64, Fixed function ARM64 (uboot), Fixed function ARMhf (uboot), HMI AMD64, HMI ARMhf (uboot), SDK AMD64

Low Medium High Critical a - automated m - manual

This report omits test cases that have not been executed. Please check the full version of the report page for the complete list of test cases.

Summary

type	defined	executed	pass	skip	fail	incomplete
automated	43	201	171	0	25	5
manual	50	168	141	0	27	0

Results

ID	Fixed function ARMhf (uboot) (edit)	Fixed function ARM64 (uboot) (edit)	Fixed function ARM64 (rpi64) (edit)	Fixed function AMD64 (edit)	HMI ARMhf (uboot) (edit)	HMI AMD64 (edit)	BaseSDK AMD64 (edit)	SDK AMD64 (edit)	Notes
ade-commands (a)	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	FAIL
agl-compositor (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
apparmor (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
apparmor-basic-profiles (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
apparmor-bluez (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	N/A
apparmor-bluez-avrcp-volume (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	N/A
apparmor-bluez-setup (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	N/A
apparmor-chaiwala-system (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
apparmor-dbus (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
apparmor-functional-demo (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
apparmor-gstreamer1-0 (a)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
apparmor-pipewire (a)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	FAIL
apparmor-session-lockdown-no-deny (a)	N/A	N/A	N/A	N/A	FAIL	FAIL	FAIL	FAIL
apparmor-tumbler (a)	N/A	N/A	N/A	N/A	FAIL	FAIL	FAIL	FAIL
apparmor-utils (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
bluez-avrcp-volume (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
bluez-file-transfer (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
bluez-hfp (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
bluez-hfp-call-hold (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
bluez-hfp-incoming-call-notification (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
bluez-phone (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
bluez-setup (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
boot-no-crashes (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
boot-performance (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
cgroups-resource-control (a)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
connman (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
connman-new-supplicant (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
connman-pan-network-access (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
connman-pan-network-access-reconnect (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
connman-pan-tethering (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
connman-pan-tethering-reboot (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
connman-services (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
connman-services-reboot (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
connman-services-switchover (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
connman-usb-tethering (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
dbus-dos-reply-time (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
dbus-installed-tests (a)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
devroot-manual-arm64 (m)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
disk-rootfs-fsck (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
evolution-sync-bluetooth (m)	N/A	N/A	N/A	N/A	FAIL	FAIL	N/A	FAIL	https://phabricator.apertis.org/T7945 https://phabricator.apertis.org/T7945 https://phabricator.apertis.org/T7945
fixedfunction-webserver (m)	PASS	PASS	NOT TESTED	PASS	N/A	N/A	N/A	N/A
flatdeb-demo (m)	N/A	N/A	N/A	N/A	FAIL	FAIL	N/A	FAIL	https://phabricator.apertis.org/T8492 https://phabricator.apertis.org/T8492 https://phabricator.apertis.org/T8492
flatdeb-example-app (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
gettext-i18n (a)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
glib-gio-fs (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	FAIL	FAIL
grilo (a)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
gstreamer1-0-decode (a)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
gupnp-services (a)	N/A	N/A	N/A	N/A	FAIL	FAIL	FAIL	FAIL
hmi-audio-play-pause (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
hmi-audio-policy (m)	N/A	N/A	N/A	N/A	FAIL	FAIL	N/A	FAIL	https://phabricator.apertis.org/T8288 https://phabricator.apertis.org/T8363 https://phabricator.apertis.org/T8363
hmi-audio-skip-start-end (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
hmi-audio-volume-control (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
hmi-flatpak-rhythmbox-app-launch (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
hmi-flatpak-rhythmbox-uninstall (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	PASS
hmi-video-load (m)	N/A	N/A	N/A	N/A	FAIL	FAIL	N/A	FAIL	https://phabricator.apertis.org/T8288 https://phabricator.apertis.org/T8363 https://phabricator.apertis.org/T8363
hmi-video-play-pause (m)	N/A	N/A	N/A	N/A	FAIL	FAIL	N/A	FAIL	https://phabricator.apertis.org/T8288 https://phabricator.apertis.org/T8363 https://phabricator.apertis.org/T8363
image-bootable (m)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
image-gui-start (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
iptables-basic (a)	FAIL	FAIL	NOT TESTED	PASS	FAIL	PASS	FAIL	FAIL
iptables-nmap (a)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
licensing-summary-availability (m)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	N/A	N/A
newport (a)	N/A	N/A	N/A	N/A	INCOMPLETE	INCOMPLETE	N/A	INCOMPLETE
polkit-parsing (a)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
rfkill-toggle (m)	N/A	N/A	N/A	N/A	PASS	PASS	N/A	N/A
robotframework (m)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sanity-check (a)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
sanity-check-manual (m)	PASS	PASS	NOT TESTED	PASS	PASS	PASS	PASS	PASS
sdk-ade-remote-debugging (m)	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T8179 https://phabricator.apertis.org/T8179
sdk-code-analysis-tools-gcov (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-code-analysis-tools-splint (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	FAIL
sdk-cross-compilation (a)	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	FAIL
sdk-dbus-tools-bustle (m)	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T5896 https://phabricator.apertis.org/T5896
sdk-dbus-tools-d-feet (m)	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	FAIL	https://phabricator.apertis.org/T6024 https://phabricator.apertis.org/T6024
sdk-debos-image-building (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-debug-tools-gdb (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-debug-tools-strace (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-debug-tools-valgrind (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-docker (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-flatpak-build-helloworld-app (m)	N/A	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	https://phabricator.apertis.org/T8009
sdk-flatpak-demo (a)	N/A	N/A	N/A	N/A	N/A	N/A	N/A	PASS
sdk-flatpak-helloworld-app (m)	N/A	N/A	N/A	N/A	N/A	N/A	N/A	FAIL	https://phabricator.apertis.org/T8009
sdk-import-debian-package (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-performance-tools-gprof (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-performance-tools-sysprof (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-persistent-disk (m)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
sdk-vb-fullscreen (m)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
traprain (a)	N/A	N/A	N/A	N/A	N/A	N/A	N/A	PASS
tumbler-thumbnailing (a)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS
video-animation-on-boot (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
webkit2gtk-ac-3d-rendering (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
webkit2gtk-gstreamer1.0 (m)	N/A	N/A	N/A	N/A	FAIL	FAIL	FAIL	FAIL	https://phabricator.apertis.org/T8069 https://phabricator.apertis.org/T8069 https://phabricator.apertis.org/T8069 https://phabricator.apertis.org/T8069
webkit2gtk-mt-touch-events (m)	N/A	N/A	N/A	N/A	PASS	PASS	PASS	PASS
x-hw-accelerated (m)	N/A	N/A	N/A	N/A	N/A	N/A	PASS	PASS