Test Report

Build: 20230712.0315 / Release: v2023

Images: BaseSDK AMD64, Fixed function AMD64, Fixed function ARM64 (rpi64), Fixed function ARM64 (uboot), Fixed function ARMhf (uboot), HMI AMD64, HMI ARMhf (uboot), SDK AMD64

Low Medium High Critical a - automated m - manual
Summary
type defined executed pass skip fail incomplete
automated 42 203 188 0 2 13
manual 54 55 28 0 27 0
Results
ID Fixed function ARMhf (uboot) (edit) Fixed function ARM64 (uboot) (edit) Fixed function ARM64 (rpi64) (edit) Fixed function AMD64 (edit) HMI ARMhf (uboot) (edit) HMI AMD64 (edit) BaseSDK AMD64 (edit) SDK AMD64 (edit) Notes
ade-commands (a) N/A N/A N/A N/A N/A N/A PASS PASS
agl-compositor (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
apparmor (a) PASS PASS PASS PASS PASS PASS PASS PASS
apparmor-basic-profiles (a) PASS PASS PASS PASS PASS PASS PASS PASS
apparmor-bluez (m) N/A N/A N/A N/A PASS FAIL N/A N/A
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
apparmor-bluez-avrcp-volume (m) N/A N/A N/A N/A NOT TESTED NOT TESTED N/A N/A
apparmor-bluez-setup (m) N/A N/A N/A N/A PASS FAIL N/A N/A
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
apparmor-chaiwala-system (a) PASS PASS PASS PASS PASS PASS PASS PASS
apparmor-dbus (a) PASS PASS PASS PASS PASS PASS PASS PASS
apparmor-functional-demo (a) PASS PASS PASS PASS PASS PASS PASS PASS
apparmor-geoclue (a) N/A N/A N/A N/A N/A N/A PASS PASS
apparmor-gstreamer1-0 (a) N/A N/A N/A N/A PASS PASS FAIL FAIL
apparmor-ofono (a) N/A N/A N/A N/A PASS PASS PASS PASS
apparmor-pipewire (a) N/A N/A N/A N/A PASS PASS PASS PASS
apparmor-session-lockdown-no-deny (a) N/A N/A N/A N/A PASS PASS PASS PASS
apparmor-utils (a) PASS PASS PASS PASS PASS PASS PASS PASS
bluez-avrcp-volume (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
bluez-file-transfer (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
bluez-hfp (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
bluez-hfp-call-hold (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
bluez-hfp-incoming-call-notification (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
bluez-phone (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
bluez-setup (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
boot-no-crashes (a) PASS PASS INCOMPLETE PASS PASS PASS PASS PASS
boot-performance (a) PASS PASS INCOMPLETE PASS PASS PASS PASS PASS
connman (a) PASS PASS INCOMPLETE PASS PASS PASS PASS PASS
connman-new-supplicant (a) PASS PASS INCOMPLETE PASS PASS PASS PASS PASS
connman-pan-network-access (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
connman-pan-network-access-reconnect (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
connman-pan-tethering (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
connman-pan-tethering-reboot (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
connman-services (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
connman-services-reboot (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
connman-services-switchover (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
connman-usb-tethering (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
dbus-installed-tests (a) N/A N/A N/A N/A PASS PASS PASS PASS
devroot-manual-arm64 (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED
disk-rootfs-fsck (a) PASS PASS INCOMPLETE PASS PASS PASS PASS PASS
fixedfunction-webserver (m) NOT TESTED NOT TESTED NOT TESTED NOT TESTED N/A N/A N/A N/A
flatpak-run-demo-cli-app (a) N/A N/A N/A N/A N/A N/A N/A PASS
flatpak-run-demo-hmi-app (m) N/A N/A N/A N/A NOT TESTED NOT TESTED N/A NOT TESTED
gettext-i18n (a) N/A N/A N/A N/A N/A N/A PASS PASS
glib-gio-fs (a) PASS PASS INCOMPLETE PASS PASS PASS PASS PASS
grilo (a) N/A N/A N/A N/A PASS PASS PASS PASS
gstreamer1-0-decode (a) N/A N/A N/A N/A PASS PASS PASS PASS
gupnp-services (a) N/A N/A N/A N/A PASS PASS PASS PASS
hmi-audio-combined (m) N/A N/A N/A N/A NOT TESTED NOT TESTED N/A NOT TESTED
hmi-audio-combined (m) N/A N/A N/A N/A NOT TESTED NOT TESTED N/A NOT TESTED
hmi-audio-play-pause (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-audio-policy (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-audio-skip-start-end (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-audio-volume-control (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-flatpak-rhythmbox-app-launch (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-flatpak-rhythmbox-uninstall (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-switch-graphical-applications (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-video-load (m) N/A N/A N/A N/A FAIL FAIL N/A NOT TESTED
Imported from v2022pre/20211201.1511/apt: https://phabricator.apertis.org/T8363
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-video-play-pause (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
image-bootable (m) PASS PASS NOT TESTED FAIL PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
image-gui-start (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
iptables-basic (a) PASS PASS INCOMPLETE PASS PASS PASS PASS PASS
licensing-summary-availability (m) PASS PASS NOT TESTED FAIL PASS FAIL N/A N/A
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
newport (a) N/A N/A N/A N/A PASS PASS N/A PASS
ofono-sms-receive (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
ofono-sms-send (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
polkit-parsing (a) N/A N/A N/A N/A PASS PASS PASS PASS
pstore-test (m) N/A N/A N/A N/A NOT TESTED N/A N/A N/A
rfkill-toggle (m) N/A N/A N/A N/A NOT TESTED NOT TESTED N/A N/A
rhosydd (a) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED
robotframework (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED
sanity-check (a) PASS PASS INCOMPLETE PASS PASS PASS PASS PASS
sanity-check-manual (m) PASS PASS NOT TESTED FAIL PASS FAIL NOT TESTED NOT TESTED
sdk-code-analysis-tools-gcov (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-code-analysis-tools-splint (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-cross-compilation (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-dbus-tools-bustle (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED
sdk-dbus-tools-d-feet (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED
sdk-debos-image-building (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-debug-tools-gdb (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-debug-tools-strace (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-debug-tools-valgrind (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-docker (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-import-debian-package (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-performance-tools-gprof (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-performance-tools-sysprof (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-persistent-disk (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED
sdk-vb-fullscreen (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED
traprain (a) N/A N/A N/A N/A N/A N/A N/A PASS
tumbler-thumbnailing (a) N/A N/A N/A N/A N/A N/A PASS PASS
video-animation-on-boot (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
webkit2gtk-ac-3d-rendering (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
webkit2gtk-gstreamer1.0 (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
webkit2gtk-mt-touch-events (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
wifi-wpa2-psk-accesspoint-setup (m) N/A N/A N/A N/A NOT TESTED NOT TESTED N/A N/A
wifi-wpa3-sae-accesspoint-setup (m) N/A N/A N/A N/A NOT TESTED NOT TESTED N/A N/A
wifi-wpa3-transition-mode-accesspoint-setup (m) N/A N/A N/A N/A NOT TESTED NOT TESTED N/A N/A
x-hw-accelerated (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED