Test Report

Build: 20230621.1604 / Release: v2024dev2

Images: BaseSDK AMD64, Fixed function AMD64, Fixed function ARM64 (rpi64), Fixed function ARM64 (uboot), Fixed function ARMhf (uboot), HMI AMD64, HMI ARMhf (uboot), SDK AMD64

Low Medium High Critical a - automated m - manual
Summary
type defined executed pass skip fail incomplete
automated 44 211 173 0 17 21
manual 48 57 30 0 27 0
Results
ID Fixed function ARMhf (uboot) (edit) Fixed function ARM64 (uboot) (edit) Fixed function ARM64 (rpi64) (edit) Fixed function AMD64 (edit) HMI ARMhf (uboot) (edit) HMI AMD64 (edit) BaseSDK AMD64 (edit) SDK AMD64 (edit) Notes
ade-commands (a) N/A N/A N/A N/A N/A N/A FAIL FAIL
agl-compositor (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
apparmor (a) PASS PASS PASS PASS PASS PASS PASS PASS
apparmor-basic-profiles (a) PASS PASS PASS PASS PASS PASS PASS PASS
apparmor-bluez (m) N/A N/A N/A N/A PASS FAIL N/A N/A
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
apparmor-bluez-avrcp-volume (m) N/A N/A N/A N/A NOT TESTED NOT TESTED N/A N/A
apparmor-bluez-setup (m) N/A N/A N/A N/A PASS FAIL N/A N/A
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
apparmor-chaiwala-system (a) PASS PASS PASS PASS PASS PASS PASS PASS
apparmor-dbus (a) PASS PASS PASS PASS PASS PASS PASS PASS
apparmor-functional-demo (a) PASS PASS PASS PASS PASS INCOMPLETE PASS PASS
apparmor-geoclue (a) FAIL FAIL FAIL FAIL FAIL FAIL FAIL FAIL
apparmor-gstreamer1-0 (a) N/A N/A N/A N/A PASS PASS PASS PASS
apparmor-ofono (a) N/A N/A N/A N/A PASS PASS PASS PASS
apparmor-pipewire (a) N/A N/A N/A N/A PASS PASS PASS PASS
apparmor-session-lockdown-no-deny (a) N/A N/A N/A N/A INCOMPLETE INCOMPLETE INCOMPLETE INCOMPLETE
apparmor-utils (a) INCOMPLETE INCOMPLETE INCOMPLETE INCOMPLETE INCOMPLETE INCOMPLETE INCOMPLETE INCOMPLETE
bluez-avrcp-volume (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
bluez-file-transfer (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
bluez-hfp (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
bluez-hfp-call-hold (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
bluez-hfp-incoming-call-notification (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
bluez-phone (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
bluez-setup (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
boot-no-crashes (a) PASS PASS PASS PASS PASS PASS PASS PASS
boot-performance (a) PASS PASS PASS PASS PASS PASS PASS PASS
cgroups-resource-control (a) N/A N/A N/A N/A PASS PASS PASS PASS
connman (a) PASS PASS PASS PASS PASS PASS PASS PASS
connman-new-supplicant (a) PASS PASS PASS PASS PASS PASS PASS PASS
connman-pan-network-access (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
connman-pan-network-access-reconnect (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
connman-pan-tethering (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
connman-pan-tethering-reboot (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
connman-services (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
connman-services-reboot (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
connman-services-switchover (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
connman-usb-tethering (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
dbus-installed-tests (a) N/A N/A N/A N/A FAIL FAIL FAIL FAIL
devroot-manual-arm64 (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED
disk-rootfs-fsck (a) PASS PASS PASS PASS PASS INCOMPLETE PASS PASS
fixedfunction-webserver (m) NOT TESTED PASS PASS NOT TESTED N/A N/A N/A N/A
flatpak-run-demo-cli-app (a) N/A N/A N/A N/A N/A N/A N/A PASS
flatpak-run-demo-hmi-app (m) N/A N/A N/A N/A NOT TESTED NOT TESTED N/A NOT TESTED
gettext-i18n (a) N/A N/A N/A N/A N/A N/A PASS PASS
glib-gio-fs (a) PASS PASS PASS PASS PASS PASS PASS PASS
grilo (a) N/A N/A N/A N/A PASS PASS PASS PASS
gstreamer1-0-decode (a) N/A N/A N/A N/A PASS PASS PASS PASS
gupnp-services (a) N/A N/A N/A N/A PASS PASS PASS PASS
hmi-audio-play-pause (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-audio-policy (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-audio-skip-start-end (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-audio-volume-control (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-flatpak-rhythmbox-app-launch (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-flatpak-rhythmbox-uninstall (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-switch-graphical-applications (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-video-load (m) N/A N/A N/A N/A PASS FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
hmi-video-play-pause (m) N/A N/A N/A N/A FAIL FAIL N/A NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
image-bootable (m) NOT TESTED PASS PASS FAIL PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
image-gui-start (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
iptables-basic (a) PASS PASS PASS PASS PASS PASS PASS PASS
iptables-nmap (a) N/A N/A N/A N/A INCOMPLETE INCOMPLETE INCOMPLETE INCOMPLETE
licensing-summary-availability (m) NOT TESTED PASS PASS FAIL PASS FAIL N/A N/A
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
newport (a) N/A N/A N/A N/A PASS PASS N/A PASS
ofono-sms-receive (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
ofono-sms-send (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
openssl (a) PASS PASS PASS PASS PASS PASS PASS PASS
polkit-parsing (a) N/A N/A N/A N/A INCOMPLETE INCOMPLETE INCOMPLETE INCOMPLETE
rfkill-toggle (m) N/A N/A N/A N/A NOT TESTED NOT TESTED N/A N/A
robotframework (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED
sanity-check (a) PASS PASS PASS PASS PASS INCOMPLETE PASS PASS
sanity-check-manual (m) NOT TESTED PASS PASS FAIL PASS FAIL NOT TESTED NOT TESTED
sdk-code-analysis-tools-gcov (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-code-analysis-tools-splint (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-cross-compilation (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-dbus-tools-bustle (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED
sdk-dbus-tools-d-feet (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED
sdk-debos-image-building (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-debug-tools-gdb (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-debug-tools-strace (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-debug-tools-valgrind (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-docker (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-import-debian-package (a) N/A N/A N/A N/A N/A N/A FAIL FAIL
sdk-performance-tools-gprof (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-performance-tools-sysprof (a) N/A N/A N/A N/A N/A N/A PASS PASS
sdk-persistent-disk (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED
sdk-vb-fullscreen (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED
traprain (a) N/A N/A N/A N/A N/A N/A N/A FAIL
tumbler-thumbnailing (a) N/A N/A N/A N/A N/A N/A PASS PASS
video-animation-on-boot (m) N/A N/A N/A N/A PASS FAIL NOT TESTED NOT TESTED
sanity-check test case had been failed on this image. https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388
webkit2gtk-ac-3d-rendering (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
webkit2gtk-gstreamer1.0 (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
webkit2gtk-mt-touch-events (m) N/A N/A N/A N/A NOT TESTED NOT TESTED NOT TESTED NOT TESTED
x-hw-accelerated (m) N/A N/A N/A N/A N/A N/A NOT TESTED NOT TESTED