Test Report
Build: 20230809.0115 / Release: v2022
Images:
BaseSDK AMD64, Fixed function AMD64, Fixed function ARM64 (rpi64), Fixed function ARM64 (uboot), Fixed function ARMhf (uboot), HMI AMD64, SDK AMD64
Low Medium High Critical a - automated m - manual
Summary
| type | defined | executed | pass | skip | fail | incomplete |
|---|---|---|---|---|---|---|
| automated | 43 | 159 | 145 | 0 | 3 | 11 |
| manual | 48 | 53 | 28 | 0 | 25 | 0 |
Results
| ID | Fixed function ARMhf (uboot) (edit) | Fixed function ARM64 (uboot) (edit) | Fixed function ARM64 (rpi64) (edit) | Fixed function AMD64 (edit) | HMI ARMhf (uboot) (edit) | HMI AMD64 (edit) | BaseSDK AMD64 (edit) | SDK AMD64 (edit) | Notes |
|---|---|---|---|---|---|---|---|---|---|
| ade-commands (a) | N/A | N/A | N/A | N/A | N/A | N/A | PASS | FAIL | |
| agl-compositor (m) | N/A | N/A | N/A | N/A | PASS | FAIL | N/A | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| apparmor (a) | PASS | PASS | PASS | PASS | NOT TESTED | PASS | PASS | PASS | |
| apparmor-basic-profiles (a) | PASS | PASS | PASS | PASS | NOT TESTED | PASS | PASS | PASS | |
| apparmor-bluez (m) | N/A | N/A | N/A | N/A | PASS | FAIL | N/A | N/A | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| apparmor-bluez-avrcp-volume (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | N/A | N/A | |
| apparmor-bluez-setup (m) | N/A | N/A | N/A | N/A | PASS | FAIL | N/A | N/A | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| apparmor-chaiwala-system (a) | PASS | PASS | PASS | PASS | NOT TESTED | PASS | PASS | PASS | |
| apparmor-dbus (a) | PASS | PASS | PASS | PASS | NOT TESTED | PASS | PASS | PASS | |
| apparmor-functional-demo (a) | PASS | PASS | PASS | PASS | NOT TESTED | PASS | PASS | PASS | |
| apparmor-geoclue (a) | PASS | PASS | PASS | PASS | NOT TESTED | PASS | PASS | PASS | |
| apparmor-gstreamer1-0 (a) | N/A | N/A | N/A | N/A | NOT TESTED | FAIL | PASS | FAIL | |
| apparmor-ofono (a) | N/A | N/A | N/A | N/A | NOT TESTED | PASS | PASS | PASS | |
| apparmor-pipewire (a) | N/A | N/A | N/A | N/A | NOT TESTED | PASS | PASS | PASS | |
| apparmor-session-lockdown-no-deny (a) | N/A | N/A | N/A | N/A | NOT TESTED | PASS | PASS | PASS | |
| apparmor-utils (a) | PASS | PASS | PASS | PASS | NOT TESTED | PASS | PASS | PASS | |
| bluez-avrcp-volume (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | |
| bluez-file-transfer (m) | N/A | N/A | N/A | N/A | PASS | FAIL | NOT TESTED | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| bluez-hfp (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | |
| bluez-hfp-call-hold (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | |
| bluez-hfp-incoming-call-notification (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | |
| bluez-phone (m) | N/A | N/A | N/A | N/A | PASS | FAIL | NOT TESTED | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| bluez-setup (m) | N/A | N/A | N/A | N/A | PASS | FAIL | N/A | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| boot-no-crashes (a) | PASS | PASS | INCOMPLETE | PASS | NOT TESTED | PASS | NOT TESTED | PASS | |
| boot-performance (a) | PASS | PASS | INCOMPLETE | PASS | NOT TESTED | PASS | NOT TESTED | PASS | |
| cgroups-resource-control (a) | N/A | N/A | N/A | N/A | NOT TESTED | PASS | NOT TESTED | PASS | |
| connman (a) | PASS | PASS | INCOMPLETE | PASS | NOT TESTED | PASS | NOT TESTED | PASS | |
| connman-new-supplicant (a) | PASS | PASS | INCOMPLETE | PASS | NOT TESTED | PASS | NOT TESTED | PASS | |
| connman-pan-network-access (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | |
| connman-pan-network-access-reconnect (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | |
| connman-pan-tethering (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | |
| connman-pan-tethering-reboot (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | |
| connman-services (m) | N/A | N/A | N/A | N/A | PASS | FAIL | NOT TESTED | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| connman-services-reboot (m) | N/A | N/A | N/A | N/A | PASS | FAIL | NOT TESTED | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| connman-services-switchover (m) | N/A | N/A | N/A | N/A | PASS | FAIL | NOT TESTED | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| connman-usb-tethering (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | |
| dbus-installed-tests (a) | N/A | N/A | N/A | N/A | NOT TESTED | PASS | NOT TESTED | INCOMPLETE | |
| devroot-manual-arm64 (m) | N/A | N/A | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | |
| disk-rootfs-fsck (a) | PASS | PASS | PASS | PASS | NOT TESTED | PASS | PASS | PASS | |
| fixedfunction-webserver (m) | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | N/A | N/A | N/A | N/A | |
| flatpak-run-demo-cli-app (a) | N/A | N/A | N/A | N/A | N/A | N/A | N/A | PASS | |
| flatpak-run-demo-hmi-app (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | N/A | NOT TESTED | |
| gettext-i18n (a) | N/A | N/A | N/A | N/A | N/A | N/A | NOT TESTED | PASS | |
| glib-gio-fs (a) | PASS | PASS | INCOMPLETE | PASS | NOT TESTED | PASS | NOT TESTED | PASS | |
| grilo (a) | N/A | N/A | N/A | N/A | NOT TESTED | PASS | NOT TESTED | PASS | |
| gstreamer1-0-decode (a) | N/A | N/A | N/A | N/A | NOT TESTED | PASS | NOT TESTED | PASS | |
| gupnp-services (a) | N/A | N/A | N/A | N/A | NOT TESTED | PASS | NOT TESTED | PASS | |
| hmi-audio-play-pause (m) | N/A | N/A | N/A | N/A | PASS | FAIL | N/A | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| hmi-audio-policy (m) | N/A | N/A | N/A | N/A | PASS | FAIL | N/A | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| hmi-audio-skip-start-end (m) | N/A | N/A | N/A | N/A | PASS | FAIL | N/A | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| hmi-audio-volume-control (m) | N/A | N/A | N/A | N/A | PASS | FAIL | N/A | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| hmi-flatpak-rhythmbox-app-launch (m) | N/A | N/A | N/A | N/A | PASS | FAIL | N/A | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| hmi-flatpak-rhythmbox-uninstall (m) | N/A | N/A | N/A | N/A | PASS | FAIL | N/A | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| hmi-video-load (m) | N/A | N/A | N/A | N/A | PASS | FAIL | N/A | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| hmi-video-play-pause (m) | N/A | N/A | N/A | N/A | PASS | FAIL | N/A | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| image-bootable (m) | PASS | PASS | NOT TESTED | FAIL | PASS | FAIL | NOT TESTED | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| image-gui-start (m) | N/A | N/A | N/A | N/A | PASS | FAIL | NOT TESTED | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| iptables-basic (a) | PASS | PASS | INCOMPLETE | PASS | NOT TESTED | PASS | NOT TESTED | PASS | |
| licensing-summary-availability (m) | PASS | PASS | NOT TESTED | FAIL | PASS | FAIL | N/A | N/A | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| newport (a) | N/A | N/A | N/A | N/A | NOT TESTED | PASS | N/A | PASS | |
| ofono-sms-receive (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | |
| ofono-sms-send (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | |
| polkit-parsing (a) | N/A | N/A | N/A | N/A | NOT TESTED | PASS | NOT TESTED | INCOMPLETE | |
| pstore-test (m) | N/A | N/A | N/A | N/A | NOT TESTED | N/A | N/A | N/A | |
| rfkill-toggle (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | N/A | N/A | |
| rhosydd (a) | N/A | N/A | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | |
| robotframework (m) | N/A | N/A | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | |
| sanity-check (a) | PASS | PASS | PASS | PASS | NOT TESTED | PASS | PASS | PASS | |
| sanity-check-manual (m) | PASS | PASS | NOT TESTED | FAIL | PASS | FAIL | NOT TESTED | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| sdk-code-analysis-tools-gcov (a) | N/A | N/A | N/A | N/A | N/A | N/A | PASS | PASS | |
| sdk-code-analysis-tools-splint (a) | N/A | N/A | N/A | N/A | N/A | N/A | PASS | PASS | |
| sdk-cross-compilation (a) | N/A | N/A | N/A | N/A | N/A | N/A | PASS | PASS | |
| sdk-dbus-tools-bustle (m) | N/A | N/A | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | |
| sdk-dbus-tools-d-feet (m) | N/A | N/A | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | |
| sdk-debos-image-building (a) | N/A | N/A | N/A | N/A | N/A | N/A | PASS | PASS | |
| sdk-debug-tools-gdb (a) | N/A | N/A | N/A | N/A | N/A | N/A | PASS | PASS | |
| sdk-debug-tools-strace (a) | N/A | N/A | N/A | N/A | N/A | N/A | PASS | PASS | |
| sdk-debug-tools-valgrind (a) | N/A | N/A | N/A | N/A | N/A | N/A | PASS | PASS | |
| sdk-docker (a) | N/A | N/A | N/A | N/A | N/A | N/A | PASS | PASS | |
| sdk-import-debian-package (a) | N/A | N/A | N/A | N/A | N/A | N/A | PASS | PASS | |
| sdk-performance-tools-gprof (a) | N/A | N/A | N/A | N/A | N/A | N/A | PASS | PASS | |
| sdk-performance-tools-sysprof (a) | N/A | N/A | N/A | N/A | N/A | N/A | PASS | PASS | |
| sdk-persistent-disk (m) | N/A | N/A | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | |
| sdk-vb-fullscreen (m) | N/A | N/A | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | |
| traprain (a) | N/A | N/A | N/A | N/A | N/A | N/A | N/A | PASS | |
| tumbler-thumbnailing (a) | N/A | N/A | N/A | N/A | N/A | N/A | PASS | PASS | |
| video-animation-on-boot (m) | N/A | N/A | N/A | N/A | PASS | FAIL | NOT TESTED | NOT TESTED | sanity-check test case had been failed on this image.
https://gitlab.apertis.org/infrastructure/apertis-issues/-/issues/388 |
| webkit2gtk-ac-3d-rendering (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | |
| webkit2gtk-gstreamer1.0 (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | Imported from v2022pre/20211201.1511/apt:
https://phabricator.apertis.org/T8069 |
| webkit2gtk-mt-touch-events (m) | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED | NOT TESTED | NOT TESTED | |
| x-hw-accelerated (m) | N/A | N/A | N/A | N/A | N/A | N/A | NOT TESTED | NOT TESTED |