Test Suite: v2025 - Test Cases
Type: 72 automated / 55 manual / 0 both
- Priority: 4 low / 64 medium / 21 high / 38 critical
- Total: 127
ade-commands automated
Test ade command and sub-command with default and custom options and arguments.
mediumagl-compositor manual
Test that agl-compositor is able to run, it can show popups and gnome-menus is able to show and launch installed applications.
highapertis-update-manager-ota-check-network-failure manual
Test the apertis-update-manager API for updates over the air when the network is diconnected and reconnected.
mediumapertis-update-manager-ota-api-switch-network manual
Test the apertis-update-manager API for updates over the air when the network is changed from a phone hotspot to wifi.
mediumapertis-update-manager-ota-rollback manual
Test the automatic rollback and blacklist mechanism of apertis-update-manager with network updates.
lowapertis-update-manager-rollback manual
Test the automatic rollback and blacklist mechanism of apertis-update-manager. The automated version of this test: https://qa.apertis.org/aum-rollback-blacklist.html
lowapertis-update-manager-usb-unplug manual
Test the apertis-update-manager automatic update interrupted by mass storage removing.
criticalapparmor-basic-profiles automated
Test basic apparmor profiles. Only parsing and syntax of profiles are tested for now. Security infrastructure: parsing and syntax of basic Apparmor profiles is part of strategic application and services confinement.
criticalapparmor-bluez-avrcp-volume manual
Test AppArmor profile for Bluez AVRCP volume up and down commands.
mediumapparmor-bluez-setup manual
Test AppArmor profiles for setting up of Bluetooth stack by running basic tests using hciconfig. Check if the interface can be brought up/down, can be changed of mode and can discover devices.
highapparmor-bluez manual
Test AppArmor profile for support for SPP profile (bluez-spp) and core functionalities (bluez-core).
highapparmor-chaiwala-system automated
Test that AppArmor's system wide rules works according to Apertis security goals (Chaiwala was an older codename for Apertis).
highapparmor-dbus automated
Security infrastructure: AppArmor D-Bus mediation is part of strategic application and service confinement.
criticalapparmor-functional-demo automated
Show some main AppArmor functionalities, like transitions, net access or resource permissions, under the form of tests.
mediumapparmor-geoclue automated
Test that geoclue apparmor profiles are working properly.
mediumapparmor-gstreamer1-0 automated
Test that AppArmor profiles provided in GStreamer 1.0 works without Auditd complaining.
mediumapparmor-ofono automated
Test that AppArmor profiles provided in ofono package work without unexpected auditd log entries.
mediumapparmor-pipewire automated
Test that AppArmor profiles provided in PipeWire work without apparmor complaining.
mediumapparmor-session-lockdown-no-deny automated
Test that the session lockdown profile is not blocking more than it should.
mediumapparmor-utils automated
Test apparmor_parser and other tools in apparmor package can be executed
mediumapparmor automated
Security infrastructure: checking that AppArmor is available in the kernel and active is part of strategic application and services confinement.
criticalaum-api automated
Apertis update manager: API test This test ensures that the update manager API behaves as expected.
criticalaum-offline-upgrade-branch automated
Apertis update manager: offline upgrade test between branches. This test ensures that Apertis is capable to upgrade the previos version to the recent. And update manager is able to fix all refs after successful update.
criticalaum-offline-upgrade-collection_id automated
Apertis update manager: test of update failure with invalid update file. This test ensures that the update manager refuses to install an update with improper Collection ID, refs or timestamps.
criticalaum-offline-upgrade-signed automated
Apertis update manager: check signed offline upgrade test This test ensures that the update manager uses static bundle with signed commit only.
criticalaum-offline-upgrade automated
Apertis update manager: Offline upgrade test This test ensures that the update manager is able to install an update provided offline.
criticalaum-ota-api automated
Apertis update manager: OTA API test This test ensures that the update manager API behaves as expected.
criticalaum-ota-auto automated
Apertis update manager: automatic OTA updates test This test ensures that the update manager is able to work in unattended mode.
criticalaum-ota-out-of-space automated
Apertis update manager: Out of space update test during OTA upgrade This test ensures that the update manager behaves appropriately in low disk space conditions.
criticalaum-ota-rollback-blacklist automated
Apertis update manager: blacklist and rollback for OTA updates. This test ensures that the update manager is able to rollback and blacklist an invalid update.
criticalaum-ota-signed automated
Apertis update manager: check signed OTA upgrade test This test ensures that the update manager uses commit signed with known key during OTA upgrades.
criticalaum-out-of-space automated
Apertis update manager: Out of space update test This test ensures that the update manager behaves appropriately in low disk space conditions.
criticalaum-power-cut automated
Apertis update manager: Power cut resiliency test This test ensures that the update manager resists a power cut.
criticalaum-rollback-blacklist automated
Apertis update manager: Blacklist and rollback This test ensures that the update manager is able to rollback and blacklist an invalid update.
criticalaum-rollback-bootcount manual
Apertis update manager: Rollback bootcount This test ensures that the update manager is able to rollback to an old deployment in case of bootcount exceeded.
criticalbluez-avrcp-volume manual
Test the AVRCP volume up and down commands.
mediumbluez-file-transfer manual
Test all BlueZ features needing interaction with a phone like file transfer of images or audio/video files
criticalbluez-hfp-call-hold manual
Test Hands Free Profile (HFP) BlueZ feature call and hold.
mediumbluez-hfp-incoming-call-notification manual
Test Hands Free Profile (HFP) BlueZ feature for incoming call.
mediumbluez-hfp manual
Test Hands Free Profile (HFP) BlueZ feature.
mediumbluez-phone manual
Test all BlueZ features needing interaction with a phone (Pairing, OBEX, PBAP, AVRCP, A2DP, HSP, HFP, PAN). Strategic component: Bluetooth phone calls is part of smartphone interaction functionality.
criticalbluez-setup manual
Test setup of Bluetooth stack by running basic tests using hciconfig. Check if the interface can be brought up/down, can be changed of mode and can discover devices. Strategic component: Bluetooth setup and basic functionality is part of smartphone interaction functionality.
criticalboot-no-crashes automated
Check that nothing crashed when booting.
highboot-performance automated
Test boot performance. This test checks boot performance using systemd-analyze statistics.
highconnman-new-supplicant automated
Test the wpa_supplicant interface.
mediumconnman-pan-network-access-reconnect manual
Test ConnMan support for bluetooth PAN Network Access Profile. This test will test that after restarting the Bluetooth tethering from the phone side the internet access from Apertis to a bluetooth device sharing its internet connection is maintained.
mediumconnman-pan-network-access manual
Test ConnMan support for bluetooth PAN Network Access Profile. This test will test internet access from Apertis to a bluetooth device sharing its internet connection. The underlying connection makes use of Bluetooth Network Access Profile with connman. First the two devices will be paired, then connection will be established. It will then be possible to verify that internet is usable from Apertis.
mediumconnman-pan-tethering-reboot manual
Test Connman-pan-tethering support for PAN connectivity after reboot.
mediumconnman-pan-tethering manual
Test ConnMan support for PAN connectivity.
mediumconnman-services-reboot manual
Tests Network connection management: ensuring that ConnMan can connect to actual networks even after the device under test is rebooted
criticalconnman-services-switchover manual
Tests Network connection management: ensuring that ConnMan can connect to actual networks even after the device under test is rebooted
criticalconnman-services manual
Tests Network connection management: ensuring that ConnMan can connect to actual networks is part of strategic network management functionality.
criticalconnman-usb-tethering manual
Test ConnMan support for USB tethering (connection side).
mediumconnman automated
Runs some automated tests using the ConnMan D-Bus API. It guarantees most of the basic features are working. Network connection management: ensuring that ConnMan's APIs are accessible is part of strategic network management functionality.
criticaldbus-installed-tests automated
Regression tests for D-Bus.
highdevroot-manual-arm64 manual
Test cross-compilation support for ARM64 architecture using devroot utility
highdisk-rootfs-fsck automated
Ensure that the root file system check is enabled on boot
highfixedfunction-webserver manual
Fixed function Web server.
mediumflatpak-run-demo-cli-app automated
Test a headless Flatpak demo application
mediumflatpak-run-demo-hmi-app manual
Test a graphical Flatpak demo application
mediumgettext-i18n automated
Check that gettext internationalization works.
mediumglib-gio-fs automated
Run the GLib gio tests that do I/O on the local filesystem.
mediumgrilo automated
Check grilo metadata notifications, and filesystem browsing.
mediumgstreamer1-0-decode automated
Test video and audio decoders and demuxers on a list of media. Audio/video decoding through GStreamer is important but not required by any of the currently strategic functionalities.
highgupnp-services automated
Run a few tests related to service browsing, introspection, etc.
mediumhmi-audio-combined manual
Test that the songs present play and can be paused, skipped, volume can be changed up/down and audio policy works correctly
highhmi-audio-management-on-same-priority manual
Test to verify the audio management functionality on switching between same priority applications
highhmi-flatpak-apps manual
Test Flatpak Apps handling (install, run, uninstall and re-install)
highhmi-switch-graphical-applications manual
Switching between two graphical applications is smooth and glitch free
highhmi-video-play manual
Test that the video files play without any glitches
highimage-bootable manual
Test whether the image is bootable. Basic functionality: booting up.
criticalimage-gui-start manual
Test whether the image starts a graphical environment. Basic functionality: ensuring that the GUI boots up.
criticaliptables-basic automated
Network connection management: ensuring that iptables is available and usable is part of strategic networking management functionality.
criticallicensing-summary-availability manual
Test the availability of the licensing summary.
highnewport automated
Run the Newport test suite
mediumnfsroot-simple-boot automated
This test checks that an image that was flashed using the nfsroot properly booted.
highofono-sms-receive manual
Test receiving SMS messages with oFono.
mediumofono-sms-send manual
Test sending of SMS with oFono.
mediumopenssl automated
Run the OpenSSL tests.
mediumostree-collection-id automated
OSTree: Collection ID test This test ensures that the system is booted with proper Collection ID.
criticalpackage-testing automated
Package testing
mediumpolkit-parsing automated
Parse polkit policy files
highpstore-test manual
Test the pstore functionality usage
highrfkill-toggle manual
Test that rfkill is functional.
mediumrhosydd-target automated
Validate the vehicle daemon functionalities using the mock backends
highrhosydd automated
Rhosydd module test.
mediumrobotframework manual
This test checks the Robot Framework functionality on SDK by running the testcases on connected target using SSH.
criticalsanity-check-manual manual
This test checks that the system bus is up, that a user session is created and that a graphical interface is successfully running in the system, as well as other similar basic services so that a stable and reliable environment can be confirmed before futher tests are executed. Basic functionality: services.
criticalsanity-check automated
This test checks that the system bus is up, that a user session is created and that a graphical interface is successfully running in the system, as well as other similar basic services so that a stable and reliable environment can be confirmed before futher tests are executed. Basic functionality: services.
criticalsdk-code-analysis-tools-gcov automated
Checks basic gcov functionality by running a sample program a few different ways and ensuring that a sufficient portion of its code paths are executed.
mediumsdk-code-analysis-tools-splint automated
Checks basic splint functionality by checking its output when run on a simple source file.
mediumsdk-cross-compilation automated
Attempt building bash package in the devroot SDK images ship.
mediumsdk-dbus-tools-bustle manual
Test that bustle-dbus-monitor shows services on the session bus.
mediumsdk-dbus-tools-d-feet manual
Test that D-Feet both shows services on the session bus and that new services appear automatically.
mediumsdk-debos-image-building automated
Ensure that the sample image recipes can be built on the SDK and that the commands in the documentation work.
criticalsdk-debug-tools-gdb automated
Checks basic gdb functionality by stopping a program at a set point and checking its backtrace matches expectations.
mediumsdk-debug-tools-strace automated
Checks basic strace functionality by checking its output when run on a simple command line program.
mediumsdk-debug-tools-valgrind automated
Checks basic valgrind functionality by running a program with and without memory leaks, ensuring expected results from valgrind.
mediumsdk-docker automated
Install and run hello-world docker container.
mediumsdk-import-debian-package automated
Checks basic import-debian-package functionality.
mediumsdk-performance-tools-gprof automated
Checks basic gprof functionality by ensuring a CPU-intensive program shows up in its log as consuming the vast majority of the CPU cycles.
mediumsdk-performance-tools-sysprof automated
Checks basic sysprof functionality by ensuring a CPU-intensive program shows up in its log as consuming the vast majority of the CPU cycles.
mediumsdk-persistent-disk manual
Tests that persistent disk can be used when upgrading the SDK.
criticalsdk-vb-fullscreen manual
Tests that the SDK VM can be fullscreened in VirtualBox. Development environment: ensuring that the VirtualBox SDK provides a seamless experience. Check that when fullscreened the output is not stretched, even for accelerated contents.
criticalsecure-boot-imx6 manual
Test that Secure Boot via HAB on the SabreLite board works for bootloader and initial OS image in FIT format.
mediumtiny-container-system-aa-enforcement automated
Test that the AppArmor profile for dbus-daemon is loaded in system-wide privileged container
mediumtiny-container-system-basic automated
Test of Tiny system-wide privileged container using shared networking with the host
mediumtiny-container-system-connectivity-profile automated
Test of AppArmor profile for Tiny system-wide privileged container
mediumtiny-container-system-device-sharing automated
Test of device sharing between host and Tiny system-wide privileged container
mediumtiny-container-system-folder-sharing automated
Test of folder sharing between host and Tiny system-wide privileged container started as user
mediumtiny-container-system-seccomp automated
Test that the custom seccomp profile could be applied for system-wide privileged container
mediumtiny-container-user-aa-enforcement automated
Test that the AppArmor profile for dbus-daemon is loaded in unprivileged container started as user
mediumtiny-container-user-basic automated
Test of Tiny unprivileged container without any networking started as user
mediumtiny-container-user-connectivity-profile automated
Test of AppArmor profile for Tiny unprivileged container started as user
mediumtiny-container-user-device-sharing automated
Test of device sharing between host and Tiny unprivileged container started as user
mediumtiny-container-user-folder-sharing automated
Test of folder sharing between host and Tiny unprivileged container started as user
mediumtiny-container-user-seccomp automated
Test that the custom seccomp profile could be applied for unprivileged container started as user
mediumtraprain automated
Traprain library test.
mediumtumbler-thumbnailing automated
Check that all thumbnailing features of tumbler are working properly (large, small, videos, documents, images).
mediumvideo-animation-on-boot manual
Test whether Plymouth is able to display a graphical theme.
highwebkit2gtk-ac-3d-rendering manual
Test that 3D transforms are applied correctly.
lowwebkit2gtk-gstreamer1.0 manual
Tests html5 video playback with GStreamer 1.0 in WebKit2GTK. This test opens an URL to stream video and audio using MiniBrowser.
mediumwebkit2gtk-mt-touch-events manual
Test implementation of W3C touch events API in WebKit2GTK.
lowwifi-wpa2-psk-accesspoint-setup manual
Test WiFi WPA2-PSK access point (AP mode) is working in Apertis. Also check connection is re-established after rebooting the AP.
criticalwifi-wpa3-sae-accesspoint-setup manual
Test WiFi WPA3-SAE access point (AP mode) is working in Apertis. Also check connection is re-established after rebooting the AP.
criticalwifi-wpa3-transition-mode-accesspoint-setup manual
Test WiFi WPA3-Transition-Mode access point (AP mode) is working in Apertis. Also check connection is re-established after rebooting the AP.
criticalx-hw-accelerated manual
Test whether the correct GLES2 render is used.
medium