From: Zhihang Wei <wzh@ilbers.de>
To: isar-users@googlegroups.com, felix.moessbauer@siemens.com,
amikan@ilbers.de
Cc: wzh@ilbers.de, cedric.hombourger@siemens.com
Subject: [PATCH v3 19/20] testsuite: Execute startvm testcases after building
Date: Fri, 23 Jan 2026 09:25:00 +0100 [thread overview]
Message-ID: <20260123082501.240751-20-wzh@ilbers.de> (raw)
In-Reply-To: <20260123082501.240751-1-wzh@ilbers.de>
Move startvm testcases up to be executed right after following targets
got built. Tag them as startvm to allow dsabling with '-startvm'.
Signed-off-by: Anton Mikanovich amikan@ilbers.de
Signed-off-by: Zhihang Wei <wzh@ilbers.de>
---
testsuite/citest.py | 588 +++++++++++++++++++++++++-------------------
1 file changed, 337 insertions(+), 251 deletions(-)
diff --git a/testsuite/citest.py b/testsuite/citest.py
index 14230062..7912566f 100755
--- a/testsuite/citest.py
+++ b/testsuite/citest.py
@@ -248,6 +248,102 @@ class CrossTest(CIBaseTest):
self.init()
self.perform_build_test(targets)
+ def test_run_arm_bullseye_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'bullseye', image='isar-image-ci', keep=True)
+
+ def test_run_arm_bullseye_example_module(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'arm',
+ 'bullseye',
+ image='isar-image-ci',
+ cmd='lsmod | grep example_module',
+ keep=True,
+ )
+
+ def test_run_arm_bullseye_getty_target(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'arm',
+ 'bullseye',
+ image='isar-image-ci',
+ script='test_systemd_unit.sh getty.target 10',
+ )
+
+ def test_run_arm_buster_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'buster', image='isar-image-ci', keep=True)
+
+ def test_run_arm_buster_getty_target(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'arm',
+ 'buster',
+ image='isar-image-ci',
+ cmd='systemctl is-active getty.target',
+ keep=True,
+ )
+
+ def test_run_arm_buster_example_module(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'arm',
+ 'buster',
+ image='isar-image-ci',
+ script='test_kernel_module.sh example_module',
+ )
+
+ def test_run_arm_bookworm_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'bookworm', image='isar-image-ci', keep=True)
+
+ def test_run_arm_bookworm_example_module(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'arm',
+ 'bookworm',
+ image='isar-image-ci',
+ cmd='lsmod | grep example_module',
+ keep=True,
+ )
+
+ def test_run_arm_bookworm_getty_target(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'arm',
+ 'bookworm',
+ image='isar-image-ci',
+ script='test_systemd_unit.sh getty.target 10',
+ )
+
def test_cross_debsrc(self):
targets = [
'mc:qemuarm64-bookworm:isar-image-ci',
@@ -269,6 +365,20 @@ class CrossTest(CIBaseTest):
except exceptions.TestFail:
self.cancel('KFAIL')
+ def test_run_amd64_trixie(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('amd64', 'trixie')
+
+ def test_run_arm64_trixie(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm64', 'trixie')
+
def test_cross_kselftest(self):
targets = [
'mc:qemuarm-buster:kselftest',
@@ -612,6 +722,195 @@ class NoCrossTest(CIBaseTest):
self.init()
self.perform_build_test(targets, cross=False)
+ def test_run_arm_bullseye(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'bullseye')
+
+ def test_run_arm_buster_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'buster', image='isar-image-ci', keep=True)
+
+ def test_run_arm_buster_example_module(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'arm',
+ 'buster',
+ image='isar-image-ci',
+ cmd='lsmod | grep example_module',
+ keep=True,
+ )
+
+ def test_run_arm_buster_getty_target(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'arm',
+ 'buster',
+ image='isar-image-ci',
+ script='test_systemd_unit.sh getty.target 10',
+ )
+
+ def test_run_arm64_bookworm_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm64', 'bookworm', image='isar-image-ci', keep=True)
+
+ def test_run_arm64_bookworm_getty_target(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'arm64',
+ 'bookworm',
+ image='isar-image-ci',
+ cmd='systemctl is-active getty.target',
+ keep=True,
+ )
+
+ def test_run_arm64_bookworm_example_module(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'arm64',
+ 'bookworm',
+ image='isar-image-ci',
+ script='test_kernel_module.sh example_module',
+ )
+
+ def test_run_i386_buster(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('i386', 'buster')
+
+ def test_run_amd64_buster_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ # test efi boot
+ self.vm_start('amd64', 'buster', image='isar-image-ci')
+
+ def test_run_amd64_buster_pcbios(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ # test pcbios boot
+ self.vm_start('amd64', 'buster', True, image='isar-image-ci')
+
+ def test_run_amd64_focal_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('amd64', 'focal', image='isar-image-ci', keep=True)
+
+ def test_run_amd64_focal_example_module(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'amd64',
+ 'focal',
+ image='isar-image-ci',
+ cmd='lsmod | grep example_module',
+ keep=True,
+ )
+
+ def test_run_amd64_focal_getty_target(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'amd64',
+ 'focal',
+ image='isar-image-ci',
+ script='test_systemd_unit.sh getty.target 10',
+ )
+
+ def test_run_amd64_bookworm(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('amd64', 'bookworm', image='isar-image-ci')
+
+ def test_run_i386_bookworm(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('i386', 'bookworm')
+
+ def test_run_mipsel_bookworm_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('mipsel', 'bookworm', image='isar-image-ci', keep=True)
+
+ def test_run_mipsel_bookworm_getty_target(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'mipsel',
+ 'bookworm',
+ image='isar-image-ci',
+ cmd='systemctl is-active getty.target',
+ keep=True,
+ )
+
+ def test_run_mipsel_bookworm_example_module(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start(
+ 'mipsel',
+ 'bookworm',
+ image='isar-image-ci',
+ script='test_kernel_module.sh example_module',
+ )
+
+ def test_run_amd64_bookworm_iso_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('amd64-iso', 'bookworm', image='isar-image-ci',
+ keep=True
+ )
+
+ def test_run_amd64_bookworm_iso_system_check(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('amd64-iso', 'bookworm', image='isar-image-ci',
+ script='test_system_running.sh 30')
+
def test_nocross_debsrc(self):
targets = [
'mc:qemuarm-bookworm:isar-image-ci',
@@ -622,6 +921,13 @@ class NoCrossTest(CIBaseTest):
self.init()
self.perform_build_test(targets, cross=False, debsrc_cache=True)
+ def test_run_arm_bookworm(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'bookworm', image='isar-image-ci')
+
def test_nocross_rpi(self):
targets = [
'mc:rpi-arm-bullseye:isar-image-base',
@@ -658,6 +964,37 @@ class NoCrossTest(CIBaseTest):
except exceptions.TestFail:
self.cancel('KFAIL')
+ def test_run_arm_trixie(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ try:
+ self.vm_start('arm', 'trixie')
+ except exceptions.TestFail:
+ self.cancel('KFAIL')
+
+ def test_run_arm64_trixie(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm64', 'trixie')
+
+ def test_run_amd64_trixie(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('amd64', 'trixie')
+
+ def test_run_riscv64_trixie(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('riscv64', 'trixie')
+
def test_nocross_sid(self):
targets = [
'mc:qemuamd64-sid:isar-image-base',
@@ -850,257 +1187,6 @@ class SourceTest(CIBaseTest):
self.perform_source_test(targets)
-class VmBootTestFast(CIBaseTest):
-
- """
- Test QEMU image start (fast)
-
- :avocado: tags=startvm,fast
- """
-
- def test_arm_bullseye(self):
- self.init()
- self.vm_start('arm', 'bullseye', image='isar-image-ci', keep=True)
-
- def test_arm_bullseye_example_module(self):
- self.init()
- self.vm_start(
- 'arm',
- 'bullseye',
- image='isar-image-ci',
- cmd='lsmod | grep example_module',
- keep=True,
- )
-
- def test_arm_bullseye_getty_target(self):
- self.init()
- self.vm_start(
- 'arm',
- 'bullseye',
- image='isar-image-ci',
- script='test_systemd_unit.sh getty.target 10',
- )
-
- def test_arm_buster(self):
- self.init()
- self.vm_start('arm', 'buster', image='isar-image-ci', keep=True)
-
- def test_arm_buster_getty_target(self):
- self.init()
- self.vm_start(
- 'arm',
- 'buster',
- image='isar-image-ci',
- cmd='systemctl is-active getty.target',
- keep=True,
- )
-
- def test_arm_buster_example_module(self):
- self.init()
- self.vm_start(
- 'arm',
- 'buster',
- image='isar-image-ci',
- script='test_kernel_module.sh example_module',
- )
-
- def test_arm_bookworm(self):
- self.init()
- self.vm_start('arm', 'bookworm', image='isar-image-ci', keep=True)
-
- def test_arm_bookworm_example_module(self):
- self.init()
- self.vm_start(
- 'arm',
- 'bookworm',
- image='isar-image-ci',
- cmd='lsmod | grep example_module',
- keep=True,
- )
-
- def test_arm_bookworm_getty_target(self):
- self.init()
- self.vm_start(
- 'arm',
- 'bookworm',
- image='isar-image-ci',
- script='test_systemd_unit.sh getty.target 10',
- )
-
- def test_amd64_trixie(self):
- self.init()
- self.vm_start('amd64', 'trixie')
-
- def test_arm64_trixie(self):
- self.init()
- self.vm_start('arm64', 'trixie')
-
-
-class VmBootTestFull(CIBaseTest):
-
- """
- Test QEMU image start (full)
-
- :avocado: tags=startvm,full
- """
-
- def test_arm_bullseye(self):
- self.init()
- self.vm_start('arm', 'bullseye')
-
- def test_arm_buster(self):
- self.init()
- self.vm_start('arm', 'buster', image='isar-image-ci', keep=True)
-
- def test_arm_buster_example_module(self):
- self.init()
- self.vm_start(
- 'arm',
- 'buster',
- image='isar-image-ci',
- cmd='lsmod | grep example_module',
- keep=True,
- )
-
- def test_arm_buster_getty_target(self):
- self.init()
- self.vm_start(
- 'arm',
- 'buster',
- image='isar-image-ci',
- script='test_systemd_unit.sh getty.target 10',
- )
-
- def test_arm_trixie(self):
- self.init()
- try:
- self.vm_start('arm', 'trixie')
- except exceptions.TestFail:
- self.cancel('KFAIL')
-
- def test_arm64_bookworm(self):
- self.init()
- self.vm_start('arm64', 'bookworm', image='isar-image-ci', keep=True)
-
- def test_arm64_bookworm_getty_target(self):
- self.init()
- self.vm_start(
- 'arm64',
- 'bookworm',
- image='isar-image-ci',
- cmd='systemctl is-active getty.target',
- keep=True,
- )
-
- def test_arm64_bookworm_example_module(self):
- self.init()
- self.vm_start(
- 'arm64',
- 'bookworm',
- image='isar-image-ci',
- script='test_kernel_module.sh example_module',
- keep=True,
- )
-
- def test_arm64_trixie(self):
- self.init()
- self.vm_start('arm64', 'trixie')
-
- def test_i386_buster(self):
- self.init()
- self.vm_start('i386', 'buster')
-
- def test_amd64_buster(self):
- self.init()
- # test efi boot
- self.vm_start('amd64', 'buster', image='isar-image-ci')
-
- def test_amd64_buster_pcbios(self):
- self.init()
- # test pcbios boot
- self.vm_start('amd64', 'buster', True, image='isar-image-ci')
-
- def test_amd64_focal(self):
- self.init()
- self.vm_start('amd64', 'focal', image='isar-image-ci', keep=True)
-
- def test_amd64_focal_example_module(self):
- self.init()
- self.vm_start(
- 'amd64',
- 'focal',
- image='isar-image-ci',
- cmd='lsmod | grep example_module',
- keep=True,
- )
-
- def test_amd64_focal_getty_target(self):
- self.init()
- self.vm_start(
- 'amd64',
- 'focal',
- image='isar-image-ci',
- script='test_systemd_unit.sh getty.target 10',
- )
-
- def test_amd64_bookworm(self):
- self.init()
- self.vm_start('amd64', 'bookworm', image='isar-image-ci', keep=True)
-
- def test_arm_bookworm(self):
- self.init()
- self.vm_start('arm', 'bookworm', image='isar-image-ci')
-
- def test_i386_bookworm(self):
- self.init()
- self.vm_start('i386', 'bookworm')
-
- def test_mipsel_bookworm(self):
- self.init()
- self.vm_start('mipsel', 'bookworm', image='isar-image-ci', keep=True)
-
- def test_amd64_trixie(self):
- self.init()
- self.vm_start('amd64', 'trixie')
-
- def test_mipsel_bookworm_getty_target(self):
- self.init()
- self.vm_start(
- 'mipsel',
- 'bookworm',
- image='isar-image-ci',
- cmd='systemctl is-active getty.target',
- keep=True,
- )
-
- def test_mipsel_bookworm_example_module(self):
- self.init()
- self.vm_start(
- 'mipsel',
- 'bookworm',
- image='isar-image-ci',
- script='test_kernel_module.sh example_module',
- )
-
- def test_riscv64_trixie(self):
- self.init()
- try:
- self.vm_start('riscv64', 'trixie')
- except exceptions.TestFail:
- self.cancel('KFAIL')
-
- def test_amd64_bookworm_iso(self):
- self.init()
- self.vm_start('amd64-iso', 'bookworm', image='isar-image-ci',
- keep = True
- )
-
- def test_amd64_bookworm_iso_system_check(self):
- self.init()
- self.vm_start('amd64-iso', 'bookworm', image='isar-image-ci',
- script='test_system_running.sh 30')
-
-
class World(CIBaseTest):
"""
--
2.39.5
--
You received this message because you are subscribed to the Google Groups "isar-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/isar-users/20260123082501.240751-20-wzh%40ilbers.de.
next prev parent reply other threads:[~2026-01-23 8:25 UTC|newest]
Thread overview: 25+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-01-23 8:24 [PATCH v3 00/20] Various improvements to the testsuite Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 01/20] testsuite: move targets with custom kernel to separate test Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 02/20] testsuite: enable ccache on kernel tests Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 03/20] testsuite: make prebuilt container a feature test Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 04/20] testsuite: make compat test standalone test Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 05/20] testsuite: handle IMAGE_INSTALL solely in cibuilder.py Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 06/20] testsuite: limit cross_debsrc test to subset of packages Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 07/20] testsuite: forward SSTATE_MIRRORS into CI env on sstate Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 08/20] ci: add support for sstate cache Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 09/20] testsuite: make test_cross_deps more specific Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 10/20] testsuite: fix typo in log message in perform_signature_lint Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 11/20] testsuite: fix SignatureTest by avoiding absolute path in bblayers Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 12/20] testsuite: use more recent distros in SignatureTest Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 13/20] testsuite: make SignatureTest idempotent Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 14/20] testsuite: add rootfs target for rootfs only tests Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 15/20] testsuite: refactor sbom tests to avoid overhead Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 16/20] testsuite: make sbuild-flavor test standalone Zhihang Wei
2026-01-23 8:24 ` [PATCH v3 17/20] testsuite: skip VM tests if images are not available Zhihang Wei
2026-01-28 11:54 ` Zhihang Wei
2026-01-28 12:46 ` 'MOESSBAUER, Felix' via isar-users
2026-01-23 8:24 ` [PATCH v3 18/20] testsuite: Group prebuilt_containers related test cases together Zhihang Wei
2026-01-23 8:25 ` Zhihang Wei [this message]
2026-01-23 8:25 ` [PATCH v3 20/20] testsuite: Remove SstateTest from full testsuite Zhihang Wei
2026-01-23 8:37 ` [PATCH v3 00/20] Various improvements to the testsuite Zhihang Wei
2026-01-28 13:01 ` Zhihang Wei
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260123082501.240751-20-wzh@ilbers.de \
--to=wzh@ilbers.de \
--cc=amikan@ilbers.de \
--cc=cedric.hombourger@siemens.com \
--cc=felix.moessbauer@siemens.com \
--cc=isar-users@googlegroups.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox