From: Anton Mikanovich <amikan@ilbers.de>
To: isar-users@googlegroups.com
Cc: Anton Mikanovich <amikan@ilbers.de>
Subject: [PATCH 18/23] CI: Execute startvm testcases after building
Date: Mon, 25 Mar 2024 17:55:35 +0200 [thread overview]
Message-ID: <20240325155540.4162990-19-amikan@ilbers.de> (raw)
In-Reply-To: <20240325155540.4162990-1-amikan@ilbers.de>
Move startvm testcases up to be executed right after following targets
git built. Tag them as startvm to allow dsabling with '-startvm'.
Full testsuite was not changed.
Signed-off-by: Anton Mikanovich <amikan@ilbers.de>
---
testsuite/citest.py | 309 +++++++++++++++++++++++++++++++++++---------
1 file changed, 245 insertions(+), 64 deletions(-)
diff --git a/testsuite/citest.py b/testsuite/citest.py
index efabd450..395b2965 100755
--- a/testsuite/citest.py
+++ b/testsuite/citest.py
@@ -145,6 +145,74 @@ class Fast(CIBaseTest):
self.init()
self.perform_build_test(targets)
+
+ """
+ BEGIN: Run tests for test_fast_min
+ """
+ def test_run_amd64_bullseye(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('amd64', 'bullseye', image='isar-image-ci')
+
+
+ def test_run_arm_buster_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'buster', image='isar-image-ci', keep=True)
+
+ def test_run_arm_buster_getty_target(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'buster', image='isar-image-ci',
+ cmd='systemctl is-active getty.target', keep=True)
+
+ def test_run_arm_buster_example_module(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'buster', image='isar-image-ci',
+ script='test_kernel_module.sh example_module')
+
+
+ def test_run_arm_bullseye_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'bullseye', image='isar-image-ci', keep=True)
+
+ def test_run_arm_bullseye_example_module(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'bullseye', image='isar-image-ci',
+ cmd='lsmod | grep example_module', keep=True)
+
+ def test_run_arm_bullseye_getty_target(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'bullseye', image='isar-image-ci',
+ script='test_systemd_unit.sh getty.target 10')
+
+
+ def test_run_arm64_focal(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm64', 'focal', image='isar-image-base')
+
+
def test_fast_debsrc(self):
targets = [
'mc:qemuarm-bookworm:isar-image-ci',
@@ -154,6 +222,34 @@ class Fast(CIBaseTest):
self.init()
self.perform_build_test(targets, debsrc_cache=True)
+
+ def test_run_arm_bookworm_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'bookworm', image='isar-image-ci', keep=True)
+
+ def test_run_arm_bookworm_example_module(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'bookworm', image='isar-image-ci',
+ cmd='lsmod | grep example_module', keep=True)
+
+ def test_run_arm_bookworm_getty_target(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'bookworm', image='isar-image-ci',
+ script='test_systemd_unit.sh getty.target 10')
+ """
+ END: Run tests for test_fast_min
+ """
+
+
def test_fast_kselftest(self):
targets = [
'mc:qemuamd64-bullseye:isar-image-ci',
@@ -233,6 +329,109 @@ class Standard(CIBaseTest):
self.init()
self.perform_build_test(targets)
+
+ """
+ BEGIN: Run tests for test_standard_cross
+ """
+ def test_run_i386_buster(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('i386', 'buster')
+
+
+ def test_run_i386_bullseye(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('i386', 'bullseye')
+
+
+ def test_run_amd64_buster(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ # test efi boot
+ self.vm_start('amd64', 'buster', image='isar-image-ci')
+ # test pcbios boot
+ self.vm_start('amd64', 'buster', True, image='isar-image-ci')
+
+
+ def test_run_mipsel_bullseye(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('mipsel', 'bullseye')
+
+
+ def test_run_amd64_focal_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('amd64', 'focal', image='isar-image-ci', keep=True)
+
+ def test_run_amd64_focal_example_module(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('amd64', 'focal', image='isar-image-ci',
+ cmd='lsmod | grep example_module', keep=True)
+
+ def test_run_amd64_focal_getty_target(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('amd64', 'focal', image='isar-image-ci',
+ script='test_systemd_unit.sh getty.target 10')
+
+
+ def test_run_amd64_bookworm(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('amd64', 'bookworm', image='isar-image-ci')
+
+
+ def test_run_i386_bookworm(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('i386', 'bookworm')
+
+
+ def test_run_mipsel_bookworm_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('mipsel', 'bookworm', image='isar-image-ci', keep=True)
+
+ def test_run_mipsel_bookworm_getty_target(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('mipsel', 'bookworm', image='isar-image-ci',
+ cmd='systemctl is-active getty.target', keep=True)
+
+ def test_run_mipsel_bookworm_example_module(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('mipsel', 'bookworm', image='isar-image-ci',
+ script='test_kernel_module.sh example_module')
+
+
def test_standard_debsrc(self):
targets = [
'mc:qemuarm64-bullseye:isar-image-ci',
@@ -242,6 +441,31 @@ class Standard(CIBaseTest):
self.init()
self.perform_build_test(targets, debsrc_cache=True)
+
+ def test_run_arm64_bullseye_base(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm64', 'bullseye', image='isar-image-ci', keep=True)
+
+ def test_run_arm64_bullseye_getty_target(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm64', 'bullseye', image='isar-image-ci',
+ cmd='systemctl is-active getty.target', keep=True)
+
+ def test_run_arm64_bullseye_example_module(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm64', 'bullseye', image='isar-image-ci',
+ script='test_kernel_module.sh example_module')
+
+
def test_standard_nocross(self):
targets = [
'mc:qemumipsel-buster:isar-image-base',
@@ -251,6 +475,26 @@ class Standard(CIBaseTest):
self.init()
self.perform_build_test(targets, cross=False)
+
+ def test_run_mipsel_buster(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('mipsel', 'buster')
+
+
+ def test_run_arm_bookworm(self):
+ """
+ :avocado: tags=startvm
+ """
+ self.init()
+ self.vm_start('arm', 'bookworm', image='isar-image-ci')
+ """
+ END: Run tests for test_standard_cross
+ """
+
+
def test_standard_rpi(self):
targets = [
'mc:rpi-arm-bullseye:isar-image-base',
@@ -470,75 +714,12 @@ class Source(CIBaseTest):
self.init()
self.perform_source_test(targets)
-class VmBootFast(CIBaseTest):
-
- """
- Test QEMU image start (fast)
-
- :avocado: tags=startvm,fast
- """
-
- def test_amd64_bullseye(self):
- self.init()
- self.vm_start('amd64', 'bullseye', image='isar-image-ci')
-
-
- def test_arm_bullseye_base(self):
- self.init()
- self.vm_start('arm','bullseye', image='isar-image-ci', keep=True)
-
- def test_arm_bullseye_example_module(self):
- self.init()
- self.vm_start('arm','bullseye', image='isar-image-ci',
- cmd='lsmod | grep example_module', keep=True)
-
- def test_arm_bullseye_getty_target(self):
- self.init()
- self.vm_start('arm','bullseye', image='isar-image-ci',
- script='test_systemd_unit.sh getty.target 10')
-
-
- def test_arm_buster_base(self):
- self.init()
- self.vm_start('arm','buster', image='isar-image-ci', keep=True)
-
- def test_arm_buster_getty_target(self):
- self.init()
- self.vm_start('arm','buster', image='isar-image-ci',
- cmd='systemctl is-active getty.target', keep=True)
-
- def test_arm_buster_example_module(self):
- self.init()
- self.vm_start('arm','buster', image='isar-image-ci',
- script='test_kernel_module.sh example_module')
-
-
- def test_arm_bookworm_base(self):
- self.init()
- self.vm_start('arm','bookworm', image='isar-image-ci', keep=True)
-
- def test_arm_bookworm_example_module(self):
- self.init()
- self.vm_start('arm','bookworm', image='isar-image-ci',
- cmd='lsmod | grep example_module', keep=True)
-
- def test_arm_bookworm_getty_target(self):
- self.init()
- self.vm_start('arm','bookworm', image='isar-image-ci',
- script='test_systemd_unit.sh getty.target 10')
-
-
- def test_arm64_focal(self):
- self.init()
- self.vm_start('arm64', 'focal', image='isar-image-base')
-
-
class VmBootFull(CIBaseTest):
"""
Test QEMU image start (full)
- :avocado: tags=startvm,standard,full
+ :avocado: tags=startvm,full
"""
def test_arm64_bullseye_base(self):
--
2.34.1
next prev parent reply other threads:[~2024-03-25 15:56 UTC|newest]
Thread overview: 24+ messages / expand[flat|nested] mbox.gz Atom feed top
2024-03-25 15:55 [PATCH 00/23] Additional CI improvements Anton Mikanovich
2024-03-25 15:55 ` [PATCH 01/23] CI: Introduce Standard CI for cross building Anton Mikanovich
2024-03-25 15:55 ` [PATCH 02/23] CI: Rename cross to fast Anton Mikanovich
2024-03-25 15:55 ` [PATCH 03/23] CI: Rename nocross to full Anton Mikanovich
2024-03-25 15:55 ` [PATCH 04/23] CI: Remove test keyword from class names Anton Mikanovich
2024-03-25 15:55 ` [PATCH 05/23] CI: Rename base test cases Anton Mikanovich
2024-03-25 15:55 ` [PATCH 06/23] CI: Remove cleanup before nocross build Anton Mikanovich
2024-03-25 15:55 ` [PATCH 07/23] CI: Update default target to bookworm Anton Mikanovich
2024-03-25 15:55 ` [PATCH 08/23] CI: Remove duplicated targets Anton Mikanovich
2024-03-25 15:55 ` [PATCH 09/23] CI: Run startvm for all qemu targets Anton Mikanovich
2024-03-25 15:55 ` [PATCH 10/23] CI: Fix errors reporting during startvm Anton Mikanovich
2024-03-25 15:55 ` [PATCH 11/23] CI: Remove logging hack for job.log Anton Mikanovich
2024-03-25 15:55 ` [PATCH 12/23] CI: Do not lost errors on failed processes Anton Mikanovich
2024-03-25 15:55 ` [PATCH 13/23] CI: Remove container package list hack from testsuite Anton Mikanovich
2024-03-25 15:55 ` [PATCH 14/23] CI: Minimize debsrc_cache checking Anton Mikanovich
2024-03-25 15:55 ` [PATCH 15/23] CI: Minimize kselftest checking Anton Mikanovich
2024-03-25 15:55 ` [PATCH 16/23] CI: Do not include testsuites into each other Anton Mikanovich
2024-03-25 15:55 ` [PATCH 17/23] CI: Mark some single testcases with tags Anton Mikanovich
2024-03-25 15:55 ` Anton Mikanovich [this message]
2024-03-25 15:55 ` [PATCH 19/23] CI: Fix missing endline in generated config Anton Mikanovich
2024-03-25 15:55 ` [PATCH 20/23] CI: Remove absolute path to citest.py Anton Mikanovich
2024-03-25 15:55 ` [PATCH 21/23] CI: Create avocado.conf inside build_dir Anton Mikanovich
2024-03-25 15:55 ` [PATCH 22/23] CI: Set also cache dir for Avocado Anton Mikanovich
2024-03-25 15:55 ` [PATCH 23/23] CI: Add make world test case Anton Mikanovich
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20240325155540.4162990-19-amikan@ilbers.de \
--to=amikan@ilbers.de \
--cc=isar-users@googlegroups.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox