[PATCH v1 0/4] Add developers test

[PATCH v1 0/4] Add developers test

[Anton Mikanovich]

Add separate quick 'developers' test for fast checking new patches.
It will test only general Isar logic on basic targets without dealing with
all the functionality.
To execute dev test run avocado testsuite like:

$ avocado run ../testsuite/citest.py -t dev --nrunner-max-parallel-tasks=1

Estimated execution time for dev test is ~20 min.

Anton Mikanovich (4):
  CI: Enable downloads dir sharing
  CI: Add IMAGE_INSTALL override
  CI: Add developers test
  CI: Remove duplicated target

 testsuite/cibuilder.py | 12 +++++++++++-
 testsuite/citest.py    | 33 ++++++++++++++++++++++++++++++++-
 2 files changed, 43 insertions(+), 2 deletions(-)

-- 
2.17.1

[PATCH v1 1/4] CI: Enable downloads dir sharing

[Anton Mikanovich]

Test cases performed in different build dir now can share DL_DIR.

Signed-off-by: Anton Mikanovich <amikan@ilbers.de>
---
 testsuite/cibuilder.py | 9 ++++++++-
 1 file changed, 8 insertions(+), 1 deletion(-)

diff --git a/testsuite/cibuilder.py b/testsuite/cibuilder.py
index d5c83b22..a09b738a 100755
--- a/testsuite/cibuilder.py
+++ b/testsuite/cibuilder.py
@@ -54,7 +54,8 @@ class CIBuilder(Test):
 
     def configure(self, compat_arch=True, cross=None, debsrc_cache=False,
                   container=False, ccache=False, sstate=False, offline=False,
-                  gpg_pub_key=None, wic_deploy_parts=False, **kwargs):
+                  gpg_pub_key=None, wic_deploy_parts=False, dl_dir=None,
+                  **kwargs):
         # write configuration file and set bitbake_args
         # can run multiple times per test case
         self.check_init()
@@ -64,6 +65,9 @@ class CIBuilder(Test):
         if cross is None:
             cross = bool(int(self.params.get('cross', default=0)))
 
+        if dl_dir is None:
+            dl_dir = os.path.join(isar_root, 'downloads')
+
         # get parameters from environment
         distro_apt_premir = os.getenv('DISTRO_APT_PREMIRRORS')
 
@@ -78,6 +82,7 @@ class CIBuilder(Test):
                       f'  sstate = {sstate}\n'
                       f'  gpg_pub_key = {gpg_pub_key}\n'
                       f'  wic_deploy_parts = {wic_deploy_parts}\n'
+                      f'  dl_dir = {dl_dir}\n'
                       f'===================================================')
 
         # determine bitbake_args
@@ -113,6 +118,8 @@ class CIBuilder(Test):
             if ccache:
                 f.write('USE_CCACHE = "1"\n')
                 f.write('CCACHE_TOP_DIR = "${TOPDIR}/ccache"\n')
+            if dl_dir:
+                f.write('DL_DIR = "%s"\n' % dl_dir)
 
         # include ci_build.conf in local.conf
         with open(self.build_dir + '/conf/local.conf', 'r+') as f:
-- 
2.17.1

[PATCH v1 2/4] CI: Add IMAGE_INSTALL override

[Anton Mikanovich]

Allow user to override the list of packages to be built.

Signed-off-by: Anton Mikanovich <amikan@ilbers.de>
---
 testsuite/cibuilder.py | 5 ++++-
 1 file changed, 4 insertions(+), 1 deletion(-)

diff --git a/testsuite/cibuilder.py b/testsuite/cibuilder.py
index a09b738a..e0980f89 100755
--- a/testsuite/cibuilder.py
+++ b/testsuite/cibuilder.py
@@ -55,7 +55,7 @@ class CIBuilder(Test):
     def configure(self, compat_arch=True, cross=None, debsrc_cache=False,
                   container=False, ccache=False, sstate=False, offline=False,
                   gpg_pub_key=None, wic_deploy_parts=False, dl_dir=None,
-                  **kwargs):
+                  image_install=None, **kwargs):
         # write configuration file and set bitbake_args
         # can run multiple times per test case
         self.check_init()
@@ -83,6 +83,7 @@ class CIBuilder(Test):
                       f'  gpg_pub_key = {gpg_pub_key}\n'
                       f'  wic_deploy_parts = {wic_deploy_parts}\n'
                       f'  dl_dir = {dl_dir}\n'
+                      f'  image_install = {image_install}\n'
                       f'===================================================')
 
         # determine bitbake_args
@@ -120,6 +121,8 @@ class CIBuilder(Test):
                 f.write('CCACHE_TOP_DIR = "${TOPDIR}/ccache"\n')
             if dl_dir:
                 f.write('DL_DIR = "%s"\n' % dl_dir)
+            if image_install is not None:
+                f.write('IMAGE_INSTALL = "%s"' % image_install)
 
         # include ci_build.conf in local.conf
         with open(self.build_dir + '/conf/local.conf', 'r+') as f:
-- 
2.17.1

[PATCH v1 3/4] CI: Add developers test

[Anton Mikanovich]

Developers test consist of minimal test cases for patches checking.
To ensure dev test is 'always green' include it into full CI.

Dev test can be executed using 'dev' avocado tag.

Signed-off-by: Anton Mikanovich <amikan@ilbers.de>
---
 testsuite/citest.py | 32 ++++++++++++++++++++++++++++++++
 1 file changed, 32 insertions(+)

diff --git a/testsuite/citest.py b/testsuite/citest.py
index 2dc78015..5db67c9c 100755
--- a/testsuite/citest.py
+++ b/testsuite/citest.py
@@ -17,6 +17,38 @@ try:
 except path.CmdNotFoundError:
     SKOPEO_AVAILABLE = False
 
+class DevTest(CIBaseTest):
+
+    """
+    Developer's test
+
+    :avocado: tags=dev,full
+    """
+    def test_dev(self):
+        targets = [
+            'mc:qemuamd64-bullseye:isar-image-base',
+            'mc:qemuarm-bullseye:isar-image-base'
+                  ]
+
+        self.init()
+        self.perform_build_test(targets, cross=True, image_install="")
+
+    def test_dev_apps(self):
+        targets = [
+            'mc:qemuamd64-bullseye:isar-image-base'
+                  ]
+
+        self.init()
+        self.perform_build_test(targets)
+
+    def test_dev_container(self):
+        targets = [
+            'mc:container-amd64-bullseye:isar-image-base'
+                  ]
+
+        self.init()
+        self.perform_build_test(targets, container=True)
+
 class ReproTest(CIBaseTest):
 
     """
-- 
2.17.1

[PATCH v1 4/4] CI: Remove duplicated target

[Anton Mikanovich]

Cross building of qemuarm-bullseye was already covered by dev test.

Signed-off-by: Anton Mikanovich <amikan@ilbers.de>
---
 testsuite/citest.py | 1 -
 1 file changed, 1 deletion(-)

diff --git a/testsuite/citest.py b/testsuite/citest.py
index 5db67c9c..f422d5f4 100755
--- a/testsuite/citest.py
+++ b/testsuite/citest.py
@@ -102,7 +102,6 @@ class CrossTest(CIBaseTest):
     def test_cross(self):
         targets = [
             'mc:qemuarm-buster:isar-image-base',
-            'mc:qemuarm-bullseye:isar-image-base',
             'mc:qemuarm64-bullseye:isar-image-base',
             'mc:de0-nano-soc-bullseye:isar-image-base',
             'mc:stm32mp15x-buster:isar-image-base'
-- 
2.17.1

Re: [PATCH v1 0/4] Add developers test

[Moessbauer, Felix]

On Tue, 2022-11-29 at 14:43 +0300, Anton Mikanovich wrote:
> Add separate quick 'developers' test for fast checking new patches.

Looks like this feature is added for me :)

> It will test only general Isar logic on basic targets without dealing
> with
> all the functionality.
> To execute dev test run avocado testsuite like:
> 
> $ avocado run ../testsuite/citest.py -t dev --nrunner-max-parallel-
> tasks=1

Can we please put this into the documentation.
Otherwise nobody will find it.

Felix

> 
> Estimated execution time for dev test is ~20 min.
> 
> Anton Mikanovich (4):
>   CI: Enable downloads dir sharing
>   CI: Add IMAGE_INSTALL override
>   CI: Add developers test
>   CI: Remove duplicated target
> 
>  testsuite/cibuilder.py | 12 +++++++++++-
>  testsuite/citest.py    | 33 ++++++++++++++++++++++++++++++++-
>  2 files changed, 43 insertions(+), 2 deletions(-)
> 
> -- 
> 2.17.1
>