[PATCH 0/3] Fix and speedup CI tests

[PATCH 0/3] Fix and speedup CI tests

[Anton Mikanovich]

This patchset fix some test cases and speedup fast CI test up to
15% (~35min for test server) and full CI test up to 17% (~2h).

Anton Mikanovich (3):
  CI: Change repro signed test case targets
  CI: Fix test conditions
  CI: Reduce debsrc_cache enabled targets

 testsuite/cibuilder.py |  2 +-
 testsuite/citest.py    | 16 +++++++++-------
 2 files changed, 10 insertions(+), 8 deletions(-)

-- 
2.17.1

[PATCH 1/3] CI: Change repro signed test case targets

[Anton Mikanovich]

Building kernel twice consume too much build time in repro test.
Set other arm+wic target which do not build kernel to speed it up.

Signed-off-by: Anton Mikanovich <amikan@ilbers.de>
---
 testsuite/citest.py | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/testsuite/citest.py b/testsuite/citest.py
index 1138eb2..ddeca69 100755
--- a/testsuite/citest.py
+++ b/testsuite/citest.py
@@ -26,7 +26,7 @@ class ReproTest(CIBaseTest):
     """
     def test_repro_signed(self):
         targets = [
-            'mc:de0-nano-soc-bullseye:isar-image-base',
+            'mc:bananapi-bullseye:isar-image-base',
             'mc:qemuarm64-bullseye:isar-image-base'
                   ]
 
-- 
2.17.1

[PATCH 2/3] CI: Fix test conditions

[Anton Mikanovich]

Move all tests to use new init and config scheme.

Signed-off-by: Anton Mikanovich <amikan@ilbers.de>
---
 testsuite/citest.py | 6 ++++--
 1 file changed, 4 insertions(+), 2 deletions(-)

diff --git a/testsuite/citest.py b/testsuite/citest.py
index ddeca69..2def9e0 100755
--- a/testsuite/citest.py
+++ b/testsuite/citest.py
@@ -164,8 +164,9 @@ class NoCrossTest(CIBaseTest):
             'mc:rpi-arm64-v8-bullseye:isar-image-base'
                   ]
 
+        self.init()
         try:
-            self.perform_build_test(targets, 0, None)
+            self.perform_build_test(targets, cross=False)
         except:
             self.cancel('KFAIL')
 
@@ -190,8 +191,9 @@ class NoCrossTest(CIBaseTest):
             'mc:sifive-fu540-sid-ports:isar-image-base'
                   ]
 
+        self.init()
         try:
-            self.perform_build_test(targets, 0, None)
+            self.perform_build_test(targets, cross=False)
         except:
             self.cancel('KFAIL')
 
-- 
2.17.1

[PATCH 3/3] CI: Reduce debsrc_cache enabled targets

[Anton Mikanovich]

To speed up CI testing disable cache-deb-src feature by default just
like local.conf.sample does and enable it only for few targets.
Enable debsrc_cache also for Raspberry targets to cover custom distros.

Signed-off-by: Anton Mikanovich <amikan@ilbers.de>
---
 testsuite/cibuilder.py |  2 +-
 testsuite/citest.py    | 10 +++++-----
 2 files changed, 6 insertions(+), 6 deletions(-)

diff --git a/testsuite/cibuilder.py b/testsuite/cibuilder.py
index 069a1d9..44d31aa 100755
--- a/testsuite/cibuilder.py
+++ b/testsuite/cibuilder.py
@@ -52,7 +52,7 @@ class CIBuilder(Test):
         if not hasattr(self, 'build_dir'):
             self.error("Broken test implementation: need to call init().")
 
-    def configure(self, compat_arch=True, cross=None, debsrc_cache=True,
+    def configure(self, compat_arch=True, cross=None, debsrc_cache=False,
                   container=False, ccache=False, sstate=False, offline=False,
                   gpg_pub_key=None, **kwargs):
         # write configuration file and set bitbake_args
diff --git a/testsuite/citest.py b/testsuite/citest.py
index 2def9e0..8f47338 100755
--- a/testsuite/citest.py
+++ b/testsuite/citest.py
@@ -71,7 +71,7 @@ class CrossTest(CIBaseTest):
                   ]
 
         self.init()
-        self.perform_build_test(targets, cross=True)
+        self.perform_build_test(targets, cross=True, debsrc_cache=True)
 
     def test_cross_rpi(self):
         targets = [
@@ -80,7 +80,7 @@ class CrossTest(CIBaseTest):
 
         self.init()
         try:
-            self.perform_build_test(targets, cross=True)
+            self.perform_build_test(targets, cross=True, debsrc_cache=True)
         except:
             self.cancel('KFAIL')
 
@@ -154,7 +154,7 @@ class NoCrossTest(CIBaseTest):
         self.init()
         # Cleanup after cross build
         self.delete_from_build_dir('tmp')
-        self.perform_build_test(targets, cross=False)
+        self.perform_build_test(targets, cross=False, debsrc_cache=True)
 
     def test_nocross_rpi(self):
         targets = [
@@ -166,7 +166,7 @@ class NoCrossTest(CIBaseTest):
 
         self.init()
         try:
-            self.perform_build_test(targets, cross=False)
+            self.perform_build_test(targets, cross=False, debsrc_cache=True)
         except:
             self.cancel('KFAIL')
 
@@ -215,7 +215,7 @@ class RebuildTest(CIBaseTest):
             file.write('do_fetch_append() {\n\n}')
 
         try:
-            self.perform_build_test('mc:qemuamd64-bullseye:isar-image-base')
+            self.perform_build_test('mc:qemuamd64-bullseye:isar-image-base', debsrc_cache=True)
         finally:
             self.restorefile(dpkgbase_file)
 
-- 
2.17.1

Re: [PATCH 0/3] Fix and speedup CI tests

[Anton Mikanovich]

21.03.2022 20:52, Anton Mikanovich wrote:
> This patchset fix some test cases and speedup fast CI test up to
> 15% (~35min for test server) and full CI test up to 17% (~2h).
>
> Anton Mikanovich (3):
>    CI: Change repro signed test case targets
>    CI: Fix test conditions
>    CI: Reduce debsrc_cache enabled targets
>
>   testsuite/cibuilder.py |  2 +-
>   testsuite/citest.py    | 16 +++++++++-------
>   2 files changed, 10 insertions(+), 8 deletions(-)

Applied to next.