Re: [PATCH 0/6] Various improvements to the testsuite

["'MOESSBAUER, Felix' via isar-users" <isar-users@googlegroups.com>]

On Wed, 2025-12-17 at 15:08 +0100, Felix Moessbauer wrote:
> This series aims at simplifying and speeding up the testsuite execution.
> This should enable contributors to actually run it and test their patches.

Hi,

I plan to send out a v2 of this series by end of today. This will
contain all "testsuite:" and "ci:" patches recently sent to the ML and
should make applying easier. There are also a couple of fixes in the
more recent parts (not this one), which will be included and marked as
well.

@Anton: Did you already test parts of the series and already have
feedback if it is conceptually ok and also passes your CI?

Best regards,
Felix

> 
> As pointed out in [1], the testsuite currently tests various features over
> and over again, while others are not tested at all. We try to improve this
> by focusing on "feature" tests, whereby each test case checks a set of
> features instead of a whole image. We further identified long running tasks
> (like the kernel builds) and move them to a dedicated test.
> 
> The execution time reduction varies greatly depending on the hardware,
> network and sstate usage. When applying these changes on recently added
> patches, the time was often decreased by more than 50% on "fast".
> 
> Note, that more refactorings of the testsuite are needed - and planned,
> but this series should already address the biggest pain points.
> 
> [1] https://groups.google.com/g/isar-users/c/uZBTIHzLp8Q/m/8k0L1vfMDAAJ
> 
> Best regards,
> Felix Moessbauer
> Siemens AG
> 
> Felix Moessbauer (6):
>   testsuite: move targets with custom kernel to separate test
>   testsuite: enable ccache on kernel tests
>   testsuite: make prebuilt container a feature test
>   testsuite: make compat test standalone test
>   testsuite: handle IMAGE_INSTALL solely in cibuilder.py
>   testsuite: limit cross_debsrc test to subset of packages
> 
>  meta-test/conf/local.conf.sample              | 10 ----
>  .../recipes-core/images/isar-image-ci.bb      |  2 -
>  testsuite/cibuilder.py                        | 24 ++++++--
>  testsuite/citest.py                           | 56 +++++++++++++++++--
>  4 files changed, 71 insertions(+), 21 deletions(-)
> 
> -- 
> 2.51.0

-- 
Siemens AG
Linux Expert Center
Friedrich-Ludwig-Bauer-Str. 3
85748 Garching, Germany

-- 
You received this message because you are subscribed to the Google Groups "isar-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/isar-users/31f7aa927e5f9bafc40a16169521f77b665c1a65.camel%40siemens.com.