Re: [PATCH v2 00/17] Various improvements to the testsuite

["'MOESSBAUER, Felix' via isar-users" <isar-users@googlegroups.com>]

On Wed, 2026-01-07 at 15:48 +0200, Anton Mikanovich wrote:
> 07/01/2026 15:13, MOESSBAUER, Felix wrote:
> > Ok, but which issues exactly remain? In v2,p3 ("testsuite: make
> > prebuilt container a feature test") the dependency between the prebuilt
> > containers and the VM tests testing these have been resolved. In
> > addition, missing VM tests (where the whole image is missing) are
> > skipped now (p17).
> > 
> > Felix
> > 
> Issues I've originally reported are still there.
> 
> Your approach is not working because for 
> test_amd64_bookworm_prebuilt_containers
> test case execution it will reuse QEMU machine already started in
> test_amd64_bookworm test case (because of keep=True option in it, this is
> startvm tests speedup optimization). And there were no prebuilt-img packages
> installed in that image.

This is a suboptimal test design. We can only test things we have, and
we should also strictly model it like that. Unfortunately we can't
model inter-test dependencies in avocado (at least I did not find a way
to express "run this test before another one"). Performance
optimization must not be an excuse here. I know performance is an
issue, but we need to work on the root cause.

> Did you try to run full CI?

Unfortunately I can't, because I don't have a system powerful enough to
execute the full testsuite (which also allows nested virtualization).

> 
> Moreover I'm against adding building step inside startvm test cases in 
> general.

Then we need to switch to another test framework to be able to express
inter test dependencies.

Felix

-- 
Siemens AG
Linux Expert Center
Friedrich-Ludwig-Bauer-Str. 3
85748 Garching, Germany

-- 
You received this message because you are subscribed to the Google Groups "isar-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/isar-users/13578c7e00b150b98aa1de73fee4d055c9a23896.camel%40siemens.com.