Re: [PATCH v14 00/16] Update Avocado testsuite

[Jan Kiszka <jan.kiszka@siemens.com>]

On 30.09.21 18:45, Anton Mikanovich wrote:
> This patchset provides implementation of build and vm_start tests
> functionality in Python with help of Avocado framework.
> Scripts ci_build and vm_smoke_test are rewritten to call Avocado.
> Build and run logs are hidden by default now until an error occurs.
> 
> Resending v14 because v13 was just a copy of v12 by mistake.
> 
> ---
> Changes since v13:
> - Remove legacy scripts.
> Changes since v12:
> - No changes, wrong patchset.
> Changes since v11:
> - Rebase on next.
> - Init environment in vm_smoke_test.
> Changes since v10:
> - Rebase on next.
> - Add DISTRO_APT_PREMIRRORS usage.
> - Remove avocado deb package install.
> - Set default runner.
> Changes since v9:
> - Rebase on next.
> - Fix avocado artifacts path.
> Changes since v8:
> - Remove duplication in logs.
> - Disable sysinfo plugin.
> - Show full errors in default mode.
> Changes since v7:
> - Remove code duplication.
> - Fix build_dir parsing.
> - Add missed protect files backup logic.
> Changes since v6:
> - Improve environment parsing.
> - Protect files backup logic.
> - Rebuild full log output option.
> - Protect ubuntu target with KFAIL.
> Changes since v5:
> - Rebase on current next.
> Changes since v4:
> - Add container tests.
> - Implement testcase skipping logic.
> - Separate and protect Bullseye tests.
> - Add checks for container dependencies.
> - Add Ilbers repo key.
> - Improve error handling.
> - Fix Ubuntu qemu image name.
> Changes since v3:
> - Add automatic bitbake init.
> - Fix line lengths.
> - Fix build without repro.
> - Fix build artifact paths.
> - Prepare for Gitlab build.
> - Change debug settings.
> - Move log splitting to start_vm.
> - Add deb package install.
> Changes since v2:
> - Make CI call Avocado tests.
> - Wait less on vm_start test.
> - Split Roman's vm_start commit.
> - Put logs to build folder.
> - Rearrange patches.
> - Split build test to classes.
> - Add test case tagging.
> - Get rid of avocado-framework-plugin-varianter-yaml-to-mux.
> - Get rid of python-subprocess32.
> - Improve logging.
> Changes since v1:
> - Merge start_vm rebuild patches.
> - Fix patch comments.
> 
> Anton Mikanovich (13):
>   start_vm.py: Fix ubuntu image name
>   vm_boot_test: Fix log file path in vm_boot_test
>   vm_boot_test: Remove external varianter
>   vm_boot_test: Improve QEMU images checking
>   build_test: Refactoring build tests cases
>   testsuite: Add Python generations for testsuite in gitignore
>   testsuite: Fix test suite prepare guide
>   gitlab-ci: Add Avocado build artifacts
>   gitlab-ci: Add debug flag
>   vm_boot_test: Add automatic bitbake init
>   build_test: Protect ubuntu target with KFAIL
>   ci_build: Migrate to Avocado
>   vm_smoke_test: Migrate to Avocado
> 
> Roman Pletnev (3):
>   start_vm.py: Fix target name handling
>   start_vm.py: Add output and PID file vm_start.py options
>   start_vm.py: Add MIPS support
> 
>  .gitlab-ci.yml                         |   5 +-
>  scripts/ci_build.sh                    | 208 ++++---------------------------
>  scripts/vm_smoke_test                  | 120 +++++-------------
>  testsuite/.gitignore                   |   1 +
>  testsuite/README.md                    |  21 +---
>  testsuite/build_test/build_test.py     | 219 ++++++++++++++++++++++++++++++---
>  testsuite/build_test/cibase.py         | 116 +++++++++++++++++
>  testsuite/build_test/cibuilder.py      | 132 ++++++++++++++++++++
>  testsuite/build_test/run.sh            |   3 -
>  testsuite/build_test/run_fast.sh       |   3 +
>  testsuite/build_test/run_full.sh       |   3 +
>  testsuite/build_test/variant.yaml      |  22 ----
>  testsuite/start_vm.py                  |  27 ++--
>  testsuite/vm_boot_test/run.sh          |   3 -
>  testsuite/vm_boot_test/run_fast.sh     |   3 +
>  testsuite/vm_boot_test/run_full.sh     |   3 +
>  testsuite/vm_boot_test/variant.yaml    |  22 ----
>  testsuite/vm_boot_test/vm_boot_test.py | 121 +++++++++++++++---
>  18 files changed, 641 insertions(+), 391 deletions(-)
>  create mode 100644 testsuite/.gitignore
>  create mode 100644 testsuite/build_test/cibase.py
>  create mode 100644 testsuite/build_test/cibuilder.py
>  delete mode 100755 testsuite/build_test/run.sh
>  create mode 100755 testsuite/build_test/run_fast.sh
>  create mode 100755 testsuite/build_test/run_full.sh
>  delete mode 100644 testsuite/build_test/variant.yaml
>  delete mode 100755 testsuite/vm_boot_test/run.sh
>  create mode 100755 testsuite/vm_boot_test/run_fast.sh
>  create mode 100755 testsuite/vm_boot_test/run_full.sh
>  delete mode 100644 testsuite/vm_boot_test/variant.yaml
> 

Didn't you once installed avocado for execution in CI? This is no longer
happening - unless I missed something - and, thus, broke gitlab-ci.

Jan

-- 
Siemens AG, T RDA IOT
Corporate Competence Center Embedded Linux