Re: [PATCH 0/4] Basic hardware testing support

["MOESSBAUER, Felix" <felix.moessbauer@siemens.com>]

On Wed, 2023-05-24 at 04:45 +0200, Uladzimir Bely wrote:
> Isar is currently able to run tests only on qemu targets over SSH.
> 
> This patchset adds basic support of running tests on real hardware
> targets in similar way. There are the following limitations:
> 
> - User `ci` should be pre-configured (e.g., isar-ci-ssh-setup recipe
> used when generating the image), similar to qemu testing;
> - The image should be flashed on the board before running tests;
> - The target should be turned on and accessible over SSH;
> 
> Possible ways to improve this:
> - Support turning on/off the hardware (via USB switches or similar);
> - Automation of board software update.

The flashing and powerctl features are implemented in MTDA [1]. We also
use that in a lab for CI tests of ISAR images on hardware devices.

Felix

[1] https://github.com/siemens/mtda

> 
> Uladzimir Bely (4):
>   cibuilder.py: Refactor vm_start related functions
>   testsuite: Add an interface to run commands over ssh
>   testsuite: Separate common part of kas-based test example
>   testsute: Provide an example of hardware test
> 
>  meta-isar/test/README.md                | 24 ++++++-
>  meta-isar/test/common.sh                | 30 +++++++++
>  meta-isar/test/run_test.sh              | 33 ++-------
>  meta-isar/test/run_test_hw.sh           | 10 +++
>  meta-isar/test/sample_kas_config_hw.yml | 32 +++++++++
>  meta-isar/test/sample_test.py           |  0
>  meta-isar/test/sample_test_hw.py        | 13 ++++
>  testsuite/cibuilder.py                  | 89 +++++++++++++++++------
> --
>  8 files changed, 174 insertions(+), 57 deletions(-)
>  create mode 100755 meta-isar/test/common.sh
>  create mode 100755 meta-isar/test/run_test_hw.sh
>  create mode 100644 meta-isar/test/sample_kas_config_hw.yml
>  mode change 100644 => 100755 meta-isar/test/sample_test.py
>  create mode 100755 meta-isar/test/sample_test_hw.py
> 
> -- 
> 2.20.1
>