From mboxrd@z Thu Jan  1 00:00:00 1970
X-GM-THRID: 7197811629045579776
X-Received: by 2002:a81:b603:0:b0:533:99bb:c296 with SMTP id u3-20020a81b603000000b0053399bbc296mr476683ywh.5.1676976963260;
        Tue, 21 Feb 2023 02:56:03 -0800 (PST)
X-BeenThere: isar-users@googlegroups.com
Received: by 2002:a25:e085:0:b0:967:525f:f280 with SMTP id x127-20020a25e085000000b00967525ff280ls1891726ybg.2.-pod-prod-gmail;
 Tue, 21 Feb 2023 02:56:02 -0800 (PST)
X-Google-Smtp-Source: AK7set/HQQ4HCmVNtfBMFyEV+g+xnogZ4kl4+pBkQeh9OYBLXuv0eoTAR58ZK28rYxeEHLJ4fJuj
X-Received: by 2002:a5b:c12:0:b0:923:6dd2:af97 with SMTP id f18-20020a5b0c12000000b009236dd2af97mr4353441ybq.45.1676976962431;
        Tue, 21 Feb 2023 02:56:02 -0800 (PST)
ARC-Seal: i=1; a=rsa-sha256; t=1676976962; cv=none;
        d=google.com; s=arc-20160816;
        b=cOw1D1SzGwTeZ8tjpnKgRhDvDTSeaEenqZn3rM4Z6DVIaUtZ4iXn0rOYLTGphrvZZc
         1hx41cuqSEO7pyPoIKpsGwqsQHGhbD6jtVGZEdRxULl9cYEfa3XFXCeAz+a2wcLVAMVs
         J8JgGNnxx13d8/5z0e2iARNRstrrlS1nEC2/rXDosAKif+aT5H12Z01CmrJ/Bo8W0ri9
         7zMct1MlyF4MxC5fBNKd/yiJ4Nm9IjVm0LoVw9WpD5tYinSE2DMHWB1HaTDQHpKIkSsV
         SO/3gXlyk25FFO/vLb9gmxgvyonRP9b1tzrt/Wjqjo6iLj8KXWfAiJF4D5biTCwYJKoR
         L8gQ==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816;
        h=content-transfer-encoding:mime-version:references:in-reply-to
         :message-id:date:subject:to:from;
        bh=lF3xv/ptt49M4EvqVXOEGyWA/6gG/0MBljjwbRTh3Rg=;
        b=iONoB2x97afvDjDsEsQN6b5t1MR8ZWVEvK+mS5jmzvtPfxGGXFYsco2RnHkxRsonHq
         +7pTh27J7RDYGhYBS1rUph4cqJJh4HHbzSF6CUcylYqMBbKlpPc1ktGTpcWdNIZnWL46
         8aZGIHto+S7zJqo3KIyjMHUZCeA22qorxPKfq4hfXXSroxUqsBSWcEXzxQKru9LQUGK8
         NO8t3KDIuQNQxqKqdEhgRMIDGPqmIWebbU7gpAbpMDrDDX9uVdpD3l+MAX5oTSI9P22g
         Y18egh21+Ld61eP3YdveCdmsYgJwv1y5sGJCN+b9pHx0+uRL8n8hyS2yd31846Vc/D3H
         ty2w==
ARC-Authentication-Results: i=1; gmr-mx.google.com;
       spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de
Return-Path: <ubely@ilbers.de>
Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166])
        by gmr-mx.google.com with ESMTPS id k188-20020a2524c5000000b0090621221d35si346904ybk.2.2023.02.21.02.56.01
        for <isar-users@googlegroups.com>
        (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256);
        Tue, 21 Feb 2023 02:56:02 -0800 (PST)
Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166;
Authentication-Results: gmr-mx.google.com;
       spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de
Received: from home.localnet (44-208-124-178-static.mgts.by [178.124.208.44] (may be forged))
	(authenticated bits=0)
	by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 31LAtxDs006677
	(version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT)
	for <isar-users@googlegroups.com>; Tue, 21 Feb 2023 11:56:00 +0100
From: Uladzimir Bely <ubely@ilbers.de>
To: isar-users@googlegroups.com
Subject: Re: [PATCH v2 0/9] Support running custom commands in VM
Date: Tue, 21 Feb 2023 13:56:00 +0300
Message-ID: <4601653.vXUDI8C0e8@home>
In-Reply-To: <20230208154511.1884-1-ubely@ilbers.de>
References: <20230208154511.1884-1-ubely@ilbers.de>
MIME-Version: 1.0
Content-Transfer-Encoding: 7Bit
Content-Type: text/plain; charset="us-ascii"
X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED
	autolearn=unavailable autolearn_force=no version=3.4.2
X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de
X-TUID: iCS6pCsFl4YK

In the email from Wednesday, 8 February 2023 18:45:02 +03 user Uladzimir Bely 
wrote:
> VM run tests implementation in Isar testsuite allows only parsing
> virtual machine boot logs, so the functionality is limited.
> 
> This patchset additionally allows to run custom commands on VM
> that runs in qemu that allows to implement any custom tests.
> 
> The concept is the following.
> 
> For running custom tests SSH is used. So:
> 
>  - SSH server on machine should be configured, so `sshd-regen-keys`
> package needs to be installed in the image.
> 
>  - Ethernet interface on machine should be automatically brought up
> to make host-to-vm port forwarding working.
> 
>  - User in VM we use to connect via SSH should have public SSH key
> in their `~/.ssh/` directory preinstalled.
> 
>  - Since base isar image don't have this included, custom image name
> for vm run tests should be supported. This also allows to make reusing
> Isar testsuite in downstream simpler.
> 
> Changes since v1:
>  - Patches "meta-isar: Fix PCI bus initialization in qemuarm machine"
> and "testsuite: Use random free port for qemu SSH forwarding" are
> excluded from patchset since they are already merged.
>  - User `ci` creation/configuration is moved to a separate package so
> now it can be simply removed from target using apt. No new user flags
> are required anymore.
>  - In addition to simple commands (cmd="<command>"), running custom
> local scripts (script="<script>.sh") on remote machine is implemented.
>  - Appropriate documentation was added.
>  - patchset rebased on top of "Add developers test" patchset which
> is supposed to be merged earlier.
> 
> Notes:
>  - Mixing positional and named arguments, e.g.
> 
> |    self.vm_start('arm','bookworm',
> |    
> |        image='isar-image-ci', script='test_getty_target.sh')
> 
> is still here, since it's easy to read.
> 
> Uladzimir Bely (9):
>   testsuite: Fix failing hostname service in qemu guest
>   testsuite: Add SSH key pair for using in CI
>   meta-isar: Add a recipe that configures ci user
>   meta-isar: Use a separate image recipe in CI
>   testsuite: Allow custom image names in start_vm.py
>   testsuite: Support running custom commands in VM
>   testsuite: Support running custom scripts in VM
>   testsuite: Run custom commands and scripts on some qemu targets
>   testsuite: Update testsuite qemu-related documentation
> 
>  meta-isar/recipes-ci/images/isar-image-ci.bb  |   9 ++
>  .../isar-ci-ssh-setup/files/postinst          |  18 +++
>  .../isar-ci-ssh-setup_0.1.bb                  |  22 ++++
>  testsuite/README.md                           |  41 ++++++-
>  testsuite/cibuilder.py                        | 105 +++++++++++++++++-
>  testsuite/citest.py                           | 105 +++++++++++++++---
>  testsuite/keys/ssh/id_rsa                     |  38 +++++++
>  testsuite/keys/ssh/id_rsa.pub                 |   1 +
>  testsuite/start_vm.py                         |  23 ++--
>  testsuite/test_example_module.sh              |   5 +
>  testsuite/test_getty_target.sh                |   7 ++
>  11 files changed, 341 insertions(+), 33 deletions(-)
>  create mode 100644 meta-isar/recipes-ci/images/isar-image-ci.bb
>  create mode 100644 meta-isar/recipes-ci/isar-ci-ssh-setup/files/postinst
>  create mode 100644
> meta-isar/recipes-ci/isar-ci-ssh-setup/isar-ci-ssh-setup_0.1.bb create mode
> 100644 testsuite/keys/ssh/id_rsa
>  create mode 100644 testsuite/keys/ssh/id_rsa.pub
>  create mode 100644 testsuite/test_example_module.sh
>  create mode 100644 testsuite/test_getty_target.sh


Applied to next.