From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7236574603632443392 X-Received: by 2002:a05:622a:306:b0:3f5:2006:50ee with SMTP id q6-20020a05622a030600b003f5200650eemr1848689qtw.2.1685566883705; Wed, 31 May 2023 14:01:23 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:ad4:4f92:0:b0:623:8bf3:d76b with SMTP id em18-20020ad44f92000000b006238bf3d76bls122174qvb.0.-pod-prod-02-us; Wed, 31 May 2023 14:01:22 -0700 (PDT) X-Google-Smtp-Source: ACHHUZ7/t0PvowsAPBUJ6PqRzMWf5+hER8jzKDG7wLL5v4in1xXy5UbXYXzujrF2oyVL9gg+dyka X-Received: by 2002:ad4:5947:0:b0:625:e039:5af1 with SMTP id eo7-20020ad45947000000b00625e0395af1mr7722402qvb.42.1685566882890; Wed, 31 May 2023 14:01:22 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1685566882; cv=none; d=google.com; s=arc-20160816; b=PyUMswwKD3gWZN0cQK1Gzx7FFK9A3nAW/l2POD8gvuOyFnr2MdDmMrA443EsZK06DT vM6wTuYmAQQghERfXlTqeaIpZG28QBAV7ypTFNoC5hRuNCBuQKk5tJDngWXBejIYEAr3 k+yYgkVNYi1LxskRo9MuHrmYR++ghSJTG32UobMGkVScgcr9mXYVkRHjgKmpG+bFfcye u06fHxZUKzmU4B9fD5i1FHpppRcyrXI2ZkpRcUxjqru8VaEmpcqC2jND6HhxdS4wLZJi gHgO9UAUni+N0pkb0icF+i+wLQDKHfw9eYNnvgJ1lPJYEhTZqm2UkspoNPdl2Azfxgr3 esvw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:to:from:subject:message-id; bh=IiOi0hekBSiJ7nAokNPgzvQVNffT7A7wYWSkV/q5v54=; b=VzvsobhNft0DGnynq5opWJNFw1sRttTKDcOWipDL4p5ZFCrF41ikgR+Wi1qXmIBRfx LMSoiWD/W5P7qnxQWyMFCUuuclbgeyMMlP1KSFmWEr8HYHXc/68OMhmYWtxmR6JSahB6 dLEd14UXZYnwaTmo5v5TzSUybjgRj2odZQ5jTGCMwuqEpjnUY5IKsPuLxtbO5BFYZjfZ DeCmMFAyNZd94lmyDuC6X0EIdeDXVAnVzJ0Ra4c01gp6kfyN8DvRpV8ZcJyuoE1KMaBH nrcL7zYS2OLmJpyYSzU6cTJRWNLDK3YPIyGBxy2qaaWHyKkrYY1foLV35i/9D2kfvjdX E8LQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id lx4-20020a0562145f0400b006260dab0171si1207669qvb.3.2023.05.31.14.01.21 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Wed, 31 May 2023 14:01:22 -0700 (PDT) Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Received: from [127.0.0.1] (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 34VL1Frl029194 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 31 May 2023 23:01:16 +0200 Message-ID: <36a652b57a6feb00a63a8b87ff3a288777ab2dc9.camel@ilbers.de> Subject: Re: [PATCH 0/4] Basic hardware testing support From: Uladzimir Bely To: isar-users@googlegroups.com Date: Thu, 01 Jun 2023 00:01:08 +0300 In-Reply-To: <20230524024514.17042-1-ubely@ilbers.de> References: <20230524024514.17042-1-ubely@ilbers.de> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.48.1 (by Flathub.org) MIME-Version: 1.0 X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: dg9AicUm9xrc On Wed, 2023-05-24 at 04:45 +0200, Uladzimir Bely wrote: > Isar is currently able to run tests only on qemu targets over SSH. >=20 > This patchset adds basic support of running tests on real hardware > targets in similar way. There are the following limitations: >=20 > - User `ci` should be pre-configured (e.g., isar-ci-ssh-setup recipe > used when generating the image), similar to qemu testing; > - The image should be flashed on the board before running tests; > - The target should be turned on and accessible over SSH; >=20 > Possible ways to improve this: > - Support turning on/off the hardware (via USB switches or similar); > - Automation of board software update. >=20 > Uladzimir Bely (4): > =C2=A0 cibuilder.py: Refactor vm_start related functions > =C2=A0 testsuite: Add an interface to run commands over ssh > =C2=A0 testsuite: Separate common part of kas-based test example > =C2=A0 testsute: Provide an example of hardware test >=20 > =C2=A0meta-isar/test/README.md=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 24 ++++++- > =C2=A0meta-isar/test/common.sh=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 30 +++++++++ > =C2=A0meta-isar/test/run_test.sh=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 33 ++------- > =C2=A0meta-isar/test/run_test_hw.sh=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 | 10 +++ > =C2=A0meta-isar/test/sample_kas_config_hw.yml | 32 +++++++++ > =C2=A0meta-isar/test/sample_test.py=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 |=C2=A0 0 > =C2=A0meta-isar/test/sample_test_hw.py=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 | 13 ++++ > =C2=A0testsuite/cibuilder.py=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 89 ++++++++++++= +++++------ > -- > =C2=A08 files changed, 174 insertions(+), 57 deletions(-) > =C2=A0create mode 100755 meta-isar/test/common.sh > =C2=A0create mode 100755 meta-isar/test/run_test_hw.sh > =C2=A0create mode 100644 meta-isar/test/sample_kas_config_hw.yml > =C2=A0mode change 100644 =3D> 100755 meta-isar/test/sample_test.py > =C2=A0create mode 100755 meta-isar/test/sample_test_hw.py >=20 > --=20 > 2.20.1 >=20 Applied to next. Lava / MTDA / labgrid are under investigation.