From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7236574603632443392 X-Received: by 2002:a05:651c:14b:b0:2a7:adf7:1788 with SMTP id c11-20020a05651c014b00b002a7adf71788mr3983309ljd.1.1684902614650; Tue, 23 May 2023 21:30:14 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:ac2:5b46:0:b0:4f1:4c37:e1cb with SMTP id i6-20020ac25b46000000b004f14c37e1cbls899623lfp.0.-pod-prod-09-eu; Tue, 23 May 2023 21:30:13 -0700 (PDT) X-Google-Smtp-Source: ACHHUZ5EdCsQMHR/YVrqIrxvttHJUH7+SF3nTXMbrp1opL24sdSZEwFkMWLjGdBK4x0L1vllzYLB X-Received: by 2002:a05:6512:21e:b0:4f4:cae3:8a2f with SMTP id a30-20020a056512021e00b004f4cae38a2fmr150564lfo.16.1684902613019; Tue, 23 May 2023 21:30:13 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1684902613; cv=none; d=google.com; s=arc-20160816; b=hJ08OlWQmfGHZHo75xS6xsXIS9vlCPnlPN1ui0y7d4g9WLpg7ddJuuMczNoXQmVNKp oLXbkAjNJhiHtnxHx9L/ga544UYeWqdf/gfosAhT9GoWdebC2UXHaakkFarGsyOXYwpT YgoBOJtqyMFA9dGRoHherbLS0xP4IkogUWiqTeaYPhFl4mLdG1RKS4gHLkVbWGwxO9HU Gs/MKogpMvg7TUNwYhSuxGIkoh3AmtppdaIsx3tXQ2moCfRgTlgWAiKCOrjzbVa0MVy1 gbWkrTp0+9Byg6pfjn/SODnzQ/B6X2GUrYtLQyeAi1nLkTNKRg2Tj2jLsyKbPASTdr0b 4GyQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=feedback-id:mime-version:content-transfer-encoding:references :in-reply-to:date:to:from:subject:message-id:dkim-signature; bh=3o3I8THGlnDZQy6czaQeQWboq5JJqsWcOelyYfJaC2I=; b=ZxsETIwOmFUchkPzIqR+K1Mh7X/CW+KcIlPJVgT3hjmcgWWlfG6ImcXaBTL3EZjxxU O3N+Q0nv4j65tzRR0FxepcIoBK5IwYM5JYYSYEoRtIy5G5rlhoQFoNp3A7IS1++kZKGN EzvrOzw0xMGN7j/4zpxZ6q3THkEL2ZmbPgXfcHfZVPrtPmvKvMxjtMqVlOg2YSCMPoPy l6pO/tQjodqYiO5ykkHYqBm0tFNc8HgABwVWAIryDziEhMZ4I1Li/QSONkuawpKPi7nS 15CJs421DG/nk2Tlfsh1/AVwV9QbZ8JtO6qeXSUANjXakguCRSUROWgAKrsxODf8LvYv n5iQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b="Vv/ylm1E"; spf=pass (google.com: domain of fm-68982-20230524043011f9c2863a72f454f12b-d2jy__@rts-flowmailer.siemens.com designates 185.136.65.225 as permitted sender) smtp.mailfrom=fm-68982-20230524043011f9c2863a72f454f12b-d2jY__@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Return-Path: Received: from mta-65-225.siemens.flowmailer.net (mta-65-225.siemens.flowmailer.net. [185.136.65.225]) by gmr-mx.google.com with ESMTPS id h16-20020a056512221000b004f3b2f0559asi880124lfu.5.2023.05.23.21.30.12 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 23 May 2023 21:30:12 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-68982-20230524043011f9c2863a72f454f12b-d2jy__@rts-flowmailer.siemens.com designates 185.136.65.225 as permitted sender) client-ip=185.136.65.225; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b="Vv/ylm1E"; spf=pass (google.com: domain of fm-68982-20230524043011f9c2863a72f454f12b-d2jy__@rts-flowmailer.siemens.com designates 185.136.65.225 as permitted sender) smtp.mailfrom=fm-68982-20230524043011f9c2863a72f454f12b-d2jY__@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: by mta-65-225.siemens.flowmailer.net with ESMTPSA id 20230524043011f9c2863a72f454f12b for ; Wed, 24 May 2023 06:30:12 +0200 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; s=fm1; d=siemens.com; i=florian.bezdeka@siemens.com; h=Date:From:Subject:To:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:References:In-Reply-To; bh=3o3I8THGlnDZQy6czaQeQWboq5JJqsWcOelyYfJaC2I=; b=Vv/ylm1EIuCDR795hFe143EnKs2PUn9cmHd00+vSE1fJYLKPGT0Ojy6rgPA8tsR17XNdz2 1lb1WFCljZRBnDpFXJlVrp5sec5L69dqbreIxMn2ZSMtb+4s86Lf4k7gw79oWhHoNybZTX3z 8v0vFga2H3xQGQ9cSncfLENzby7Gc=; Message-ID: <01510fd6fb6722d661b7d23e6e3ba4f89440498f.camel@siemens.com> Subject: Re: [PATCH 0/4] Basic hardware testing support From: Florian Bezdeka To: "MOESSBAUER, Felix" , "ubely@ilbers.de" , "isar-users@googlegroups.com" Date: Wed, 24 May 2023 06:30:10 +0200 In-Reply-To: <06fd09e60c6af243f836bc06736b05218734e9d3.camel@siemens.com> References: <20230524024514.17042-1-ubely@ilbers.de> <06fd09e60c6af243f836bc06736b05218734e9d3.camel@siemens.com> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-68982:519-21489:flowmailer X-TUID: KYSoN69sTzxL On Wed, 2023-05-24 at 03:06 +0000, 'MOESSBAUER, Felix' via isar-users wrote: > On Wed, 2023-05-24 at 04:45 +0200, Uladzimir Bely wrote: > > Isar is currently able to run tests only on qemu targets over SSH. > >=20 > > This patchset adds basic support of running tests on real hardware > > targets in similar way. There are the following limitations: > >=20 > > - User `ci` should be pre-configured (e.g., isar-ci-ssh-setup recipe > > used when generating the image), similar to qemu testing; > > - The image should be flashed on the board before running tests; > > - The target should be turned on and accessible over SSH; > >=20 > > Possible ways to improve this: > > - Support turning on/off the hardware (via USB switches or similar); > > - Automation of board software update. >=20 > The flashing and powerctl features are implemented in MTDA [1]. We also > use that in a lab for CI tests of ISAR images on hardware devices. I would say flashing is not necessary or at least no hard requirement. We have LAVA (tool behind kernelci) setups deployed that implement NFS based booting of ISAR generated images. One public available instance is lava.xenomai.org. Example test runs can be found at [1] with the CI triggers coming from the xenomai-images project [2]. Florian [1] https://lava.xenomai.org/scheduler/alljobs [2] https://source.denx.de/Xenomai/xenomai-images >=20 > Felix >=20 > [1] https://github.com/siemens/mtda >=20 > >=20 > > Uladzimir Bely (4): > > =C2=A0 cibuilder.py: Refactor vm_start related functions > > =C2=A0 testsuite: Add an interface to run commands over ssh > > =C2=A0 testsuite: Separate common part of kas-based test example > > =C2=A0 testsute: Provide an example of hardware test > >=20 > > =C2=A0meta-isar/test/README.md=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 24 ++++++- > > =C2=A0meta-isar/test/common.sh=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 30 +++++++++ > > =C2=A0meta-isar/test/run_test.sh=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 33 ++------- > > =C2=A0meta-isar/test/run_test_hw.sh=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 | 10 +++ > > =C2=A0meta-isar/test/sample_kas_config_hw.yml | 32 +++++++++ > > =C2=A0meta-isar/test/sample_test.py=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0 |=C2=A0 0 > > =C2=A0meta-isar/test/sample_test_hw.py=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 | 13 ++++ > > =C2=A0testsuite/cibuilder.py=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 89 +++++++++= ++++++++------ > > -- > > =C2=A08 files changed, 174 insertions(+), 57 deletions(-) > > =C2=A0create mode 100755 meta-isar/test/common.sh > > =C2=A0create mode 100755 meta-isar/test/run_test_hw.sh > > =C2=A0create mode 100644 meta-isar/test/sample_kas_config_hw.yml > > =C2=A0mode change 100644 =3D> 100755 meta-isar/test/sample_test.py > > =C2=A0create mode 100755 meta-isar/test/sample_test_hw.py > >=20 > > --=20 > > 2.20.1 > >=20 >=20