From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7236574603632443392 X-Received: by 2002:a17:90b:e8f:b0:24d:fb1d:106d with SMTP id fv15-20020a17090b0e8f00b0024dfb1d106dmr3970684pjb.2.1684896322106; Tue, 23 May 2023 19:45:22 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a62:8607:0:b0:64d:2b93:f620 with SMTP id x7-20020a628607000000b0064d2b93f620ls839054pfd.1.-pod-prod-04-us; Tue, 23 May 2023 19:45:21 -0700 (PDT) X-Google-Smtp-Source: ACHHUZ71wxgg6WMIC/fTrQJBnyfG3MRZjsl0H+tCPCScmix/THCzKp2PF6rmo+7f/Ow79p2ZD7O8 X-Received: by 2002:a05:6a00:158d:b0:64f:3fc8:5d19 with SMTP id u13-20020a056a00158d00b0064f3fc85d19mr1526169pfk.32.1684896321084; Tue, 23 May 2023 19:45:21 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1684896321; cv=none; d=google.com; s=arc-20160816; b=BWqGcrIxI74uBrDSUO8RD0NUTsD+Ws7I6RyEq75RmtkHYFU/skET1S4Rc+/0ORRpHr hkzkj8gltFHtrU7YL5uA723XUt8WRy3aIrsH3ycNNBYk+lOOwhO94KpwAGaf6o8IorJ9 ATVVYU3Kaduo9U5whXLAMWSLOm5gFePR2pJF9n/Cwy9v2PhBsaWm6nPDD1JGvW7NTWI6 ykl1NbxyZhpVHuueQYCQ+9c1ter2tPWd75wsTLD1xmdZMZ2mD0W+8oP6QLg4nHSIrn2j ij0EPmpWXx1HkJVSu59D9Tm6ErC63XhO/lVKaZXw2H7UwmIDcGLtl2W4qZqqKrBltfOr ttWQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:to :from; bh=rqrL1ldoRpJ+8eLRUa60NxYPHLGd+0Rce1LMPgML3no=; b=ax7OhJuMMf4ZQkl1Q8i9DnC+PmiABmlvv1rcU35jLumAUPLP64GY3n06RWweJkggFW fru6z+8U6a4uMWFORXeOs57nq/mtzhHb8fVJZr+McRu1sBTudkwiSKr1+JiZqDejItEy gCrUKkwecX3OLgbGOIBPol2D4EAq8+fKx9tbuJfgcyTnAOQv6yUpNklSr/8ULGITDTVV hZ6HMNeTu/fEeqWPoMiWDe18KXP+xdLygt5GOHvdI7cJTJb7eUd6cHcsmEhFfdiuYHMp ozK1ty975iO7UG8M4tbjin9/uKIzXlblrVXY9fCeN2CjIgJJi3wxX9HFfuIAguZET7K0 ujDQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id 130-20020a630788000000b00513924516ddsi825280pgh.5.2023.05.23.19.45.19 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Tue, 23 May 2023 19:45:20 -0700 (PDT) Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Received: from baighyz.m.ilbers.de (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 34O2jEc4032413 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 24 May 2023 04:45:15 +0200 From: Uladzimir Bely To: isar-users@googlegroups.com Subject: [PATCH 0/4] Basic hardware testing support Date: Wed, 24 May 2023 04:45:10 +0200 Message-Id: <20230524024514.17042-1-ubely@ilbers.de> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: LuL5mNJSDkjP Isar is currently able to run tests only on qemu targets over SSH. This patchset adds basic support of running tests on real hardware targets in similar way. There are the following limitations: - User `ci` should be pre-configured (e.g., isar-ci-ssh-setup recipe used when generating the image), similar to qemu testing; - The image should be flashed on the board before running tests; - The target should be turned on and accessible over SSH; Possible ways to improve this: - Support turning on/off the hardware (via USB switches or similar); - Automation of board software update. Uladzimir Bely (4): cibuilder.py: Refactor vm_start related functions testsuite: Add an interface to run commands over ssh testsuite: Separate common part of kas-based test example testsute: Provide an example of hardware test meta-isar/test/README.md | 24 ++++++- meta-isar/test/common.sh | 30 +++++++++ meta-isar/test/run_test.sh | 33 ++------- meta-isar/test/run_test_hw.sh | 10 +++ meta-isar/test/sample_kas_config_hw.yml | 32 +++++++++ meta-isar/test/sample_test.py | 0 meta-isar/test/sample_test_hw.py | 13 ++++ testsuite/cibuilder.py | 89 +++++++++++++++++-------- 8 files changed, 174 insertions(+), 57 deletions(-) create mode 100755 meta-isar/test/common.sh create mode 100755 meta-isar/test/run_test_hw.sh create mode 100644 meta-isar/test/sample_kas_config_hw.yml mode change 100644 => 100755 meta-isar/test/sample_test.py create mode 100755 meta-isar/test/sample_test_hw.py -- 2.20.1