From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7268555392064421888 X-Received: by 2002:a5d:5946:0:b0:317:49e9:c57 with SMTP id e6-20020a5d5946000000b0031749e90c57mr11839724wri.43.1692891338656; Thu, 24 Aug 2023 08:35:38 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:600c:15d6:b0:3fb:b071:d165 with SMTP id v22-20020a05600c15d600b003fbb071d165ls121611wmf.0.-pod-prod-02-eu; Thu, 24 Aug 2023 08:35:36 -0700 (PDT) X-Google-Smtp-Source: AGHT+IGFWxyFj1zpIRapF+aeitarzzezENz1kqX8heIQYwQL9nhras/IlDL6P8rwgVLxv8qoPkj3 X-Received: by 2002:a7b:cd8a:0:b0:400:8d91:ffea with SMTP id y10-20020a7bcd8a000000b004008d91ffeamr3215830wmj.37.1692891336721; Thu, 24 Aug 2023 08:35:36 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1692891336; cv=none; d=google.com; s=arc-20160816; b=s+L8zAaY/mtrOMZJ2p1Elf1+tbKqpw9lH6y00+blBuu+SJ/irdMfWGgKKIQgvJ0pUw 4SuTegxZ1VWypCceWKJa+Mz5X15/7D+shEj5ACij01K4SZ7A2gRWhvmy0Z7HIk+/u4RK X1yU3peBqRNtWiwO5F1jG0lJWM9pBMJVjP0Z4Ztc4aBoucOrPP/3dbWZB/u10IDmGFWe Pe6Q9us1DEgEFRjDAPMjrq5OhFpL6ESsLDrDA6LW9IOzH+trPPeP4kFpw2bEX4Ml3DEb qY8DmBPC/bBpObZIqpFlESS6cdhxmSypKS7NUSCimJjvfwrs/hcuklHV0dJadUVG1zT5 Nxbw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:to:from:subject:message-id; bh=hykjLgog7xfC5SgBhA9Ln7JZvZ7TWOcamVQmDCAkKvc=; fh=7tclEdh7YbwSQowgJ6LNq720O7H5HTEaqj22NJWRE2E=; b=Job/gTJXJxmwHD55XJa1DKEGqJKtZ7Rw0vrerDVsxsVQZDnG8vrbgFsQglEOpI0FlE HIR1ZtY96jqrJTaSQ4DnYhcCA9B/prgu3xBqpjwNpHKXigke0IWJBAJN7eQBy7ESyrPy VvLqGxFTXC8tPMcN9jG8/lAhYq6FVomcKYlJ4hi1RG+jrH53ccEXfuNj5MDfU7gT6OiA g/+Pj67bb3L3K5eW6ZhgU7FDGcvc8RAr8eIAxOXqVsR/JHa3poU2X4qA8jkkMGCL+aDb B88iGy2NV05DrjtbWEBTvOLnComeE04JyAeqgwO81MoIs5IYWnkD5ma0yt803W4c2/Xw vtjA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id o18-20020a05600c511200b003fe18653557si165473wms.1.2023.08.24.08.35.36 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Thu, 24 Aug 2023 08:35:36 -0700 (PDT) Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Received: from [127.0.0.1] (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 37OFZZLs020618 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 24 Aug 2023 17:35:35 +0200 Message-ID: Subject: Re: [PATCH 0/8] Testsuite improvements for SSH-based tests From: Uladzimir Bely To: isar-users@googlegroups.com Date: Thu, 24 Aug 2023 18:34:24 +0300 In-Reply-To: <20230818070706.27913-1-ubely@ilbers.de> References: <20230818070706.27913-1-ubely@ilbers.de> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.48.4 (by Flathub.org) MIME-Version: 1.0 X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: Zcx6dxu6OoBQ On Fri, 2023-08-18 at 09:06 +0200, Uladzimir Bely wrote: > This patchset expands testsuite capabilities in the field of > SSH-based tests: >=20 > 1. Remote scripts can now accept additional arguments. >=20 > 2. Return code, stdout and stderr from remote scripts and commands > can now be handled in the tests. >=20 > 3. Several tests can now reuse the same qemu process and don't need > to start/kill it in each test. >=20 > Uladzimir Bely (8): > =C2=A0 cibuilder.py: Support custom arguments passing to CI scripts > =C2=A0 meta-isar: Add more extra space to qemu ext4 images > =C2=A0 cibuilder.py: Split vm_start function to smaller subfunctions > =C2=A0 cibuilder.py: Simplify remote_run command > =C2=A0 cibuilder.py: Reuse the same qemu machine in ssh-based tests > =C2=A0 citest.py: Adapt tests to qemu reuse > =C2=A0 cibuilder.py: enable output from remote scripts > =C2=A0 testsuite: Switch to remote scripts with arguments >=20 > =C2=A0meta-isar/conf/machine/qemuarm.conf=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 |= =C2=A0=C2=A0 1 + > =C2=A0meta-isar/conf/machine/qemuarm64.conf=C2=A0=C2=A0=C2=A0 |=C2=A0=C2= =A0 1 + > =C2=A0meta-isar/conf/machine/qemumipsel.conf=C2=A0=C2=A0 |=C2=A0=C2=A0 1 = + > =C2=A0meta-isar/conf/machine/qemuriscv64.conf=C2=A0 |=C2=A0=C2=A0 1 + > =C2=A0testsuite/README.md=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 |=C2=A0=C2=A0 2 +- > =C2=A0testsuite/cibuilder.py=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 339 +++++= ++++++++++------ > -- > =C2=A0testsuite/citest.py=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 | 136 +++++---- > =C2=A0testsuite/scripts/test_example_module.sh |=C2=A0=C2=A0 5 - > =C2=A0testsuite/scripts/test_getty_target.sh=C2=A0=C2=A0 |=C2=A0=C2=A0 7 = - > =C2=A0testsuite/scripts/test_kernel_module.sh=C2=A0 |=C2=A0=C2=A0 5 + > =C2=A0testsuite/scripts/test_systemd_unit.sh=C2=A0=C2=A0 |=C2=A0 23 ++ > =C2=A011 files changed, 335 insertions(+), 186 deletions(-) > =C2=A0delete mode 100755 testsuite/scripts/test_example_module.sh > =C2=A0delete mode 100755 testsuite/scripts/test_getty_target.sh > =C2=A0create mode 100755 testsuite/scripts/test_kernel_module.sh > =C2=A0create mode 100755 testsuite/scripts/test_systemd_unit.sh >=20 > --=20 > 2.20.1 >=20 Applied to next.