From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7268555392064421888 X-Received: by 2002:a05:6000:d:b0:317:54de:9718 with SMTP id h13-20020a056000000d00b0031754de9718mr1368335wrx.22.1692342430295; Fri, 18 Aug 2023 00:07:10 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:adf:f6cd:0:b0:319:7a47:8a59 with SMTP id y13-20020adff6cd000000b003197a478a59ls274162wrp.0.-pod-prod-04-eu; Fri, 18 Aug 2023 00:07:08 -0700 (PDT) X-Google-Smtp-Source: AGHT+IF4H46VaQ4roxuJr/1Iglo0QcnbT4bNmJLONHh9gUihKOtIRUDGBZKo6PUfm+hfthyedB/w X-Received: by 2002:a5d:4ac9:0:b0:317:636b:fcb1 with SMTP id y9-20020a5d4ac9000000b00317636bfcb1mr1195382wrs.27.1692342428023; Fri, 18 Aug 2023 00:07:08 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1692342428; cv=none; d=google.com; s=arc-20160816; b=ys7GY/d2RlK+EcMyVI55CKw6DBDMLSmzi+jJAxJd8nP27pCbUu0/E90F992Haw4j98 kh6tGYx7LlZDfDusCC+KjUzFpL840hKmpLY33lH8rJxpVqgzFFpf/yfWgQ7BSN4cqorU 6NbR8fbiQXESPw5TZ/tG4EAEDbxNSr5IK/k7D4L88vgK9WGuy8yzs7ox93x1YSIUtFRb KkxZkPl6w1c+quEHDcfvqB2RJwDnMxlYOfLmGGy573hX/kcG4y38rZmuahKCvsqpquzz UBWajKHxpRocRHbNYU4F8UC0Ysum7tmsWPhX1sS1ytKpoU+fb13LbBGhLv87SWFncSpA 5Oww== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:to :from; bh=GaqaCtRxeD0PFS2vu9di1Cu7rgl8WhWMiLaovxU6VeM=; fh=swRs1+OhWjovx1IrvOlKBWsdq9manB5qdcuGoHoh5Ak=; b=cIOngTZ5gQCFXsH+CTkFYcPO3uSMQE6Gs6AUltChtlD9cjfPjlXZKsW/qn4wf28RdB /7Ine9ZvbefheyY0XmqBwrIX8azflhEw3ZLdheFAI4pIlP8DzMSCvNlfLrNYbADVxsaZ MBXIrPxoFqVrKDHZXFmrNusdbSqR3QrTRHgvAzLmk8z7RgRuNaRpryvxPST1COYMuBV4 W2Ob4l79goQ0xeGmQOIIhlR4l7HYeg5A40o5zl4xsRpfXSYAXrLQLfjKXL2LJ2pIfrd8 kuWsBAFoX/XMNYeqE18r5H14pVbmFGB6W4jCVtQw2WZ471AEQXRC3SSyQqS4kU+o6QCg WOuA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id m27-20020a056000025b00b0031ac9fda4c5si65558wrz.8.2023.08.18.00.07.07 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Fri, 18 Aug 2023 00:07:07 -0700 (PDT) Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Received: from baighyz.m.ilbers.de (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 37I7769g024239 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Fri, 18 Aug 2023 09:07:07 +0200 From: Uladzimir Bely To: isar-users@googlegroups.com Subject: [PATCH 0/8] Testsuite improvements for SSH-based tests Date: Fri, 18 Aug 2023 09:06:58 +0200 Message-Id: <20230818070706.27913-1-ubely@ilbers.de> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: 7W23/VtUylkE This patchset expands testsuite capabilities in the field of SSH-based tests: 1. Remote scripts can now accept additional arguments. 2. Return code, stdout and stderr from remote scripts and commands can now be handled in the tests. 3. Several tests can now reuse the same qemu process and don't need to start/kill it in each test. Uladzimir Bely (8): cibuilder.py: Support custom arguments passing to CI scripts meta-isar: Add more extra space to qemu ext4 images cibuilder.py: Split vm_start function to smaller subfunctions cibuilder.py: Simplify remote_run command cibuilder.py: Reuse the same qemu machine in ssh-based tests citest.py: Adapt tests to qemu reuse cibuilder.py: enable output from remote scripts testsuite: Switch to remote scripts with arguments meta-isar/conf/machine/qemuarm.conf | 1 + meta-isar/conf/machine/qemuarm64.conf | 1 + meta-isar/conf/machine/qemumipsel.conf | 1 + meta-isar/conf/machine/qemuriscv64.conf | 1 + testsuite/README.md | 2 +- testsuite/cibuilder.py | 339 +++++++++++++++-------- testsuite/citest.py | 136 +++++---- testsuite/scripts/test_example_module.sh | 5 - testsuite/scripts/test_getty_target.sh | 7 - testsuite/scripts/test_kernel_module.sh | 5 + testsuite/scripts/test_systemd_unit.sh | 23 ++ 11 files changed, 335 insertions(+), 186 deletions(-) delete mode 100755 testsuite/scripts/test_example_module.sh delete mode 100755 testsuite/scripts/test_getty_target.sh create mode 100755 testsuite/scripts/test_kernel_module.sh create mode 100755 testsuite/scripts/test_systemd_unit.sh -- 2.20.1