From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7227180191860129792 X-Received: by 2002:a05:620a:13ae:b0:74e:30c9:63e1 with SMTP id m14-20020a05620a13ae00b0074e30c963e1mr916153qki.12.1682709015294; Fri, 28 Apr 2023 12:10:15 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:622a:514a:b0:3e1:c0bd:797c with SMTP id ew10-20020a05622a514a00b003e1c0bd797cls5227785qtb.9.-pod-prod-gmail; Fri, 28 Apr 2023 12:10:14 -0700 (PDT) X-Google-Smtp-Source: ACHHUZ7QHs1w6/isa7eTsU67Y59Rd3EqeqqW1/wczry54auAbbpsYYsk9+Hri5AXFL06xXxiKCR1 X-Received: by 2002:a05:622a:50d:b0:3ef:3e8a:d46a with SMTP id l13-20020a05622a050d00b003ef3e8ad46amr10655974qtx.62.1682709014596; Fri, 28 Apr 2023 12:10:14 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1682709014; cv=none; d=google.com; s=arc-20160816; b=k0jc0ER/NWmZppcaMNhHvwvB/54OsK1uv11gcZfrcdTHo7gk8ht/7oIXbfJMQzkbcz AxYP+HFldAAKVbHeldc1vlOtGdpIAqWgN0UzcJhczINywltGzgMBQr13tSvQE74M0+Y6 SWkmWw79fmdSTEeNg1hZqQu/UbzDwmqsu2R7ajb8pO4WCz+yInPDqVgIPWA8jabN/wmd 3n4G+oGPolEb+7gkSs07XyT0eyFOQUPt5XouY6PvrQHzrWpcSgiosNsPnvM5ArN+bgHn J8X2NW3wTk8+jm/uxr7CVvfXIDGgmYX43Iq3su2crHub2d2s5/+Q2cdKRU5qbbaicPwo LNrA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from; bh=FIkPaSnt9oz63zzv1UH5HdfJgaEKtrKJs5ELvYnDkr0=; b=IBM3z8J09VeXBT6pUulaV+Jghk257lcqsUYnoPJk5Eae1BG4DG4et8Rvp+ATdkLcj1 Qi+BCt2dLLp8Hj2MYWQgZ7+vC0NgIBaVoPSXKDnFzpzmoF0ZP2plQGlGJ6ltYOPf05gu 1HkRpIAXk8PO1hHVrjJ7XI3dWes9V4TL9kflOpzHNT06+s4+HwOC7p7pqm2+mabGOyt3 i8430ludVPKXWiu49nQanX+C/1Jj07HQbhKQoJix2zAQbxA8EnPkVOwVMI5u/l6OCOzo nuDCZgShnjkdr9b0YCUwRazyerbGMtQ+DLS8f602KiXBdziCbJjy6LicsuZ0e3u2qX5P XGmg== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id p3-20020a05622a00c300b003d2b5e4bce2si1149199qtw.5.2023.04.28.12.10.13 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Fri, 28 Apr 2023 12:10:14 -0700 (PDT) Received-SPF: pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Received: from user-B660.promwad.com (IN-213-226-141-183.bitemobile.lv [213.226.141.183] (may be forged)) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 33SJA7F7011347 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 28 Apr 2023 21:10:08 +0200 From: Anton Mikanovich To: isar-users@googlegroups.com Cc: Anton Mikanovich Subject: [PATCH v1 00/10] Move testsuite hacks to separate layer Date: Fri, 28 Apr 2023 22:09:54 +0300 Message-Id: <20230428191004.243993-1-amikan@ilbers.de> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: vlcPerq3iuGU There are a lot of hacks in Isar are used by testsuite only. Some of them even cause variable setting issues for users. To prevent this kind of issues introduce separate meta-test layer to be used by testsuite only. This patchset also removes variables setting from multiconfigs to allow building without multiconfigs. The current patchset version is not fully tested and lack some documentation, but it should be a good starting point. Known issues: - Image isar-image-ci do not buildable for some targets - Not all the hacks in meta-test can be overriden in local.conf Anton Mikanovich (10): CI: Introduce meta-test layer ubuntu: Fix WKS_FILE overriding CI: Move qemuamd64-bookworm hacks to CI layer CI: Move qemuamd64-bullseye hacks to CI layer CI: Move qemuamd64-buster hacks to CI layer CI: Move qemuarm-bookworm hacks to CI layer CI: Move qemuarm64-bookworm hacks to CI layer meta-isar: Remove qemuamd64-sb settings from multiconfig meta-isar: Remove imx6-sabrelite settings from multiconfig meta-isar: Unify multiconfigs to use weak assignments meta-isar/conf/distro/ubuntu-focal.conf | 2 + meta-isar/conf/machine/imx6-sabrelite.conf | 6 + meta-isar/conf/machine/qemuamd64-sb.conf | 9 + meta-isar/conf/machine/qemuamd64.conf | 9 - .../conf/multiconfig/bananapi-bullseye.conf | 4 +- .../conf/multiconfig/bananapi-buster.conf | 4 +- .../multiconfig/de0-nano-soc-bullseye.conf | 4 +- .../conf/multiconfig/de0-nano-soc-buster.conf | 4 +- .../conf/multiconfig/hikey-bookworm.conf | 4 +- .../conf/multiconfig/hikey-bullseye.conf | 4 +- .../multiconfig/imx6-sabrelite-bullseye.conf | 6 - .../multiconfig/imx6-sabrelite-buster.conf | 6 - .../conf/multiconfig/nanopi-neo-bullseye.conf | 4 +- .../conf/multiconfig/nanopi-neo-buster.conf | 4 +- .../conf/multiconfig/qemuamd64-bookworm.conf | 1 - .../conf/multiconfig/qemuamd64-bullseye.conf | 2 - .../conf/multiconfig/qemuamd64-buster.conf | 4 - .../conf/multiconfig/qemuamd64-focal.conf | 2 - .../multiconfig/qemuamd64-sb-bullseye.conf | 9 - .../conf/multiconfig/qemuarm-bookworm.conf | 6 - .../conf/multiconfig/qemuarm64-bookworm.conf | 3 - .../multiconfig/sifive-fu540-sid-ports.conf | 4 +- .../conf/multiconfig/stm32mp15x-bullseye.conf | 4 +- .../conf/multiconfig/stm32mp15x-buster.conf | 4 +- .../conf/multiconfig/virtualbox-bullseye.conf | 5 +- meta-isar/recipes-ci/images/isar-image-ci.bb | 9 - meta-test/conf/bblayers.conf.sample | 15 + meta-test/conf/conf-notes.txt | 3 + meta-test/conf/layer.conf | 20 ++ meta-test/conf/local.conf.sample | 261 ++++++++++++++++++ meta-test/recipes-ci/images/isar-image-ci.bb | 42 +++ .../isar-ci-ssh-setup/files/postinst | 0 .../isar-ci-ssh-setup_0.1.bb | 0 testsuite/cibuilder.py | 1 + testsuite/citest.py | 32 ++- 35 files changed, 401 insertions(+), 96 deletions(-) delete mode 100644 meta-isar/recipes-ci/images/isar-image-ci.bb create mode 100644 meta-test/conf/bblayers.conf.sample create mode 100644 meta-test/conf/conf-notes.txt create mode 100644 meta-test/conf/layer.conf create mode 100644 meta-test/conf/local.conf.sample create mode 100644 meta-test/recipes-ci/images/isar-image-ci.bb rename {meta-isar => meta-test}/recipes-ci/isar-ci-ssh-setup/files/postinst (100%) rename {meta-isar => meta-test}/recipes-ci/isar-ci-ssh-setup/isar-ci-ssh-setup_0.1.bb (100%) -- 2.34.1