From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7239976793797558272 X-Received: by 2002:a9d:74cc:0:b0:6af:95c0:fe1e with SMTP id a12-20020a9d74cc000000b006af95c0fe1emr1776108otl.5.1685688456647; Thu, 01 Jun 2023 23:47:36 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a62:8644:0:b0:650:7fac:ea09 with SMTP id x65-20020a628644000000b006507facea09ls403003pfd.0.-pod-prod-06-us; Thu, 01 Jun 2023 23:47:35 -0700 (PDT) X-Google-Smtp-Source: ACHHUZ4/iEs5zpugvad+nBv7geZBpERdnlkpOGoF/t+h3cPiWbscw8EAvBXKJZnX41Yk2gVIOnsY X-Received: by 2002:a05:6a00:a8f:b0:64d:2ea4:937a with SMTP id b15-20020a056a000a8f00b0064d2ea4937amr16111805pfl.7.1685688455491; Thu, 01 Jun 2023 23:47:35 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1685688455; cv=none; d=google.com; s=arc-20160816; b=EifoXFKf0pFyWUxGOhxIejDDr0wRmlUhO++cyqEh61r7m82WmUZx/zlvw352veLUnu SoR515L9CkoZC0zx9L60sjOKnh005KsOSXcy/a4MNrlomloCHMmTUzaw8/0JxYGyU0iS MeC2XBmH2EvLaes/cviFBK3vn0J8SjPgPtEf6V/7hAlCuh87Pn6KIrXgyCqfyW+fOZmu j1VQpWtRFBUZqclIv+lCAoaxgiPoaKqomwDbUh1xhgwMh+X8cVtAzcj+5bZNcsWZSFnS p3wNH3b0+N3GdRHezunbf4m2d06MeHGdwT7atWRj5dXKBX7ZunqA0pRjlvbISuuFCdn2 zNuQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:to :from; bh=5k/r//sUMvMl40cWIi1sai4Il/wXELJ1CspW2HFTGCY=; b=QMEvvHvoZzbcUAp1AXcL4Ovttrh9JAW2fuH5n19ukGH3pCb1JcjA3uFYb7D7UFnim4 GrKvAE2vjacwd9pFSa4VptLTi90yV5KBDWULANf9TBq1nd3rI6JW8uF3X7p7u+2H+sVk Uws9uBtXhIb8P5OYPhc+gfber/5My5KQE5SGAtg8ieXSlIlYGHkDJTO1rjWOapq0aJvZ UXnn0fZ3AGHntVMONmtrTN0iaWBlLRW+wZlTHwGimINp6Mna+LOPC9wwPmVljDWJH6KV 7L9/qE9zqzx2eA9gemrPO7+iRTUrSVw3NgOYLbnJXEIIPMJlgYOGDChmA0FpKStFe9UU mOeQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id g11-20020a056a000b8b00b006438069d21bsi34154pfj.1.2023.06.01.23.47.34 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Thu, 01 Jun 2023 23:47:35 -0700 (PDT) Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Received: from baighyz.m.ilbers.de (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 3526lTcp003460 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Fri, 2 Jun 2023 08:47:29 +0200 From: Uladzimir Bely To: isar-users@googlegroups.com Subject: [PATCH v2 00/10] Move testsuite hacks to separate layer Date: Fri, 2 Jun 2023 08:47:19 +0200 Message-Id: <20230602064729.10331-1-ubely@ilbers.de> X-Mailer: git-send-email 2.20.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: WqDeYuFBzYmx There are a lot of hacks in Isar are used by testsuite only. Some of them even cause variable setting issues for users. To prevent this kind of issues introduce separate meta-test layer to be used by testsuite only. This patchset also removes variables setting from multiconfigs to allow building without multiconfigs. The current patchset version is not fully tested and lack some documentation, but it should be a good starting point. Changes since v1: - Rebased on latest `next` - Added RECIPE-API-CHANGELOG.md entry The patchset is additionally tested with `meta-iot2050` downstream. Anton Mikanovich (10): CI: Introduce meta-test layer ubuntu: Fix WKS_FILE overriding CI: Move qemuamd64-bookworm hacks to CI layer CI: Move qemuamd64-bullseye hacks to CI layer CI: Move qemuamd64-buster hacks to CI layer CI: Move qemuarm-bookworm hacks to CI layer CI: Move qemuarm64-bookworm hacks to CI layer meta-isar: Remove qemuamd64-sb settings from multiconfig meta-isar: Remove imx6-sabrelite settings from multiconfig meta-isar: Unify multiconfigs to use weak assignments RECIPE-API-CHANGELOG.md | 5 + meta-isar/conf/distro/ubuntu-common.inc | 2 + meta-isar/conf/machine/imx6-sabrelite.conf | 6 + meta-isar/conf/machine/qemuamd64-sb.conf | 9 + meta-isar/conf/machine/qemuamd64.conf | 12 - .../conf/multiconfig/bananapi-bullseye.conf | 4 +- .../conf/multiconfig/bananapi-buster.conf | 4 +- .../multiconfig/de0-nano-soc-bullseye.conf | 4 +- .../conf/multiconfig/de0-nano-soc-buster.conf | 4 +- .../conf/multiconfig/hikey-bookworm.conf | 4 +- .../conf/multiconfig/hikey-bullseye.conf | 4 +- .../multiconfig/imx6-sabrelite-bullseye.conf | 6 - .../multiconfig/imx6-sabrelite-buster.conf | 6 - .../conf/multiconfig/nanopi-neo-bullseye.conf | 4 +- .../conf/multiconfig/nanopi-neo-buster.conf | 4 +- .../conf/multiconfig/qemuamd64-bookworm.conf | 1 - .../conf/multiconfig/qemuamd64-bullseye.conf | 2 - .../conf/multiconfig/qemuamd64-buster.conf | 4 - .../conf/multiconfig/qemuamd64-focal.conf | 2 - .../conf/multiconfig/qemuamd64-jammy.conf | 2 - .../multiconfig/qemuamd64-sb-bullseye.conf | 10 +- .../conf/multiconfig/qemuarm-bookworm.conf | 6 - .../conf/multiconfig/qemuarm64-bookworm.conf | 3 - .../multiconfig/sifive-fu540-sid-ports.conf | 4 +- .../starfive-visionfive2-sid-ports.conf | 4 +- .../conf/multiconfig/stm32mp15x-bullseye.conf | 4 +- .../conf/multiconfig/stm32mp15x-buster.conf | 4 +- .../conf/multiconfig/virtualbox-bullseye.conf | 5 +- meta-isar/recipes-ci/images/isar-image-ci.bb | 9 - meta-test/conf/bblayers.conf.sample | 15 + meta-test/conf/conf-notes.txt | 3 + meta-test/conf/layer.conf | 20 ++ meta-test/conf/local.conf.sample | 264 ++++++++++++++++++ meta-test/recipes-ci/images/isar-image-ci.bb | 47 ++++ .../isar-ci-ssh-setup/files/postinst | 0 .../isar-ci-ssh-setup_0.1.bb | 0 testsuite/cibuilder.py | 1 + testsuite/citest.py | 32 ++- 38 files changed, 417 insertions(+), 103 deletions(-) delete mode 100644 meta-isar/recipes-ci/images/isar-image-ci.bb create mode 100644 meta-test/conf/bblayers.conf.sample create mode 100644 meta-test/conf/conf-notes.txt create mode 100644 meta-test/conf/layer.conf create mode 100644 meta-test/conf/local.conf.sample create mode 100644 meta-test/recipes-ci/images/isar-image-ci.bb rename {meta-isar => meta-test}/recipes-ci/isar-ci-ssh-setup/files/postinst (100%) rename {meta-isar => meta-test}/recipes-ci/isar-ci-ssh-setup/isar-ci-ssh-setup_0.1.bb (100%) -- 2.20.1