From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7176574728906211328 X-Received: by 2002:a92:d8ca:0:b0:303:6b79:14bb with SMTP id l10-20020a92d8ca000000b003036b7914bbmr11023573ilo.9.1671529050924; Tue, 20 Dec 2022 01:37:30 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6e02:d53:b0:306:79cf:3c41 with SMTP id h19-20020a056e020d5300b0030679cf3c41ls2711974ilj.7.-pod-prod-gmail; Tue, 20 Dec 2022 01:37:30 -0800 (PST) X-Google-Smtp-Source: AMrXdXvuxJQoGF8J6kIbHra6vI20yUUlnP0jFRwg+vz4wHe4v7qhrAMUtLB/yl0WtXzsHjd46Mpt X-Received: by 2002:a05:6e02:12ce:b0:307:7cf3:ca79 with SMTP id i14-20020a056e0212ce00b003077cf3ca79mr14207606ilm.22.1671529050242; Tue, 20 Dec 2022 01:37:30 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1671529050; cv=none; d=google.com; s=arc-20160816; b=maGFaOOZaR/urX28DF/o2mJZuYllBYxI1Ng/S4VEkZBaSu63q1bYo8oI71aQCp63Qj 2ELym6Xg/aiEe6Z7iOFQSl4IO/XVb0MXDbJwHkoTjtdUwcVH9cpeXeoXZ3wR4qPlgURc KM+l9T29hpqav05DUG3qCCd6JOuSZ3f974Vctmqq9hTpUewSO+bSalzWoy800P2QJAsD TJCJ8kxemCB/l7kChuiRxc3Zq3qJ6OegGcsIGh2Q19U9DveNvJqWMNQc4k/dlSDWXKtN E4tRrd6h9uulkldBp671FOP2tRlMxX48CCz1H8ft64Ao752/yMhcu1jBel1Na3gVYB// fOyA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:to:from; bh=VNmzXIcpgJcl6LJH8gj87E5lVdEzgYNMNu+VhTY2Xj0=; b=dERjqQf7MyxPJYKZ4kI00ttsLGTk14piM8gK8pdp2k0sz7ZuPCDuLp0xQjW+uePct8 rj0Yl3yxUrw+ZxCTBzTTcxQPYG07Qekiri3VUkLbqFQ819LIE5Zzte+yz4cPob6a5BmS A6DMkH+87fg/9zQlYjdnQ5sslLkO4yXw8abdcK9E2FgTYCIX3lElB254vnlls1E2u1NZ ukePqKQl+FpmGtPEwrUmkFwxf62wwBdoujy0wypca+72wQq/ydSrxb04kLwqSDptHwxO dNgqMkXoHLW4GHIBxNzvp5iMjuagi9LWIIn6WwSlOEU/kM0oI34sJwtFU4FKPdbFjO85 f93A== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id n2-20020a02a902000000b0038a6bbe1e21si906664jam.1.2022.12.20.01.37.29 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Tue, 20 Dec 2022 01:37:30 -0800 (PST) Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Received: from home.localnet (44-208-124-178-static.mgts.by [178.124.208.44] (may be forged)) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 2BK9bQ5H000445 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Tue, 20 Dec 2022 10:37:27 +0100 From: Uladzimir Bely To: isar-users@googlegroups.com, Henning Schild Subject: Re: [PATCH v4 0/5] expand-on-first-boot btrfs and CI testing Date: Tue, 20 Dec 2022 12:37:24 +0300 Message-ID: <2618987.lGaqSPkdTl@home> In-Reply-To: <20221213112526.3e2bcae8@md1za8fc.ad001.siemens.net> References: <20221213101509.535-1-henning.schild@siemens.com> <20221213112526.3e2bcae8@md1za8fc.ad001.siemens.net> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: jFtjq3lLz0Wk In the email from Tuesday, 13 December 2022 13:25:26 +03 user Henning Schild wrote: > Hi all, > > i decided to merge the re-introduction of btrfs with the CI series i > had going on. Because that is all so important yet seemingly fragile > that we really do not want any big change without CI. > > this is based on > "expand-on-first-boot: switch back away from systemd-growfs" > which should be merged because it breaks several machines like rpis, > with the udev race we found lately > > It is tested manually in qemu, especially debian-bullseye (btrfs > candidate) and on that formerly affected rpi. > In addition i pushed it here to trigger CI runs at ilbers already: > https://github.com/henning-schild-work/isar/tree/henning/ilbers-ci > > I get the feeling we really need a way to log in to the images running > in CI and run test code there. Only waiting for the login prompt and > hoping for bits in the kernel log is not powerful enough do perform > real tests. That is something to improve at some point. > Hello Henning. We are currently working on the downstream that requires such kind of access to the machine running under qemu. We want to implement the essential parts of functionality in Isar in the nearest future: - remove scripts/start_vm in favor of testsuite/start_vm.py (or, at least, scripts/start_vm will be just a wrapper) - allow custom image names (not only hardcoded 'isar-image-base') to be tested - support checking the image for service status (at least) - support any custom commands execution (at most) Actually, the latest thing should also cover previous "service status checking". Also, when implemented, we will be able to completely remove boot log parsing that is used currently. The main idea of the upcoming implementation is executing custom commands over SSH in "test" thread while the machine is kept running in "main" thread. > regards, > Henning > > Am Tue, 13 Dec 2022 11:15:04 +0100 > > schrieb henning.schild@siemens.com: > > From: Henning Schild > > > > changes since v3: > > - rebased on "expand-on-first-boot: switch back away from > > > > systemd-growfs" > > > > - implement btrfs resizing and CI testing it > > - put the padding wks entry into an include > > > > changes since v2: > > - add python namespace prefix for the bitbake get functions > > - install only in images that use WKS_FILEs that have the "gap" > > > > changes since v1: > > - complete rewrite to not focus only on the tests but rather the > > > > feature for all examples > > > > This first was only about testing but meanwhile has a focus on > > enabling the expand feature in all example images anyhow, and later > > look for traces of that happening in CI test where we can. > > We install the application in any image and in the wic images add some > > scratch space at the end. That will enable improved interactive use of > > all those wic images, so makes sense apart from any testing. > > Later use the log reading feature of the qemu tests to look for traces > > of successful resizing for non ubuntu images. In ubuntu the > > console_loglevel is not verbose enough to find traces. > > > > Henning Schild (5): > > expand-on-first-boot: support resizing a btrfs > > meta-isar: introduce an example to use btrfs > > CI: improve cibuilder readability > > meta-isar: install expand-on-first-boot in most images and add space > > CI: expect a message about filesystem resize vom expand script > > > > meta-isar/conf/machine/qemuamd64.conf | 6 ++++ > > meta-isar/conf/machine/virtualbox.conf | 1 + > > meta-isar/conf/machine/vmware.conf | 1 + > > .../conf/multiconfig/qemuarm-bookworm.conf | 1 + > > .../lib/wic/canned-wks/expand-padding.wks.inc | 5 +++ > > .../lib/wic/canned-wks/sdimage-efi-btrfs.wks | 11 ++++++ > > .../lib/wic/canned-wks/sdimage-efi-sd.wks | 2 ++ > > .../lib/wic/canned-wks/sdimage-efi.wks | 2 ++ > > .../files/expand-last-partition.sh | 35 > > > > ++++++++++++++++--- testsuite/cibuilder.py | > > 28 ++++++++++++--- 10 files changed, 83 insertions(+), 9 deletions(-) > > > > create mode 100644 > > > > meta-isar/scripts/lib/wic/canned-wks/expand-padding.wks.inc create > > mode 100644 meta-isar/scripts/lib/wic/canned-wks/sdimage-efi-btrfs.wks -- Uladzimir Bely