From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7176574728906211328 X-Received: by 2002:a7b:c44b:0:b0:3cf:8b32:a52 with SMTP id l11-20020a7bc44b000000b003cf8b320a52mr143774wmi.72.1670927139972; Tue, 13 Dec 2022 02:25:39 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:600c:3b17:b0:3d1:be63:3b63 with SMTP id m23-20020a05600c3b1700b003d1be633b63ls11803330wms.1.-pod-canary-gmail; Tue, 13 Dec 2022 02:25:39 -0800 (PST) X-Google-Smtp-Source: AA0mqf5qZvGsyZbSbAQ58U5SzV4JkjPndUMtNVf4I9zOD9/rPV2D40ufcZH+PDrfpucMybtVKIru X-Received: by 2002:a05:600c:915:b0:3d0:8477:4448 with SMTP id m21-20020a05600c091500b003d084774448mr15165200wmp.26.1670927138950; Tue, 13 Dec 2022 02:25:38 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1670927138; cv=pass; d=google.com; s=arc-20160816; b=NdjqcVoSmYI3KFyZGGflPivrwvqv6W9ta2LXvqiPQZmCFD65VTIVH3VhHopGENVO3v jMenIEEIrzf3w4GF2Nz9R7rUGIprhGGBCadDE3732OwMXkwtOj8UbMxaCw0L7LAu/HTM KbGtdNbiAnrgW91tF/+8pPAfDWmjgP93maRPPSNxaFXX2PYg4UkwWGIYOLpiuvTQcyUd 5YyxnbRiZim7VQC72Cuuid0Md2K7DzzxdlRQgSUyAyjLkXOKq8HxT27d9ZN+TA9lKDdt wf3QxsnCsHVnWYssNa80Lhrh17CphOMZuXxTiroR6QMGU8W1Pgq+PDVbdZmCkPwp680K ++eQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:references:in-reply-to :message-id:subject:cc:to:from:date:dkim-signature; bh=lk6h7X88NpPVO2OGfEarTrm1K46GE6unIfqfXhpNYlg=; b=sSc0RipEYg5tX27pCFFpwqh4Y+0DvCWzqPVrA3LPaWf2grlvqB5QYX3xVIzATkMNQX JljVUu8gcdBJo7LYnafxjcoXna/V3AcQ2n1VmkyHKs/XREaO4lE8lwgiNpl4ok5IUxjK bsXoYkl/EihkZwe467pakXXqdNSraYWY4PydjEu9nB0YjeoI202Me3EhKmxENr11JH24 SLxhOeiyeSrLIIx0jOuPmMbNjKLjvle5BRyHi/HuAC/mqW45vNYnbAWfXr6eZ8EKRrkR h4WoHTxpc7J8g8HFuN+ceRAXka3o4pNYTCu2t1pdm/2IAKcSPheg6Oh4UDmMEAIw07yW a4ag== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=h4dapMUb; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.241.79 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR02-VI1-obe.outbound.protection.outlook.com (mail-vi1eur02on2079.outbound.protection.outlook.com. [40.107.241.79]) by gmr-mx.google.com with ESMTPS id k66-20020a1ca145000000b003cfc33e8333si55309wme.4.2022.12.13.02.25.38 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 13 Dec 2022 02:25:38 -0800 (PST) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 40.107.241.79 as permitted sender) client-ip=40.107.241.79; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=h4dapMUb; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.241.79 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=JTLwd9xTJwTmbEivl1IRF+GlciDXfJbwLq8WfjJTAf77G8VBjiRcev4D1kPNcZ01AMOje5x5uZpMcPaBOc2eXAazb0BVvTj5fAiZ8ssKV6CPiEfRkUN8dvHwcDQANr3NTJjJL/j9Zv5TiAj+FnG1/aNhFiuUAtylXlYfFMVzVN2W0QR3O9GcyUlITNaFdqjB0uV2ehXGo2y5USEBSBRmbd3xQ4Lzt2ANFKfHvjs8Qa2uKiehSve5hMWgm27/l6DQI94hk0qcclNPTLZBvluS95gY0QbEkkf2J6bM/j/yL+p/v2RXPMbL//E1QiBXTRK6rQcnENWqoymEEHFwfxGhWQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=lk6h7X88NpPVO2OGfEarTrm1K46GE6unIfqfXhpNYlg=; b=RnY9qMCfRZT+LPjv+zevViH/d/HzoTUM1CDgRB1s7kkyefFT7XjGwkKV7qSa6aLWPM6tidHCcV8XLDchgYHEBeOtI0FtHhsk7xsnw+cNdRdYYBmTc+XtPwtvpkSV9Wv2adgBJ0ZKiu7kJRLAhmMQLQMlRsLzvcXXvivbbmqZI/f0jXW8pqHUv94k1uJezIvLmRmClau2Og7IfIElYHZ9IY30siX/amHycF/secdqIt8ujqxJMHKUxvoCfUoDu8a/LOmciAn2mlzDkCT9VLXmtk9LS33EKD9NdNGI/ds8IErdkdDAiKBnEG9cxVbskpQcQ/LezNJ9h/oQcianFeemyQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=lk6h7X88NpPVO2OGfEarTrm1K46GE6unIfqfXhpNYlg=; b=h4dapMUb3N9qOQkfcqyEy5BN2ALQtA3eAdxWBIQG4iMsBUoQ8Piaw9qmHU2qt7HQZusMNvRpLe+UYbNJ39bJAGhsCvopoBbVLCX8MDRkF34MlPJLuArKa4u1laZRA4k4iGDwk8MqIx6QBjZTxUK9Np3sq+jOc1LBAXgXPfAYusb0ZQMR2w7MNuUNKnYARtRRN/lH1Y2xXGVcud90AeKV5OXe9FW4WasdLrmOgsp4vd9VLYnA8YKzQ77FYMt86T9f9nKjmjHNSvurqczo9OpnmRXDOnfBOCSVF7Ogu6TWP9u/hr+ofbx71m7t0kNchG+n+yZrOaXyzD24BqowzsE1Xg== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=siemens.com; Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) by DU0PR10MB6954.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:415::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5880.19; Tue, 13 Dec 2022 10:25:36 +0000 Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::bdf0:fdeb:f955:bc79]) by PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::bdf0:fdeb:f955:bc79%3]) with mapi id 15.20.5880.019; Tue, 13 Dec 2022 10:25:36 +0000 Date: Tue, 13 Dec 2022 11:25:26 +0100 From: Henning Schild To: isar-users@googlegroups.com Cc: felix.moessbauer@siemens.com, "Roberto A . Foglietta" , Joe MacDonald Subject: Re: [PATCH v4 0/5] expand-on-first-boot btrfs and CI testing Message-ID: <20221213112526.3e2bcae8@md1za8fc.ad001.siemens.net> In-Reply-To: <20221213101509.535-1-henning.schild@siemens.com> References: <20221213101509.535-1-henning.schild@siemens.com> X-Mailer: Claws Mail 4.1.0 (GTK 3.24.34; x86_64-pc-linux-gnu) Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-ClientProxiedBy: CH0PR13CA0024.namprd13.prod.outlook.com (2603:10b6:610:b1::29) To PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) Return-Path: henning.schild@siemens.com MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PA4PR10MB5780:EE_|DU0PR10MB6954:EE_ X-MS-Office365-Filtering-Correlation-Id: 1feb9d1d-22cd-4117-93fc-08dadcf45fcc X-LD-Processed: 38ae3bcd-9579-4fd4-adda-b42e1495d55a,ExtAddr X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: kQ0sxjAN1W9sYk1yiphx5wO7MZciCdYU4y0zuVgdh5aW4P160JCnWarSUaM7yPBXjI1zNt6vPIA1Re8t2TXg/My33rcffFayvXsVeGDREokpk9jZBEtRi2+t3Vgh1ymKbR3fMSerrPa2yTb6nHBH2PgyqkmHJw5bT6y3o0zyqNY4j2XPht6M+tAPx+HjxryrO29W0GR503A9MMxGqoTV5iQyEXIcMNiJ4mszuUiGPVFDypUQ2Bcd9iah9/Xr3aQvzH8eJ+UbYEOZMZhSDHPQIvfIgWCniT1PYyIUK7R4b34iqPawqt5BMUE6n9imA1pDheAzwxaikMYHQTlsGH/5Tc6C5wR8+d2GjgGJ5qIqPm31PQTRXN9XI4ORTARG2/sLdxuCHz0fKbt9VGMV2WynGt8yZG8djizhdeArG5YtfkUnn+svf1x+AIAXvfXeMBV7ZnFXN5EtXRRl5RORKnA5vQQbZjbaRIgpGkSe9peoQE+wJLOSKF1LgvUw50SseRwS+J8e03Uiu2ij+1JqEZ4EWOkB4EeGMyMCcz6dPF36FBRerW85ARnJU4x+cvPhs4gP76T3Jws671ehcjjke03cPfmmN6P8jo9ewtCxhlVPoOrYHyZ5e7Q/zPcosDhI18BzpGF/vpc/XEWdOl6NDV8liCkxCod8K1QYGLjm6RkI9wk= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230022)(4636009)(136003)(366004)(346002)(396003)(376002)(39860400002)(451199015)(966005)(86362001)(6486002)(6916009)(316002)(478600001)(38100700002)(82960400001)(54906003)(6512007)(9686003)(186003)(1076003)(6506007)(6666004)(26005)(44832011)(41300700001)(5660300002)(66556008)(66476007)(66946007)(8936002)(2906002)(8676002)(4326008)(83380400001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?+AdHIzFN0ueafuG1pPF8qIldt9IF9Kwc1Gf0lJI2lsWPqTlJso83W9Iy2GeI?= =?us-ascii?Q?c7d5ZZeSjOwbjf1oMTt1Lj/nNURKHlN0QnYGZnAnMAVOPFIbZJlmzOH+FBj2?= =?us-ascii?Q?gZ0oWE2aeXJXvwJeC0ZKkZvp7UB4RiBWntf0LMXFMFP7dW9/tWk2WUCtrww6?= =?us-ascii?Q?ZzFUhwk6yb0hWxYpPiVQMFFjV+NGcbaSP5h63xsgKxTByeAgMC/+pTvUVElI?= =?us-ascii?Q?/fGPXJrhSjQJxQJBB5r5BNGCq/uNO54oaT6ap1+tiHnVsPvXh0GITvAzF9Yi?= =?us-ascii?Q?ztsbMI0H46Ocur8inFadLm5rKWNEgXxDx/SaiIMn1Mg7ihElOH9eP9pZg8qz?= =?us-ascii?Q?xTNoSJEHHhhq+zYW0zttuMhjY3MQ0kp1X3bU8E+Ga/KjhUzqlNTwgAA2mON8?= =?us-ascii?Q?lvdQQXjcgNiH+SrNOw4fmVEHncOqXoHV6Pc58QCix48aWjjnivGZ1WVemtBe?= =?us-ascii?Q?5W9wHeNsASV/6zsYoXGnMCdYct+hC1bxaeJd85JU3ji5IaT9YDlfgDF+QvZM?= =?us-ascii?Q?fYbCiQ0okXHKDx4tfIsz4d5qQ8X8/ams/w9wZztsZd2gcg4T2sfff75i4SA6?= =?us-ascii?Q?Kdvahp1r8+XoEeKUlIh9meCm/oCN8x7QzRUMfgmGyKZ5zbY3PDuuH8UFTNKr?= =?us-ascii?Q?uIngW0BsN+z/cbQHtEujpZfzWjmSJC2/XifHHdTeBrUfOIfcZe/DPrZDE05Y?= =?us-ascii?Q?2/B+0SyrshQAaUEZsBN3w6rpJtNFexBTAOZKzGZMFIL47IiNfMpCaaitdgWx?= =?us-ascii?Q?KSJNzPiNWNYltGlmACOP7nUZ/VqT4Z2Bqr7taV9lpfQtzdmRewl1Y8G8rpFS?= =?us-ascii?Q?AnpYjLG7aZbhcHwvSZ7aMSHf8wK9OElnueOIIpWsHhW78H+EgKk988ak5J3n?= =?us-ascii?Q?F9pw0DKUj8pAt+/OuX6oqYbRkS92z+aU2fOUo6xG+n54VLAeeZs6IAlIwIQW?= =?us-ascii?Q?99Bhzoy4S5mnNRHW5WORJu+iciPnSwIVz/IW7NPPGeKfEZcBGwB9Hp+dxdch?= =?us-ascii?Q?wR6qsPWTERwDYB59gf0HGqUANmmnE7bfyUdpbsLvfNm6iK/dxCHTJR2blf6o?= =?us-ascii?Q?3VGcA2CAXWh3aMwxKvxoMt+INoHLiMNievx5U5LMirEQ0lSwa9kcwR9kh5z+?= =?us-ascii?Q?sMwCqRJCctjT2H77OTEWNIUtpixb4uUbRy5lZn9YUDl6YBGNB1tmV2WR+chT?= =?us-ascii?Q?2xHU4WFTCDlUyXioMH4vpeowvF4vik8VqiVpSh8hWlxA8cWEClxGfJN05q1y?= =?us-ascii?Q?U3uswk4aQwHFM5EOoLNjsm1Ki9C9FFNgv3rXPF5P90us13VhDs/ebnIXiQHz?= =?us-ascii?Q?l5PdR98axNmqKr0VMTm0A+mgQXo84vZuFWsJ0BQTpZwvMb+EvYWBD75yatP8?= =?us-ascii?Q?p5PgOuDL9cvvlDfezQnnRsOqos1dGAaUOnJ08ZBBZsesuGSSRQjaZ0JimWe1?= =?us-ascii?Q?S0L0YYYPFKXwEFeL+ZuI6a/QeHJomHrN4302xwD1sTqOJWQPRkM7Qxr9Cpwf?= =?us-ascii?Q?vo8fOT2aCwwRim6dI406igJ0Eud1IGoAyA1NtcGGKRlbwhJoWvA0YVaBnJW7?= =?us-ascii?Q?7IDILcGJgYImcQ3g86T04UHVo+WTSE8XONbl/ReegN3r7GG+qvTXVf+dMXTR?= =?us-ascii?Q?dA=3D=3D?= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: 1feb9d1d-22cd-4117-93fc-08dadcf45fcc X-MS-Exchange-CrossTenant-AuthSource: PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 13 Dec 2022 10:25:36.4827 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: LkPFPrWo2hXxblEo/sHol3320qIpVDWIBf0sBYmX7JW3ayw8kMZpdkCPQii9nqIe+3dsBF9r4The4iCOEGSZBQq1reGri81EO83Vs6rRKng= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DU0PR10MB6954 X-TUID: WBIiXI9xhhpz Hi all, i decided to merge the re-introduction of btrfs with the CI series i had going on. Because that is all so important yet seemingly fragile that we really do not want any big change without CI. this is based on "expand-on-first-boot: switch back away from systemd-growfs" which should be merged because it breaks several machines like rpis, with the udev race we found lately It is tested manually in qemu, especially debian-bullseye (btrfs candidate) and on that formerly affected rpi. In addition i pushed it here to trigger CI runs at ilbers already: https://github.com/henning-schild-work/isar/tree/henning/ilbers-ci I get the feeling we really need a way to log in to the images running in CI and run test code there. Only waiting for the login prompt and hoping for bits in the kernel log is not powerful enough do perform real tests. That is something to improve at some point. regards, Henning Am Tue, 13 Dec 2022 11:15:04 +0100 schrieb henning.schild@siemens.com: > From: Henning Schild > > changes since v3: > - rebased on "expand-on-first-boot: switch back away from > systemd-growfs" > - implement btrfs resizing and CI testing it > - put the padding wks entry into an include > > changes since v2: > - add python namespace prefix for the bitbake get functions > - install only in images that use WKS_FILEs that have the "gap" > > changes since v1: > - complete rewrite to not focus only on the tests but rather the > feature for all examples > > This first was only about testing but meanwhile has a focus on > enabling the expand feature in all example images anyhow, and later > look for traces of that happening in CI test where we can. > We install the application in any image and in the wic images add some > scratch space at the end. That will enable improved interactive use of > all those wic images, so makes sense apart from any testing. > Later use the log reading feature of the qemu tests to look for traces > of successful resizing for non ubuntu images. In ubuntu the > console_loglevel is not verbose enough to find traces. > > > Henning Schild (5): > expand-on-first-boot: support resizing a btrfs > meta-isar: introduce an example to use btrfs > CI: improve cibuilder readability > meta-isar: install expand-on-first-boot in most images and add space > CI: expect a message about filesystem resize vom expand script > > meta-isar/conf/machine/qemuamd64.conf | 6 ++++ > meta-isar/conf/machine/virtualbox.conf | 1 + > meta-isar/conf/machine/vmware.conf | 1 + > .../conf/multiconfig/qemuarm-bookworm.conf | 1 + > .../lib/wic/canned-wks/expand-padding.wks.inc | 5 +++ > .../lib/wic/canned-wks/sdimage-efi-btrfs.wks | 11 ++++++ > .../lib/wic/canned-wks/sdimage-efi-sd.wks | 2 ++ > .../lib/wic/canned-wks/sdimage-efi.wks | 2 ++ > .../files/expand-last-partition.sh | 35 > ++++++++++++++++--- testsuite/cibuilder.py | > 28 ++++++++++++--- 10 files changed, 83 insertions(+), 9 deletions(-) > create mode 100644 > meta-isar/scripts/lib/wic/canned-wks/expand-padding.wks.inc create > mode 100644 meta-isar/scripts/lib/wic/canned-wks/sdimage-efi-btrfs.wks >