From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7176574728906211328 X-Received: by 2002:a2e:3806:0:b0:279:f7e5:9d82 with SMTP id f6-20020a2e3806000000b00279f7e59d82mr86826lja.81.1671610947106; Wed, 21 Dec 2022 00:22:27 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6512:750:b0:4a2:3951:eac8 with SMTP id c16-20020a056512075000b004a23951eac8ls3062705lfs.0.-pod-prod-gmail; Wed, 21 Dec 2022 00:22:25 -0800 (PST) X-Google-Smtp-Source: AMrXdXt5+Eqvcjr2TPr+ZLyFH/+yXf/ZYKThVOcEH2NS8/t4LHJEq31UNmKkPetBm5UhrbWJmn1A X-Received: by 2002:ac2:47e2:0:b0:4b5:7282:868c with SMTP id b2-20020ac247e2000000b004b57282868cmr303961lfp.55.1671610945670; Wed, 21 Dec 2022 00:22:25 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1671610945; cv=pass; d=google.com; s=arc-20160816; b=w0K0Kfr5UmULcO8laQkz/bF6c3DtxgcCRgvkdtiYpftB/+6wx0zK+FxnXM9cJ6ClWe 3///05okS5fPhXAVJG2RSLDL93gqt8/mDV58+9fUTUB2KfHDr+LidqV1+YHfrOCg6WOp 9r4xfOONtdKwTindf7ChOQiwAzC1nS2NL+oENw8sY4+rHZ6NfkEvTg9a/8OqqDXhg4o6 ibjYjj8RjzaynyV1pAFNMGtBLOq2xGrnYlACQIZe+6IQJxODVnfK4c7JyzgzQFQarZMY nbGHRjJ5fI+0ZySKpWl7Cadfn+T6wm2EGPvMv9hMUYO2wWDUIiVUm9TtNMw/71vi4SCt hulA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:references:in-reply-to :message-id:subject:cc:to:from:date:dkim-signature; bh=70Rj05H8x8JP2bCKmc+6usBGWXoOjOC3KdM4nLULb5k=; b=re2d2HsbD70CrZU07bzPBAAgcYGTdcLcZAh47pSYmyndpRV4GRFbk7S36tAA3BmnXu tXA81dUarPd4GU85xN/ZiWf1WeVExWv3HbJABD8wqxQaMCtfqEQmTlmBbmy7NE0PXlk6 UJssSxMUCpZzcUTrO3ZxmBBkSf0pWJ8psSoD5JLNHtIaAOeKYa95CDAGm1rl7GhcHsZt l3uwDhPsae6erE03AlkWxdqExWLi5fJO+7ldsr4tChuZU4HWPPBJkjttY08XR2ZxAT3P GglswHL+7UHl7Lj5rvYlIM9TkIYzL/ixo2S/iOeSxs7obdaR5xAJFnj03bRK7DsUQMgG waXA== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=kq6CsCOp; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.8.77 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR04-VI1-obe.outbound.protection.outlook.com (mail-vi1eur04on2077.outbound.protection.outlook.com. [40.107.8.77]) by gmr-mx.google.com with ESMTPS id z10-20020a2eb52a000000b0027974eb1dc3si681067ljm.7.2022.12.21.00.22.25 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 21 Dec 2022 00:22:25 -0800 (PST) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 40.107.8.77 as permitted sender) client-ip=40.107.8.77; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=kq6CsCOp; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.8.77 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=JNBK7dFkx3zMRqgcpoQT/gt2sSauKmgp+nEr9+D1RdT6JxHeC07VNkkzS6b1RuWnCTYSCR+adwUIf6mWyXr0PTjTd3WIKXLZepptWiqmQ1vpWavM+8DAiYThewnfMsN/760jtX6KQDSLZIUXm6nSeI3zRHTKCDDtKjAoS0ZC1QYp1CG4Y0FEnWfTtEKSrYFtKeYCeE52kOA7AwBvwoN+HlziVV7rKv1hyMeJIECsSndnv4v3YSl6RiRqAVW2G1PZPa5NyqKuVZX8xqrdj5ZQH4aYIBz8Ugj0hNFFxw2d62MTOpvPq0R43DqHhFVsJ/q8Ue0ewPMCDAVkJACngGJHIA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=70Rj05H8x8JP2bCKmc+6usBGWXoOjOC3KdM4nLULb5k=; b=WvqIA1W5K8eurHQbpi48EwJt2Vdc+d26v67OlDZ6YgQcdzvHj0Hy3XK0uhF03xTyUhrQ0q/WkQqRDErsMZepL/MlW2fXcgTT+YDAomHEM/BPYP5RMi/ZH3ktIarj84X+uIzBged5w2IaFwYf4KM2bpdrcEP5+37odQoOxHWYZIMAltgw+d9oAwUkrroqmkYaHhgYEl6+RR1/ye65mRGnFc2O4wv6KULBV/xCyuMFutRu1ZPuytUcshfzmJ7RiqQAIBNhQ0UQb9VckXKaGGwPHeVZCeLmRHTBMntkjEbiDTrznoJv8Sju7OQk2HfrPoSBHt5DzodGKU1ROIUjMHEEdg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=70Rj05H8x8JP2bCKmc+6usBGWXoOjOC3KdM4nLULb5k=; b=kq6CsCOptE8Y+6Sh2bzbxjqYhCBpUS0OLowUxMDClSlGgVCvMAKH/vE83lmMtrLp/sbe2/0gqhiFeksGM5lWxRi9ndkQ6vIiBREYfeZxyBO7MMImDJ9XgkDDcJNx6uY4kRMpT+ik9Jewstdg5AtnJAA6ByZg6ug3uTr/XTcMCD7DmnUDnwxj0DjjLza5YWVkl+muhmmqALZ5CWDOX8Rz+pFX6WOS+dDBccBYrHLO3jXbpUZxGDBQVBH5mW+4XuBxQFkngPndiLX2R9Ca5UnoGqgjyqRy1sYO9hJ1fvHYUUe0q9XsYn67YIlnd1TA62yYZD70PXFm6Zn87GVBu0hDdA== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=siemens.com; Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) by DB5PR10MB7668.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:488::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5924.16; Wed, 21 Dec 2022 08:22:24 +0000 Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::bdf0:fdeb:f955:bc79]) by PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::bdf0:fdeb:f955:bc79%3]) with mapi id 15.20.5924.016; Wed, 21 Dec 2022 08:22:23 +0000 Date: Wed, 21 Dec 2022 09:22:21 +0100 From: Henning Schild To: Anton Mikanovich Cc: isar-users@googlegroups.com Subject: Re: [PATCH v6 0/6] expand-on-first-boot btrfs and CI testing Message-ID: <20221221092221.3276345a@md1za8fc.ad001.siemens.net> In-Reply-To: References: <20221215221606.5623-1-henning.schild@siemens.com> X-Mailer: Claws Mail 4.1.0 (GTK 3.24.35; x86_64-pc-linux-gnu) Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-ClientProxiedBy: FR3P281CA0085.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:1f::22) To PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) Return-Path: henning.schild@siemens.com MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PA4PR10MB5780:EE_|DB5PR10MB7668:EE_ X-MS-Office365-Filtering-Correlation-Id: 02309154-dc1e-4acc-3654-08dae32c7cc0 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 8+OAGe2OsbvGGCikrgjD0S03g3PDMsFdmPWOq53c8730CEqNVGpUM3pYUcdbyzPszReYDR68oo8zWegZ7CNrwuqZIB37WJ22/pItiMGpu9YasjThwVat+sCiiG3FT970qLRC5fA+Frg2lfKibs9h+2vO6ezu2UoYqZu2P0gXVtwQRBDURz2eN939BH2zSOOOxNu6JX2ddXuCFQHgegqA3/KegTSsIcGcWSmV//5+bnaoo8ktmSOl1lIsygGIeWJTtGFqzS4qBW4i6fglbpxsQG3m++/ipN8XeHBqJBH6ZljpWJhpYS5qAzEbYF9Nzq24PaXyRyi/1KbqhO43rRBNb6SJ2ugNXoKosIzati+jVv+6KPO4R2jjEzCFGKoCMf2RFbwbJ9Gi5gp8amhL0pwVCL9TMraI1EGZaaY/2KpGIFh6JNzpMxN1T4gjVjegbhtUpaSacgdHfHKIfh681BVX7h0YUt8c7VOWlhesAC3Ez7jqcAM0HfIUUpvuVkjSBLxVAjzIbrdiPJCE5Mh1DyI1Q22B7LyzmbUVNz63/KUKEn4xDcUpexFvvSwym01NjM8zj3Nb+GjNrjtsOHRUrq8xb3OtBxYjlb5OlU7mg0teCwZy3ZHHIjGuCR/BYymQcSJYfmsIj5IeOJ8W9bwKPuBosw== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230022)(4636009)(366004)(346002)(376002)(39860400002)(396003)(136003)(451199015)(5660300002)(44832011)(4326008)(8676002)(66556008)(66476007)(6916009)(66946007)(2906002)(6486002)(478600001)(186003)(9686003)(6512007)(41300700001)(26005)(6506007)(316002)(86362001)(83380400001)(1076003)(82960400001)(38100700002)(8936002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?3x12ByjgLhAltphONyFZHsgdlRhjAEk2rwg3c/ENl6nQHkC8vJ4dsg4HTBvm?= =?us-ascii?Q?QMg4HFQqS3VM3pBVdIx/gublNJyuA0LdJbOKPC35BA9S81PFyXmHcTcppFbG?= =?us-ascii?Q?9vp1Uh69qOjNJHFVekMTHcwXF3STYth6MicKFQBCN14cAEj/C/yUibEMrRoG?= =?us-ascii?Q?me1Bj+CQEloHeaSWsKa5rBFmXhQ7csi9vjft4dMfHLoEU3Y2AZN4Jgq8a8W0?= =?us-ascii?Q?6kk4PdnKgJ7lX9/5+YYSjqlEfJA0AheTdlrQ7KIpusbZ7RkGfc2c24oUuJ9r?= =?us-ascii?Q?cGM66fycbYII3QWnMNf6xnilCv91vDFbvSSYKRLpiBCcLy4egvfAp1ablHGt?= =?us-ascii?Q?grTY0K7QmrbOUqrmW12vH+s2KXvAOr+ews9HfeqHagu1C64/wAvdvaV1Xpql?= =?us-ascii?Q?ZpdksdXVi6K75EztJPzUYb9cU/rRQkKPI0FuOyuOBb3cPIWvEf+QcIAe8M3z?= =?us-ascii?Q?EL2sBi7wfzqfp+faqDLSGdMkAv3kW3zlrrWvdVyqwV4X+RLqP3rbMGfVCEWa?= =?us-ascii?Q?+mo3XGNIth43M3RJUVYFx+CwC4dPGkqounbxaWSB9n1CAE8Esx4RSbFVwg60?= =?us-ascii?Q?hFu5FJkV0lH7sX8QktoJGiXOJRS0cBxDnRQQzVEYF4iids02w2AlLPoCeX6r?= =?us-ascii?Q?WZi8Izvt4VqKKil6Z+BdHP32BI2p2jAoF1ZLhiYIHRBkhT/OB4eLzw7vhjb6?= =?us-ascii?Q?eFZjkxg2zw0ok82VOKJuD//DdCGik7UFybvaIHm9UgbRPkidTjxY6Wid8UrU?= =?us-ascii?Q?SmzE9oZg40nksw3Vu0cUjUCogaT0HMWhTv5tG1zh5rr/HgsKEYAzqLXNgmSf?= =?us-ascii?Q?eX+sde6c9962PXByYWneciUthPdb7hawNL13YMYZ+mn4ex3z5gDZi5OJk2Pq?= =?us-ascii?Q?31MXujbrXMnp/gWUXELY/KEvgkaMV2LOizIYTtyRi4DmHYxRotu+A/cxYM9f?= =?us-ascii?Q?Ri9/QaUhnT8zAyKpS+IK1r5Sekzip3K8ms3z2tIazGYajk6h+A+lu+9GbRvN?= =?us-ascii?Q?q2Ddh477tLFXiWDKUZE87R1ohCjCD/9n2B1VVMZ4o9spKO3k5qyBBP2Aa18t?= =?us-ascii?Q?K+74msu/VNonGyaCvONauBzbp+A/xAiSyAcG2mwkzbMdZT0swbE8l/VqDe5E?= =?us-ascii?Q?uPOgydvKyuadoui1Bgo1bzhdNalqajhUORSyGym8IE8N8OCcOnQkvBGUF2wA?= =?us-ascii?Q?o7L4U2XWF2xaFIOSRScXSof7NKXuyVEQtvsL71N9T/4HD7y5SdzP2sw5SFcx?= =?us-ascii?Q?n1bAUTGVJTGh9/cirGoobiM/3JIOGRvfVglkIUg4g/E76zAAH/eJcjfIxjBH?= =?us-ascii?Q?7Ueih4l12pJAXcTuZdjyMCWqX55VXzR/a1EfZw847HYF/y7+txYOBqdTpUJ/?= =?us-ascii?Q?/ZKpSWjyAVa2op2+f1fDSGLi3jmlotst+NwAj+FyffVjASuIQwfc1i1CRC1L?= =?us-ascii?Q?zhGvLVcVAfIxly3xrWhTsuVimFAtbZqYtgy3/MVHysnX4QVKawRv+9LeC512?= =?us-ascii?Q?LhWs8sYKxpnZl/z3Oy8FsYCXxlV24IPz4iaZT4IGYtn/qPIpU6OBoVkfbC0k?= =?us-ascii?Q?9QbHSXEPBbnkqIOr6WU3bWCZ448fzLlntxYtUkiGZUpBQ5MdhKpvFxi2oN9M?= =?us-ascii?Q?kg=3D=3D?= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: 02309154-dc1e-4acc-3654-08dae32c7cc0 X-MS-Exchange-CrossTenant-AuthSource: PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Dec 2022 08:22:23.8634 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: I8Qtf0Z1mNPtY5WoC+Ni5Pbqs/Vz2mjT62DHrovUtarH5xK/BKG8FYqQGxiaCx1HNZqoSWghCC1EJYVA98svSIx7NXrhNT896fLldPLldrI= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB5PR10MB7668 X-TUID: KFZ5M4vp82z3 Am Tue, 20 Dec 2022 22:36:03 +0300 schrieb Anton Mikanovich : > 16.12.2022 01:16, henning.schild@siemens.com wrote: > > From: Henning Schild > > > > changes since v5: > > - drop dead code around mktemp subshell > > - revert cosmetic mktemp stuff back to v3 > > - remove "Suggested-by" tag to hopefully improve signal to noise > > ratio in review process > > > > changes since v4: > > - cosmetic fix in the way we call mktemp > > - add a patch that makes sure the service is run only once, also > > on error > > - bump package version after changes are done > > > > changes since v3: > > - rebased on "expand-on-first-boot: switch back away from > > systemd-growfs" > > - implement btrfs resizing and CI testing it > > - put the padding wks entry into an include > > > > changes since v2: > > - add python namespace prefix for the bitbake get functions > > - install only in images that use WKS_FILEs that have the "gap" > > > > changes since v1: > > - complete rewrite to not focus only on the tests but rather the > > feature for all examples > > > > This first was only about testing but meanwhile has a focus on > > enabling the expand feature in all example images anyhow, and later > > look for traces of that happening in CI test where we can. > > We install the application in any image and in the wic images add > > some scratch space at the end. That will enable improved > > interactive use of all those wic images, so makes sense apart from > > any testing. Later use the log reading feature of the qemu tests to > > look for traces of successful resizing for non ubuntu images. In > > ubuntu the console_loglevel is not verbose enough to find traces. > > > > Henning Schild (6): > > expand-on-first-boot: really only do that once, especially on > > failure expand-on-first-boot: support resizing a btrfs > > meta-isar: introduce an example to use btrfs > > CI: improve cibuilder readability > > meta-isar: install expand-on-first-boot in most images and add > > space CI: expect a message about filesystem resize vom expand script > > > > meta-isar/conf/machine/qemuamd64.conf | 6 ++++ > > meta-isar/conf/machine/virtualbox.conf | 1 + > > meta-isar/conf/machine/vmware.conf | 1 + > > .../conf/multiconfig/qemuarm-bookworm.conf | 1 + > > .../lib/wic/canned-wks/expand-padding.wks.inc | 5 +++ > > .../lib/wic/canned-wks/sdimage-efi-btrfs.wks | 11 +++++++ > > .../lib/wic/canned-wks/sdimage-efi-sd.wks | 2 ++ > > .../lib/wic/canned-wks/sdimage-efi.wks | 2 ++ > > ...oot_1.3.bb => expand-on-first-boot_1.4.bb} | 0 > > .../files/expand-last-partition.sh | 31 > > ++++++++++++++++--- .../files/expand-on-first-boot.service | > > 1 + testsuite/cibuilder.py | 28 > > ++++++++++++++--- 12 files changed, 80 insertions(+), 9 deletions(-) > > create mode 100644 > > meta-isar/scripts/lib/wic/canned-wks/expand-padding.wks.inc create > > mode 100644 > > meta-isar/scripts/lib/wic/canned-wks/sdimage-efi-btrfs.wks rename > > meta/recipes-support/expand-on-first-boot/{expand-on-first-boot_1.3.bb > > => expand-on-first-boot_1.4.bb} (100%) > Hello Henning, > > This patchset look really good, but still fails on arm-bookworm > startvm test of > our fast CI. The issue can be reproduced by just building > qemuarm-bookworm target with bitbake (even outside testsuite) and > then execute VmBootTestFast.test_arm_bookworm test case. I saw that when i ran ilbers CI once. Was hoping it to be unrelated and maybe a known issue. But if you confirm that these patches introduced it, i will have a look > So my proposal is to apply revert expand commit now without waiting > for this patchset to be ready. Sure. The "revert" patch is important. This stuff can wait. Henning