From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7176574728906211328 X-Received: by 2002:a05:6512:ac6:b0:4b6:e956:54a2 with SMTP id n6-20020a0565120ac600b004b6e95654a2mr1229272lfu.663.1671143884505; Thu, 15 Dec 2022 14:38:04 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6512:3242:b0:4b5:3cdf:5a65 with SMTP id c2-20020a056512324200b004b53cdf5a65ls568598lfr.2.-pod-prod-gmail; Thu, 15 Dec 2022 14:38:03 -0800 (PST) X-Google-Smtp-Source: AMrXdXtFfHzRgLxetqrIaBS2ABs72PY7sBBjjGJxHYf6nJgpU7qhMbt0SXP9My6HQ2K5Btz0/Qhm X-Received: by 2002:a19:ae08:0:b0:4bb:344c:2937 with SMTP id f8-20020a19ae08000000b004bb344c2937mr1685200lfc.35.1671143883219; Thu, 15 Dec 2022 14:38:03 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1671143883; cv=pass; d=google.com; s=arc-20160816; b=m8r7jXVBtj8jql91y00KebNspDzkqGlrGm4jgVxULoEii0K3wotst+a3WSvWX6tc0T lMPckZ6AJN9i8swSsAk+kgEzpS1WuKWBOpFRS2f7YzZxSUkVGQm29muOe56OWzxiu9CG 1dCnSoJ/lSjK/HMJPJ9Fd4wpevaJGgQtO/F4/9OgI74mvZXjf+/PrJInny7rqwMyT9gY /reSyS0pleLvGhgLjAIJUFc1oBKHSqYxlTqACPYnqYGXL4DNL1dhUSEZAhYc75z6RCAh XIgDx6zyYk0+RLd+ks0kEoXq0ArWwU7iYQbBL2ZsGtnVmXe6f/fVO3XWY3T2EufEctIf ZDVw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:references:in-reply-to :message-id:subject:to:from:date:dkim-signature; bh=3Szk7OReIhW/uJkUP0JKpIc6QkljkdOBxr2kPw4+5PU=; b=vw0qzruhe55TxZ/UPaYXJWPwA1tJsWzCkia3nYLfcqXu56U0vrabsKrTUrpLhqkq3s bxX6bfPnDFRL/cxFWHPLVlOPIhlwsdWN/SgST2zSFYEYnN2dfkEB+YZZYSLfg429Cfdy FKl/hJAa1f2SOGLevfzYzFYB+I5s5mmNzLX2FoAf4rSlUQeRwVDIxTQoE9Fn47ZYKqzq IEPCqnoCFoWh+xDIqSOr1htFbSmvODUa+Xsy8HfzyGZDURMAWHVvpm/VSJcOYZS08g8k raSBvJxpW4bm8f4CD599EMGO24a6qqtGv/vKJcKDu+59elIA7EOdSoWiKCC1nVzgFyym zJtQ== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=HOiOzEfI; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.7.79 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR04-HE1-obe.outbound.protection.outlook.com (mail-he1eur04on2079.outbound.protection.outlook.com. [40.107.7.79]) by gmr-mx.google.com with ESMTPS id bd27-20020a05651c169b00b00278f552596bsi28801ljb.2.2022.12.15.14.38.03 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 15 Dec 2022 14:38:03 -0800 (PST) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 40.107.7.79 as permitted sender) client-ip=40.107.7.79; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=HOiOzEfI; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.7.79 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=FDYdjW5tD0wtXI+dNRbN0LdHeYiCB8xAp9O6vW8nYpVoLVErHjVGh6vngNdhGZ2jil8lxqsIUQpKuI+ygUp4phV7dOIdct2jdUNco1XDrfYH4OvHReznqi3E8kCPnjh2v8h5Mr13dUrHBw5RLHEYf3kGZJG5ry9tdq+W7pedU0URkxwK9QHswu8CEnr8wbXZGzQHiUwYeBqSJDgYu2tYOYWXjK5uORpX7WOyL1jG8vHYAYIOHvqvJCV8RqTz/dqivbYb62O1nBu6Ntobv0i/rFynFHcEHgFKw94APvVASVzhGIEtfVGP51dSIMDsvcp2kA+gj0Uyb2m4v4audFnJYQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=3Szk7OReIhW/uJkUP0JKpIc6QkljkdOBxr2kPw4+5PU=; b=RMXsUXKJv2RCVeMUFAqY3FBxzTj83sRbYYj6aZorB854+axsOHM1qBid5MibIRZ9vYnB6GKoqwueBQDqdt8wrrwvIzIffYi6M7/5+FDPai0iFQEEJX4TH81Tm67z7Dm6j9lwYQOXaaYC6rxMlbtGvjeqVf+B4bvdbcZnjvdH58N6TmFoiE7FYw/gWfKGXykM+t4vGKNSCld8fYt1MvJ5EVWdyTQfvr4Y+QEe8tznZuYM9cBnm5UWBhJ6QDVSSqjy+xiE7voXv/YWKsgAgCLValKaBd5dQ4fnBEt1bcsO+KowTtuhIlJvhnJ5DrtGOLhRZocJFXLPDGpOBFM/DMptkA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=3Szk7OReIhW/uJkUP0JKpIc6QkljkdOBxr2kPw4+5PU=; b=HOiOzEfI7Qg+MLPUTvQyGIFnZTKr5jgYK1x8ePjkF6KGRvuUP2YrJxFSLJDOUSIuq7pU/Tk0BRd+OX7n1je3K9jsxlaEd626i5f0RkAN1astUT26UsZcgZ/JrDQYomjjmu8agH3iZjEzO0TPad+B89tFtl8h2BUlhH82xw3xpvP1HIoW3P+EPwlROFT2X1SVrzcljiH2+1rok48opbhNrTmPEAiIXjWi0+azQNwHRKyJEjNx1nlYUqfYaJ+xylEStBbWoutrPIm63pK7AvS1A9BAOWPhgAT2XuaXbs2JqY3AxSZQ681IOdAX5H1bahG7KwVy7vPxMw6Q6DFYK8/kJA== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=siemens.com; Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) by DU0PR10MB7287.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:445::10) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5924.11; Thu, 15 Dec 2022 22:38:02 +0000 Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::bdf0:fdeb:f955:bc79]) by PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::bdf0:fdeb:f955:bc79%3]) with mapi id 15.20.5924.012; Thu, 15 Dec 2022 22:38:02 +0000 Date: Thu, 15 Dec 2022 23:37:55 +0100 From: Henning Schild To: isar-users@googlegroups.com Subject: Re: [PATCH v6 0/6] expand-on-first-boot btrfs and CI testing Message-ID: <20221215233755.7f1c0ff2@md1za8fc.ad001.siemens.net> In-Reply-To: <20221215221606.5623-1-henning.schild@siemens.com> References: <20221215221606.5623-1-henning.schild@siemens.com> X-Mailer: Claws Mail 4.1.0 (GTK 3.24.34; x86_64-pc-linux-gnu) Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-ClientProxiedBy: FR0P281CA0110.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:a8::6) To PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) Return-Path: henning.schild@siemens.com MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: PA4PR10MB5780:EE_|DU0PR10MB7287:EE_ X-MS-Office365-Filtering-Correlation-Id: aadd5b51-49b5-40d6-085e-08dadeed0642 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: PSaaXJEDeruFS6xCHDBtOJXEXIHiNavhwaUyTa3KXgXV3QEtCF0LuMGIOn8TAf52tI6cziXxsoRQU2GS19yfJQ8e6qear86SXxr5RVFpp52aUeOCLfNzxt33IKvPzacKL7qhkxhRvE+xltRIMGCHMW9aIT7a21x2aKPiNsQ2EVCpCXuybfQQkJ2fUII7NxnTHc3wZxm7tmpk8h8t12pwCrVS44I7D9d6hn30HjnOkzDonBS0+MK5TshX1v+fku4al91pPM4ekMgfvBeWo/17od9IyuCyfWM8xw7MRB50bW9NDJ62K/9tpJ6ELhxkOgbUsE+ybrDGhOXTBhkwPJsuFFaQCxrDGJ/UZKP8RQ2rPhNL7a1S5UW5L+iDn+sCdya9cqAmlkx4FHgQzaai/88txYy/LtBLUncz+5HI8fETLT+J+3Z54DJZ0g8DjJuqb14GbuCz6b2qlLhAOj0pvq0JpTQpJZXUV53HHTHQ5UMTINHR1oj6CHCqzaM4NqwERU8HlE5dYM4jukiBSHdXo3zu8CNzUolEMqe9lFIO8k/Oxyea/jYmfEF3kz4of+u7D2nONOAUFtdqbT7mhXVJIbCbbUIAHLRppysxIeuZ8cVaJAexmA963h2GhFufoYz4hnBGBWXZFJQx4YWcawbKOHVw8A== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230022)(4636009)(376002)(39860400002)(396003)(366004)(136003)(346002)(451199015)(38100700002)(44832011)(5660300002)(8936002)(66556008)(83380400001)(186003)(66946007)(41300700001)(66476007)(8676002)(1076003)(9686003)(86362001)(82960400001)(6506007)(2906002)(316002)(6512007)(6666004)(6486002)(478600001)(6916009);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?C6GGe4yu+7sRpCJlI4E0OKu7tJkz4v/OKeCpVDILrV9N5nhbb6MeJ58ICxIF?= =?us-ascii?Q?ht1Gy5w9Cs100RfC0QJNe5dMClrlGN1KPYBO+IX6hM0brAw7fhoTcG+wRL0/?= =?us-ascii?Q?hXoHFlERoM90XlDxpHSZjiDt9mt6ez4jTe/K2wnuI+MM3Bma/JrZ/y4THyQ7?= =?us-ascii?Q?psr2CC0HzWBO18X9yeN6cIk/76TXt6+euQiuAXBzgVL6ZW0YmYPcDQiz78Rz?= =?us-ascii?Q?beSGFFJ5x6u7Q2ZpZI+2gJme1VD0HoiLR5be+W2wzRV7lnfWIT6HlMufau7z?= =?us-ascii?Q?sOEL2BTLBiIe9tccjclfbEA1tq8lX6GyBrJ7W9MZtEW/In7DPtUmK/G1Tq6V?= =?us-ascii?Q?aEzmSzLqcxzQNR0uirZgacQ3xURqE7ZTvV27mS2eXlT6bXDX0aAbE6iEFsNg?= =?us-ascii?Q?t8Yqrm5/DPcFvXRhbmTGv4/8LAZdrEpucizOoCxmcP4FXmjeFBWuS8EomjEa?= =?us-ascii?Q?Iwju5eqVkzX0qVsp7olCmkmgQBu/r6Hy+OCupoAOINN72TJypudxYHEUIVeH?= =?us-ascii?Q?0GDGCgYGu0ADJjjkZCP+52uS00+aJmld+sys8B6ftVO5Y7VPxEo8wgRqwQBq?= =?us-ascii?Q?SeV8+tw2+IePL8AJ7nOfHUXvK8DIdqhOjvuXIg9QAWFJuoB5zSrVpjShTdWi?= =?us-ascii?Q?TEsD17R3j1enXPl1gPdpnW/G9v4ODZ2bSLDOeoPOzn4bCuSE+ND30EwRCu/6?= =?us-ascii?Q?zFljc06hosoMSx8Jrk3NCvqMgmAY/KeLnsIXjNnrGm2cE8ZaAKOJMozA5zPo?= =?us-ascii?Q?HzI4riwO92KG3JqBN4aF0Fs6Eemd3C7Nrw2X69MlHHaR3tYn4/O2vvu6vom5?= =?us-ascii?Q?O6RnwoELNlYhGsOn5qzlE21FA5QHVZsHe9DBibrDb1eoiGSescGHh3RCWA/6?= =?us-ascii?Q?c5VHLDx7nOf9S9wGmKgfh9bg9I9OVC8ySIf2jcbm4gQae3rkLX+YIERkqkC9?= =?us-ascii?Q?n90jo8KXfHpBFYSh1icCrmDEJ57FmdkpVZ0ntlPiv2H9YQ5I09hxGUQBDNef?= =?us-ascii?Q?WPEK0lDy7S2ybtWE45z6ksKxXuZaf3foAXEgxx7bE+a6lfUJ8Vu+2J/XyOBZ?= =?us-ascii?Q?JQUu11MfORieMlIbLhtSySEXPIRWpt5m1/KCpjj/0gXZ1YnEuX8WCo9vRCIa?= =?us-ascii?Q?U1Y5e6I2VxSSoxF4L1oIfwVgL8BR53EAKUB+HF1OuDF/0gikUSL5PY3c2FBT?= =?us-ascii?Q?V8JsgywD8cTaw4KmNdRmrdqPSyJYGJg8UyYNmLHlfhP5irYbnzEOUaG+r9vL?= =?us-ascii?Q?Csqxo51XLC7fkKCSc2tq5ALXX+2Vs1yjlgaSoIaGl0dA/YYuyHaGPMq1/+1+?= =?us-ascii?Q?appJJtepqlA4U0VgbxN3i8EUUYdXv/utt+WDxctcPKD+hG4Z62EYHTSxsa3c?= =?us-ascii?Q?+1IDfax7h/K5ArOZP2XDHL+iVDslR1r5LaY+w7+Hk+rDPHTJmRbezJkjmEKh?= =?us-ascii?Q?1i8+oF/QYhre4gMf06i0p5rMmjq2CFDV0waEQIlHYRxjPyNel+UtccMX93sB?= =?us-ascii?Q?p3HQAJ57CMyfvLOn3zL4Lw1d+tRGOwWpgn52VLHXr9b0bzAPu37Aj7BMEN05?= =?us-ascii?Q?GoUsLsmUXvEMGLRDS/qzpPgp7XeuvgBdHr+JnAlJxVFJgzdZV5ZCqqRSE0T5?= =?us-ascii?Q?j1t+/EZzmOEGC/pcWyFWBxj1Nu0xJPjzBWirrtydraRjftrlT1KEymB3af1a?= =?us-ascii?Q?Lguuag=3D=3D?= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: aadd5b51-49b5-40d6-085e-08dadeed0642 X-MS-Exchange-CrossTenant-AuthSource: PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 15 Dec 2022 22:38:02.1982 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: Bkq68/BUdMjSvOaltQ59NWrMj5BSCWx4xQQoyN8VixSim58ISrepFuckIRsOFeaA97RgPaH7ETlnk0BghFqq8PsVd1aX5Uvze5ZnwjDlhXI= X-MS-Exchange-Transport-CrossTenantHeadersStamped: DU0PR10MB7287 X-TUID: AA3zcl2JuO+L In case we keep seeing more trolling on that one i think we should only consider the CI bits and drop btrfs. btrfs has been proposed by two downstream users who already have their own patches and might not care too much about upstream. I am trying hard to cater for them. But one might not care too much, while the other should likely be ignored because the demand and all the reviews seem more like an act of sabotage than actually wanting to help. Please review this if you care about this in a truly relevant use-case. Please stop reviewing this if you are only looking into Isar as a hobby or revenge for something that went south for you. Henning Am Thu, 15 Dec 2022 23:16:00 +0100 schrieb henning.schild@siemens.com: > From: Henning Schild > > changes since v5: > - drop dead code around mktemp subshell > - revert cosmetic mktemp stuff back to v3 > - remove "Suggested-by" tag to hopefully improve signal to noise > ratio in review process > > changes since v4: > - cosmetic fix in the way we call mktemp > - add a patch that makes sure the service is run only once, also on > error > - bump package version after changes are done > > changes since v3: > - rebased on "expand-on-first-boot: switch back away from > systemd-growfs" > - implement btrfs resizing and CI testing it > - put the padding wks entry into an include > > changes since v2: > - add python namespace prefix for the bitbake get functions > - install only in images that use WKS_FILEs that have the "gap" > > changes since v1: > - complete rewrite to not focus only on the tests but rather the > feature for all examples > > This first was only about testing but meanwhile has a focus on > enabling the expand feature in all example images anyhow, and later > look for traces of that happening in CI test where we can. > We install the application in any image and in the wic images add some > scratch space at the end. That will enable improved interactive use of > all those wic images, so makes sense apart from any testing. > Later use the log reading feature of the qemu tests to look for traces > of successful resizing for non ubuntu images. In ubuntu the > console_loglevel is not verbose enough to find traces. > > Henning Schild (6): > expand-on-first-boot: really only do that once, especially on > failure expand-on-first-boot: support resizing a btrfs > meta-isar: introduce an example to use btrfs > CI: improve cibuilder readability > meta-isar: install expand-on-first-boot in most images and add space > CI: expect a message about filesystem resize vom expand script > > meta-isar/conf/machine/qemuamd64.conf | 6 ++++ > meta-isar/conf/machine/virtualbox.conf | 1 + > meta-isar/conf/machine/vmware.conf | 1 + > .../conf/multiconfig/qemuarm-bookworm.conf | 1 + > .../lib/wic/canned-wks/expand-padding.wks.inc | 5 +++ > .../lib/wic/canned-wks/sdimage-efi-btrfs.wks | 11 +++++++ > .../lib/wic/canned-wks/sdimage-efi-sd.wks | 2 ++ > .../lib/wic/canned-wks/sdimage-efi.wks | 2 ++ > ...oot_1.3.bb => expand-on-first-boot_1.4.bb} | 0 > .../files/expand-last-partition.sh | 31 > ++++++++++++++++--- .../files/expand-on-first-boot.service | > 1 + testsuite/cibuilder.py | 28 > ++++++++++++++--- 12 files changed, 80 insertions(+), 9 deletions(-) > create mode 100644 > meta-isar/scripts/lib/wic/canned-wks/expand-padding.wks.inc create > mode 100644 > meta-isar/scripts/lib/wic/canned-wks/sdimage-efi-btrfs.wks rename > meta/recipes-support/expand-on-first-boot/{expand-on-first-boot_1.3.bb > => expand-on-first-boot_1.4.bb} (100%) >