From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7127570847942836224 X-Received: by 2002:a17:90b:514:b0:1f5:59b2:fceb with SMTP id r20-20020a17090b051400b001f559b2fcebmr21675529pjz.82.1659972659638; Mon, 08 Aug 2022 08:30:59 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a63:2b48:0:b0:41d:9c6a:a064 with SMTP id r69-20020a632b48000000b0041d9c6aa064ls1019625pgr.3.-pod-prod-gmail; Mon, 08 Aug 2022 08:30:58 -0700 (PDT) X-Google-Smtp-Source: AA6agR4K1GfWhQGGDWMnqpp8cLzIVXvwTMOTM9LlGdpe/0klNGvt2a1Bzx74dmMaroqOYIjh22Iz X-Received: by 2002:a65:6d8f:0:b0:41b:f0a5:4abf with SMTP id bc15-20020a656d8f000000b0041bf0a54abfmr16142412pgb.277.1659972658727; Mon, 08 Aug 2022 08:30:58 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1659972658; cv=pass; d=google.com; s=arc-20160816; b=J6p9bia/lJpP5lQJNAGzAbum8LLXSkqiuy+eF2MJjpcu9unr4JCFGxKYxNE50wPkr+ zp33THo1tbkXBvGu6cllEyNQ/B5oLc/FZP59Syg9VUWxmq18IowZcjiTcK9urSgt9+uI 4nOPJX/GboPDM5VAAB9Sn1MWi2MODU83uVyRwyNY6nMuWtHdZSqby6NPb7r/Q9FXL/5X E/pU0UBzhNhcbjHXnAhZWxMHF0H6nHFD54XPzdCfT51Ky2/VdJSolhfbRQw0kRdR+jhM Afk0O3d97Or/O2gcvcPmIGhO6KuXzwyGkY+KHwHtkci4n9XjMoKWpP5IptTH0rT6GLfL yN4g== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:references:in-reply-to :message-id:subject:cc:to:from:date:dkim-signature; bh=f19z8gTGc/pMuqlcNNP+P9JMcMeAo5BtL+Brx/+qDoQ=; b=kIdBA/P3SqZX0QBAjMc2j4hrwTMceq32uU8frga7sSJNdU4xyHaTBdE590fxjj/mMc OilE/lATKvwZrue8Vc93sYpNQCB+iYhrRvhNb3gzQ3xzIoyg3zcMlYnf8nyDkjy1ufHm Bdg8dqnzaudB6UdlbEUfRpIeKvrQpGM2r0OBWXx5LJS9jCyw+EjTgJOEzkkd8poflz3M wmI7C+oA9oVKoK/UCEJvN3/yahH7zUp1+qV5AeHOWrL9q93tnjbZCMHHZ3anQ5/GqoBb 2W4vfo1+Hf3dXjct0QW6OxLL9dlcb2+R6NbOuTzks4X+ya+5zWElVtk/4zyukGrTc6t+ LujA== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=SVF00J98; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.20.58 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR05-DB8-obe.outbound.protection.outlook.com (mail-db8eur05on2058.outbound.protection.outlook.com. [40.107.20.58]) by gmr-mx.google.com with ESMTPS id y9-20020aa79429000000b0052e0354e5c0si413978pfo.2.2022.08.08.08.30.58 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 08 Aug 2022 08:30:58 -0700 (PDT) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 40.107.20.58 as permitted sender) client-ip=40.107.20.58; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=SVF00J98; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 40.107.20.58 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=UQerRADpOQ1D5SfxlsAk8BC5eIUlz0qdWk1xmGqxvDjukqBWq4xGJZZQWJ9fT6oyJNwsTdKP3tMczzAY45tTH0KGjiEBL+XogbQcAbBBhSvzpsLly34ereS9vWA4pLbnWkOp1bGjnnv9vgwJJ8v2kihvoyO3W17Pa/2KGscFz/Ccs97ZN4JE6hnTRBPE8g8zSj+eS+Wqa9m51aBgH9bB94PMNrU50TqTNcjwTAXxteho3g3dX7UFKVtpcxBewV2XNsz1lFC/ZS6T4oMsxm4FNOhbv8sBp1H6OqP+RvNlJM+XMwUhgqc6l7CPzC3qLNozMMTX9KH4p9HAAjhY+QDguw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=f19z8gTGc/pMuqlcNNP+P9JMcMeAo5BtL+Brx/+qDoQ=; b=NtSA2s/TuIlRw2FpBpIpWjZcv+6boQlBsOmaTf4d7NMQHsQj3xkXvi0bxLGbYjxqSuvTQvOXXs5nPyQct1jAmz67Tc13WEJHmux4jBDYvcjpoO8Achrf3UJfkaZRR3ud3NKKjTASKgYHGebUN81APubawsGjP+SoxfxWzY2N/OwmjgaRij2jAHTL1Qk4qmATzWFd8d5bvdULot1F9fLa7aqa0cJgs/m8H0zOEejJvoYAqLijzk/PPmfzjGdbgau4tJujso8+zcqLbKIC/5T42ehmXxg21G5lYmnWFWA5HIZ0fjaDXDmBzG+zCX3aHQIiz/DlMfnjF2ECBHPorNnVIg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=f19z8gTGc/pMuqlcNNP+P9JMcMeAo5BtL+Brx/+qDoQ=; b=SVF00J9834z4Dv+Jd9Brv9UPi5HarqI6jtl3MfBPkPpfOX6Ukv103bdnFX/grzmdbd8w5DrsYEnumvh/PZ+wqT4NtcaOXn0iOpXFQp+GktWGUOL5Xj5OQBXflKHfmx51PZgkR4Oh081i5nGbcBXyXiPFXGVm1XZWo/ybUT417iExbaVPl4+imCiMiLx4perlENuxNSlATqb5ZLRmL4U+MbCnAba0DRbTOtpXRd5MNYfw3dJqVctQetzFZCbFP7Z620Q8uJiCkpY2wzafA9yuinu46jYmQEehKGpnewDEZEmMtjRsxeS+ap8RJ6slxLgdShrrTa71pzfyr3jvY3lPOA== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=siemens.com; Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) by PR3PR10MB4109.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:a0::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5504.14; Mon, 8 Aug 2022 15:30:56 +0000 Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::75ee:d5d2:6b1d:150b]) by PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::75ee:d5d2:6b1d:150b%3]) with mapi id 15.20.5504.019; Mon, 8 Aug 2022 15:30:56 +0000 Date: Mon, 8 Aug 2022 17:30:49 +0200 From: Henning Schild To: Felix Moessbauer Cc: isar-users@googlegroups.com, Adriaan Schmidt Subject: Re: [PATCH v2] use xz and gzip on host (outside chroot) Message-ID: <20220808173049.23ea9579@md1za8fc.ad001.siemens.net> In-Reply-To: <20220808073613.133842-1-felix.moessbauer@siemens.com> References: <20220808073613.133842-1-felix.moessbauer@siemens.com> X-Mailer: Claws Mail 3.19.0 (GTK+ 2.24.33; x86_64-pc-linux-gnu) Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-ClientProxiedBy: CH2PR11CA0027.namprd11.prod.outlook.com (2603:10b6:610:54::37) To PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) Return-Path: henning.schild@siemens.com MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 057eec49-5204-416e-9d97-08da7952fce0 X-MS-TrafficTypeDiagnostic: PR3PR10MB4109:EE_ X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: hBRbNER2mEQWw0/f5zk7Jh6TRTD9qbo7PUvhqEsHfJzE99nCvUJyUS891SyiEvsuDYbrBp/vFnGMfWop5P31bMyNz0WPAP6W8qHKLNFUOEdvZnCgzJFTl3ZH7VMT/dFAoraZ4xJVIgmyik5ZiNjELFvaYWwj3pBSUWJq7F3zmYI44APmiCa0uJ0w2/M6Hwnc4M6pRCDclYczhVn5ELeU7nie+LarYLTx4CZ5i+caFNe4xyokUDVIZ+AuhjsqCsiO4C/ZRipC2ypQNwymg2kVuqmdVzwA3/EJ4Hn4PFFoaOkAgymWDVlxWcLYmdlCnAsEqPqIoSghnxOqB2GqnKiTvHqSZt6T+weBMqXTtcpP9063z3gr14kTn6egOjtOmC61WvFStgrhb+S9J/G7ez1vauZsWTYPl9u6MAQQHc0Wh1vhK0z90vtdpI4e+WFrAHUFYF0J3NFSVX1UypgAKVXhoHThdV75OquD9ttljtwwbiNcCtdwatdc4F3Z57qLpf8YL9kYXK9JPRGnF2O8SOq61BK/DXERAy45+9I6C8RJ7QlQobNfCrcQeNm+9XReFpFIzS69gZFoKSE8A1x3DI7VBm1MtDuWMwpZpD4z+e7MgXJPWZjFtUIK7IswPCkJKmyp7RehvhYHy4kYxaEkr1muvCXAQwpNPN+/WHd5IQYOjzDaX7MYG8CwoVv71UvFCLFWR2sx6jEjOlmGgjE30z9QTSErvCL17wUd02r1ql/+2N1E3aE2vdNFWUVSumMlk5ab X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230016)(4636009)(376002)(39860400002)(136003)(366004)(396003)(346002)(4326008)(5660300002)(6862004)(44832011)(107886003)(478600001)(1076003)(6486002)(8936002)(8676002)(6506007)(6512007)(6666004)(41300700001)(9686003)(26005)(66556008)(66476007)(66946007)(86362001)(2906002)(82960400001)(38100700002)(186003)(6636002)(316002)(83380400001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?N8mJQTeRgu7VTdwP2pQOo1+eXekwoX/WC30lcI3tJ2Nr3LgJCmLUb2FgSVRJ?= =?us-ascii?Q?giMk1bNQVAT3XXttaOPaWu+ud/siG0OujP32bmnQXXiBQqf3cfrnhbGGXUhl?= =?us-ascii?Q?mM8jHNsencnXj+bwZZF3Xl83DTnVeMfodtohT2ABFOiUHgTQ5l292ADw4P6w?= =?us-ascii?Q?S7/26Ut89IodBJjMO3YBb84KYtVwt0d5xPFK9eEI9NILZ17I14MUgb1DlAvk?= =?us-ascii?Q?uMB6BtWmudZc3Av0u7WoXBWrPwii83Y7Rkenx7SnSU53JufC+Ky6RhwRG8aA?= =?us-ascii?Q?KL9YAwPu4Td6RldlG7ipvKKM5UI8qmpvBXosuem1PwqKOAhH4lOKD0gtJGK2?= =?us-ascii?Q?WLdmHkUiKgjblwXBGmG9XUdOCISEQJCXzL9B4R5DyBqr+h+VmsAIuY3mjR9q?= =?us-ascii?Q?83k29rvqHhQYqDWgjFlItnuRo3R52JyMTiCYvR3He/n4tfC3BUTd5KvYxRYr?= =?us-ascii?Q?BZXqZJDAgIz5PZR/iXy5Qx7ov2ieplDo9F1p0UB/MEr98NAn9n2hzT5IjNU0?= =?us-ascii?Q?UNgereHQMglxXhH0xmYAiwRAtP/7lLBZYsRz4H/2CxdpmIJwgfiKI42y3ldA?= =?us-ascii?Q?9Z8VltRv+0Kf3+dm0PExKInixGHZW/9J6qDHlASeSxSts1aMb1K4VKf8H0n1?= =?us-ascii?Q?3InO4EIApOBGN4bFrMYB65FqhaLuD0z9UyIVhVq49RHAgbZ/UPLGKvDWCccj?= =?us-ascii?Q?cxD8RMHLCE+D0qgEUwFHRmdbpCsxjpU8qykzom+DSDcXi+Fun3uVp5mqRxgf?= =?us-ascii?Q?qU8YrJ7TqpAQmDmvmG2OJBznwKl3QyURJGd40yLOLdKs05gUwebZDBzIlC+C?= =?us-ascii?Q?dsglp7AtCBC5Or8AdHizTmEHkX9zLpqhjHMNRU+73AnrjankPC9LAAgRNq2p?= =?us-ascii?Q?/MqoyBrnkY9NhIRUuY9eHPUInc48/CvQORRtmdwUdvIb/iRcPcyxzcgqDZu0?= =?us-ascii?Q?zsz+JQf2eVhJxXq4bpcTPng7ffXHw6bp2XX/UTOKEBUDwfRSztDqj73UG4Jf?= =?us-ascii?Q?R3fASWg06h4/XhyqFBDQkhsMVIADIgi5/bMu8Fd8PxF72L615sK+QPVtWNZl?= =?us-ascii?Q?Hhn+GU8bZpuPhHTmvUtb4yLSxZnJNz2mfGTG0d+fHsyrtq0RU3bDna45V3OP?= =?us-ascii?Q?8nFxqP9ZTYry75neno2B6mq3+i/WuS+o5X5AxPN0szJ5pSOwtqePDCHOnVQ0?= =?us-ascii?Q?niCWlq9tn4piKaUpIoiao1XMvhyuOLCgluk/7fqD5P6WY7Cv4B8j8v5YL1T+?= =?us-ascii?Q?GIXkt/M+E43pG0Q8qt/u8IAexrE1Z8RKW3l9aMJ9LxsoqVENUcTMcDT8cDkE?= =?us-ascii?Q?Y0IXBcdU62T9EyqEI6HzmkNhdVWqYWSxrbwH8QHfgtZpBMtm5CW5aY6x5yVr?= =?us-ascii?Q?kqtSOlbzHtQLR/yzIDzNuGKVaswtWv7vzjB0vJiqU2J78NuSs0Mb20jEZQT9?= =?us-ascii?Q?rMi1PKG45kYk4RRA+WhpX536/tMZSKhscEqS0N97sAjW3LSIWUbw7z5bfP3x?= =?us-ascii?Q?5Ju0x9Q6LJKODn2uB8m62/qA9G7a2YUf6oIxIadRIi0XrULSLTJ2FAXAJZO6?= =?us-ascii?Q?U7LNi0Fc8gOlUIaSSjy71sPwAETW2k7dXfkDyCVL/kelSzw3VVnJ23SAAOj4?= =?us-ascii?Q?1w=3D=3D?= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: 057eec49-5204-416e-9d97-08da7952fce0 X-MS-Exchange-CrossTenant-AuthSource: PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 08 Aug 2022 15:30:56.4454 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: n7J+CWgUFZoBTh2S5+LB4lG26xUTZtEuEqkHGuPeuG5BTt8LKOAgf/QBkmElpXfSbsWI/ND43Vm5X4M8p4RQPlpyjgD/H+otuWko1L+PzZw= X-MS-Exchange-Transport-CrossTenantHeadersStamped: PR3PR10MB4109 X-TUID: nIUsWLs7IvlK Am Mon, 8 Aug 2022 09:36:12 +0200 schrieb Felix Moessbauer : > From: Adriaan Schmidt > > This patch significantly speeds up the final image compression > as the compression itself is no longer emulated. > > For gzip, no additional dep has to be installed on the system, > for xz the xz-utils package has to be installed but this will > be required from bitbake 2.0 on anyways. > > Signed-off-by: Adriaan Schmidt > Acked-by: Felix Moessbauer > --- > doc/user_manual.md | 3 ++- > meta/classes/imagetypes.bbclass | 8 ++++---- > 2 files changed, 6 insertions(+), 5 deletions(-) > > diff --git a/doc/user_manual.md b/doc/user_manual.md > index 546ae75c..932bfbe5 100644 > --- a/doc/user_manual.md > +++ b/doc/user_manual.md > @@ -83,7 +83,8 @@ apt install \ > reprepro \ > sudo \ > git-buildpackage \ > - pristine-tar > + pristine-tar \ > + xz-utils > ``` > > Additional setup is required since `sbuild` is now used for package > build. diff --git a/meta/classes/imagetypes.bbclass > b/meta/classes/imagetypes.bbclass index 1e8e223d..319e9dc8 100644 > --- a/meta/classes/imagetypes.bbclass > +++ b/meta/classes/imagetypes.bbclass > @@ -95,13 +95,13 @@ IMAGE_CMD_ubi[depends] = > "${PN}:do_transform_template" # image conversions > IMAGE_CONVERSIONS = "gz xz" > > -CONVERSION_CMD_gz = "${SUDO_CHROOT} sh -c 'gzip -f -9 -n -c > --rsyncable ${IMAGE_FILE_CHROOT} > ${IMAGE_FILE_CHROOT}.gz'" > -CONVERSION_DEPS_gz = "gzip" +CONVERSION_CMD_gz ?= "gzip -f -9 -n -c > --rsyncable ${IMAGE_FILE_HOST} > ${IMAGE_FILE_HOST}.gz" > +CONVERSION_DEPS_gz ?= "" No. Please only add the ? so you can take the shortcut in your layer, without changing the conservative and slow isar defaults. Henning > XZ_MEMLIMIT ?= "50%" > XZ_THREADS ?= "${@oe.utils.cpu_count(at_least=2)}" > XZ_THREADS[vardepvalue] = "1" > XZ_OPTIONS ?= "--memlimit=${XZ_MEMLIMIT} --threads=${XZ_THREADS}" > XZ_OPTIONS[vardepsexclude] += "XZ_MEMLIMIT XZ_THREADS" > -CONVERSION_CMD_xz = "${SUDO_CHROOT} sh -c 'xz -c ${XZ_OPTIONS} > ${IMAGE_FILE_CHROOT} > ${IMAGE_FILE_CHROOT}.xz'" -CONVERSION_DEPS_xz > = "xz-utils" +CONVERSION_CMD_xz ?= "xz -c ${XZ_OPTIONS} > ${IMAGE_FILE_HOST} > ${IMAGE_FILE_HOST}.xz" +CONVERSION_DEPS_xz ?= ""