From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7127570847942836224 X-Received: by 2002:a17:906:cc15:b0:731:6cc2:7a85 with SMTP id ml21-20020a170906cc1500b007316cc27a85mr1259838ejb.512.1659944193636; Mon, 08 Aug 2022 00:36:33 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6402:34cc:b0:43e:ac81:1b80 with SMTP id w12-20020a05640234cc00b0043eac811b80ls3543477edc.1.-pod-prod-gmail; Mon, 08 Aug 2022 00:36:32 -0700 (PDT) X-Google-Smtp-Source: AA6agR6+u+c8RpmRnZ5irsyG6tVt5kIQ88SPwbT1auETxEfcvi5CXS6ve54txlgGPZBlk8I+WNQh X-Received: by 2002:a50:cd1c:0:b0:43d:4821:88a8 with SMTP id z28-20020a50cd1c000000b0043d482188a8mr16683168edi.396.1659944192047; Mon, 08 Aug 2022 00:36:32 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1659944192; cv=none; d=google.com; s=arc-20160816; b=sxdavmtyLfudS5v9x/K0C+ReacwppWxW7RPwh08sqOmtT5bo2KM7/b3Nxqw60YsHXU /ke/Spz2uHzxQJm3PwUn/YwNluOGg3Z5N66tWZNIvQf1iV4DdTQASLsfqz0PBGMWoEXN dUsZp9GqPHFlHZUS8XwVh1C+8z8OOhF0wGnHhZOfjgflc3ZUW4+YFBmzzZUofvDl8Duz NoFzY5MLjUkIMVH12/sK6LshB3Fty1NzevTAT2sLnEpHkT82VzGUve1AknQBmzTiU8bq 1YCPaHPY2KRixroTXGBNNd5k2cYb/xp/5yjQ/zDseOUmb4LPnaGa2oY1ZE70os3GJz7R aOZw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=feedback-id:content-transfer-encoding:mime-version:message-id:date :subject:cc:to:from:dkim-signature; bh=tdBg7NOWaFj6SdRHdB59EVzQx1f9TmFSjDu3lp+tcK4=; b=cjECXyqCcYTdc57fS7NJZUlB+7KR9PFgzUnyDql4ZVV6VOeNPuOWGC/ZHpAifSQOeC Ym96TiTTNafrHgF7zM/XIUia5nz0GjdjqRro+zmcCtbT5wmQs6wp6KrNnMQGGKl9oiMM km6HtRrCRncxVFW5xvvbXk+cpuWo3ukyw9ZGaRvDwmxSi15Ak6F/ntynlhEog/Z0/V6F o2OhUiLIRwYRxFJkyxH+tSzenufXUt8GMA4sc3i9SY3k5nU936QwH1O+DoAGR9EQ53Zq 7pgbh3qML7hp0f2KzOJTgCp0vH9ZojO2nnYl3WmCzFWKBI6J/ZBMYKdFqfsbrD8vCOr3 1Nxg== ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=V7orE2W4; spf=pass (google.com: domain of fm-72506-20220808073631f42c6be4580a189732-uy66eo@rts-flowmailer.siemens.com designates 185.136.65.227 as permitted sender) smtp.mailfrom=fm-72506-20220808073631f42c6be4580a189732-uY66Eo@rts-flowmailer.siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from mta-65-227.siemens.flowmailer.net (mta-65-227.siemens.flowmailer.net. [185.136.65.227]) by gmr-mx.google.com with ESMTPS id o3-20020aa7c503000000b0043dc5dd9a71si204712edq.2.2022.08.08.00.36.32 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 08 Aug 2022 00:36:32 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-72506-20220808073631f42c6be4580a189732-uy66eo@rts-flowmailer.siemens.com designates 185.136.65.227 as permitted sender) client-ip=185.136.65.227; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=V7orE2W4; spf=pass (google.com: domain of fm-72506-20220808073631f42c6be4580a189732-uy66eo@rts-flowmailer.siemens.com designates 185.136.65.227 as permitted sender) smtp.mailfrom=fm-72506-20220808073631f42c6be4580a189732-uY66Eo@rts-flowmailer.siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Received: by mta-65-227.siemens.flowmailer.net with ESMTPSA id 20220808073631f42c6be4580a189732 for ; Mon, 08 Aug 2022 09:36:31 +0200 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; s=fm2; d=siemens.com; i=felix.moessbauer@siemens.com; h=Date:From:Subject:To:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:Cc; bh=tdBg7NOWaFj6SdRHdB59EVzQx1f9TmFSjDu3lp+tcK4=; b=V7orE2W4aqaw9SHF6Iu66d86SFz23xjbv7femu/ETyvjD2/6Yes+l8Sve1JvRIpy/suChY gMw7ANps4tdB8QSIYakg91uR75VW90UXr4o6eQJkJwTnrNM71sBA+Jh8s5cLeHDJzPRZzG1m X18weVQxSLgKDfd4+JWN96cSbGXWI=; From: Felix Moessbauer To: isar-users@googlegroups.com Cc: henning.schild@siemens.com, Adriaan Schmidt , Felix Moessbauer Subject: [PATCH v2] use xz and gzip on host (outside chroot) Date: Mon, 8 Aug 2022 09:36:12 +0200 Message-Id: <20220808073613.133842-1-felix.moessbauer@siemens.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-72506:519-21489:flowmailer X-TUID: kXa9sYOeWNm1 From: Adriaan Schmidt This patch significantly speeds up the final image compression as the compression itself is no longer emulated. For gzip, no additional dep has to be installed on the system, for xz the xz-utils package has to be installed but this will be required from bitbake 2.0 on anyways. Signed-off-by: Adriaan Schmidt Acked-by: Felix Moessbauer --- doc/user_manual.md | 3 ++- meta/classes/imagetypes.bbclass | 8 ++++---- 2 files changed, 6 insertions(+), 5 deletions(-) diff --git a/doc/user_manual.md b/doc/user_manual.md index 546ae75c..932bfbe5 100644 --- a/doc/user_manual.md +++ b/doc/user_manual.md @@ -83,7 +83,8 @@ apt install \ reprepro \ sudo \ git-buildpackage \ - pristine-tar + pristine-tar \ + xz-utils ``` Additional setup is required since `sbuild` is now used for package build. diff --git a/meta/classes/imagetypes.bbclass b/meta/classes/imagetypes.bbclass index 1e8e223d..319e9dc8 100644 --- a/meta/classes/imagetypes.bbclass +++ b/meta/classes/imagetypes.bbclass @@ -95,13 +95,13 @@ IMAGE_CMD_ubi[depends] = "${PN}:do_transform_template" # image conversions IMAGE_CONVERSIONS = "gz xz" -CONVERSION_CMD_gz = "${SUDO_CHROOT} sh -c 'gzip -f -9 -n -c --rsyncable ${IMAGE_FILE_CHROOT} > ${IMAGE_FILE_CHROOT}.gz'" -CONVERSION_DEPS_gz = "gzip" +CONVERSION_CMD_gz ?= "gzip -f -9 -n -c --rsyncable ${IMAGE_FILE_HOST} > ${IMAGE_FILE_HOST}.gz" +CONVERSION_DEPS_gz ?= "" XZ_MEMLIMIT ?= "50%" XZ_THREADS ?= "${@oe.utils.cpu_count(at_least=2)}" XZ_THREADS[vardepvalue] = "1" XZ_OPTIONS ?= "--memlimit=${XZ_MEMLIMIT} --threads=${XZ_THREADS}" XZ_OPTIONS[vardepsexclude] += "XZ_MEMLIMIT XZ_THREADS" -CONVERSION_CMD_xz = "${SUDO_CHROOT} sh -c 'xz -c ${XZ_OPTIONS} ${IMAGE_FILE_CHROOT} > ${IMAGE_FILE_CHROOT}.xz'" -CONVERSION_DEPS_xz = "xz-utils" +CONVERSION_CMD_xz ?= "xz -c ${XZ_OPTIONS} ${IMAGE_FILE_HOST} > ${IMAGE_FILE_HOST}.xz" +CONVERSION_DEPS_xz ?= "" -- 2.30.2