From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7225928350672355328 X-Received: by 2002:ac2:4146:0:b0:4eb:93a:41f0 with SMTP id c6-20020ac24146000000b004eb093a41f0mr3868432lfi.4.1682417548707; Tue, 25 Apr 2023 03:12:28 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6512:4013:b0:4ec:6fe6:9f26 with SMTP id br19-20020a056512401300b004ec6fe69f26ls718970lfb.0.-pod-prod-gmail; Tue, 25 Apr 2023 03:12:26 -0700 (PDT) X-Google-Smtp-Source: AKy350YCraq477zh0QCz5CiluuCm5Vz8ZKjArXl59A/38rgbh13hYPdM99JuvvoR49iy077DMDjT X-Received: by 2002:ac2:4204:0:b0:4ea:e296:fe9e with SMTP id y4-20020ac24204000000b004eae296fe9emr4134177lfh.9.1682417546915; Tue, 25 Apr 2023 03:12:26 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1682417546; cv=none; d=google.com; s=arc-20160816; b=Oz6jCrVY5igFWk5s4XTQZRH0DwZVClrKEglcTia+JgPSMWjqpvfp5U2DUnLdw0/dO4 s8c4va/iURcbJD1IBrZcJ1zJYmLYtNXU/yPIFsf6qS08OlFKkJM8pb2mXc9R7Q6TtqzI Vs2GdpncQFn0A04FUIeXcRs9Mray5ZCLIBETe68i4ePznCVuGZFfRO1Z+v0YJl1440yV L5bEoES9ORXWgfM3H4tdY4MDyOziSzR4ckfCCl9BdIl96OMk5A063H/VI+DUaBeKS2F0 jciS7TOUiS+s5NDf+wMd3BWnKjEsywHy1U92kwFSje7eECD8towLbM49htFI7i0faJlc bROw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=feedback-id:content-transfer-encoding:mime-version:message-id:date :subject:cc:to:from:dkim-signature; bh=CRGr1P1DYNHw0s6xBVDq8rro+GasTxCCzHfJfRC9jaI=; b=UcWtlFBTQl7H6MzAoImOkfj4Ffb0EoDlDGJFfnfFZosIermwrVqDvV5Q3+D12NwwVK kLt7pTvNGffiDnpfFvbb7RJW9dGbrAvT0NTFWUcMeRFKYGKcW2cVI7xvHgmhZw2Gvixm c1wkt99ZaUC330hG0k4yReFqfzjMsS949RYTw6njHWdKfS/cnWUuphltSu4qB8dphIsw x7ahx6ISrGmkfsakgT4kLvoaAVCOqv1ng/BwwrP9vp93ko3dFmIEP17Lv6vF8evjTcI+ qWNGXNoYBIQiLy9XZfDAXGbvOJwiBPnkily9mBJz2ujW2q5WTNrczcs/lRdIPa50cZCM SuXA== ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=PiKQhi61; spf=pass (google.com: domain of fm-72506-20230425101226e14462ed4c50a9fb6e-8cp8og@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) smtp.mailfrom=fm-72506-20230425101226e14462ed4c50a9fb6e-8cP8oG@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Return-Path: Received: from mta-64-227.siemens.flowmailer.net (mta-64-227.siemens.flowmailer.net. [185.136.64.227]) by gmr-mx.google.com with ESMTPS id d29-20020a0565123d1d00b004dd84067a4asi861022lfv.4.2023.04.25.03.12.26 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 25 Apr 2023 03:12:26 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-72506-20230425101226e14462ed4c50a9fb6e-8cp8og@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) client-ip=185.136.64.227; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=PiKQhi61; spf=pass (google.com: domain of fm-72506-20230425101226e14462ed4c50a9fb6e-8cp8og@rts-flowmailer.siemens.com designates 185.136.64.227 as permitted sender) smtp.mailfrom=fm-72506-20230425101226e14462ed4c50a9fb6e-8cP8oG@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: by mta-64-227.siemens.flowmailer.net with ESMTPSA id 20230425101226e14462ed4c50a9fb6e for ; Tue, 25 Apr 2023 12:12:26 +0200 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; s=fm1; d=siemens.com; i=felix.moessbauer@siemens.com; h=Date:From:Subject:To:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:Cc; bh=CRGr1P1DYNHw0s6xBVDq8rro+GasTxCCzHfJfRC9jaI=; b=PiKQhi61hwzqkXJ095AC3cyMF8U/vjwoWjNNVOvj0h3b7ih+Fp8dAGYoqHvBc46ILwV0Xe q1uoGIoCloY8mux8VpozBmBAdoJBnT+5NN7lXGLhx/EQGXFMqFJFynbKH7lOlNRaXT1tK/Jt A2aAPlAsTkffA1/dr0Ke+0vUUDK6A=; From: Felix Moessbauer To: isar-users@googlegroups.com Cc: michael.adler@siemens.com, Felix Moessbauer Subject: [PATCH 1/1] make compressed images better syncable Date: Tue, 25 Apr 2023 10:12:16 +0000 Message-Id: <20230425101216.1693998-1-felix.moessbauer@siemens.com> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-72506:519-21489:flowmailer X-TUID: nSPWc0uuEayW For compression formats that support these options (currently only zstd), we enable to include the sparseness information into the archive. By that, disk IO on decompression of large zero blocks is speedup and storage usage is decreased. Usually, this is handled automatically by the compression tools, but not when sending output to stdout. In addition, we add the rsyncable flag to reduce the number of changed blocks in the output when only changing some input blocks. Signed-off-by: Felix Moessbauer --- meta/classes/imagetypes.bbclass | 2 +- meta/conf/bitbake.conf | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/meta/classes/imagetypes.bbclass b/meta/classes/imagetypes.bbclass index 2ee3240b..a80a6da5 100644 --- a/meta/classes/imagetypes.bbclass +++ b/meta/classes/imagetypes.bbclass @@ -101,5 +101,5 @@ CONVERSION_DEPS:gz = "gzip" CONVERSION_CMD:xz = "${SUDO_CHROOT} sh -c 'xz -c ${XZ_DEFAULTS} ${IMAGE_FILE_CHROOT} > ${IMAGE_FILE_CHROOT}.xz'" CONVERSION_DEPS:xz = "xz-utils" -CONVERSION_CMD:zst = "${SUDO_CHROOT} sh -c 'zstd -c ${ZSTD_DEFAULTS} ${IMAGE_FILE_CHROOT} > ${IMAGE_FILE_CHROOT}.zst'" +CONVERSION_CMD:zst = "${SUDO_CHROOT} sh -c 'zstd -c --sparse ${ZSTD_DEFAULTS} ${IMAGE_FILE_CHROOT} > ${IMAGE_FILE_CHROOT}.zst'" CONVERSION_DEPS:zst = "zstd" diff --git a/meta/conf/bitbake.conf b/meta/conf/bitbake.conf index f421050e..c660660a 100644 --- a/meta/conf/bitbake.conf +++ b/meta/conf/bitbake.conf @@ -141,7 +141,7 @@ XZ_DEFAULTS[vardepsexclude] += "XZ_MEMLIMIT XZ_THREADS" ZSTD_THREADS ?= "${@oe.utils.cpu_count(at_least=2)}" ZSTD_THREADS[vardepvalue] = "1" ZSTD_LEVEL ?= "19" -ZSTD_DEFAULTS ?= "-${ZSTD_LEVEL} --threads=${ZSTD_THREADS}" +ZSTD_DEFAULTS ?= "--rsyncable -${ZSTD_LEVEL} --threads=${ZSTD_THREADS}" ZSTD_DEFAULTS[vardepsexclude] += "ZSTD_LEVEL ZSTD_THREADS" BBINCLUDELOGS ??= "yes" -- 2.34.1