From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7191847640499224576 X-Received: by 2002:a05:6870:a11d:b0:15f:df61:5e9c with SMTP id m29-20020a056870a11d00b0015fdf615e9cmr1048062oae.282.1674530312214; Mon, 23 Jan 2023 19:18:32 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:aca:1708:0:b0:363:b56:297 with SMTP id j8-20020aca1708000000b003630b560297ls4242632oii.1.-pod-prod-gmail; Mon, 23 Jan 2023 19:18:31 -0800 (PST) X-Google-Smtp-Source: AMrXdXumbHMYg06/ya+4AG/muN9sZA8nMPNSr4ejvJozewMGmELqriotgPhCo6yL2doJKTtjZSuC X-Received: by 2002:aca:36c1:0:b0:35b:e443:e5d0 with SMTP id d184-20020aca36c1000000b0035be443e5d0mr10424773oia.17.1674530311690; Mon, 23 Jan 2023 19:18:31 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1674530311; cv=none; d=google.com; s=arc-20160816; b=A4rm4R/35Jn0f1nTKepJAi07ML2pnqXF4yyjQ/Ph8tvqe8/dAd20q3LwN/uKHwZ6Jz M4tjcFjc0K8vwu+uJawrg51YIFDwkkl0BKCNtCDDB8zAo3zFgUQjcZ5s3g1ICVYC8Nfz pa9Etr12EIO03Vii8ziPMERucVSI+GC0BiLJFU2om8Ae8EWO7mqu4QF3iyDq/x6LmIEB i6pZuw9LmwlG2NAlm/gJVbUAr9SoA40HbQ00oyHNfrPKN1WldHr4aWKbC1v9G+pQYvk/ 8l3u8NY//WcJNaHWbZCKirx233dxP4D/vYqSp5/hwts3Va8n9qYjSxqSKi5kQQV/Xc2L S5sQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:dkim-signature; bh=H0rjReufOPvBbxzPLhlPwpnbIMD0BTQeyob5T/VtgPk=; b=lWkw1DBIHeAD3zzpyaH9S56kEX0+aSBv0AMLvxrprOPvvlDr97kok55/2X5v7+5YU4 wlnPEfEceYd75wphE0DIOPeM5RXrOIdzQPFzauBJORFO+JbtdOG+4izzhGUk1hqywsN8 bHW8hDLvHwbOhkkYMHC/Mq9+3OuAsYh+TJgug0+JrjFWL40gbmYFoy2cLf/aVzPhaCuU s29dbDpcXr0C+FlreqPMZRqUtzDsB80JCZDpP7njp0SQQqBfjHPgAIA7x5gamdgCg1R3 ip4whQONAIMnig5NjHshqp6jH/+zh6QA6/t4UMGb8VWRZQUktb+lWTuqCVXvWHoGBeJ0 XELQ== ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=DtcsGLia; spf=pass (google.com: domain of roberto.foglietta@gmail.com designates 2607:f8b0:4864:20::f2b as permitted sender) smtp.mailfrom=roberto.foglietta@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Return-Path: Received: from mail-qv1-xf2b.google.com (mail-qv1-xf2b.google.com. [2607:f8b0:4864:20::f2b]) by gmr-mx.google.com with ESMTPS id r27-20020a056808211b00b0035c4c510304si108125oiw.1.2023.01.23.19.18.31 for (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Mon, 23 Jan 2023 19:18:31 -0800 (PST) Received-SPF: pass (google.com: domain of roberto.foglietta@gmail.com designates 2607:f8b0:4864:20::f2b as permitted sender) client-ip=2607:f8b0:4864:20::f2b; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@gmail.com header.s=20210112 header.b=DtcsGLia; spf=pass (google.com: domain of roberto.foglietta@gmail.com designates 2607:f8b0:4864:20::f2b as permitted sender) smtp.mailfrom=roberto.foglietta@gmail.com; dmarc=pass (p=NONE sp=QUARANTINE dis=NONE) header.from=gmail.com Received: by mail-qv1-xf2b.google.com with SMTP id k12so10813748qvj.5 for ; Mon, 23 Jan 2023 19:18:31 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:from:to:cc:subject:date:message-id:reply-to; bh=H0rjReufOPvBbxzPLhlPwpnbIMD0BTQeyob5T/VtgPk=; b=DtcsGLiatGPLK5/5C5qa2ixZ01OX5fo05hZFRtix5mpCrrYKSSNKvTIaTom0I6isIP wm/CpTTFpA5FTXy264E+HOKX+ce+NKy4ZSFsI//In5ijugLHTJjuq1/C4vniinYJ3wxN U3E6FvmpUmW7vPSygzmHC57JxxqfRuxyBNJz+BKj0VlAuoxBOyGIMwpwpzL/22XcDMMW OnmyCxKD2yoBJ5PuboE9FiUKTRIvQvAOlNPtGmntLJk+8eVUV6NHZWSZiTrXexD6aOZQ 3C+Yol9FN9+r7tm4PGLmhEXQn5ijBvdh8Qu9jVPNNogXCdydK8qnK3jPNm2NgkWYvlEy bq0A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=cc:to:subject:message-id:date:from:in-reply-to:references :mime-version:x-gm-message-state:from:to:cc:subject:date:message-id :reply-to; bh=H0rjReufOPvBbxzPLhlPwpnbIMD0BTQeyob5T/VtgPk=; b=wCrqciQjeNCoV/QMYyJkYccvpdbvX+E8p6kkDeZRm62G3SF3E8/T+DnMHvv54KhaPi eLc5VuTZbDvwZvE4hmEJyIS7xfP4H/C7L6dNjGDWeWFDOipS8bz1zTkvmOm2mNpHRnmn 1TRes3wIppUY51/PtOo9S4nS0Dhmzs+/ktiu3+8ZfYWbR3fC1hZ4lpzOzvtCHnG9ttu3 QGp1y7RM2D5dGkIiAaTTHpMgmc9ws8hQ4xtasPRFExb4IsFXTEmpSKnER1mksHkj8+12 hQeGilomQRXQTHKSA7SOmB7PD7gyH1sr6RmHcDTN9ZayzFnsWY4c56Ogb/fyVs4TgWed WkEQ== X-Gm-Message-State: AO0yUKU7jzXgrCbMxXOwxAJhD8UnBJVaBiWRZudurskYeFeC3UkKEGKG PVWMu4365XfyuDjb3VJt5AXeNoEqMcjnIDK6emSNUvbaZcyZ X-Received: by 2002:a05:6214:5f0d:b0:537:653d:c866 with SMTP id lx13-20020a0562145f0d00b00537653dc866mr53862qvb.32.1674530311049; Mon, 23 Jan 2023 19:18:31 -0800 (PST) MIME-Version: 1.0 References: <20230123140016.71522-1-michael.adler@siemens.com> <6d7ab6e6-6260-6a85-587e-9609e9314645@siemens.com> In-Reply-To: <6d7ab6e6-6260-6a85-587e-9609e9314645@siemens.com> From: "Roberto A. Foglietta" Date: Tue, 24 Jan 2023 04:17:54 +0100 Message-ID: Subject: Re: [PATCH] feat: add zstd support to image conversions To: Jan Kiszka Cc: Michael Adler , isar-users@googlegroups.com Content-Type: multipart/alternative; boundary="0000000000005b17f905f2f9f814" X-TUID: bpVheupnIpD7 --0000000000005b17f905f2f9f814 Content-Type: text/plain; charset="UTF-8" Il Lun 23 Gen 2023, 20:22 Jan Kiszka ha scritto: > On 23.01.23 15:00, Michael Adler wrote: > > This patch enables ISAR to build zstd compressed images. > > > > I was briefly thinking you had solved the dpkg vs. zstd issue - just a > dream :) > Hi Jan. I think you are speaking about zstd compression for the debian package that is 1% bigger but 13x times faster in expanding. [1] Ubuntu and Arch adopted zstd but not debian which is still using xz and as far as I have seen neither in parallel using option -T. I think you should ask them to produce all package with export XZ_DEFAULTS='-T 8' and enabling dpkg to set internally XZ_DEFAULTS='-T 0' unless it is differently set. What Do you think about changing ISAR to use zstd or xz -T without repackaging everything at fetch time? It would be a solution: fetch, repackage with zstd and the downloads remain for a long time like a permanent cache and also the benefits. The counter effect is that those debian packages and those produced by ISAR will be not anymore compatible with a standard debian and this could be a nasty surprise in some cases for some users. The alternative is to repackage everything with xz parallel. Usually a modern laptop has 8 pipes but I have the sensation that with -T 0 it counts just the cores because on my machine spawn 4 not 8. Best regards, R- [1] https://archlinux.org/news/now-using-zstandard-instead-of-xz-for-package-compression/ --0000000000005b17f905f2f9f814 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Il Lu= n 23 Gen 2023, 20:22 Jan Kiszka <jan.kiszka@siemens.com> ha scritto:
On 23.01.23 15:00, Michael Adler = wrote:
> This patch enables ISAR to build zstd compressed images.
>

I was briefly thinking you had solved the dpkg vs. zstd issue - just a
dream :)

Hi Jan.

I think you are speaking about zstd compression for the debian package t= hat is 1% bigger but 13x times faster in expanding. [1]

Ubuntu and Arch adopted zstd but not debian which is still using xz a= nd as far as I have seen neither in parallel using option -T.
I think you should ask them to produce all package with=C2=A0

export XZ_DEFAULTS=3D'-T 8'=C2=A0

and enabling dpkg to set internally=C2=A0

XZ_DEFAULTS=3D'-T 0'

unless it is = differently set. What Do you think about changing ISAR to use zstd or xz -T= without repackaging everything at fetch time?

It = would be a solution: fetch, repackage with zstd and the downloads remain fo= r a long time like a permanent cache and also the benefits.

<= /div>
The counter effect is that those debian packages and those produc= ed by ISAR will be not anymore compatible with a standard debian and this c= ould be a nasty surprise in some cases for some users.

=
The alternative is to repackage everything=C2=A0with=C2=A0xz=C2=A0para= llel. Usually a modern laptop has 8 pipes but I have the sensation that wit= h -T 0 it counts just the cores because on my machine spawn 4 not 8.
<= div>
Best regards, R-


--0000000000005b17f905f2f9f814--