From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Thu, 08 Aug 2024 08:35:43 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-lj1-f186.google.com (mail-lj1-f186.google.com [209.85.208.186]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 4786Zgna018700 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 8 Aug 2024 08:35:43 +0200 Received: by mail-lj1-f186.google.com with SMTP id 38308e7fff4ca-2ef23a67c5bsf4926071fa.3 for ; Wed, 07 Aug 2024 23:35:43 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1723098937; cv=pass; d=google.com; s=arc-20160816; b=nQj97it/C2HD3KHmqqAl8a0yY7AmEjVdk/5smcVKgKrSCOJTvcNc32p4wNmVJOMCpD gL2V7P4MLjBBHlwYo6v4+5fo6cjPcltBEqmrMXZZJNBuU4/NWkFXspdku9XYtGPIrLQ/ 6hKPGi3RmXJ2y9oXyq9ugZcrhR9R/TtUiTw8wloi+2To/D+pmaUYd1GYxN1Zn0lDFU3O jJKqz5gENMLn46W7dTij1SXl1J63dDuqS5tMUIMW6WUb8uGmRrigoijz9sN/gigGWdIb QjQ8bpWAIq6mrFnWXwobUBrmgN3es9EY8tvza0V5QmDyjvpS3NWU5ZoERPHIX23qnrPK /9pg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:user-agent :content-transfer-encoding:references:in-reply-to:date:to:from :subject:message-id:sender:dkim-signature; bh=8bBi3RTYWI/3EMRebEfvmuySSPDggXhjsKTgsA/LWDw=; fh=BN6anAyo6Jx2FSfwlKhEXn0b3oGQIRNNjoY6p2hsH4o=; b=WTuKepO4l8I0JicPX/kK8veD1bPpQ+GAFesqsyhtENOm6/GsDTSTvXunske1Eyhrqk FeaLtGKGIB0ww4ReGFXTE0vRfV7yN8V7ggZ5RBdrcv7KbFs4HGVumHl0je3Sb6JGw2f5 Vg7xL0yTc9uUE7MdONmDoLUy1Fa+mWZK+EF43tdHxrWcm3dqNjXMeSIVysKrRHWxwhfO 29y6PjMHmn49VWrQLeXGfyLoLsTi5KIOeBRZ9pYXVsra2WSWIXpWL4+qlUertrMvEjcB tco5zilnA27MGnO+I2Pdn3gyUWgFrQ8NoQKyBA0NI5s2J1bfEaSaXzJEL1TUp1spfWRb osvQ==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1723098937; x=1723703737; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:user-agent:content-transfer-encoding :references:in-reply-to:date:to:from:subject:message-id:sender:from :to:cc:subject:date:message-id:reply-to; bh=8bBi3RTYWI/3EMRebEfvmuySSPDggXhjsKTgsA/LWDw=; b=gtE0eSo61+FUmxYGYjciluH0ASEqcLm4KqzTnolanESfatNBe76EL3A6E4OvWDFCiV iCb6IHgXOHVA3uL2pkQLKRi0VgW7edGMnDV1WoOrB3JiRsvjGYSI1th4ycpJ8HxaFeGD /W4arZJQnr0kwB3CnTZKVN2G8zOXm4ytOCK1HUuWANk8tXS3Wrinwnn9akogMF0sAyY3 rdbU+SRx//j2P/HRmFw2qhtnASOS1FZF2bbGB3uo02UaohNQAtv2BF+LhifOtHhnVd4x aw7LJId8RZjRVOoS9UOwipvRs0l00XcWTbFBAref9Rx81B1rgTPHR7HlpQtpHkm6KJQV opvA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1723098937; x=1723703737; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :user-agent:content-transfer-encoding:references:in-reply-to:date:to :from:subject:message-id:x-beenthere:x-gm-message-state:sender:from :to:cc:subject:date:message-id:reply-to; bh=8bBi3RTYWI/3EMRebEfvmuySSPDggXhjsKTgsA/LWDw=; b=CvckcCCA8MS0zfHZ+/rGHQGEBIYwaR6t82oOGT4w3gP4L+wALv1PXOdq5G6wWRE6Hu UjjdbRXPHXUolISiHF5K4nxXfoEm5zT2qspD666GZngB2N6vS3ARyqwTRmMQAJ4Vbu30 L3DZPMhcWGcmfjSPzo70sqPZYCFPnaBwNoD+iCJI28PIlkTjNFbwjIYdVZKy8r3M5xec uSmYTuYrVY4nVoPPQvY9SNOj4wRJ/gsjC+I4a1Szb7gA5WHZmZSf7NajuhS3MTbWX/5d Y2aUCWXuPC1TMst4rhVjThuH/20Y1AteJ2rAxOw3s2wwBHgcrJ7b2F9klGdmoiQ306CJ skfw== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCXzb+CzBrj4dLqHbmGrQGy6NbWVMkslfoPDmQdxSmbjUoweELu/x2e4IB4zDyw6300dkcw=@isar-build.org X-Gm-Message-State: AOJu0YxcTRMXhPE4+3y4TuL+mNBhzn4J8DXlaYJ8bJwlHZDNvOX/Bn07 o3Wj24T5NIfF7V5sbnSq9wV6VNY2J2Rsx5TYMlZ3Y70VhGOmJBDU X-Google-Smtp-Source: AGHT+IF6rwku0B31RUP+Ut38f6nToDTenlx5SOarpuhA72/RxhQn6AAi3yF/yRKpTdjEYMIm+Bo0Sg== X-Received: by 2002:a2e:a541:0:b0:2f0:20cd:35fc with SMTP id 38308e7fff4ca-2f19de1fed7mr7107011fa.7.1723098936203; Wed, 07 Aug 2024 23:35:36 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a2e:1f0a:0:b0:2f0:1cb8:9ecd with SMTP id 38308e7fff4ca-2f19bb20449ls2341921fa.0.-pod-prod-04-eu; Wed, 07 Aug 2024 23:35:33 -0700 (PDT) X-Forwarded-Encrypted: i=2; AJvYcCUvmAoquaKyWMivZdTssQz6Vf5kY16qIt6aMVuEF3yOXkr/Nn01aqr0NkrnfZxet3D0w8c3besMxvEl@googlegroups.com X-Received: by 2002:a2e:a583:0:b0:2ef:2f9e:dd1b with SMTP id 38308e7fff4ca-2f19de2d8d5mr7134161fa.14.1723098933377; Wed, 07 Aug 2024 23:35:33 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1723098933; cv=none; d=google.com; s=arc-20160816; b=tTqLCOMzY/VrZBJyiibnGICqKfbi9djuuHhAzOoCa80lfPufif7VTdDNQj7SyX4bH1 BJD41k/Y7ZpuHYHy18vhyKh14S0MUM2FBjFSwUZ4S7nT0vqp/ITt8PrcYnmmzYWHxX4O AQiPAMVJg8lIepKv/xseBa/6CQW+6Tl6oLcLEQRBG2NTU9rLQIi8yYCCDgphQs+T/1EH ykX/NUf73ygO6OxZKeT1LJ3GqQd/ebURxJ7afQnWlKQF7SLpEAzzCYJFatlIpuPNou3S /OuqKWSLYKTfTY8XMnXWBNqjW6rVIrOj8BSweO1+4Ir44s4fLVvI6V9VdDljpY4JWf7W txBg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:to:from:subject:message-id; bh=3qcwbcdr0ya9thDORw2dL7NB+YR29sJ2D6Ly7VSD6fw=; fh=IxbeHM4vWxalf1XNf2rnGcQL+r1v0Lr0C6ICsGNNkYw=; b=UShiklkPHoSh6cnHIPiBUNY10tIrscalry5CGn9QEmq+bnzK2ctIMK2kl5pVFhYHBP bY7monUTfXMqwGiW8OR97Z11Ft6TczCRPu/EcAaj3F3JsOKpaSO/ilNQ4J3LWV+qCInR 7q+plSXQbqydINOVzFb2TUkYK4nJ3jtGrixrNBsyVn07Ry/O+C/5QTaxDougiIq483oX F4K+yqOzLScCfNUS6GGVHMybdCl1g5XPxtfLciOHIluI8VTAN1FaYljwYP3+oGMHTbgK 79cYTB+UMHR47zMyHp76XJR7jCnZjlrMBDC5wJLoRCT09eBtOqOpg8A7H3keB0ud5OLe 3vdg==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id ffacd0b85a97d-36d2733dfffsi14502f8f.6.2024.08.07.23.35.33 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Wed, 07 Aug 2024 23:35:33 -0700 (PDT) Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from [127.0.0.1] (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 4786ZUgD018695 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 8 Aug 2024 08:35:32 +0200 Message-ID: <2b56490fcf23aff01adcc3b69f3dc9c3a0c48fa5.camel@ilbers.de> Subject: Re: [PATCH v4 0/5] Introduce container fetcher and pre-loader From: Uladzimir Bely To: Jan Kiszka , isar-users Date: Thu, 08 Aug 2024 09:35:30 +0300 In-Reply-To: References: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.52.3 (by Flathub.org) MIME-Version: 1.0 X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED, RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: ubely@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-TUID: 8jC2YuwbNi9M On Fri, 2024-07-19 at 18:38 +0200, 'Jan Kiszka' via isar-users wrote: > We noticed internally that there are at least 3 implementations for > solving the task of pre-loading container images into isar-built base > systems, may it be that the images are not publicly available or the > device is only poorly connected, if at all. This series tries to > solve > the task generically - hopefully. >=20 > Changes in v4 > =C2=A0- fetch per architecture, no longer full multi-arch > =C2=A0- directly archive and compress in download task > =C2=A0- use hard links where possible to reduce disk usage > =C2=A0- always use zstd, remove configurability >=20 > Changes in v3: > =C2=A0- do not compress container deb packages [Benedikt] > =C2=A0- fix various spelling issues in the doc [Adriaan, Benedikt] >=20 > Changes in v2: > =C2=A0- switch to open-coded unpack before loading > =C2=A0- switch to zstd as default compression > =C2=A0- use default compression settings from bitbake.conf > =C2=A0- add support for delete-after-load (opt-in) > =C2=A0- factor out fetched container installation into separate task > =C2=A0=C2=A0 (should make self-built container packaging easier) > =C2=A0- use BPN instead of PN > =C2=A0- add "Requires" to systemd service > =C2=A0- use PACKAGE_ARCH to select container arch (rather than > DISTRO_ARCH) > =C2=A0- add CI test > =C2=A0- add documentation >=20 > Jan >=20 > Jan Kiszka (5): > =C2=A0 Introduce fetcher from container registries > =C2=A0 container-loader: Introduce helper to load container images into > local > =C2=A0=C2=A0=C2=A0 registry > =C2=A0 meta-isar: Add demo packages for installing prebuilt containers > =C2=A0 ci: Add test cases for container fetching and loading > =C2=A0 doc: Describe how to use the container fetcher and loader >=20 > =C2=A0doc/user_manual.md=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 58 +++++++++++++ > =C2=A0kas/package/Kconfig=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 19 ++++ > =C2=A0kas/package/pkg_prebuilt-docker-img.yaml=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 |=C2=A0 9 ++ > =C2=A0kas/package/pkg_prebuilt-podman-img.yaml=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 |=C2=A0 9 ++ > =C2=A0.../prebuilt-docker-img_0.1.bb=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 12 +++ > =C2=A0.../prebuilt-podman-img_0.1.bb=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 10 +++ > =C2=A0.../recipes-core/images/isar-image-ci.bb=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0 |=C2=A0 2 + > =C2=A0meta/classes/dpkg-base.bbclass=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 |=C2=A0 6 ++ > =C2=A0meta/lib/container_fetcher.py=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 86 > +++++++++++++++++++ > =C2=A0.../container-loader/container-loader.inc=C2=A0=C2=A0=C2=A0=C2=A0 |= 73 ++++++++++++++++ > =C2=A0.../container-loader/docker-loader.inc=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 | 10 +++ > =C2=A0.../files/container-loader.service.tmpl=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0 | 12 +++ > =C2=A0.../files/container-loader.sh.tmpl=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 18 ++++ > =C2=A0.../container-loader/podman-loader.inc=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0 | 10 +++ > =C2=A0testsuite/citest.py=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2= =A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 | 21 +++++ > =C2=A015 files changed, 355 insertions(+) > =C2=A0create mode 100644 kas/package/pkg_prebuilt-docker-img.yaml > =C2=A0create mode 100644 kas/package/pkg_prebuilt-podman-img.yaml > =C2=A0create mode 100644 meta-isar/recipes-app/prebuilt- > container/prebuilt-docker-img_0.1.bb > =C2=A0create mode 100644 meta-isar/recipes-app/prebuilt- > container/prebuilt-podman-img_0.1.bb > =C2=A0create mode 100644 meta/lib/container_fetcher.py > =C2=A0create mode 100644 meta/recipes-support/container-loader/container- > loader.inc > =C2=A0create mode 100644 meta/recipes-support/container-loader/docker- > loader.inc > =C2=A0create mode 100644 meta/recipes-support/container- > loader/files/container-loader.service.tmpl > =C2=A0create mode 100755 meta/recipes-support/container- > loader/files/container-loader.sh.tmpl > =C2=A0create mode 100644 meta/recipes-support/container-loader/podman- > loader.inc >=20 > --=20 > 2.43.0 >=20 Applied to next (w/o patch 4 for CI), thanks. --=20 Best regards, Uladzimir. --=20 You received this message because you are subscribed to the Google Groups "= isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an e= mail to isar-users+unsubscribe@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/= isar-users/2b56490fcf23aff01adcc3b69f3dc9c3a0c48fa5.camel%40ilbers.de.