From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Mon, 15 Jul 2024 12:08:42 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-lj1-f186.google.com (mail-lj1-f186.google.com [209.85.208.186]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 46FA8giA005834 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Mon, 15 Jul 2024 12:08:42 +0200 Received: by mail-lj1-f186.google.com with SMTP id 38308e7fff4ca-2ee87069f27sf40455161fa.2 for ; Mon, 15 Jul 2024 03:08:42 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1721038116; cv=pass; d=google.com; s=arc-20160816; b=G59B/cz4ga27BQ+q3TEd+Nuhg8nCHjBcgFph4pVu7sOAd7CWHUyA7dFbT5IwC9zWOg cg3ESuC7XchPmmd66j1VG7fFqwia+SUBCkRrSkMP4XM8ISPpekAFBQAtPASHDePrzEnC peBAFTz9KHy7EZOXFYqDGeZCVf0EkQcprcxt0l9fNTu3m4gCiHf7t51y6s67Fl6Glr3X fU3HWNy8Wk7VdSkoKYzdFmLIwRnAFjr+4iIlC8S2FfQW4S0j6YIf4a6LHLH9RP+6Lt79 xsAQVWqtJb95JWhJvGOR21bQkeZwJP2oFqrizDt54p/a77/5JOPvlf03zjxGzoJQO/qB fPjg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:mime-version :message-id:date:subject:cc:to:from:dkim-signature; bh=r7/ZvZaP9wpNLVQZp8Sc3Au2XVqRkqcyMNCmIPCHqAk=; fh=3PY+QRIE57pq4v0jfFxAp2PSJOgCM+Rtso29goTk/fE=; b=Av7MxMc9/kJ1W6f2JEv1R9PvMtdxCs4rN2FmpKUo/Fw0TVaQUArLHrGqM39TQhaV83 p8MrhKyxIvqWSxuvysIaxnWbBhMUiSVJQjp1WRM4XLDMtrpRgUiL1JnPMT5quc7WvgCu 95rCr7UBAkTKV1qdGGCYhHvmwM5yFiHy81ngvWyaGXsxqbkUS2Njpf2Hq+8tuhwfblEc NPdqlF/K7mdyFGPTnpyoV5KYdsX3S2YiEU2fBuFnvlEY6mUV2O/a+LVUeqlb87720gx8 9tF7TH2yVJeY34Ty9vu7FOW6AZyX5fXiag3NFoNHF+TG5HqXVWV45vgh36cbZsRI+U1U CmYg==; darn=isar-build.org ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=vhuz4Pgz; spf=pass (google.com: domain of fm-294854-2024071510083328912e780f7ddbf5fd-gjdgqw@rts-flowmailer.siemens.com designates 185.136.65.228 as permitted sender) smtp.mailfrom=fm-294854-2024071510083328912e780f7ddbf5fd-GjDGqW@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1721038116; x=1721642916; darn=isar-build.org; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:cc:to:from:from:to:cc:subject :date:message-id:reply-to; bh=r7/ZvZaP9wpNLVQZp8Sc3Au2XVqRkqcyMNCmIPCHqAk=; b=BS+Mnfoc/Mr128Kbnddcyvp8Jtc362AAHnzhxeZHO3d4UwhH2PlBE3QF3C5qOYZkz9 XaSWAAUdbRKTFoKsWqWkuG9gQ2+cdyNxWe5hdsJmB0jA1wHw+hmVIofbOgvtF8mh2fmm iduuQmvZmKIlpz72SthJOPIMuwF8kTJhI1im5R7+UygZUSm7fyFu8tpMsgr0U9UTf+mK N2usqQRKqAh+/5g/5n1+iTX4i4Eivfp47yq/1LGyiiCkGcOovHv3/WWaFzxtQsHXEbfs ewsUyXJt1tug+5aOrxRuIqBAMtI5bN3C8voiRsVGV5imePrcgQO7bp63dZYjBM1wqu3Z zatw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1721038116; x=1721642916; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :mime-version:message-id:date:subject:cc:to:from:x-beenthere :x-gm-message-state:from:to:cc:subject:date:message-id:reply-to; bh=r7/ZvZaP9wpNLVQZp8Sc3Au2XVqRkqcyMNCmIPCHqAk=; b=GNMGXjm/EFMmcp3ufMk+DrK3JRJUq0lTvqG7j85zn5rPbqUbi2bfcnTm0YLB+5tbYZ /1+VFqEOCdLcQU5rcNQjyf1/Gnvoz0A/kL2YFuwL6W1mM5sCcrgslERLfjvu0jFw0c8o IjOutIpnNBizpQI3RYZSHtUibnjrI0ISnw1oKxge3vfZgLnjMp68b3dpPoXknm6WbimG FINuG17OuLx/3A1CT2t9Pj1H89oOz+gn5I7QhshoheRqTl8nJ6DIT6ZRZCXcW295DQey NE49WJpq65elXiQThZr9QORRuxE92yZsDzBr2xe5eTmDm1uTxv0Fc8Cl0TDMytKc319j t6QA== X-Forwarded-Encrypted: i=2; AJvYcCU1a6uwc+x68BL29GpmvxT8dMN1QQvtzr3zuaQ/0Hs9vxTA9D4M79g3YmFfRST3hjavqIZT0lYNqb1SeQes7WY7J90= X-Gm-Message-State: AOJu0YzMUM3u6KWMeB/Y9teJujwrfpGkkI9P2kPPcbJ6l83YTDsneqXb ywgPaJv9yEFn2UtDX27x/Jtf0nCb3Iu1G3z93vJbBkiAz1zzED9X X-Google-Smtp-Source: AGHT+IHMUBB7kY9Nr4cHqpEoXL/HZ1kWX6fZQ3sscEjZF3+T0PjbalGOH4/Mv4ZTqs85uY9tv8mQOw== X-Received: by 2002:a05:6512:1051:b0:52b:c0b1:ab9e with SMTP id 2adb3069b0e04-52eb999124fmr13030541e87.5.1721038115951; Mon, 15 Jul 2024 03:08:35 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6512:3e2a:b0:52e:d12c:cf91 with SMTP id 2adb3069b0e04-52ed12cd053ls1058425e87.2.-pod-prod-02-eu; Mon, 15 Jul 2024 03:08:34 -0700 (PDT) X-Received: by 2002:ac2:42d8:0:b0:52b:b327:9c1c with SMTP id 2adb3069b0e04-52eb99d59e8mr9901603e87.62.1721038113667; Mon, 15 Jul 2024 03:08:33 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1721038113; cv=none; d=google.com; s=arc-20160816; b=1Is2BrycmWw386WRX0+TM6ebl6gzFxVhcRXfgDVoc/NZjuXYJunXP9yvYqe4uCJHz+ 82yYUE+wLtBFtJg3eAEarmM8sgCkkEB74aoFtJvcqHYGKBYWDGJJjbaNIgiHcw/cSmxL TennAuNdlGx3YUpBleFBISl2Y8LYXlNNc/ZvmrmKlIxpypA0XUQScTa4FpFzymor4g7t jMuH0SHVLiaznz5tYMLk/vo6wad0SL65300h6ISEabzp8Cif40WYIpfpVr37wz+1Um7q pi1CMtqVYScwmtUAePbvk1Ox5nLdsTK0lUVPo1z7RdRDEM/ZtkKBqyGpxHMbdryDbPDv kaAQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=feedback-id:content-transfer-encoding:mime-version:message-id:date :subject:cc:to:from:dkim-signature; bh=EY+d4pEq6Zhz4VSIEvw+n/1HEjxAoWPNrCNGjB/lzUo=; fh=sG8mVX6bNXJXg1RhSNhryk9YKHryCWWF37H72hfFhEU=; b=h1dnUwzyr+o7Jg1wcW38UXN4G5DscQ0bfWyuor/VPfiH7g1OmuYoIJD9vk27c3Vgt2 WFG79voU9L6H/hdbN4mD9+ASDlkxVrEJKwTeov/NXgWQdKFYzEryM1qKt8FpKW+/b0Qq YyI9x2uC0IOKmg5ENTjkmCyoDVFpAr838LxvWhL+IKG/hmxZjvEpIpaX7zKciyIy3tbv xDlzBZECDE4+AdGHdQ56iufM+PNzbIRF8PzGnyyBZYGBQVl5RFa7TocwiaNix81aJLW4 WBPciBEj15ry+vt12eJUFqiWyKHnyNuqIFa0198cgGHSF9jawYCo7oA0AO3+0rvIxWfL dBYw==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=vhuz4Pgz; spf=pass (google.com: domain of fm-294854-2024071510083328912e780f7ddbf5fd-gjdgqw@rts-flowmailer.siemens.com designates 185.136.65.228 as permitted sender) smtp.mailfrom=fm-294854-2024071510083328912e780f7ddbf5fd-GjDGqW@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-65-228.siemens.flowmailer.net (mta-65-228.siemens.flowmailer.net. [185.136.65.228]) by gmr-mx.google.com with ESMTPS id 5b1f17b1804b1-427a5ec6cb7si674365e9.1.2024.07.15.03.08.33 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 15 Jul 2024 03:08:33 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-294854-2024071510083328912e780f7ddbf5fd-gjdgqw@rts-flowmailer.siemens.com designates 185.136.65.228 as permitted sender) client-ip=185.136.65.228; Received: by mta-65-228.siemens.flowmailer.net with ESMTPSA id 2024071510083328912e780f7ddbf5fd for ; Mon, 15 Jul 2024 12:08:33 +0200 From: "'Jan Kiszka' via isar-users" To: isar-users Cc: Silvano Cirujano-Cuesta , Benedikt Niedermayr , Felix Moessbauer Subject: [PATCH v2 0/5] Introduce container fetcher and pre-loader Date: Mon, 15 Jul 2024 12:08:27 +0200 Message-ID: MIME-Version: 1.0 X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-294854:519-21489:flowmailer X-Original-Sender: jan.kiszka@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm2 header.b=vhuz4Pgz; spf=pass (google.com: domain of fm-294854-2024071510083328912e780f7ddbf5fd-gjdgqw@rts-flowmailer.siemens.com designates 185.136.65.228 as permitted sender) smtp.mailfrom=fm-294854-2024071510083328912e780f7ddbf5fd-GjDGqW@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Jan Kiszka Reply-To: Jan Kiszka Content-Type: text/plain; charset="UTF-8" Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_MSPIKE_H2,RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE, SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: Xe9F2e5+k4hf We noticed internally that there are at least 3 implementations for solving the task of pre-loading container images into isar-built base systems, may it be that the images are not publicly available or the device is only poorly connected, if at all. This series tries to solve the task generically - hopefully. Changes in v2: - switch to open-coded unpack before loading - switch to zstd as default compression - use default compression settings from bitbake.conf - add support for delete-after-load (opt-in) - factor out fetched container installation into separate task (should make self-built container packaging easier) - use BPN instead of PN - add "Requires" to systemd service - use PACKAGE_ARCH to select container arch (rather than DISTRO_ARCH) - add CI test - add documentation Jan Jan Kiszka (5): Introduce fetcher from container registries container-loader: Introduce helper to load container images into local registry meta-isar: Add demo packages for installing prebuilt containers ci: Add test cases for container fetching and loading doc: Describe how to use the container fetcher and loader doc/user_manual.md | 60 ++++++++++++ kas/package/Kconfig | 19 ++++ kas/package/pkg_prebuilt-docker-img.yaml | 9 ++ kas/package/pkg_prebuilt-podman-img.yaml | 9 ++ .../prebuilt-docker-img_0.1.bb | 12 +++ .../prebuilt-podman-img_0.1.bb | 10 ++ .../recipes-core/images/isar-image-ci.bb | 2 + meta/classes/dpkg-base.bbclass | 6 ++ meta/lib/container_fetcher.py | 90 ++++++++++++++++++ .../container-loader/container-loader.inc | 94 +++++++++++++++++++ .../container-loader/docker-loader.inc | 10 ++ .../files/container-loader.service.tmpl | 12 +++ .../files/container-loader.sh.tmpl | 18 ++++ .../container-loader/podman-loader.inc | 10 ++ testsuite/citest.py | 21 +++++ 15 files changed, 382 insertions(+) create mode 100644 kas/package/pkg_prebuilt-docker-img.yaml create mode 100644 kas/package/pkg_prebuilt-podman-img.yaml create mode 100644 meta-isar/recipes-app/prebuilt-container/prebuilt-docker-img_0.1.bb create mode 100644 meta-isar/recipes-app/prebuilt-container/prebuilt-podman-img_0.1.bb create mode 100644 meta/lib/container_fetcher.py create mode 100644 meta/recipes-support/container-loader/container-loader.inc create mode 100644 meta/recipes-support/container-loader/docker-loader.inc create mode 100644 meta/recipes-support/container-loader/files/container-loader.service.tmpl create mode 100755 meta/recipes-support/container-loader/files/container-loader.sh.tmpl create mode 100644 meta/recipes-support/container-loader/podman-loader.inc -- 2.43.0 -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/isar-users/cover.1721038111.git.jan.kiszka%40siemens.com.