From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Wed, 06 Nov 2024 09:21:35 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-wm1-f61.google.com (mail-wm1-f61.google.com [209.85.128.61]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 4A68LYhv016988 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Wed, 6 Nov 2024 09:21:34 +0100 Received: by mail-wm1-f61.google.com with SMTP id 5b1f17b1804b1-43157e3521dsf43262195e9.1 for ; Wed, 06 Nov 2024 00:21:34 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1730881289; cv=pass; d=google.com; s=arc-20240605; b=aU2/loUmI+5rKJVvvIHRAY/UWr8NNgJH1u6jEYmae/okBhl0VzgWtNuNbWvYW7WtWD 2CGNT6JZ4sQtrruubNkUaUR4QbDYv5byaqeg+RfTK5GyoVuFtsDqxJqa+4gwhk5tyKhr e1H6uCFKTiZ2nFlDCgFFrSeHrTqXDmoze38lSYqLoFEMDEggv0AlSLbkpnk9DxsYyshy BlDWfJV3WfyVhFDQSb8WKvZvbul7BTbMo+WeLmb0DXH2dpc9fxmpjezUKOdtr5BMwKyZ +AMqh/Cw6ILEe7GkNWZ2dZCbvsNAtR+pYABdDPnSYyEbL5ldNRZzN77L7E628MLHWpdB ckvQ== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:message-id:date :subject:cc:to:from:sender:dkim-signature; bh=jc9+MNvjb4StupLtlTzN3aEgmEMsaEzwsr/zzs+udBk=; fh=ozrg9dDoA/V/yKu4N2I/8Bc2vceSKI7JL4b9c7D6Ylo=; b=hearinKJ9wLjkgzPuoWomHzSn0/lOrHTpI2+hZLTiVU3+m9QKXHF8YmYuGbeEIQIsY 2kS2v3baRb6mUXtXxRNmrZoBeF0sSQNLoqc+byGrSAZdN947qbGlkIRiwE4p6B8VUYZP dSKxbTY/5mzzFsw+mnql6ME20s1QJMf/RtywXMD12J5dmyOh+nJQ8dI+aUnhyDieZExB XGjp5zi6nZztZpapUiGSwPkzaTMzaDuo6wwp4t+BqpdfmDzppbRsRwTXgn78xrW529/K DD0038Xx30n3XsOlQs9DfKi9B4mF/4z8ngAFOAgtDcik28oLMaQCjdMtk5+/rQJ6SlzC BGMA==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1730881289; x=1731486089; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:message-id:date:subject:cc:to:from :sender:from:to:cc:subject:date:message-id:reply-to; bh=jc9+MNvjb4StupLtlTzN3aEgmEMsaEzwsr/zzs+udBk=; b=oCifb6pcej2N/IENCHd+N5rujn7CuvFgXFlzzJlzwuT4kvAfm89VgLpcFd0C5+/O9f rpOG90Yh58Mtjp7Y5FbiKFnZ6vfOQzVKh8+c1OIJafr8BQAOKhJnfeUo9B9BhNly+n1/ uIj/rFF469MikrfzEGMq+vGt6j3Qr2jhbqag1cjXHdqdL+3mJB6M9Lb4d3rKZ7xziyQa FQ6azTlU8TXWCjmyN+znTjhMQuqkpVP1i5A/5grj2vNUTDEZT2ujwWKNJMku+NOx739R JX5sNugM88nyqpKwNKKOx3KdOXQttNu+XCXMEBmVE7PaPbnLEZIwADV+8FVV3CT71e4Z HgMw== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1730881289; x=1731486089; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :message-id:date:subject:cc:to:from:x-beenthere:x-gm-message-state :sender:from:to:cc:subject:date:message-id:reply-to; bh=jc9+MNvjb4StupLtlTzN3aEgmEMsaEzwsr/zzs+udBk=; b=Pr4jpR4g4Tb9NqRhu1t/wybasoOB19+bvjEMPANvTUqiq0PQb6o699vGTcs+jtO2Ca MmQ4HjpPgi9ZKlpWzVARQB9V5JmSVkpmCd5ULxfq4BwaJhZkzJQvqQ4i7FHBHfKygMKU gfHlQ+v2MPQCwaV4lxcpO66uU9Ic4pIuEZB6V6MjQ4Z2ftuqAUQ5sXXOnbgfTGKbPyLI tWd+XAOjM7C47brIvss1CsJTuXuAUENM0wCkvdE8OoqjR6+wdhZsb5WTkjj8w1KCGYou 6j54RBVOPVdVupgYfFU12fI7uDUzrInKwkHF1qCAI1JVxTlhwUvU0yzXPVh4GpgEGr5C Z8qw== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCWatMm6v2Z1MfVyVKDpch2HKvYgThGfLBbAEb/HpGM/XqIkybluX0pOCL7GU8JJJxSlWCmF@ilbers.de X-Gm-Message-State: AOJu0YyIKhOwz6VUOgymZtwfdq5128ZfpV4NvHdC7WiSAAEiER755My8 iBYMVwZTcw318kIMKXMbiQgunWTHcW2/XSnVhEzqF3P202MI2kk4 X-Google-Smtp-Source: AGHT+IGkPqseUN7vQLLRwjoBHIJSn1x9VOhHufpoLAITvDYCUyp+TvbRxSZseg+VWvS+Gcyj5w+lTg== X-Received: by 2002:a05:600c:5493:b0:431:5533:8f0c with SMTP id 5b1f17b1804b1-43285649fe6mr147377375e9.29.1730881288367; Wed, 06 Nov 2024 00:21:28 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:600c:1548:b0:42c:b037:5fba with SMTP id 5b1f17b1804b1-4327b8195a0ls13494795e9.2.-pod-prod-06-eu; Wed, 06 Nov 2024 00:21:26 -0800 (PST) X-Received: by 2002:a05:600c:1909:b0:431:542d:2592 with SMTP id 5b1f17b1804b1-4328327eba3mr145698435e9.27.1730881285753; Wed, 06 Nov 2024 00:21:25 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1730881285; cv=none; d=google.com; s=arc-20240605; b=bJl4BZoVDv+os4HxkeRqi807/U4soRbryGdgNnDCuW70Uraj5G83ehFK1KYtQgOycm yI5E3EvDjtmtgpe6qui2o6VsdlXqWBmw8eoKiBkgjjkTkw0Aj4CiXsKwHXU83i2hNc3w JACAC5Uvt7llO51d54O8d+3Fwcefhipt1d1qFW5twnDOFH2r0iYkAIPtbeG3sPRh2k3I mwAsTLYjv0XL3xDdloIlW1KsZzCVWysmCQtroKbzfTjHNDClVcDi1xXsx6RDzYiAFndm ZAHd470Jp1Qva1aMLO9exKg7fsabY3HiUv9K1YsbZO53+rz4Er8eOmr0GaubRwlwU8bQ da8w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from; bh=n+zHe0Y39xNIlrfVoQRZjCj83fmqqywhWpHZ0IfcUpQ=; fh=/h9QQkzJ8EboVkWg45aWwpaUro6WMavIVd2OhN45RtE=; b=IK7xpAo8JYk8XXJ0uXW1tebmhs4S9psyqKZeXj3kiOfijNNwEKKx3J9HBKf0BVpjJ5 H16St+CXjQZ+CBO9mxPVzCRePi+plDDti/rmwvZx9gWxSgQ3DqnWB/7w4CF/rB6lvYJQ zLdgS0HveK3ixsdkV6RhX8MpFKH/TPVopXOml4oU6Xp9BQYnp32/8/wiv6lzSTGVsiIr RqWg2TN7UXTwR8rETrhs/TDu3YvY5Gbc9FNyO0JRBhnSEyRc4pBXXhkVTmhRDX0/I1De PMhb2gp3kdrYXZki61S/eQtrqZEqeNj4JVPQD8cKCJFIMHmAKgYZ6GIXqO3RZZg/ldAU Gf7A==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id ffacd0b85a97d-381c1161a94si270194f8f.4.2024.11.06.00.21.25 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Wed, 06 Nov 2024 00:21:25 -0800 (PST) Received-SPF: pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from user-B660.promwad.corp ([159.148.83.114]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 4A68LOjp016956 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 6 Nov 2024 09:21:24 +0100 From: Anton Mikanovich To: isar-users@googlegroups.com Cc: Anton Mikanovich Subject: [PATCH v11 0/8] Migrate to mmdebstrap Date: Wed, 6 Nov 2024 10:21:09 +0200 Message-Id: <20241106082117.1089554-1-amikan@ilbers.de> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: amikan@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Content-Type: text/plain; charset="UTF-8" Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-TUID: TE7YbyMSw6W6 Switch Isar from debootstrap to mmdebstrap. It makes isar-bootstrap target ~10..30% faster on both cross and native rootfs types. Some measurements on qemuarm64-bookworm (required debs are predownloaded and used during deb-dl-import): - 20s vs 28s for "isar-bootstrap-host" - 1m32s vs 1m48s for "isar-bootstrap-target Also mmdebstrap support using SOURCE_DATE_EPOCH for images reproducibly out of the box. But the main advantage is an ability to remove sudo for debootstrapping later on (this needs "uidmap" package installed). This patchset was successfully tested with following downstreams: - cip-core - meta-iot2050 - xenomai-images This change breaks Debian Buster support as host distro, but previous isar-bootstrap (with Buster support) still can be selected by setting in local.conf: PREFERRED_PROVIDER_bootstrap-host ?= "isar-bootstrap-host" PREFERRED_PROVIDER_bootstrap-target ?= "isar-bootstrap-target" Changes since v10: - Rebase on next. Changes since v9: - Rebase on next. - Separate common code into bbclass. - Skip deb cache on rootfs packing. Changes since v8: - Rebase on next. - Keep isar-bootstrap recipes. - Implement bootstrap provider selection. Changes since v7: - Rebase on next. Changes since v6: - Reorder patches. Changes since v5: - Improve keyring handling. - Fix mmdebstrap hooks. Changes since v4: - Rebase on next. - Migrate from apt-key to gpg. - Fix Ubuntu and RPi targets. - Cleanup debootstrap mentions. - Fix commit messages. Changes since v3: - Rebase on latest next. - Remove temporary patch 7 since kas:4.0 already includes mmdebstrap. Changes since v2: - Rebase on next. - Fix commit messages. - Update host requirements. Changes since v1: - Move mmdebstrap tmpdir to workdir. - Fix kas building. - Improve mounts cleanup. Anton Mikanovich (8): isar-bootstrap: Move common parts to bbclass meta: Add mmdebstrap recipe meta: Allow selecting bootstrap providers testsuite: Allow variable bootstrap providers mmdebstrap: Fix missing dpkg available mmdebstrap: Move preparations to hooks isar-bootstrap: Use tar output instead of directory user_manual.md: Update boostrap related documentation RECIPE-API-CHANGELOG.md | 13 + doc/user_manual.md | 15 +- meta-isar/conf/local.conf.sample | 4 + meta/classes/bootstrap.bbclass | 226 ++++++++++++++++ meta/classes/rootfs.bbclass | 13 +- meta/conf/bitbake.conf | 3 + .../isar-bootstrap/isar-bootstrap-host.bb | 2 + .../isar-bootstrap/isar-bootstrap-target.bb | 2 + .../isar-bootstrap/isar-bootstrap.inc | 244 ++---------------- .../isar-mmdebstrap/isar-mmdebstrap-host.bb | 19 ++ .../isar-mmdebstrap/isar-mmdebstrap-target.bb | 14 + .../isar-mmdebstrap/isar-mmdebstrap.inc | 216 ++++++++++++++++ testsuite/cibase.py | 9 +- 13 files changed, 540 insertions(+), 240 deletions(-) create mode 100644 meta/classes/bootstrap.bbclass create mode 100644 meta/recipes-core/isar-mmdebstrap/isar-mmdebstrap-host.bb create mode 100644 meta/recipes-core/isar-mmdebstrap/isar-mmdebstrap-target.bb create mode 100644 meta/recipes-core/isar-mmdebstrap/isar-mmdebstrap.inc -- 2.34.1 -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/20241106082117.1089554-1-amikan%40ilbers.de.