From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7380320960081035264 X-Received: by 2002:ac2:5058:0:b0:52c:8009:d983 with SMTP id 2adb3069b0e04-52ca6e65894mr1313480e87.24.1718364879715; Fri, 14 Jun 2024 04:34:39 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6512:1313:b0:52c:a105:90f0 with SMTP id 2adb3069b0e04-52ca1059382ls927053e87.1.-pod-prod-02-eu; Fri, 14 Jun 2024 04:34:37 -0700 (PDT) X-Google-Smtp-Source: AGHT+IFHOiPRrzDE+s17fjR4vLEaJgQ0Iydj6h3Jb5m193d7Z8n/9JQt+oWjxeREVv2cabY7QqIC X-Received: by 2002:a05:6512:3b26:b0:52c:ab83:d783 with SMTP id 2adb3069b0e04-52cab83d904mr1127778e87.6.1718364877329; Fri, 14 Jun 2024 04:34:37 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1718364877; cv=none; d=google.com; s=arc-20160816; b=D7WtikiRuBagCjPQKMTGlNB6GCTH2psCeLDmnOFoOZFZjAnFN1Qmjy7m8x9YCf69/3 /RNVVbu4ywHuJJzTJEby3EilbB+jIjmhmQLwSW4vR/ukWrlGTwv1Fv0o8iQf4z4SO63l BvAI8n/grh/jb33cn6b3pAgfQszlkP6/pPmfJLJpCrntoG9pm/9JIDGFXUvPDf//X96p q173Lg/kU1AWRU4RB8pN5gscikOmctRjP3TUX1GhKoPnPpFBXiWWUMvscf3oeeJqc94/ Pr4+Zft7pXOO6l97FbS+WzlI9R0RcWNDqaUpU/76mRmYIamdlskFIYlvUOrXhStm9qHu AmIA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:message-id:date:subject:cc :to:from; bh=L141coa0sySZA8cEE+gvBvgqJfOMBJe5bL8INdZVxC8=; fh=/h9QQkzJ8EboVkWg45aWwpaUro6WMavIVd2OhN45RtE=; b=OPpNdOFRv4PaWzAXUhbZnUVmeekxpK/pxwG9zUuGAiLRzBJgzOwGAOQn5GKVabA1xY VWZyN+tnidM6oRphzHTBBbXRGzbbICk0ERncDGG8J2UmrQU0KpU95U5j2oZ2dqkHqbxG KTNVGyEheCEmIioHZ+X+QaxZWXve0OxUKMP7BQ8AtckRMv7ek6X/Af0T3ky7pQwxWJDV kJfUIU+2AfM+eyOzck9k5I7orchCKXmE43RzS82aoo249/jrRkGHqyrcVW1EJRrtwlKB +LGGzAsX8ExixSaGuWmZwGKI81Wb1YpkFPbKrvWUBuqrmzYn/GzNLe4h7fiSr+k4lWdJ /KOg==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id 2adb3069b0e04-52ca2839febsi78661e87.7.2024.06.14.04.34.37 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Fri, 14 Jun 2024 04:34:37 -0700 (PDT) Received-SPF: pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of amikan@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=amikan@ilbers.de Received: from localhost.localdomain (r154-240-38-77-broadband.btv.lv [77.38.240.154] (may be forged)) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 45EBYZOv032043 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 14 Jun 2024 13:34:36 +0200 From: Anton Mikanovich To: isar-users@googlegroups.com Cc: Anton Mikanovich Subject: [PATCH v9 0/8] Migrate to mmdebstrap Date: Fri, 14 Jun 2024 14:34:17 +0300 Message-Id: <20240614113425.122722-1-amikan@ilbers.de> X-Mailer: git-send-email 2.34.1 MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: buPnLOF0/w0v Switch Isar from debootstrap to mmdebstrap. It makes isar-bootstrap target ~10..30% faster on both cross and native rootfs types. Some measurements on qemuarm64-bookworm (required debs are predownloaded and used during deb-dl-import): - 20s vs 28s for "isar-bootstrap-host" - 1m32s vs 1m48s for "isar-bootstrap-target Also mmdebstrap support using SOURCE_DATE_EPOCH for images reproducibly out of the box. But the main advantage is an ability to remove sudo for debootstrapping later on (this needs "uidmap" package installed). This change breaks Debian Buster support as host distro, but previous isar-bootstrap (with Buster support) still can be selected by setting in local.conf: PREFERRED_PROVIDER_bootstrap-host ?= "isar-bootstrap-host" PREFERRED_PROVIDER_bootstrap-target ?= "isar-bootstrap-target" Changes since v8: - Rebase on next. - Keep isar-bootstrap recipes. - Implement bootstrap provider selection. Changes since v7: - Rebase on next. Changes since v6: - Reorder patches. Changes since v5: - Improve keyring handling. - Fix mmdebstrap hooks. Changes since v4: - Rebase on next. - Migrate from apt-key to gpg. - Fix Ubuntu and RPi targets. - Cleanup debootstrap mentions. - Fix commit messages. Changes since v3: - Rebase on latest next. - Remove temporary patch 7 since kas:4.0 already includes mmdebstrap. Changes since v2: - Rebase on next. - Fix commit messages. - Update host requirements. Changes since v1: - Move mmdebstrap tmpdir to workdir. - Fix kas building. - Improve mounts cleanup. Anton Mikanovich (8): isar-bootstrap: Move common parts to bbclass meta: Add mmdebstrap recipe meta: Allow selecting bootstrap providers testsuite: Allow variable bootstrap providers mmdebstrap: Fix missing dpkg available mmdebstrap: Move preparations to hooks isar-bootstrap: Use tar output instead of directory user_manual.md: Update boostrap related documentation RECIPE-API-CHANGELOG.md | 13 + doc/user_manual.md | 15 +- meta-isar/conf/local.conf.sample | 4 + meta/classes/bootstrap.bbclass | 229 +++++++++++++++++ meta/classes/rootfs.bbclass | 13 +- meta/conf/bitbake.conf | 3 + .../isar-bootstrap/isar-bootstrap-host.bb | 2 + .../isar-bootstrap/isar-bootstrap-target.bb | 2 + .../isar-bootstrap/isar-bootstrap.inc | 243 +----------------- .../isar-mmdebstrap/isar-mmdebstrap-host.bb | 19 ++ .../isar-mmdebstrap/isar-mmdebstrap-target.bb | 14 + .../isar-mmdebstrap/isar-mmdebstrap.inc | 215 ++++++++++++++++ testsuite/cibase.py | 7 +- 13 files changed, 538 insertions(+), 241 deletions(-) create mode 100644 meta/classes/bootstrap.bbclass create mode 100644 meta/recipes-core/isar-mmdebstrap/isar-mmdebstrap-host.bb create mode 100644 meta/recipes-core/isar-mmdebstrap/isar-mmdebstrap-target.bb create mode 100644 meta/recipes-core/isar-mmdebstrap/isar-mmdebstrap.inc -- 2.34.1