From: Aliaksei Karpovich <akarpovich@ilbers.de>
To: isar-users@googlegroups.com
Cc: Uladzimir Bely <ubely@ilbers.de>,
Aliaksei Karpovich <akarpovich@ilbers.de>
Subject: [v9 06/13] meta: Add cache-deb-src functionality in base-apt mode
Date: Thu, 20 Aug 2026 15:29:21 +0200 [thread overview]
Message-ID: <20260820133934.383231-7-akarpovich@ilbers.de> (raw)
In-Reply-To: <20260820133934.383231-1-akarpovich@ilbers.de>
From: Uladzimir Bely <ubely@ilbers.de>
Fill base-apt repo with source packages.
Signed-off-by: Uladzimir Bely <ubely@ilbers.de>
Signed-off-by: Aliaksei Karpovich <akarpovich@ilbers.de>
---
meta/classes-recipe/deb-dl-dir.bbclass | 41 ++++++++++++++++++++++++++
meta/classes-recipe/rootfs.bbclass | 7 +++++
2 files changed, 48 insertions(+)
diff --git a/meta/classes-recipe/deb-dl-dir.bbclass b/meta/classes-recipe/deb-dl-dir.bbclass
index 60e2fecc..7e9f89b1 100644
--- a/meta/classes-recipe/deb-dl-dir.bbclass
+++ b/meta/classes-recipe/deb-dl-dir.bbclass
@@ -27,6 +27,47 @@ debsrc_source_version_filter() {
| sort -u
}
+debsrc_fill_base_apt() {
+ export rootfs="$1"
+ export rootfs_distro="$2"
+ mkdir -p "${DEBSRCDIR}"/"${rootfs_distro}"
+
+ ( flock 9
+ set -e
+ printenv | grep -q BB_VERBOSE_LOGS && set -x
+
+ # We need temporary files for our lists of source packages
+ # trap exit of this sub-shell to remove them (this script may exit abruptly
+ # since "set -e" is used)
+ avail=$(mktemp)
+ wanted=$(mktemp)
+ trap "rm -f ${avail} ${wanted}" EXIT
+
+ # List all packages known to apt
+ rootfs_cmd \
+ --bind "${DEBSRCDIR}" "/deb-src" \
+ --bind "${rootfs}" "${rootfs}" \
+ -- \
+ apt-cache dumpavail \
+ | debsrc_source_version_filter > ${avail}
+
+ # Use apt-ftparchive to scan all .deb files found in the download directory
+ # and get the <source> <version> pairs that we wish to download
+ apt-ftparchive --md5=no --sha1=no --sha256=no --sha512=no \
+ -a "${DISTRO_ARCH}" packages \
+ "${REPO_BASE_DIR}" \
+ | debsrc_source_version_filter > ${wanted}
+
+ # We now have two sorted lists: source packages we want and those known to
+ # apt. We will only consider source packages that may be found in both.
+ comm -12 ${wanted} ${avail} \
+ | while read src version; do
+ debrepo_add_packages --srcmode "${DEBREPO_TARGET_DIR}" "${src}=${version}"
+ done
+
+ ) 9>"${DEBSRCDIR}/${rootfs_distro}.lock"
+}
+
debsrc_download() {
export rootfs="$1"
export rootfs_distro="$2"
diff --git a/meta/classes-recipe/rootfs.bbclass b/meta/classes-recipe/rootfs.bbclass
index d1f24d68..bdca9b42 100644
--- a/meta/classes-recipe/rootfs.bbclass
+++ b/meta/classes-recipe/rootfs.bbclass
@@ -489,6 +489,13 @@ do_cache_deb_src() {
run_privileged tar -xf "${BOOTSTRAP_SRC}" ./var/lib/apt/lists --one-top-level="${ROOTFSDIR}"
deb_dl_dir_import ${ROOTFSDIR} ${ROOTFS_BASE_DISTRO}-${BASE_DISTRO_CODENAME}
+
+ debsrc_fill_base_apt ${ROOTFSDIR} ${ROOTFS_BASE_DISTRO}-${BASE_DISTRO_CODENAME}
+
+ rootfs_do_mounts_priv
+ debrepo_update_apt_source_list "${ROOTFSDIR}" "base-apt"
+ rootfs_do_umounts_priv
+
debsrc_download ${ROOTFSDIR} ${ROOTFS_BASE_DISTRO}-${BASE_DISTRO_CODENAME}
run_privileged rm -f "${ROOTFSDIR}"/etc/resolv.conf
--
2.43.0
--
You received this message because you are subscribed to the Google Groups "isar-users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com.
To view this discussion visit https://groups.google.com/d/msgid/isar-users/20260820133934.383231-7-akarpovich%40ilbers.de.
next prev parent reply other threads:[~2026-08-20 13:42 UTC|newest]
Thread overview: 16+ messages / expand[flat|nested] mbox.gz Atom feed top
2026-08-20 13:29 [v9 00/13] Improving base-apt usage Aliaksei Karpovich
2026-08-20 13:29 ` [v9 01/13] scripts: Add debrepo python script handling base-apt Aliaksei Karpovich
2026-08-20 13:29 ` [v9 02/13] meta: Add debrepo bbclass handling base-apt prefetching Aliaksei Karpovich
2026-08-20 13:29 ` [v9 03/13] meta: Always use base-apt repo in local mode Aliaksei Karpovich
2026-08-20 13:29 ` [v9 04/13] meta: Use cached base-apt repo to bootstrap Aliaksei Karpovich
2026-08-20 13:29 ` [v9 05/13] base-apt: Predownload packages to base-apt before install Aliaksei Karpovich
2026-08-20 13:29 ` Aliaksei Karpovich [this message]
2026-08-20 13:29 ` [v9 07/13] testsuite: Set ISAR_PREFETCH_BASE_APT by default Aliaksei Karpovich
2026-08-20 14:01 ` 'MOESSBAUER, Felix' via isar-users
2026-08-20 13:29 ` [v9 08/13] Disable deb-dl-dir in base-apt prefetch mode Aliaksei Karpovich
2026-08-20 13:29 ` [v9 09/13] kas: Add PREFETCH_BASE_APT config entry Aliaksei Karpovich
2026-08-20 13:29 ` [v9 10/13] ci_build.sh: Install python3-apt if not installed Aliaksei Karpovich
2026-08-20 13:29 ` [v9 11/13] sbom-chroot: Fix python3-apt dependency Aliaksei Karpovich
2026-08-20 13:59 ` 'MOESSBAUER, Felix' via isar-users
2026-08-20 13:29 ` [v9 12/13] debrepo: Add override for reprepro Aliaksei Karpovich
2026-08-20 13:29 ` [v9 13/13] base-apt: Move bullseye-mipsel in separate dir Aliaksei Karpovich
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20260820133934.383231-7-akarpovich@ilbers.de \
--to=akarpovich@ilbers.de \
--cc=isar-users@googlegroups.com \
--cc=ubely@ilbers.de \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox