From: Uladzimir Bely <ubely@ilbers.de>
To: isar-users@googlegroups.com
Subject: [PATCH v8 15/15] sbuild: Fix debsrc_download for packages dependencies
Date: Wed, 16 Mar 2022 08:26:07 +0100 [thread overview]
Message-ID: <20220316072607.20518-16-ubely@ilbers.de> (raw)
In-Reply-To: <20220316072607.20518-1-ubely@ilbers.de>
With sbuild, build deps are internally installed in temporary sbuild
environment,so they don't appear in any external dpkg.log files.
With "cache-deb-src" base repo feature enabled, these such packages
are considered not to belong to current build, so their src packages
are not downloaded at image postprocess stage.
The patch fixes this by extracting dpkg.log files from the sbuild
environment to one common log file. This consolidated log is then
used at rootfs_postprocess to get source packages.
Signed-off-by: Uladzimir Bely <ubely@ilbers.de>
---
meta/classes/deb-dl-dir.bbclass | 4 ++++
meta/classes/dpkg.bbclass | 6 +++++-
meta/classes/sbuild.bbclass | 9 +++++++++
3 files changed, 18 insertions(+), 1 deletion(-)
diff --git a/meta/classes/deb-dl-dir.bbclass b/meta/classes/deb-dl-dir.bbclass
index f49f1c2a..484fda69 100644
--- a/meta/classes/deb-dl-dir.bbclass
+++ b/meta/classes/deb-dl-dir.bbclass
@@ -14,6 +14,10 @@ is_not_part_of_current_build() {
# build using the below method.
local output="$( grep -hs "status installed ${package}:${arch} ${version}" \
"${IMAGE_ROOTFS}"/var/log/dpkg.log \
+ "${SCHROOT_HOST_DIR}"/var/log/dpkg.log \
+ "${SCHROOT_TARGET_DIR}"/var/log/dpkg.log \
+ "${SCHROOT_HOST_DIR}"/tmp/dpkg_common.log \
+ "${SCHROOT_TARGET_DIR}"/tmp/dpkg_common.log \
"${BUILDCHROOT_HOST_DIR}"/var/log/dpkg.log \
"${BUILDCHROOT_TARGET_DIR}"/var/log/dpkg.log | head -1 )"
diff --git a/meta/classes/dpkg.bbclass b/meta/classes/dpkg.bbclass
index 126a4ee4..9b9de236 100644
--- a/meta/classes/dpkg.bbclass
+++ b/meta/classes/dpkg.bbclass
@@ -55,7 +55,8 @@ dpkg_runbuild() {
deb_dl_dir_import "${WORKDIR}/rootfs" "${distro}"
deb_dir="/var/cache/apt/archives/"
- ext_deb_dir="/home/builder/${PN}/rootfs/${deb_dir}"
+ ext_root="/home/builder/${PN}/rootfs"
+ ext_deb_dir="${ext_root}/${deb_dir}"
if [ ${USE_CCACHE} -eq 1 ]; then
schroot_configure_ccache
@@ -82,11 +83,14 @@ dpkg_runbuild() {
sbuild -A -n -c ${SBUILD_CHROOT} --extra-repository="${ISAR_APT_REPO}" \
--host=${PACKAGE_ARCH} --build=${SBUILD_HOST_ARCH} ${profiles} \
--no-run-lintian --no-run-piuparts --no-run-autopkgtest \
+ --chroot-setup-commands="rm -f /var/log/dpkg.log" \
--chroot-setup-commands="cp -n --no-preserve=owner ${ext_deb_dir}/*.deb -t ${deb_dir}/ || :" \
--finished-build-commands="rm -f ${deb_dir}/sbuild-build-depends-main-dummy_*.deb" \
--finished-build-commands="cp -n --no-preserve=owner ${deb_dir}/*.deb -t ${ext_deb_dir}/ || :" \
+ --finished-build-commands="cp /var/log/dpkg.log ${ext_root}/dpkg_partial.log" \
--debbuildopts="--source-option=-I" \
--build-dir=${WORKDIR} --dist="isar" ${WORKDIR}/${DSC}
+ sbuild_dpkg_log_export "${WORKDIR}/rootfs/dpkg_partial.log"
deb_dl_dir_export "${WORKDIR}/rootfs" "${distro}"
}
diff --git a/meta/classes/sbuild.bbclass b/meta/classes/sbuild.bbclass
index 7a732da5..760a0203 100644
--- a/meta/classes/sbuild.bbclass
+++ b/meta/classes/sbuild.bbclass
@@ -200,3 +200,12 @@ END
echo "command-prefix=/ccache/sbuild-setup" >> "${SCHROOT_CONF_FILE}"
EOSUDO
}
+
+sbuild_dpkg_log_export() {
+ export dpkg_partial_log="${1}"
+
+ ( flock 9
+ set -e
+ cat ${dpkg_partial_log} >> ${SCHROOT_DIR}/tmp/dpkg_common.log
+ ) 9>"${SCHROOT_DIR}/tmp/dpkg_common.log.lock"
+}
--
2.20.1
next prev parent reply other threads:[~2022-03-16 7:26 UTC|newest]
Thread overview: 17+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-03-16 7:25 [PATCH v8 00/15] Sbuild/Schroot migration Uladzimir Bely
2022-03-16 7:25 ` [PATCH v8 01/15] dpkg-gbp: Use separate command to export tarball Uladzimir Bely
2022-03-16 7:25 ` [PATCH v8 02/15] dpkg-gbp: Use host tools for dsc preparation Uladzimir Bely
2022-03-16 7:25 ` [PATCH v8 03/15] sbuild: Add recipes for host and target rootfs to run sbuild Uladzimir Bely
2022-03-16 7:25 ` [PATCH v8 04/15] sbuild: Introduce a class for another build method Uladzimir Bely
2022-03-16 7:25 ` [PATCH v8 05/15] dpkg: Build packages with sbuild Uladzimir Bely
2022-03-16 7:25 ` [PATCH v8 06/15] sbuild: Support of DEB_BUILD_PROFILES Uladzimir Bely
2022-03-16 7:25 ` [PATCH v8 07/15] sbuild: Support of shell exports from dpkg_runbuild_prepend Uladzimir Bely
2022-03-16 7:26 ` [PATCH v8 08/15] dpkg: Remove builddeps install task Uladzimir Bely
2022-03-16 7:26 ` [PATCH v8 09/15] sbuild: Add ccache support Uladzimir Bely
2022-03-16 7:26 ` [PATCH v8 10/15] dpkg-base: Switch devshell to use schroot Uladzimir Bely
2022-03-16 7:26 ` [PATCH v8 11/15] dpkg-base: Switch apt_fetch and apt_unpack " Uladzimir Bely
2022-03-16 7:26 ` [PATCH v8 12/15] doc: Add sbuild-related documentation Uladzimir Bely
2022-03-16 7:26 ` [PATCH v8 13/15] sbuild: Use .dsc file instead of source directory Uladzimir Bely
2022-03-16 7:26 ` [PATCH v8 14/15] sbuild: Fixed proxy support Uladzimir Bely
2022-03-16 7:26 ` Uladzimir Bely [this message]
2022-03-16 7:50 ` [PATCH v8 00/15] Sbuild/Schroot migration Uladzimir Bely
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20220316072607.20518-16-ubely@ilbers.de \
--to=ubely@ilbers.de \
--cc=isar-users@googlegroups.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox