From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Fri, 07 Aug 2026 11:24:57 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-lj1-f185.google.com (mail-lj1-f185.google.com [209.85.208.185]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 6779OugV010531 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Fri, 7 Aug 2026 11:24:56 +0200 Received: by mail-lj1-f185.google.com with SMTP id 38308e7fff4ca-39d93d95a21sf20238441fa.0 for ; Fri, 07 Aug 2026 02:24:56 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1786094691; cv=pass; d=google.com; s=arc-20260327; b=aSXiQUMBwhvxnWLBThZLQbF3ShWAt1gJuBvOTl1PKuQStAwc8E/i9hydYaTjMAT+VR 0NhR5BSuJqfTb/hkNWfOyGZByGjkuh5TmuIAb+M15sbP1SEE5EwgRpnu8vAft8DVLVSG OknrdQ7vGzBHoHncFkWYg13CJ2mrW+qpARnN0RojF7y+T7PwyVfGWhUhbXqkgCZVgGp5 REDQ/9S6llw+WpHr0Y+UTvXO4gqswF5mX2PWVPTHPIaKKZc3u4Wv4pldz17Lbdo/lZV/ 8amO3Xbg+ccCF7kwpeUU3ILHfQtSRsY42hcxViQYaQkuGbYtcWH6H6PlPXUBhYnYoUW5 HV7w== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:content-transfer-encoding :in-reply-to:from:content-language:references:cc:to:subject :user-agent:mime-version:date:message-id:sender:dkim-signature; bh=naS0R70/HwUcGvQSum1oxEIx9ao8+DRv+y4O+rKrgnQ=; fh=XLKkzg/2zJ6CzHqQyDQFjbR4c8E3/VbWCnJ9+r6TDCU=; b=TvPuIa43lxWUiiKZ9v2bDJMktgP9vvBrgFB+VgU/PddZYHtV+cn6vJ7smtJYQg6XZz jh62wlTCWaM+b1EubOSCXZj151AwPl5M1SYuWZslNLn4MeB1dE7CUsY087QfhHwIzqGb eaiAKWSiVlF2HGfrd2ZgguzxM8NTvSDM+BLaXPoQXROycF8pt75NgI3e1aMsRgdPlkCd 10wFgzhlyDK0Lz525x1mgyRL5Jk8c4ppcTFO6CKcrXW+i9ZzTaNEAq4B4s9i4JqLn/OR 9VnVpk4rH91lzat7licQEu8+4o2BKTI1Pacit5SAX8tWlQEjiYY0u+mFvklsJV/3XZZv 2RXg==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20251104; t=1786094691; x=1786699491; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:content-transfer-encoding:content-type :in-reply-to:from:content-language:references:cc:to:subject :user-agent:mime-version:date:message-id:sender:from:to:cc:subject :date:message-id:reply-to:content-type; bh=naS0R70/HwUcGvQSum1oxEIx9ao8+DRv+y4O+rKrgnQ=; b=hTtMH7X6FT/QlWlPtX4ZaOiuNqCMi72+9FAizO6JVwyU+iax85IqZFahUuH1R1Yrs3 5tZlB1W6ipI6sCMe2uW07p6gUaO0eTbM1BKmHe8Kae6TfaJ1+8j8gXzaVzxFv+ghMHqM 59/91I5A1iJxNtz0SYmFj9VolelXWqzol7gKJ2Bjc3jLX7/oyGVT4iJkgrE+jR5E5mNc yK53INZeNPaLNQ7vl7d6kRTpgeFx0S4Ru6YIKqhtBC5bLRyED1ctYJsC9u3jluvEyS0r gDflpqfAxyU60ODBsRVmUzSqREUJg7jxDjMR7vWh+ZQzpGST2i2pRp2DtO2irJgFjyzq 3ofg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1786094691; x=1786699491; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender :content-transfer-encoding:content-type:in-reply-to:from :content-language:references:cc:to:subject:user-agent:mime-version :date:message-id:x-beenthere:x-gm-message-state:sender:from:to:cc :subject:date:message-id:reply-to:content-type; bh=naS0R70/HwUcGvQSum1oxEIx9ao8+DRv+y4O+rKrgnQ=; b=X77k+xRn2h84yxT30Ll4h/1LDxmutAZalZ7Z3UOSFc1Yzcdv4PIfyJGNuY2eRpTcXU 80P0dJDkPTGJhETl3V26svhmRwJjQQR42fXKpampA0FH3/eWDe462BRvQHYgI4/WwGZM EE8t/gqXBjuSGuOt2Md9iiqCGeSWbK7EY074rVJM1OjJNNsM6INRnJPYTRWbRfkx1ACH 0+XBqx3YkhNT9Zmx9wL1o2K2Uvhq8RydrhSqKkyUspjNpcHZ5BP1BI4+KKIkWmQKotLP xX9bDlldbA+mk7dllHXNx8H1KojVYXYkXqo3GOCATO0z3Dmiuy9BYM0g4sNNQWC2wzKZ ho5Q== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AHgh+RqOWwBboUvZvWuvizrDDWtDfJtCL8+TSotT/f4h1VBVypAmqaEySmi5tNvuPOIcNVbG9okA@ilbers.de X-Gm-Message-State: AOJu0YwfoW0pKjzvSYpnr73hnzmb7l5WhY1RWNwIV0FHMHsKSJXaSMRn VBBCylNUjNaTwNM9OQrYQvaDDiqEneECKHYeBspmtzrZ3UCWFhp7rEUL X-Received: by 2002:a05:651c:2205:b0:399:9436:15c8 with SMTP id 38308e7fff4ca-39fdf2c758amr3235071fa.2.1786094690523; Fri, 07 Aug 2026 02:24:50 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h="Aa7YSPQUA9RAAthNWp20EbIYlreC5AZzQli87FZ0paUMqiWDVQ==" Received: by 2002:a05:651c:43c2:20b0:396:6636:628 with SMTP id 38308e7fff4ca-39fcfa6cf21ls3743361fa.1.-pod-prod-08-eu; Fri, 07 Aug 2026 02:24:46 -0700 (PDT) X-Forwarded-Encrypted: i=2; AHgh+RprKVkHMiuDidQEysPxa62u0tx6Cciy666T//6blqYlax948wDv65jbwGzaEM21Ifbww2uzKlpnI8ff@googlegroups.com X-Received: by 2002:a05:6512:39d1:b0:5b0:1a3a:6680 with SMTP id 2adb3069b0e04-5b3092cbf3amr381947e87.30.1786094686587; Fri, 07 Aug 2026 02:24:46 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1786094686; cv=none; d=google.com; s=arc-20260327; b=Bq9LnWJ4HnFV5iiFg+/Qr9sQClb8wHYXMt/tUg8eVeF4m1G28sW+xmQWG56rKiEzZC V902LjXvEH/vkyElfC61Wlu88oMImQbKdbsydtn4ZycB4n18YqcWwJ7pMFLc/YCf2EFe 2kI4LbVje8MtdTKHmoKH7aWLAUh38P2/gg5u2ryDKbrAZd73Lxye4O2R1Gw3z4OuAX4+ NLMgK6ic2z8Rguf0X9asET/wX276ZowVMA9AD90RkF52cXZ27jthF5/CZ+hOq7btR2Dn qxlcLUUx7GaolvP6RSKyCtXrRqm8akG+8wGOw2o2rAz+8cuglAT0vb1wBP74cX2xur8/ jbCQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=content-transfer-encoding:in-reply-to:from:content-language :references:cc:to:subject:user-agent:mime-version:date:message-id; bh=PiPf9XG4B8dMJOkpB9Y/S2E84Ai+xjaKQlgY50XrMqQ=; fh=R+SXLrSJlN9HkutB3k+5UMxoUtc+6Y14K46XS05spCs=; b=Ef7goY4JDDDXo7vk4VpDmX0bdBY0GloKUOsmtTtFqUyM0yGdbjI2lmynXU35vq7B1a uIfeReBNRNiARKQNo71aVHsCt3e6Zm/6QWKYYK8aFI9JoHZzWnH/78seS/FxTq4I3qZ1 +qk4fsPT16MJvtYI2Ix9+e1tq6bdFD/v/Bp327qHLWoea4bs03cLwwYR7qqoEZwR2P4R tJrF77QRwBRlTX1VRqKbDFQvMQ7GBIVcoGXeFbcvxTLYWyO2Dk2JD/z7HJ3sanvLOrF8 RD4QgnXE52oXeC/uXsuSXC5h2ja559f6u0owcGefwAfqf520EUigiAhCbGvbyHLQvv5t K9rg==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id 2adb3069b0e04-5b304e9692bsi34766e87.0.2026.08.07.02.24.46 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Fri, 07 Aug 2026 02:24:46 -0700 (PDT) Received-SPF: pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from [192.168.178.139] ([88.130.203.42]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 6779OiLS010525 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 7 Aug 2026 11:24:45 +0200 Message-ID: <19e5d32e-e1b8-4860-884b-c05a87952006@ilbers.de> Date: Fri, 7 Aug 2026 11:24:44 +0200 MIME-Version: 1.0 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v2 2/2] dpkg: cache do_dpkg_source results in sstate To: Felix Moessbauer , isar-users@googlegroups.com Cc: ziegler.andreas@siemens.com References: <20260806072428.2409275-1-felix.moessbauer@siemens.com> <20260806072428.2409275-3-felix.moessbauer@siemens.com> Content-Language: en-US From: Zhihang Wei In-Reply-To: <20260806072428.2409275-3-felix.moessbauer@siemens.com> Content-Type: text/plain; charset="UTF-8"; format=flowed Content-Transfer-Encoding: quoted-printable X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: wzh@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of wzh@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=wzh@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-TUID: NGvz8N4iuH3E On 8/6/26 09:24, 'Felix Moessbauer' via isar-users wrote: > As the do_dpkg_source task now runs for each corresponding > do_deploy_deb task, we also want to cache the generated results (to > avoid pulling in a much bigger dependency tree on otherwise cached > rebuilds). > > For that, we cache the .dsc and the .tar.* artifacts in the deploy dir. > This is implemented similar to how do_dpkg_build artifacts (.debs) are > cached, which is also compatible with a hash equivalence server. > > Signed-off-by: Felix Moessbauer > --- > RECIPE-API-CHANGELOG.md | 8 ++++++++ > meta/classes-recipe/dpkg-source.bbclass | 19 +++++++++++++++++-- > meta/classes-recipe/dpkg.bbclass | 2 +- > 3 files changed, 26 insertions(+), 3 deletions(-) > > diff --git a/RECIPE-API-CHANGELOG.md b/RECIPE-API-CHANGELOG.md > index 7e923e55..7386f5d1 100644 > --- a/RECIPE-API-CHANGELOG.md > +++ b/RECIPE-API-CHANGELOG.md > @@ -1146,6 +1146,14 @@ deploy directory `DEPLOY_DIR_DEB` instead of being= deployed to the `WORKDIR`. > Recipes that accessed the built debs through `${WORKDIR}/*.deb` (e.g. t= o unpack an > artifact in a `do_deploy` task) must now reference `${DEPLOY_DIR_DEB}/*= .deb` instead. > =20 > +### Debian source packages are deployed to `DEPLOY_DIR_SRC` > + > +The source packages produced by `do_dpkg_source` are now exported into a= shared, > +sstate-tracked deploy dir `DEPLOY_DIR_SRC` instead of being deployed to = the `WORKDIR`. > + > +Recipes that access the source packages through `${WORKDIR}/*.tar.{gz,xz= }` must now > +reference the local copy in `${DEPLOY_DIR_SRC}` instead. > + > ### Add Hyper-V machine support > =20 > A new machine `hyper-v` has been introduced for building images > diff --git a/meta/classes-recipe/dpkg-source.bbclass b/meta/classes-recip= e/dpkg-source.bbclass > index 92d06e1b..97cf9714 100644 > --- a/meta/classes-recipe/dpkg-source.bbclass > +++ b/meta/classes-recipe/dpkg-source.bbclass > @@ -13,7 +13,12 @@ TAR_REPRO_OPTS ?=3D "--exclude=3D.git --exclude=3Ddebi= an \ > DPKG_SOURCE_EXTRA_ARGS ?=3D "-I" > =20 > DEBIAN_SOURCE ?=3D "${BPN}" > +SRCPKG_DIR =3D "${WORKDIR}/deploy-srcpkg" > +DEPLOY_DIR_SRC =3D "${DEPLOY_DIR}/isar-source/${DISTRO}/${BPN}" > =20 > +do_dpkg_source[cleandirs] =3D "${SRCPKG_DIR}" > +do_dpkg_source[sstate-inputdirs] =3D "${SRCPKG_DIR}" > +do_dpkg_source[sstate-outputdirs] =3D "${DEPLOY_DIR_SRC}" > do_dpkg_source() { > # Create a .dsc file from source directory to use it with sbuild > DEB_SOURCE_NAME=3D$(dpkg-parsechangelog --show-field Source --file = ${WORKDIR}/${PPS}/debian/changelog) > @@ -22,9 +27,19 @@ do_dpkg_source() { > fi > find ${WORKDIR} -maxdepth 1 -name "${DEBIAN_SOURCE}_*.dsc" -delete > sh -c "cd ${WORKDIR}; dpkg-source ${DPKG_SOURCE_EXTRA_ARGS} -b ${PP= S}" > + # move packages to deploy directory > + find ${WORKDIR} -maxdepth 1 \( -name "${DEBIAN_SOURCE}_*.tar.*" -o -= name "${DEBIAN_SOURCE}_*.dsc" \) -exec mv {} ${SRCPKG_DIR}/ \; > } > addtask dpkg_source after do_prepare_build > =20 > +SSTATETASKS +=3D "do_dpkg_source" > + > +python do_dpkg_source_setscene() { > + sstate_setscene(d) > +} > + > +addtask dpkg_source_setscene > + > CLEANFUNCS +=3D "deb_clean_source" > =20 > deb_clean_source() { > @@ -34,11 +49,11 @@ deb_clean_source() { > =20 > do_deploy_source[depends] +=3D "isar-apt:do_cache_config" > do_deploy_source[lockfiles] =3D "${REPO_ISAR_DIR}/isar.lock" > -do_deploy_source[dirs] =3D "${S}" > +do_deploy_source[dirs] =3D "${S} ${DEPLOY_DIR_SRC}" > do_deploy_source() { > repo_del_srcpackage "${REPO_ISAR_DIR}"/"${DISTRO}" \ > "${REPO_ISAR_DB_DIR}"/"${DISTRO}" "${DEBDISTRONAME}" "${DEBIAN_= SOURCE}" > - DSC_FILE=3D$(find ${WORKDIR} -maxdepth 1 -name "${DEBIAN_SOURCE}_*.d= sc") > + DSC_FILE=3D$(find ${DEPLOY_DIR_SRC} -maxdepth 1 -name "${DEBIAN_SOUR= CE}_*.dsc") > if [ -n "${DSC_FILE}" ]; then > repo_add_srcpackage "${REPO_ISAR_DIR}"/"${DISTRO}" \ > "${REPO_ISAR_DB_DIR}"/"${DISTRO}" \ > diff --git a/meta/classes-recipe/dpkg.bbclass b/meta/classes-recipe/dpkg.= bbclass > index d8e129bb..a42703d5 100644 > --- a/meta/classes-recipe/dpkg.bbclass > +++ b/meta/classes-recipe/dpkg.bbclass > @@ -116,7 +116,7 @@ dpkg_runbuild() { > echo '$apt_keep_downloaded_packages =3D 1;' >> ${SBUILD_CONFIG} > echo '$stalled_pkg_timeout =3D ${DPKG_BUILD_TIMEOUT};' >> ${SBUILD_= CONFIG} > =20 > - DSC_FILE=3D$(find ${WORKDIR} -maxdepth 1 -name "${DEBIAN_SOURCE}_*.d= sc" -print) > + DSC_FILE=3D$(find ${DEPLOY_DIR_SRC} -maxdepth 1 -name "${DEBIAN_SOUR= CE}_*.dsc" -print) > =20 > # networking is automatically enabled on older versions of sbuild > sbuild_network_option=3D"" Hi Felix, This test case builds containers for qemuamd64-bookworm and=20 qemuarm64-bookworm together using multiconfig. They can be built separately. But when they are built together in this test case, the following error occurs: [stdlog] 2026-08-07 09:00:54,845 avocado.app cibuilder L0371 ERROR|=20 ERROR: mc:qemuamd64-bookworm:prebuilt-docker-img-0.1-r0 do_dpkg_build:=20 ExecutionError('/build/isar_wzh_devel_1z_others/42/build/tmp/work/debian-bo= okworm-amd64/prebuilt-docker-img/0.1-r0/temp/run.dpkg_runbuild.399927',=20 1, None, None) [stdlog] 2026-08-07 09:00:54,845 avocado.app cibuilder L0371 ERROR|=20 ERROR: Logfile of failure stored in:=20 /build/isar_wzh_devel_1z_others/42/build/tmp/work/debian-bookworm-amd64/pre= built-docker-img/0.1-r0/temp/log.do_dpkg_build.399927 [stdlog] 2026-08-07 09:00:54,845 avocado.test cibuilder L0369 INFO | Log=20 data follows: ...... +--------------------------------------------------------------------------= ----+ | Check architectures =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 | +--------------------------------------------------------------------------= ----+ Initial Foreign Architectures: i386 E: dsc: amd64 not in arch list or does not match any arch wildcards:=20 arm64 -- skipping +--------------------------------------------------------------------------= ----+ | Cleanup =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 | +--------------------------------------------------------------------------= ----+ Purging /<> Not cleaning session: cloned chroot in use E: dsc: amd64 not in arch list or does not match any arch wildcards:=20 arm64 -- skipping +--------------------------------------------------------------------------= ----+ | Summary =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 | +--------------------------------------------------------------------------= ----+ Build Architecture: amd64 Build Type: binary Build-Space: n/a Build-Time: 0 Distribution: isar Fail-Stage: arch-check Foreign Architectures: i386 Host Architecture: amd64 Install-Time: 2 Job:=20 /build/isar_wzh_devel_1z_others/42/build/tmp/deploy/isar-source/debian-book= worm/prebuilt-docker-img/prebuilt-docker-img_0.1.dsc Machine Architecture: amd64 Package: prebuilt-docker-img Package-Time: 0 Source-Version: 0.1 Space: n/a Status: skipped Version: 0.1 ---------------------------------------------------------------------------= ----- Finished at 2026-08-07T07:00:50Z Build needed 00:00:00, no disk space E: dsc: amd64 not in arch list or does not match any arch wildcards:=20 arm64 -- skipping cat:=20 /build/isar_wzh_devel_1z_others/42/build/tmp/work/debian-bookworm-amd64/pre= built-docker-img/0.1-r0/rootfs/dpkg_partial.logWARNING:=20 exit code 1 from a shell command. : No such file or directory DEBUG: Executing shell function dpkg_chroot_finalize Zhihang --=20 You received this message because you are subscribed to the Google Groups "= isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an e= mail to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/= 19e5d32e-e1b8-4860-884b-c05a87952006%40ilbers.de.