From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Thu, 06 Aug 2026 10:39:55 +0200 X-Sieve: CMU Sieve 2.4 Received: from mail-qt1-f188.google.com (mail-qt1-f188.google.com [209.85.160.188]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 6768ds69003560 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 6 Aug 2026 10:39:55 +0200 Received: by mail-qt1-f188.google.com with SMTP id d75a77b69052e-51a8db414c7sf24117901cf.0 for ; Thu, 06 Aug 2026 01:39:55 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1786005588; cv=pass; d=google.com; s=arc-20260327; b=S4VC/RPWq8TzzHUqGrVxnxSPpU9p8QciXg8bvi8GP3tvaeMjb0Lx4bnTHwzJi34HbT m1Mm7e1mVH6+RWPw8o0RKS4ElvICP3XQJJNAQByT95voHrhhC1eRggJXqntBo0r2wei3 NU8shJS9odBb9qeGEtgVkdHL7bNYLFkIsIM1RiHslS7PaDCMmxKOBglff8m7nly4pW2V 4/8S4CzLCixTUtZggKw3V5nuP9AF4AuimtRaIqFDftjux5vWqDmU7G7HHr17q/sZ2mzj 6nuRIGDRbUN/bINu9z2BhHaOC+dA69NFIvV8/rby+gGmXij/UVkqGFxnxV+r56iU8mJc Jkpg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to:feedback-id:in-reply-to :from:references:to:subject:mime-version:date:message-id :dkim-signature; bh=6OTuBVs3OZEBq4/yw3O9qWLB2cnnzd0+W/oDon9hz/4=; fh=3sK+H4harxRj4DHBDrb8S1t3qo46VB+Ce29vIUk7Vt8=; b=hme3W8VwHh+ZstFrN5jiN8LHfQL/e0RNbhVQueUTxp9GFom/fFZ7k7HBeBfkhbYEU0 czDnxVJXygH/ZCfbCsNKRCdX0909f4rFMDqBrcPt8n4xzOM+3awXS7ZyhHeC1RMN5q18 AkdCi3ljN2+k2rkhaz81yqjci7pNFstDIb0UxtIB66L12VItfZWo2J6loPpNihIQTYf1 VlLQ0ouEFDMDwuUNHa4IZ+TeObXbrqVEQb8+pn29vpw+ru3bf+bhLqr8SOgvNZezSzLk +ImW0ed0FYiOggUZSBstopp065wG3hQuhhAnAVgF+enPuKuX7uJMv1UiqxL3rHI2SjQ+ 8fOw==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=fBvXmHc5; spf=pass (google.com: domain of fm-1326705-202608060820142442d2f67b000207d9-xboinb@rts-flowmailer.siemens.com designates 185.136.65.225 as permitted sender) smtp.mailfrom=fm-1326705-202608060820142442d2f67b000207d9-XBOinB@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20251104; t=1786005588; x=1786610388; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :content-type:in-reply-to:from:references:to:subject:mime-version :date:message-id:from:to:cc:subject:date:message-id:reply-to :content-type; bh=6OTuBVs3OZEBq4/yw3O9qWLB2cnnzd0+W/oDon9hz/4=; b=kaClRikK7nCwKfbBWGiHZbGZHkSpjXzAK8nmsOHL0OTozRWbx5ddr606wfU5sz/dwd D/qF+ecEVdHQ4bN9Iql6q6CreAMuieVaH4ph+vjC/jbMRzHJMryWEs9PP5cgbarBdyKb yoBqqLlAeaZkQjvaQjxt1zv4AJDHT1TAOzMfn8s/Z4op9uXX74BYIujVbPkems6Yf7pe derqP8QCyDPap3lejfcL5bGjZAlJWjAxsUZAARYck5PlIIJkx5fYqlTPoOShm0nh3G1T xefURN0f5nAHECOmEaIrMn2BEPmVL94Pw7mPD/5WZdMULfHrnE8rsZQ74M4EGqwCv7Jz gdMQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20251104; t=1786005588; x=1786610388; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:reply-to :x-original-authentication-results:x-original-sender:feedback-id :content-type:in-reply-to:from:references:to:subject:mime-version :date:message-id:x-beenthere:x-gm-message-state:from:to:cc:subject :date:message-id:reply-to:content-type; bh=6OTuBVs3OZEBq4/yw3O9qWLB2cnnzd0+W/oDon9hz/4=; b=g5NmZALf+4BeT828udaRw1AolUPiFqPhW96fWHCoYhWkCtoXPhnY4NxgDUr2G59zjP p6cBoh1AvjBKSPUgz9EbC0KAHITOojrsTB5WqKWS8fNVEHdzUyVxCqkAir7nlterPVsT THYaSADT+SlThdrpPYbI6YgBw1t8jevUkkFfl9hZkBc7mtDpHGM2+DHlR6drYbjsUSvx 5qbTxbCJfO0tL6GeiMF3ZArEHq5M8MH6iPkANObIcVBVy6Xw0Sd2KAHlKCWMuRY4Ivy8 MJo6B6sqhdk6lOVjWFxJ1FWLkc75NCi2o3EJDNymUZozGrOt8aa72sUaihz+KaBnaSpE 8YpA== X-Forwarded-Encrypted: i=2; AHgh+RpqhOaYJ3PpJBHK0CawXHXpK6EOC8rtegTKVib9fzC3DHN4zwwiNRS0i3sSfTTHyu2AjONr@ilbers.de X-Gm-Message-State: AOJu0YzW9EoQbCqcMQmDlSFuNr3RnNAXdoAsjoOmN1Fbt5CzkkHLbFdv dsVTYD9zXUm0BL3L4QQrxm1P+ktLvoiLabXnCfaXp0j821a3u2jZBQ6s X-Received: by 2002:a05:622a:6097:b0:527:7a5b:ca67 with SMTP id d75a77b69052e-52ce612ecb0mr137196051cf.20.1786005587786; Thu, 06 Aug 2026 01:39:47 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h="Aa7YSPRkJnrulnN2MMkzTgTP4IxmvP27rXTsF4+JjH/KbAdCaQ==" Received: by 2002:a0c:eac5:0:b0:8f0:6c24:4aa with SMTP id 6a1803df08f44-90892ba3a9fls5944996d6.2.-pod-prod-06-us; Thu, 06 Aug 2026 01:39:47 -0700 (PDT) X-Forwarded-Encrypted: i=2; AHgh+RpDisevTl32CLg0KiKsSN+1Vd7yv2KvSLzgvu4te4nSZzJgri6cH2XQiN2mUcVr94tTm7F1APIV3q2O@googlegroups.com X-Received: by 2002:a05:620a:601c:b0:934:9f6d:d1a6 with SMTP id af79cd13be357-93649077deamr1211560885a.17.1786005587183; Thu, 06 Aug 2026 01:39:47 -0700 (PDT) Received: by 2002:ab3:109c:0:b0:306:e47b:2a88 with SMTP id a1c4a302cd1d6-30eb91a6e29msc7a; Thu, 6 Aug 2026 01:20:17 -0700 (PDT) X-Forwarded-Encrypted: i=2; AHgh+Rpmbw99mxDYmPZEgGnWXm1gFiBvUtchMKD6h7aGhLEWToAQCLG1Z9dRSnhP5TbkYhxGA5hGeWtKKBCV@googlegroups.com X-Received: by 2002:a2e:be91:0:b0:396:8029:e2e5 with SMTP id 38308e7fff4ca-39fbb2bc6b5mr15699501fa.18.1786004415423; Thu, 06 Aug 2026 01:20:15 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1786004415; cv=none; d=google.com; s=arc-20260327; b=sxDSwnCfxBxf88zT7AwHUufAMBJpyqqLLtoGPaMiDAYtdOjpB69yrXrrQVShhO3ez+ RNNJznMOH/YZbvM8aoSG8QYMdZlWVxmu1ZbPIAAjl/kRHJLp2LJ4zR/T1n6T6CI+ko6W 9REf/C1Ztc1t20jy2JQSrJ1QTI8isJNtjpxuATD7XW2c8oNNVZd14w4oWMYwnIkuXvi5 uxSONft/tiUJD7LFgmadnOT4y/gxlHyp4fqTXA+z3GjCoFekpLNOLCLUNd2wZYnIbk80 FTrHEH7WtxoRWWONG7S+K0olz/dmbWMThX0zLWHqJXWiUNGK0fl2ZT7+twTg/3IR2YEI rJpw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20260327; h=feedback-id:content-transfer-encoding:in-reply-to:from:references :to:subject:mime-version:date:message-id:dkim-signature; bh=H2PCHZv+QB9cKiQNQseSH7Uif74XBJjObdlwcvJa0Bc=; fh=ez+yYIN2+t1/A1KtVD1essDQ6+anTTnZTbSXjuK9WaU=; b=PaF560+dmKmLA9Z25uDHOsS8zzGDKhaj++ChMjGHdVM3OqzYCG84TKIuq5QSJ1OYfd 8V2mk7cgrhb4qYqUbl1Zj3jIRcjVbwXOu5vn6sGk1+QnRC3yTlRlnWMtntj39yUkNFwF lbx3TgLFqnPDdmFxMMCRx179wwVS7FEdv2abymFEULgxhZiv7PgGCjbJxav12JunhjU+ EcSlP604iJJ6qD/us3Na8/d0ikAemS+Xj+cP7dIpXnoi84N2xrdCsUdbyOCS8R8cUwpi bJ4zIGjrL7lT1yIce6lCNEWuiUe0+zgduNkUfmQ/ZPKT4Lbda6zPBEH7WD7+3sdEVEoR M4cw==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=fBvXmHc5; spf=pass (google.com: domain of fm-1326705-202608060820142442d2f67b000207d9-xboinb@rts-flowmailer.siemens.com designates 185.136.65.225 as permitted sender) smtp.mailfrom=fm-1326705-202608060820142442d2f67b000207d9-XBOinB@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Received: from mta-65-225.siemens.flowmailer.net (mta-65-225.siemens.flowmailer.net. [185.136.65.225]) by gmr-mx.google.com with ESMTPS id 38308e7fff4ca-39fb99b40b2si899461fa.5.2026.08.06.01.20.15 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 06 Aug 2026 01:20:15 -0700 (PDT) Received-SPF: pass (google.com: domain of fm-1326705-202608060820142442d2f67b000207d9-xboinb@rts-flowmailer.siemens.com designates 185.136.65.225 as permitted sender) client-ip=185.136.65.225; Received: by mta-65-225.siemens.flowmailer.net with ESMTPSA id 202608060820142442d2f67b000207d9 for ; Thu, 06 Aug 2026 10:20:14 +0200 Message-ID: <2f561e79-2776-4c70-b36b-7e4829884fd6@siemens.com> Date: Thu, 6 Aug 2026 10:20:13 +0200 MIME-Version: 1.0 Subject: Re: [PATCH v2 2/2] dpkg: cache do_dpkg_source results in sstate To: Felix Moessbauer , isar-users@googlegroups.com References: <20260806072428.2409275-1-felix.moessbauer@siemens.com> <20260806072428.2409275-3-felix.moessbauer@siemens.com> From: "'Andreas Ziegler' via isar-users" In-Reply-To: <20260806072428.2409275-3-felix.moessbauer@siemens.com> Content-Type: text/plain; charset="UTF-8"; format=flowed X-Flowmailer-Platform: Siemens Feedback-ID: 519:519-1326705:519-21489:flowmailer X-Original-Sender: ziegler.andreas@siemens.com X-Original-Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=fm1 header.b=fBvXmHc5; spf=pass (google.com: domain of fm-1326705-202608060820142442d2f67b000207d9-xboinb@rts-flowmailer.siemens.com designates 185.136.65.225 as permitted sender) smtp.mailfrom=fm-1326705-202608060820142442d2f67b000207d9-XBOinB@rts-flowmailer.siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com X-Original-From: Andreas Ziegler Reply-To: Andreas Ziegler Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-Spam-Status: No, score=-4.9 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,MAILING_LIST_MULTI, RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H3,RCVD_IN_MSPIKE_WL, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: U5MGu46eM3fn Am 06.08.2026 um 09:24 schrieb Felix Moessbauer: > As the do_dpkg_source task now runs for each corresponding > do_deploy_deb task, we also want to cache the generated results (to > avoid pulling in a much bigger dependency tree on otherwise cached > rebuilds). > > For that, we cache the .dsc and the .tar.* artifacts in the deploy dir. > This is implemented similar to how do_dpkg_build artifacts (.debs) are > cached, which is also compatible with a hash equivalence server. > > Signed-off-by: Felix Moessbauer > --- > RECIPE-API-CHANGELOG.md | 8 ++++++++ > meta/classes-recipe/dpkg-source.bbclass | 19 +++++++++++++++++-- > meta/classes-recipe/dpkg.bbclass | 2 +- > 3 files changed, 26 insertions(+), 3 deletions(-) > > diff --git a/RECIPE-API-CHANGELOG.md b/RECIPE-API-CHANGELOG.md > index 7e923e55..7386f5d1 100644 > --- a/RECIPE-API-CHANGELOG.md > +++ b/RECIPE-API-CHANGELOG.md > @@ -1146,6 +1146,14 @@ deploy directory `DEPLOY_DIR_DEB` instead of being deployed to the `WORKDIR`. > Recipes that accessed the built debs through `${WORKDIR}/*.deb` (e.g. to unpack an > artifact in a `do_deploy` task) must now reference `${DEPLOY_DIR_DEB}/*.deb` instead. > > +### Debian source packages are deployed to `DEPLOY_DIR_SRC` > + > +The source packages produced by `do_dpkg_source` are now exported into a shared, > +sstate-tracked deploy dir `DEPLOY_DIR_SRC` instead of being deployed to the `WORKDIR`. > + > +Recipes that access the source packages through `${WORKDIR}/*.tar.{gz,xz}` must now > +reference the local copy in `${DEPLOY_DIR_SRC}` instead. > + > ### Add Hyper-V machine support > > A new machine `hyper-v` has been introduced for building images > diff --git a/meta/classes-recipe/dpkg-source.bbclass b/meta/classes-recipe/dpkg-source.bbclass > index 92d06e1b..97cf9714 100644 > --- a/meta/classes-recipe/dpkg-source.bbclass > +++ b/meta/classes-recipe/dpkg-source.bbclass > @@ -13,7 +13,12 @@ TAR_REPRO_OPTS ?= "--exclude=.git --exclude=debian \ > DPKG_SOURCE_EXTRA_ARGS ?= "-I" > > DEBIAN_SOURCE ?= "${BPN}" > +SRCPKG_DIR = "${WORKDIR}/deploy-srcpkg" > +DEPLOY_DIR_SRC = "${DEPLOY_DIR}/isar-source/${DISTRO}/${BPN}" > > +do_dpkg_source[cleandirs] = "${SRCPKG_DIR}" > +do_dpkg_source[sstate-inputdirs] = "${SRCPKG_DIR}" > +do_dpkg_source[sstate-outputdirs] = "${DEPLOY_DIR_SRC}" > do_dpkg_source() { > # Create a .dsc file from source directory to use it with sbuild > DEB_SOURCE_NAME=$(dpkg-parsechangelog --show-field Source --file ${WORKDIR}/${PPS}/debian/changelog) > @@ -22,9 +27,19 @@ do_dpkg_source() { > fi > find ${WORKDIR} -maxdepth 1 -name "${DEBIAN_SOURCE}_*.dsc" -delete > sh -c "cd ${WORKDIR}; dpkg-source ${DPKG_SOURCE_EXTRA_ARGS} -b ${PPS}" > + # move packages to deploy directory > + find ${WORKDIR} -maxdepth 1 \( -name "${DEBIAN_SOURCE}_*.tar.*" -o -name "${DEBIAN_SOURCE}_*.dsc" \) -exec mv {} ${SRCPKG_DIR}/ \; > } > addtask dpkg_source after do_prepare_build > > +SSTATETASKS += "do_dpkg_source" > + > +python do_dpkg_source_setscene() { > + sstate_setscene(d) > +} > + > +addtask dpkg_source_setscene > + > CLEANFUNCS += "deb_clean_source" > > deb_clean_source() { > @@ -34,11 +49,11 @@ deb_clean_source() { > > do_deploy_source[depends] += "isar-apt:do_cache_config" > do_deploy_source[lockfiles] = "${REPO_ISAR_DIR}/isar.lock" > -do_deploy_source[dirs] = "${S}" > +do_deploy_source[dirs] = "${S} ${DEPLOY_DIR_SRC}" > do_deploy_source() { > repo_del_srcpackage "${REPO_ISAR_DIR}"/"${DISTRO}" \ > "${REPO_ISAR_DB_DIR}"/"${DISTRO}" "${DEBDISTRONAME}" "${DEBIAN_SOURCE}" > - DSC_FILE=$(find ${WORKDIR} -maxdepth 1 -name "${DEBIAN_SOURCE}_*.dsc") > + DSC_FILE=$(find ${DEPLOY_DIR_SRC} -maxdepth 1 -name "${DEBIAN_SOURCE}_*.dsc") > if [ -n "${DSC_FILE}" ]; then > repo_add_srcpackage "${REPO_ISAR_DIR}"/"${DISTRO}" \ > "${REPO_ISAR_DB_DIR}"/"${DISTRO}" \ > diff --git a/meta/classes-recipe/dpkg.bbclass b/meta/classes-recipe/dpkg.bbclass > index d8e129bb..a42703d5 100644 > --- a/meta/classes-recipe/dpkg.bbclass > +++ b/meta/classes-recipe/dpkg.bbclass > @@ -116,7 +116,7 @@ dpkg_runbuild() { > echo '$apt_keep_downloaded_packages = 1;' >> ${SBUILD_CONFIG} > echo '$stalled_pkg_timeout = ${DPKG_BUILD_TIMEOUT};' >> ${SBUILD_CONFIG} > > - DSC_FILE=$(find ${WORKDIR} -maxdepth 1 -name "${DEBIAN_SOURCE}_*.dsc" -print) > + DSC_FILE=$(find ${DEPLOY_DIR_SRC} -maxdepth 1 -name "${DEBIAN_SOURCE}_*.dsc" -print) > > # networking is automatically enabled on older versions of sbuild > sbuild_network_option="" Tested-by: Andreas Ziegler Thanks! Andreas -- You received this message because you are subscribed to the Google Groups "isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an email to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/2f561e79-2776-4c70-b36b-7e4829884fd6%40siemens.com.