From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Fri, 21 Mar 2025 07:27:30 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-pj1-f64.google.com (mail-pj1-f64.google.com [209.85.216.64]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 52L6RSx4007048 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Fri, 21 Mar 2025 07:27:29 +0100 Received: by mail-pj1-f64.google.com with SMTP id 98e67ed59e1d1-2ff53a4754asf4527231a91.2 for ; Thu, 20 Mar 2025 23:27:29 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1742538442; cv=pass; d=google.com; s=arc-20240605; b=FWIGkfbDkphNNBNpTw26Yefk47P2DiQMcekvA5L/EUV22jU26bSsgyLPFR5iqyf6xA vTAoPkulsJVvH43BQaMaWHx8tVjbjTw/aSwviAuHSBmY4GmFWsD2xTXOewvw74Bsbx4i etDtT2u1xndDNlj7XheqOItZAXIDHXMI/F+UNN3qQEOrcPjA2gfzjgzAl9RIXktQa0EP VAymTiO/5r0kqysJTJQOvIRnTupCl0/7oJ+remT1vTekjdGdiNy2oI/amR0kCPWkH2fU 8ukAYzYtEyrpZaiWomeVtO9Kdgs1MdUkn+VCb8lwLHsYGFGDBo//Kc97aYZEGzKdb66J WTtw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:user-agent :content-transfer-encoding:references:in-reply-to:date:cc:to:from :subject:message-id:sender:dkim-signature; bh=h6ZzpGyUJ6iJ31mq/c12f6Rkyv8dP7rLppKPNTJYP5U=; fh=dmJCCOP7EMvuOqvXyq/5tI3PYXgMsBuXzxmEnan/5ds=; b=KZolhKcywGxlCBznVj8pLpNeIKK5t1yQ+bc0eibomnz3Kmtn+eEswWO5OoKSU08NM0 ngJEN1ZtInVLqfC1DnZIbbPEstA7vgsP8MCDciK/uUrvojvJmfVrMks4LSR1X2PR/Ice sYXSnR7JYBQwbxa/Sz33bWhPIvYPl/FR1TDKLjAZ9/J+ms2gwEIyIVOSEBTG1uaTNN+O +ZkMT7uUXXBjWdsaliQD2AJlGRKt3xgJviZ9yBfU8waBs931J/dHKGr0lyA28L8lyxLF LYexuzbmsc7HuQgXArRq4AoCz+FEpMPYU8KAC/jWMVzOnf8mxmitf3Oit/NuRt7qIofy RrgQ==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1742538442; x=1743143242; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:user-agent:content-transfer-encoding :references:in-reply-to:date:cc:to:from:subject:message-id:sender :from:to:cc:subject:date:message-id:reply-to; bh=h6ZzpGyUJ6iJ31mq/c12f6Rkyv8dP7rLppKPNTJYP5U=; b=VltLTPOjLhEHg+2ssn8XE81N/Oow5Hjkhsl+FSCtEe6kfsWxD+T+AhyhgAOnKvspCW J97l/rwLrWztESF/X4dWFHKHDUq//xn8jbLjLnzzIIdrpKqYLpOHcJfKpz/EEMHfZb3r 7UBYzMa4VSt8GxKH/rCB1Wnhufb7pKwXttI/qkPaxQ6oLaC2KZ4S5/16YUFczVWXGUho oDbupypXtxc+0YgwkbxNJH5Xd+JUX6eTvgHrxqO4buL5hKSYy9IspA0kl7yuK3qd+mGS 5hpiC9cGiBIxpeS+1odiHEq6CyzUVILY1DwJSMseax5Fic3R49YMpV5oz7b83zhu4wfv /PFQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1742538442; x=1743143242; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :user-agent:content-transfer-encoding:references:in-reply-to:date:cc :to:from:subject:message-id:x-beenthere:x-gm-message-state:sender :from:to:cc:subject:date:message-id:reply-to; bh=h6ZzpGyUJ6iJ31mq/c12f6Rkyv8dP7rLppKPNTJYP5U=; b=kzuHUeDAFwN4ySJvCGzCidQl6aeUcjiHVzNoeoVylJALQSKPZGw9D4K8Df0Y2JuSJd Tz1+0/VNSTNs7GGtxlDh24Xx6/v9CrlwVkmcqDwb1Z2DHfPJ4L8jnoVOuX67sQEgYuVZ kOG7cYfcHXTOR/syG5pHWH1Z05ocKPwC7eMYIlHEnZ6gHEQLTxWjzohRzwhkWbmxUIxH YqA76PIWctza2Z6ES87oWIxdjVR9ZOWFn7wszrmb1wirshPngIdzAigTEAZggYVTW28F +3jHMUHSm6fAcFNG+zc3NUkBX8O4ij2hmWi8ZLZKPSyR+fkBIatfi3rd8wWe2P7pdwuy D2fQ== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCWyyqOLKZ7SfytelIrnXNQa82E755DA4cl5n1Anjp5szHGQHcsfUb0T89Ui1LeEqAYjk0In@ilbers.de X-Gm-Message-State: AOJu0YwTE8QL7kroXoKh8qmmASRP9kwib+43OXIc+n9g6ZmZXxXxOTmP 9nOpoCIu4mm4B57UKDAsVPhlc2+H4ggDiUkHfjYCocWiHaSF4W19 X-Google-Smtp-Source: AGHT+IHxWbZFWrURCmDo94/0j9WrIOAIVn3wPeHHOXFNXH85k9jP+oiclfa21+77yQcbLwQnTjaPmw== X-Received: by 2002:a17:90b:4cc1:b0:2ff:5cb7:5e73 with SMTP id 98e67ed59e1d1-3030feebe86mr3121500a91.23.1742538442240; Thu, 20 Mar 2025 23:27:22 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h=ARLLPAKwai1+DRWu/X6XQpj1jPQJKkmmsfMoK39Zo9A2qzfBww== Received: by 2002:a17:90a:ca88:b0:2ff:4f04:3973 with SMTP id 98e67ed59e1d1-302e3acf370ls821196a91.2.-pod-prod-08-us; Thu, 20 Mar 2025 23:27:20 -0700 (PDT) X-Forwarded-Encrypted: i=2; AJvYcCUz+QZtRiPMtrXNW2qCTBov8rzIeHJpJ0YJs+Yy2TtPNlfQKd/NNPwBNOC6XmruEKHqzoEBb+60LElP@googlegroups.com X-Received: by 2002:a05:6a21:496:b0:1f5:6c94:2cc9 with SMTP id adf61e73a8af0-1fe42f9c5c7mr4163665637.22.1742538440035; Thu, 20 Mar 2025 23:27:20 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1742538440; cv=none; d=google.com; s=arc-20240605; b=GNpWW5aDdkYe7sgRZFw6vOwQAkoWOoxUlDevr3KkafprtYDWokYHHKqi819fqwoLOz dTXSgW0FFhSfcwl+Of/O0+oc4uChimI6Es/Hd6CVcapjCiKpvaUldbuowlH9fiQcTTcS nSNGOvmM/UeU46gQm6YNJ3Mtvhdrgp2CEUIbnav3j+TK4saqGemGbK9X3t+5dIElFkjO 8iliC0nBxagKM3Gm38o3OmB4Nx1ZRFn+RbNIe+10jTp8M8PQnm75+1mhp0UZjfN+y68O livyc4zepNTL39YbHON03BrYWQXioH4i/y55/NVwL/g3eZ6dIz2Ud8z/89apUfybs1Ii YCrA== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:cc:to:from:subject:message-id; bh=ScK5WgMsqWW91We7vVPgfEHkr53w2qn0EqaU5OuyteI=; fh=6vFygM0RuqoM15szbrWMBL0XkroJ3EIZ5xeIoT68QsY=; b=BSa+fCQNp1CW+APIwAjFT1zHiOuHrEM0u5UsFiQvEVVIiSdJi4gNS+TjgNw7tKh7rj mhwXQT2KrAQN20CDINw59QOkXWMfOq2trbVahf7nfN/G0aRpFqL4YQX8VbHPcJowswXB Da2fiZv7VsRrZmk+mIo5a4fe0x8kg6YhTVENwQBNckcHI5F9csN/bbp6X/9hNF7d4sak JJxg77jKFDPQ/UiLOVcWMeh1bAB+DWv7tYzbxlNKhDVej0G5BPLyyPqvszOv4WlH1VW8 Yf2FMNu3kjXYPaurcy4ec5MLbIbRV8uGLv5Gv1V1i1ohaR8DpkhCmmc3QB9kuSfRMyJ/ WOAg==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id d2e1a72fcca58-7390617905fsi51681b3a.6.2025.03.20.23.27.19 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Thu, 20 Mar 2025 23:27:19 -0700 (PDT) Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from [127.0.0.1] (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 52L6REHb007039 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Fri, 21 Mar 2025 07:27:16 +0100 Message-ID: Subject: Re: [PATCH 1/1] image: move deb-src-caching functionality after image creation From: Uladzimir Bely To: "Arjunan, Srinu" , "isar-users@googlegroups.com" Cc: "Kiszka, Jan" , "cedric.hombourger@siemens.com" , "Niedermayr, BENEDIKT" , "Adithya.Balakumar@toshiba-tsip.com" Date: Fri, 21 Mar 2025 09:27:14 +0300 In-Reply-To: References: <20250310115149.1977443-1-srinuvasan.a@siemens.com> <20250310115149.1977443-2-srinuvasan.a@siemens.com> <10e50be6804f29eadc84d4e511542ee212b92125.camel@ilbers.de> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.54.3 (by Flathub.org) MIME-Version: 1.0 X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: ubely@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-TUID: EyuEyG1SQo8c On Thu, 2025-03-20 at 07:18 +0000, 'Arjunan, Srinu' via isar-users wrote: >=20 >=20 > -----Original Message----- > From: Uladzimir Bely =20 > Sent: 20 March 2025 11:02 > To: Arjunan, Srinu (FT FDS CES LX PBU 2) ; > isar-users@googlegroups.com > Cc: Kiszka, Jan (FT RPD CED) ; Hombourger, > Cedric (FT FDS CES LX) ; Niedermayr, > Benedikt (FT RPD CED OES-DE) ; > Adithya.Balakumar@toshiba-tsip.com > Subject: Re: [PATCH 1/1] image: move deb-src-caching functionality > after image creation >=20 > On Tue, 2025-03-18 at 16:45 +0000, Arjunan, Srinu wrote: > >=20 > >=20 > > -----Original Message----- > > From: Arjunan, Srinu (FT FDS CES LX PBU 2) > > > > Sent: 10 March 2025 17:22 > > To: isar-users@googlegroups.com > > Cc: Kiszka, Jan (FT RPD CED) ; Hombourger,=20 > > Cedric (FT FDS CES LX) ;=20 > > ubely@ilbers.de; Niedermayr, Benedikt (FT RPD CED OES-DE)=20 > > ; > > Adithya.Balakumar@toshiba-tsip.com; Arjunan, Srinu (FT FDS CES LX > > PBU > > 2) > > Subject: [PATCH 1/1] image: move deb-src-caching functionality > > after=20 > > image creation > >=20 > > From: srinuvasan > >=20 > > When we do deb-src caching, we are missing to cache imager related=20 > > packages, because the deb-src-caching functionality runs in the > > stage=20 > > of ROOTFS_POSTPROCESS_COMAMND, but image creation task runs after > > the=20 > > rootfs creation, hence imager related packages are missing in > > rootfs's=20 > > var/cache/apt/archives. > >=20 > > To solve this issue run the deb-src-caching after image creation, > > now=20 > > we can able to download deb-src for all the deb packages. > >=20 > > Signed-off-by: srinuvasan > > --- > > =C2=A0meta/classes/image.bbclass=C2=A0 | 8 +++++++- > > meta/classes/rootfs.bbclass=20 > > > 3 ++- > > =C2=A02 files changed, 9 insertions(+), 2 deletions(-) > >=20 > > diff --git a/meta/classes/image.bbclass > > b/meta/classes/image.bbclass=20 > > index 56eca202..66b4d313 100644 > > --- a/meta/classes/image.bbclass > > +++ b/meta/classes/image.bbclass > > @@ -72,7 +72,13 @@ ROOTFS_MANIFEST_DEPLOY_DIR ?=3D > > "${DEPLOY_DIR_IMAGE}" > > =C2=A0ROOTFS_DPKGSTATUS_DEPLOY_DIR ?=3D "${DEPLOY_DIR_IMAGE}" > > =C2=A0ROOTFS_PACKAGE_SUFFIX ?=3D "${PN}-${DISTRO}-${MACHINE}" > > =C2=A0 > > -ROOTFS_POSTPROCESS_COMMAND:prepend =3D > > "${@bb.utils.contains('BASE_REPO_FEATURES', 'cache-deb-src',=20 > > 'cache_deb_src', '', d)} " > > +CACHE_DEB_SRC =3D "${@bb.utils.contains('BASE_REPO_FEATURES', > > 'cache- > > deb-src', '1', '0', d)}" > > + > > +python () { > > +=C2=A0=C2=A0=C2=A0 if bb.utils.to_boolean(d.getVar('CACHE_DEB_SRC')): > > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 bb.build.addtask('do_cache_= deb_src', 'do_deploy', > > 'do_image', > > +d) } > > + > > =C2=A0 > > =C2=A0inherit rootfs > > =C2=A0inherit sdk > > diff --git a/meta/classes/rootfs.bbclass > > b/meta/classes/rootfs.bbclass=20 > > index 2348e269..c9e832dc 100644 > > --- a/meta/classes/rootfs.bbclass > > +++ b/meta/classes/rootfs.bbclass > > @@ -272,7 +272,8 @@ python do_rootfs_install() {=C2=A0 }=C2=A0 addtask= =20 > > rootfs_install before do_rootfs_postprocess after do_unpack > > =C2=A0 > > -cache_deb_src() { > > +do_cache_deb_src[network] =3D "${TASK_USE_SUDO}" > > +do_cache_deb_src() { > > =C2=A0=C2=A0=C2=A0=C2=A0 if [ -e "${ROOTFSDIR}"/etc/resolv.conf ] || > > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 [ -h "${ROOTFSDIR}"/etc/reso= lv.conf ]; then > > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 sudo mv "${ROOTFSDIR}"= /etc/resolv.conf=20 > > "${ROOTFSDIR}"/etc/resolv.conf.isar > > -- > > 2.39.5 > >=20 > > Hi All, > >=20 > > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Can you please u= pdate the status of this patch?, or > > anything=20 > > missing from my end? > >=20 >=20 > Hello. >=20 > Sorry for delays related to "installer" currently breaking full CI on > "next" branch. >=20 > Tested recently your patch, it also makes CI fail at: >=20 > CrossTest.test_cross_debsrc: >=20 > ``` > [stdlog] 2025-03-19 21:29:50,542 avocado.app ERROR| ERROR: Task > (mc:qemuarm64-bookworm:/workspace/build/isar_ub_devel_fast/214/meta- > test/recipes-core/images/isar-image-ci.bb:do_cache_deb_src) failed > with exit code '1' > [stdlog] 2025-03-19 21:30:44,921 avocado.test INFO | | DEBUG: > Executing shell function do_cache_deb_src [stdlog] 2025-03-19 > 21:30:44,921 avocado.test INFO | | Reading package lists... > [stdlog] 2025-03-19 21:30:44,921 avocado.test INFO | | E: You must > put some 'deb-src' URIs in your sources.list ``` >=20 > NoCrossTest.test_nocross_debsrc: >=20 > ``` > [stdlog] 2025-03-20 01:09:35,759 avocado.app ERROR| ERROR: Logfile of > failure stored in: > /workspace/build/isar_ub_devel/126/build/tmp/work/debian-bookworm- > armhf/isar-image-ci-qemuarm/1.0-r0/temp/log.do_cache_deb_src.218291 > [stdlog] 2025-03-20 01:09:35,832 avocado.app ERROR| ERROR: Task > (mc:qemuarm-bookworm:/workspace/build/isar_ub_devel/126/meta- > test/recipes-core/images/isar-image-ci.bb:do_cache_deb_src) failed > with exit code '1' > [stdlog] 2025-03-20 01:19:35,822 avocado.test INFO | | DEBUG: > Executing shell function do_cache_deb_src [stdlog] 2025-03-20 > 01:19:35,823 avocado.test INFO | | Reading package lists... > [stdlog] 2025-03-20 01:19:35,823 avocado.test INFO | | E: You must > put some 'deb-src' URIs in your sources.list ``` >=20 >=20 > Hi Uladzimir, >=20 > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Thank you for the re= ply, I am not able to > reproduce the build issue what you reported , I triggered the build > for isar-image-ci target and it's getting passed. >=20 > This patch depend on Cedric patch [1] > [1]: https://groups.google.com/g/isar-users/c/OwrSBmCPe0Y >=20 > I validated my patch along with the [1], it seems working fine. >=20 > Or Can you please provide the steps to reproduce the issue? >=20 >=20 > > Many thanks, > > Srinu > >=20 >=20 I finally found root cause and easy steps to reproduce. The patch moves debsrc caching to later stage and that results in incompatibility with DISTRO_APT_PREMIRRORS option we are globally using in CI. Steps to reproduce: 1. Run `./kas/kas-container menu` 2. Change the configuration: - `Mirror selection =3D> Use specific Debian mirror`: http://ftp.de.debian.org - `Cache all source packages`: Check the option - `Packages selection =3D> Isar packages`: Uncheck everything to speedup build (not necessary step) 3. Run build It fails with: ``` ERROR: isar-image-base-1.0-r0 do_cache_deb_src: ExecutionError('/build/tmp/work/debian-bookworm-amd64/isar-image-base- qemuamd64/1.0-r0/temp/run.do_cache_deb_src.10979', 100, None, None) ERROR: Logfile of failure stored in: /build/tmp/work/debian-bookworm- amd64/isar-image-base-qemuamd64/1.0-r0/temp/log.do_cache_deb_src.10979 Log data follows: | DEBUG: Executing shell function do_cache_deb_src | Reading package lists... | E: You must put some 'deb-src' URIs in your sources.list ERROR: Task (/build/../repo/meta-isar/recipes-core/images/isar-image- base.bb:do_cache_deb_src) failed with exit code '1' ``` > -- > Best regards, > Uladzimir. >=20 --=20 Best regards, Uladzimir. --=20 You received this message because you are subscribed to the Google Groups "= isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an e= mail to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/= b2d7131d9972d36b57adde42c0f0aa06f092ad48.camel%40ilbers.de.