From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from shymkent.ilbers.de ([unix socket]) by shymkent (Cyrus 2.5.10-Debian-2.5.10-3+deb9u2) with LMTPA; Thu, 20 Mar 2025 18:56:33 +0100 X-Sieve: CMU Sieve 2.4 Received: from mail-yb1-f186.google.com (mail-yb1-f186.google.com [209.85.219.186]) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPS id 52KHuVfJ004276 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT) for ; Thu, 20 Mar 2025 18:56:32 +0100 Received: by mail-yb1-f186.google.com with SMTP id 3f1490d57ef6-e643e2847b0sf1401300276.2 for ; Thu, 20 Mar 2025 10:56:32 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1742493386; cv=pass; d=google.com; s=arc-20240605; b=c67CXwQCvG5INK5z+y2fTDL7qOlfc12YGsnvVXJhswq/jTad1QGdFXNg9Go7sbCKqK mFWLPDjM/EUbJbOhFY8wRpsbgGPy8W//US7TYMh+YwFIhR116wDqRYjdBraS7agcLhlH hlvx8quREFgRKaOTsZdmZ1/1GB4GBs5ZnuNpBkCg/eO4sNJ6iNP0K6TZUsKru0tydeum lygGehelpL5h64FgO1nm/WyKutsORIKi3gksnltYj+tywn14ZPx2JcDaX0/GGzz0C41k mVj9OlyEgRaz2Fg990qMBGQQ9u9jJjt6IBLsVry59IX8eCE8En790fFrrDs69+c6b9Hl 84Jg== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:mime-version:user-agent :content-transfer-encoding:references:in-reply-to:date:cc:to:from :subject:message-id:sender:dkim-signature; bh=dGZCg0J2miHtG3DQQ3T8BtBD1lvI8hVGq6yHdS0+86s=; fh=f3miva/G6Ay+4PS+VnSvx6tU3N9cO/kVe0Gm01xvp70=; b=H9pORvpUO6jqE1QpCcNgRJcUpySh+U4HRbCiTuKwYl8gJHG0c21ze7DrRlDALUsBWH t01YOj6uHWSBPtppoHa1iYf+8XKE0kTOjHBvpAvuQspPMiFXrN9Aogg9WLL2B9czRmv6 zpWlC+6zwo2RFci4iV5mN4wsJQVDmiWOXg4erLHpbiNU+2WUvwDZI9uH6iqVVKoS0/sz WFbvmMrMu62hd6UcBtCNkmJYmiZwxxHK3skQpuYuBKZIYJCK3m40epZS8t2RZjyPa78Z ctYVR/wFAhxflbE4jSRpW5dYQwYT5YDE8WXz6np09cVp71CS50u5uOPWMthAZqrTYfXd m3Nw==; darn=ilbers.de ARC-Authentication-Results: i=2; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=googlegroups.com; s=20230601; t=1742493386; x=1743098186; darn=ilbers.de; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :list-id:mailing-list:precedence:x-original-authentication-results :x-original-sender:mime-version:user-agent:content-transfer-encoding :references:in-reply-to:date:cc:to:from:subject:message-id:sender :from:to:cc:subject:date:message-id:reply-to; bh=dGZCg0J2miHtG3DQQ3T8BtBD1lvI8hVGq6yHdS0+86s=; b=YBXmOGpDX+V6Squef3KpNZeMiSePXgqkeZEZJw22Vfx3RV0yL1Zqcv1Ad4RPp+blyh v6/jj5sHtZY/FFqwfcra3t9u/aWNDF8oHFzW/kZP8PfeCRJ3vSJAzmwlgwXVGNyCnvhi e7HT8Nh9Kz7+YsYq6L1cm3eyRL/0mX9S+9yjaDL3OqasSzSbf2KBD2lLBxmpt8i5iH4g e4XCUC4ckelqoOLu+kPp7/D/zrt4yrOjokXolvaFr2selAc70Gp/VUuE3fg+6+dua3Qb 3AWqKRMT7yfo1m0kFgxT5GhiLOLNB05iO9tsNU8V8FyvUlA4JhnqhUQ5Ze9UHpObuy6k 0zGg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20230601; t=1742493386; x=1743098186; h=list-unsubscribe:list-subscribe:list-archive:list-help:list-post :x-spam-checked-in-group:list-id:mailing-list:precedence :x-original-authentication-results:x-original-sender:mime-version :user-agent:content-transfer-encoding:references:in-reply-to:date:cc :to:from:subject:message-id:x-beenthere:x-gm-message-state:sender :from:to:cc:subject:date:message-id:reply-to; bh=dGZCg0J2miHtG3DQQ3T8BtBD1lvI8hVGq6yHdS0+86s=; b=Uxhs+xtZH2dm5Km6AQA9fC140oXC1ry6p0YXhlX5HtUs5UqMK6LsitRCl3Uo7wLZzV wfO+cBJunk9gz7nDNfBgeE4s4LHPP8JFFFGlLS8wyjPys2Cvc6qQ1pgcNWrWwlY/0Taa aSt8k8ocSphAWnckbyrnIrY5jeTBxKyGl6KnSmP91kMMCq1/tOeU1V96VkgEMNDQsFiU 3UisqdN12ng2NDAjwQ0FyBtvKmOVOe2IvxhqRhGGagnsL15m+WZmevGEP1L2CkP0u9KM 194h+qxaDCB4/QA3u8OfvSYdpa8Uwc2ZPCGDusbBhl+1L6BpKfjWWhVrD3JDocZOTYAZ 7lHw== Sender: isar-users@googlegroups.com X-Forwarded-Encrypted: i=2; AJvYcCUHd9T9jhBwR2AEhwflRvJ8p31j6+25mifdF9ItoCbmFhjWc+uAAkjLuelSYpTrIpDIOWIm@ilbers.de X-Gm-Message-State: AOJu0Yzj3oIFIGpgrQ3XGM9e9Mrn0L6N+LeDevoYx5BHdk7ucmUREz0A w51xpilOW4nFLdpfS920tmCp76XI+1rMwOIoGjOO4mOeYw19BFsx X-Google-Smtp-Source: AGHT+IFwPlXNqPICCo7z4xMuNTS5qeSnetR3V/HxctSPjzLX/AshtDtgc7/hVlWUhrY+kwD0JonJOw== X-Received: by 2002:a05:6902:161e:b0:e5d:c97b:78a8 with SMTP id 3f1490d57ef6-e66a4faa008mr30966276.36.1742493385751; Thu, 20 Mar 2025 10:56:25 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com; h=ARLLPAKNVmHcvGfBzPBJke7jP0f4t1Mdru2NCrIIDd7TvuXcvg== Received: by 2002:a05:6902:2613:b0:e60:8c7f:fe47 with SMTP id 3f1490d57ef6-e66908f8784ls1530673276.0.-pod-prod-03-us; Thu, 20 Mar 2025 10:56:24 -0700 (PDT) X-Forwarded-Encrypted: i=2; AJvYcCWhgNCb+xR0WzldVOPucWMxjRdLmULB0CQ9fkv6HciVIjuVI1XtMEmqWthpJ2s+BRlFKPJoZG90NIfD@googlegroups.com X-Received: by 2002:a05:6902:2384:b0:e5d:d161:268f with SMTP id 3f1490d57ef6-e66a4fd0566mr21841276.42.1742493384199; Thu, 20 Mar 2025 10:56:24 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1742493384; cv=none; d=google.com; s=arc-20240605; b=lBGlL14n/LQ5RDPRCTOGuErIrP0+NT6LOthaWnPRWgDHTX/V7C0RJ7OZB8k3SkrJvz EOfG4Vv/pHWucIdunBaG7A7C7jFDMDHYgUMRdcK3jDpbFb037MMk0TyDF619gtvFJRRT cQubRaKNHosy/zjMk8uxQ5C5BRwMn5Z0l7LiqeI+mLSG0Mjeky0qIG3FDWVM3ECQIiBc fYJKqgkXg6CckhGvmeWan+Cwl9Vi2hnikp2NWUWe/rlIP5lw5Z7WBnN1aCD5n/4FV2y2 P6slv1xH8nawkFBjQbohEZCflkxQyrErsJjM+qqaxT7eDHwGEd1gSivVHA/slvHiBNEK Bh1Q== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20240605; h=mime-version:user-agent:content-transfer-encoding:references :in-reply-to:date:cc:to:from:subject:message-id; bh=2iOG94yP6KvJj5msAvMzYLJjxXhiPazZsnDqMtVHFrc=; fh=6vFygM0RuqoM15szbrWMBL0XkroJ3EIZ5xeIoT68QsY=; b=U8TNww8+SaXVZazzWyfCgpBMZdFPYxadgnFzJyoL9I5oTk6IHee4/n3Y2dLVwsveju tSc54bHhA7bV89t09LinZZCFsG/KgfHPydjfgt0DxSQk9Hxm+ADmCe9g9+0atQoGU486 l3MlBSaU//UoQkwyZI+HTaqm6ZytdtInFgfpRho/xXthkZhmFiFYkrlL3pNlgdYTvXIC j4mTRPW0PMJGYDMLOy1E2JsAOc5ykT3m+U9oOXzfq+x6xAdLg0UepK3nHZowIJiOwOai kPpNE+zUcvlAgDg7FPLqHyMUnsKK1zzZF59BAVEqHt8S5HIodHpd3oyY6PxOAJbOJPqe 1PaA==; dara=google.com ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id 3f1490d57ef6-e66a440575fsi7360276.3.2025.03.20.10.56.23 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Thu, 20 Mar 2025 10:56:24 -0700 (PDT) Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Received: from [127.0.0.1] (host-80-81-17-52.static.customer.m-online.net [80.81.17.52]) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8+deb9u1) with ESMTPSA id 52KHuJoe004270 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Thu, 20 Mar 2025 18:56:21 +0100 Message-ID: <362f19d61f23ad0f1c218476fe9f939b2b70a68f.camel@ilbers.de> Subject: Re: [PATCH 1/1] image: move deb-src-caching functionality after image creation From: Uladzimir Bely To: "Arjunan, Srinu" , "isar-users@googlegroups.com" Cc: "Kiszka, Jan" , "cedric.hombourger@siemens.com" , "Niedermayr, BENEDIKT" , "Adithya.Balakumar@toshiba-tsip.com" Date: Thu, 20 Mar 2025 20:56:19 +0300 In-Reply-To: References: <20250310115149.1977443-1-srinuvasan.a@siemens.com> <20250310115149.1977443-2-srinuvasan.a@siemens.com> <10e50be6804f29eadc84d4e511542ee212b92125.camel@ilbers.de> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable User-Agent: Evolution 3.54.3 (by Flathub.org) MIME-Version: 1.0 X-Spam-Status: No, score=-4.6 required=5.0 tests=DKIMWL_WL_MED,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_EF,HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,RCVD_IN_DNSWL_BLOCKED,RCVD_IN_MSPIKE_H2, RCVD_IN_RP_CERTIFIED,RCVD_IN_RP_RNBL,RCVD_IN_RP_SAFE,SPF_PASS autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-Original-Sender: ubely@ilbers.de X-Original-Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Precedence: list Mailing-list: list isar-users@googlegroups.com; contact isar-users+owners@googlegroups.com List-ID: X-Spam-Checked-In-Group: isar-users@googlegroups.com X-Google-Group-Id: 914930254986 List-Post: , List-Help: , List-Archive: , List-Unsubscribe: , X-TUID: APqYgeHKmKrx On Thu, 2025-03-20 at 07:18 +0000, Arjunan, Srinu wrote: >=20 >=20 > -----Original Message----- > From: Uladzimir Bely =20 > Sent: 20 March 2025 11:02 > To: Arjunan, Srinu (FT FDS CES LX PBU 2) ; > isar-users@googlegroups.com > Cc: Kiszka, Jan (FT RPD CED) ; Hombourger, > Cedric (FT FDS CES LX) ; Niedermayr, > Benedikt (FT RPD CED OES-DE) ; > Adithya.Balakumar@toshiba-tsip.com > Subject: Re: [PATCH 1/1] image: move deb-src-caching functionality > after image creation >=20 > On Tue, 2025-03-18 at 16:45 +0000, Arjunan, Srinu wrote: > >=20 > >=20 > > -----Original Message----- > > From: Arjunan, Srinu (FT FDS CES LX PBU 2) > > > > Sent: 10 March 2025 17:22 > > To: isar-users@googlegroups.com > > Cc: Kiszka, Jan (FT RPD CED) ; Hombourger,=20 > > Cedric (FT FDS CES LX) ;=20 > > ubely@ilbers.de; Niedermayr, Benedikt (FT RPD CED OES-DE)=20 > > ; > > Adithya.Balakumar@toshiba-tsip.com; Arjunan, Srinu (FT FDS CES LX > > PBU > > 2) > > Subject: [PATCH 1/1] image: move deb-src-caching functionality > > after=20 > > image creation > >=20 > > From: srinuvasan > >=20 > > When we do deb-src caching, we are missing to cache imager related=20 > > packages, because the deb-src-caching functionality runs in the > > stage=20 > > of ROOTFS_POSTPROCESS_COMAMND, but image creation task runs after > > the=20 > > rootfs creation, hence imager related packages are missing in > > rootfs's=20 > > var/cache/apt/archives. > >=20 > > To solve this issue run the deb-src-caching after image creation, > > now=20 > > we can able to download deb-src for all the deb packages. > >=20 > > Signed-off-by: srinuvasan > > --- > > =C2=A0meta/classes/image.bbclass=C2=A0 | 8 +++++++- > > meta/classes/rootfs.bbclass=20 > > > 3 ++- > > =C2=A02 files changed, 9 insertions(+), 2 deletions(-) > >=20 > > diff --git a/meta/classes/image.bbclass > > b/meta/classes/image.bbclass=20 > > index 56eca202..66b4d313 100644 > > --- a/meta/classes/image.bbclass > > +++ b/meta/classes/image.bbclass > > @@ -72,7 +72,13 @@ ROOTFS_MANIFEST_DEPLOY_DIR ?=3D > > "${DEPLOY_DIR_IMAGE}" > > =C2=A0ROOTFS_DPKGSTATUS_DEPLOY_DIR ?=3D "${DEPLOY_DIR_IMAGE}" > > =C2=A0ROOTFS_PACKAGE_SUFFIX ?=3D "${PN}-${DISTRO}-${MACHINE}" > > =C2=A0 > > -ROOTFS_POSTPROCESS_COMMAND:prepend =3D > > "${@bb.utils.contains('BASE_REPO_FEATURES', 'cache-deb-src',=20 > > 'cache_deb_src', '', d)} " > > +CACHE_DEB_SRC =3D "${@bb.utils.contains('BASE_REPO_FEATURES', > > 'cache- > > deb-src', '1', '0', d)}" > > + > > +python () { > > +=C2=A0=C2=A0=C2=A0 if bb.utils.to_boolean(d.getVar('CACHE_DEB_SRC')): > > +=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 bb.build.addtask('do_cache_= deb_src', 'do_deploy', > > 'do_image', > > +d) } > > + > > =C2=A0 > > =C2=A0inherit rootfs > > =C2=A0inherit sdk > > diff --git a/meta/classes/rootfs.bbclass > > b/meta/classes/rootfs.bbclass=20 > > index 2348e269..c9e832dc 100644 > > --- a/meta/classes/rootfs.bbclass > > +++ b/meta/classes/rootfs.bbclass > > @@ -272,7 +272,8 @@ python do_rootfs_install() {=C2=A0 }=C2=A0 addtask= =20 > > rootfs_install before do_rootfs_postprocess after do_unpack > > =C2=A0 > > -cache_deb_src() { > > +do_cache_deb_src[network] =3D "${TASK_USE_SUDO}" > > +do_cache_deb_src() { > > =C2=A0=C2=A0=C2=A0=C2=A0 if [ -e "${ROOTFSDIR}"/etc/resolv.conf ] || > > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 [ -h "${ROOTFSDIR}"/etc/reso= lv.conf ]; then > > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 sudo mv "${ROOTFSDIR}"= /etc/resolv.conf=20 > > "${ROOTFSDIR}"/etc/resolv.conf.isar > > -- > > 2.39.5 > >=20 > > Hi All, > >=20 > > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Can you please u= pdate the status of this patch?, or > > anything=20 > > missing from my end? > >=20 >=20 > Hello. >=20 > Sorry for delays related to "installer" currently breaking full CI on > "next" branch. >=20 > Tested recently your patch, it also makes CI fail at: >=20 > CrossTest.test_cross_debsrc: >=20 > ``` > [stdlog] 2025-03-19 21:29:50,542 avocado.app ERROR| ERROR: Task > (mc:qemuarm64-bookworm:/workspace/build/isar_ub_devel_fast/214/meta- > test/recipes-core/images/isar-image-ci.bb:do_cache_deb_src) failed > with exit code '1' > [stdlog] 2025-03-19 21:30:44,921 avocado.test INFO | | DEBUG: > Executing shell function do_cache_deb_src [stdlog] 2025-03-19 > 21:30:44,921 avocado.test INFO | | Reading package lists... > [stdlog] 2025-03-19 21:30:44,921 avocado.test INFO | | E: You must > put some 'deb-src' URIs in your sources.list ``` >=20 > NoCrossTest.test_nocross_debsrc: >=20 > ``` > [stdlog] 2025-03-20 01:09:35,759 avocado.app ERROR| ERROR: Logfile of > failure stored in: > /workspace/build/isar_ub_devel/126/build/tmp/work/debian-bookworm- > armhf/isar-image-ci-qemuarm/1.0-r0/temp/log.do_cache_deb_src.218291 > [stdlog] 2025-03-20 01:09:35,832 avocado.app ERROR| ERROR: Task > (mc:qemuarm-bookworm:/workspace/build/isar_ub_devel/126/meta- > test/recipes-core/images/isar-image-ci.bb:do_cache_deb_src) failed > with exit code '1' > [stdlog] 2025-03-20 01:19:35,822 avocado.test INFO | | DEBUG: > Executing shell function do_cache_deb_src [stdlog] 2025-03-20 > 01:19:35,823 avocado.test INFO | | Reading package lists... > [stdlog] 2025-03-20 01:19:35,823 avocado.test INFO | | E: You must > put some 'deb-src' URIs in your sources.list ``` >=20 >=20 > Hi Uladzimir, >=20 > =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0= =C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0=C2=A0 Thank you for the re= ply, I am not able to > reproduce the build issue what you reported , I triggered the build > for isar-image-ci target and it's getting passed. >=20 > This patch depend on Cedric patch [1] > [1]: https://groups.google.com/g/isar-users/c/OwrSBmCPe0Y >=20 > I validated my patch along with the [1], it seems working fine. >=20 > Or Can you please provide the steps to reproduce the issue? >=20 I tried to find easy way to reproduce (e.g., one target case), but didn't find it - build was OK. But it fails in CI - most probably, due to specific sequence of tests, that share sstate cache and download directory between each other. Similar behavior is reproduced in CI also with other patches, like "deb-dl-dir: remove excessive calls to dpkg-deb in debsrc_download". Building some target alone is OK, but under CI it fails. > > Many thanks, > > Srinu > >=20 >=20 > -- > Best regards, > Uladzimir. --=20 Best regards, Uladzimir. --=20 You received this message because you are subscribed to the Google Groups "= isar-users" group. To unsubscribe from this group and stop receiving emails from it, send an e= mail to isar-users+unsubscribe@googlegroups.com. To view this discussion visit https://groups.google.com/d/msgid/isar-users/= 362f19d61f23ad0f1c218476fe9f939b2b70a68f.camel%40ilbers.de.