From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 6816610675337461760 Date: Fri, 17 Apr 2020 07:21:50 -0700 (PDT) From: vijai kumar To: isar-users Message-Id: <9ca262c8-391b-475d-bcef-16a3ab25348f@googlegroups.com> In-Reply-To: <20200417093040.15130-1-Vijaikumar_Kanagarajan@mentor.com> References: <20200417093040.15130-1-Vijaikumar_Kanagarajan@mentor.com> Subject: Re: [PATCH v5 00/13] Deb-src caching implementation MIME-Version: 1.0 Content-Type: multipart/mixed; boundary="----=_Part_662_327526473.1587133310855" X-Google-Token: EP725vQFBpDcapETtto0 X-Google-IP: 192.94.34.34 X-TUID: XDl/r3zf+Mz4 ------=_Part_662_327526473.1587133310855 Content-Type: multipart/alternative; boundary="----=_Part_663_1641208245.1587133310855" ------=_Part_663_1641208245.1587133310855 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit On Friday, April 17, 2020 at 3:00:51 PM UTC+5:30, vijai kumar wrote: > > Changes in v5: > The major changes in this series are as below, > - (P2) Handle cases where HOST_DISTRO!=DISTRO. This avoids mixing > of debs from different distro which inturn helps the src caching logic. > - (P5) Avoid downloading package from other builds. > - (P8) Add a reprepro based sanity test to check if the repo contains > the sources for all the debs. > - (P9) Introduce a new variable BASE_REPO_FEATURES which provides > means > to enable or disable various base-apt features. (cache-deb-src for now) > - Some fixes in (P12 & P13) > Also, addressed some review comments from Henning. > Git Tree: https://github.com/vj-kumar/isar/tree/vijai/debsrc5 > CI build is successful. http://ci.isar-build.org:8080/job/isar_vkk_devel/56/console > > Changes in v4: > - Use = format instead of just using > > to download the right version of source package. > > Changes in v3: > - Take care of non-existent downloads/deb-src directory. > > Changes in v2: > - Introduced additional patch to cache deb src > - Rebased on top of henning/staging4 tree > > > Vijai Kumar K (13): > rootfs: Make rootfs finalize a separate task > deb-dl-dir: Cache host distro debs separately > meta: cache deb srcs as part of postprocessing > deb-dl-dir: Make debsrc_download faster > deb-dl-dir: Download files only belonging to the current image > deb-dl-dir: Factor out the mounting part > deb-dl-dir: Fix skipping of removed files > repository: Add a sanity test to check missing sources > base-apt: Introduce BASE_REPO_FEATURES > repository: Fix failures due to missing section > scripts/ci_build.sh: Enable deb-src caching > rootfs: Fix possible overwrite of existing resolv.conf > rootfs: Handle failures when postprocess is rerun > > meta-isar/conf/local.conf.sample | 4 ++ > meta/classes/deb-dl-dir.bbclass | 72 ++++++++++++++++++- > meta/classes/dpkg-gbp.bbclass | 8 ++- > meta/classes/dpkg.bbclass | 8 ++- > meta/classes/image-tools-extension.bbclass | 4 +- > meta/classes/image.bbclass | 43 ++++++++++- > meta/classes/repository.bbclass | 13 +++- > meta/classes/rootfs.bbclass | 62 ++++++---------- > .../isar-bootstrap/isar-bootstrap.inc | 12 +++- > meta/recipes-devtools/base-apt/base-apt.bb | 3 + > scripts/ci_build.sh | 1 + > 11 files changed, 177 insertions(+), 53 deletions(-) > > -- > 2.17.1 > > > ------=_Part_663_1641208245.1587133310855 Content-Type: text/html; charset=utf-8 Content-Transfer-Encoding: quoted-printable

On Friday, April 17, 2020 at 3:00:51 PM UTC+5:30, vija= i kumar wrote:
Changes in v5:
=C2=A0The major changes in this series are as below,
=C2=A0 =C2=A0 - (P2) Handle cases where HOST_DISTRO!=3DDISTRO. This avo= ids mixing
of debs from different distro which inturn helps the src caching logic.
=C2=A0 =C2=A0 - (P5) Avoid downloading package from other builds.
=C2=A0 =C2=A0 - (P8) Add a reprepro based sanity test to check if the r= epo contains
the sources for all the debs.
=C2=A0 =C2=A0 - (P9) Introduce a new variable BASE_REPO_FEATURES which = provides means
to enable or disable various base-apt features. (cache-deb-src for now)
=C2=A0 =C2=A0 - Some fixes in (P12 & P13)
Also, addressed some review comments from Henning.
Git Tree: https://github.com/vj-kumar/isar/tree/vijai/de= bsrc5


CI build is success= ful.


=C2=A0

Changes in v4:
=C2=A0- Use <source package>=3D<version> format instead of = just using <packagename>
to download the right version of source package.

Changes in v3:
=C2=A0- Take care of non-existent downloads/deb-src directory.

Changes in v2:
=C2=A0- Introduced additional patch to cache deb src
=C2=A0- Rebased on top of henning/staging4 tree


Vijai Kumar K (13):
=C2=A0 rootfs: Make rootfs finalize a separate task
=C2=A0 deb-dl-dir: Cache host distro debs separately
=C2=A0 meta: cache deb srcs as part of postprocessing
=C2=A0 deb-dl-dir: Make debsrc_download faster
=C2=A0 deb-dl-dir: Download files only belonging to the current image
=C2=A0 deb-dl-dir: Factor out the mounting part
=C2=A0 deb-dl-dir: Fix skipping of removed files
=C2=A0 repository: Add a sanity test to check missing sources
=C2=A0 base-apt: Introduce BASE_REPO_FEATURES
=C2=A0 repository: Fix failures due to missing section
=C2=A0 scripts/ci_build.sh: Enable deb-src caching
=C2=A0 rootfs: Fix possible overwrite of existing resolv.conf
=C2=A0 rootfs: Handle failures when postprocess is rerun

=C2=A0meta-isar/conf/local.conf.sample =C2=A0 =C2=A0 =C2=A0 =C2=A0= =C2=A0 =C2=A0 =C2=A0| =C2=A04 ++
=C2=A0meta/classes/deb-dl-dir.bbclass =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 | 72 ++++++++++++++++++-
=C2=A0meta/classes/dpkg-gbp.bbclass =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 | =C2=A08 ++-
=C2=A0meta/classes/dpkg.bbclass =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 | =C2=A08 ++-
=C2=A0meta/classes/image-tools-extension.bbclass =C2=A0 =C2=A0| = =C2=A04 +-
=C2=A0meta/classes/image.bbclass =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0| 43 ++++++++++-
=C2=A0meta/classes/repository.bbclass =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 | 13 +++-
=C2=A0meta/classes/rootfs.bbclass =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 =C2=A0 =C2=A0 | 62 ++++++----------
=C2=A0.../isar-bootstrap/isar-bootstrap.inc =C2=A0 =C2=A0 =C2=A0 = =C2=A0 | 12 +++-
=C2=A0meta/recipes-devtools/base-apt/base-apt.bb =C2=A0 =C2=A0| =C2=A03 +
=C2=A0scripts/ci_build.sh =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 | =C2=A01 +
=C2=A011 files changed, 177 insertions(+), 53 deletions(-)

--=20
2.17.1


------=_Part_663_1641208245.1587133310855-- ------=_Part_662_327526473.1587133310855--