[PATCH v4 00/13] Improving base-apt usage PoC

[Uladzimir Bely <ubely@ilbers.de>]

Currently, base-apt is used in the following way:

 - After the first build, all .deb files that took part in the process
are is cached in the ${DL_DIR}/deb/. All the packages are downloaded
from the remote repositories.

 - At the second build, `base-apt` repo is first created from the
previously downloaded packages (if ISAR_USE_CACHED_BASE_REPO is set).
Futher debootstrap and installing packages are done from this local repo

The idea of this patchset is using local `base-apt` repo even at
the first build. Before any build step that requires additional
packages, these packages are predownloaded with `debrepo` script to
the `base-apt` repo and the debootstrapping / installation are always
done from it.

Potentialy, such an approach allows to stop using deb-del-dir import
and export functionality in favour of debian-like repositories.

Currently, separate `debrepo` script is used for prefetching packages
to the local 'base-apt' repo. It requires python3-apt to be installed
on the build host. Potentially, the functionality it provides could be
directly integrated to the `debrepo.bbclass`.

Changes since v3:
 - rebased on latest next;
 - cross-building for raspberry supported;
 - code passes both full and fast CI.

Changes since v2:
 - populate base-apt before using at all steps of native build.

Changes since v1:
 - rebased on latest next;
 - updated patchset description.

Uladzimir Bely (13):
  scripts: Add debrepo python script handling base-apt
  meta: Add debrepo bbclass handling base-apt prefetching
  meta-isar: Add local ubuntu-focal public key
  meta: Always use base-apt repo in local mode
  meta: move base-apt from deploy directory to the top
  meta: Use cached base-apt repo to debootstrap
  meta: Setup debrepo context for dpkg-base
  meta: Setup debrepo context for buildchroot
  meta: Setup debrepo context for sbuild-chroot
  base-apt: Predownload packages to base-apt before install
  meta: Add cache-deb-src functionality to base-apt
  meta: Specify grub-efi packages arch
  isar-apt: Fix copying isar-apt to workdir

 meta-isar/conf/distro/ubuntu-focal.conf       |   5 +
 meta-isar/conf/distro/ubuntu.public.key       |  53 +++
 meta/classes/buildchroot.bbclass              |  10 +-
 meta/classes/deb-dl-dir.bbclass               |  22 +
 meta/classes/debrepo.bbclass                  |  74 +++
 meta/classes/dpkg-base.bbclass                |  51 +-
 meta/classes/dpkg.bbclass                     |   4 +-
 meta/classes/image-locales-extension.bbclass  |   5 +
 meta/classes/image-tools-extension.bbclass    |   9 +
 meta/classes/rootfs.bbclass                   |  18 +-
 meta/conf/bitbake.conf                        |   9 +-
 meta/conf/distro/debian-common.conf           |   8 +-
 .../isar-bootstrap/isar-bootstrap.inc         | 124 +++--
 meta/recipes-devtools/base-apt/base-apt.bb    |  46 --
 .../buildchroot/buildchroot.inc               |  11 +
 .../sbuild-chroot/sbuild-chroot.inc           |  11 +
 scripts/debrepo                               | 440 ++++++++++++++++++
 testsuite/citest.py                           |   3 +
 18 files changed, 799 insertions(+), 104 deletions(-)
 create mode 100644 meta-isar/conf/distro/ubuntu.public.key
 create mode 100644 meta/classes/debrepo.bbclass
 create mode 100755 scripts/debrepo

-- 
2.20.1