[PATCH 00/17] base-apt rework

[Henning Schild <henning.schild@siemens.com>]

From: Henning Schild <henning.schild@siemens.com>

This series build upon "[PATCHv2 0/9] a few cleanups a bug and a
feature".

base-apt has two main issues that this series fixes:
 - it relied on the rootfs /var/cache/apt to contain all *.debs
  - this is only true of nobody cleaned up, could happen with hooks
    like used in "isar-disable-apt-cache" or similar mechanisms
 - it did not handle "dsc"s (source packages)

It had other minor issues that are described in the individual patches.

The series fixes those issues and extends CI to fully test base-apt.

The general mechanism used in the end is:
 - split all apt-gets into a download and an execution phase
 - copy out all download inbetween the two phases
 - execution phase can now go ahead and possibly delete cached files
   from the rootfs
 - actually copy in everything "old" before the download phase
 - that means the download phase potentially becomes a noop and we speed
   up by using already downloaded files (new feature)

There are a few open points that i will mention later.

Henning Schild (17):
  repository: new class to deal with repos
  dpkg-base: add download caching of apt:// downloads
  base-apt: change the sources.list to also offer deb-src
  base-apt: add deb-src packages as well
  base-apt: do not skip gpg check when it is signed
  ci: conf: add "hello" to the sample config and every build
  meta: split all apt-get invocations into download and execution
  meta: create DL_DIR support for all apt-get downloaded .debs
  meta: import DL_DIR debs before apt-get download steps
  base-apt: populate from DEBDIR as well
  base-apt: drop the "apt_cache" feature
  base-apt: do not copy debs directly out of rootfss anymore
  base-apt: rework base-apt population
  base-apt: move class "base-apt-helper" into only user
  CI: include "isar-disable-apt-cache" into all CI images
  CI: include "cowsay" into default build to test dpkg-gbp
  CI: set BB_NO_NETWORK for cached rebuild

 doc/user_manual.md                            |  1 +
 meta-isar/conf/local.conf.sample              | 10 +--
 meta/classes/base-apt-helper.bbclass          | 57 --------------
 meta/classes/deb-dl-dir.bbclass               | 24 ++++++
 meta/classes/dpkg-base.bbclass                | 45 ++++++-----
 meta/classes/dpkg-gbp.bbclass                 |  5 ++
 meta/classes/dpkg.bbclass                     |  7 +-
 meta/classes/image-cache-extension.bbclass    | 67 +++++++++++++---
 meta/classes/image-locales-extension.bbclass  |  2 +-
 meta/classes/image-tools-extension.bbclass    |  7 ++
 meta/classes/image.bbclass                    |  2 +-
 meta/classes/repository.bbclass               | 78 +++++++++++++++++++
 meta/classes/rootfs.bbclass                   | 28 ++++---
 meta/conf/bitbake.conf                        |  2 +
 .../isar-bootstrap/files/base-apt-sources     |  1 -
 .../isar-bootstrap/isar-bootstrap.inc         | 16 ++--
 meta/recipes-devtools/base-apt/base-apt.bb    | 31 ++------
 .../base-apt/files/distributions.in           |  3 -
 .../buildchroot/files/deps.sh                 | 37 +++++----
 .../isar-apt/files/distributions.in           |  3 -
 meta/recipes-devtools/isar-apt/isar-apt.bb    | 26 ++-----
 scripts/ci_build.sh                           |  7 +-
 22 files changed, 272 insertions(+), 187 deletions(-)
 delete mode 100644 meta/classes/base-apt-helper.bbclass
 create mode 100644 meta/classes/deb-dl-dir.bbclass
 create mode 100644 meta/classes/repository.bbclass
 delete mode 100644 meta/recipes-core/isar-bootstrap/files/base-apt-sources
 delete mode 100644 meta/recipes-devtools/base-apt/files/distributions.in
 delete mode 100644 meta/recipes-devtools/isar-apt/files/distributions.in

-- 
2.23.0