Re: [PATCH v2 00/24] Sbuild/Schroot migration

[Henning Schild <henning.schild@siemens.com>]

Did not look into any of the patches so far ... but the number 24 makes
it close to impossible to review. Can this q be split up to ease review?

Henning

Am Fri, 19 Nov 2021 13:13:09 +0100
schrieb Uladzimir Bely <ubely@ilbers.de>:

> This is a patchset showing how sbuild/schroot tools can be integrated
> into Isar build system.
> 
> Base schroot image is created with sbuild-chroot-target (or
> sbuild-chroot-host in case of cross-build) recipe. These images are
> based on isar-bootstrap ones, but include some build-related stuff
> preinstalled.
> 
> To use this changes you need to have sbuild and schroot installed and
> configured. Current user should be added to sbuild group.
> 
> Changes since v1:
> - parallel builds with different BUILD_DIR are supported
> - parallel multiconfig targets in one build are supported
> - per-task schroot configuration in /etc/schroot/ is now used
> - patchset now passes Jenkins CI (so patches changes RFC => PATCH)
> 
> Current limitations:
> - there is an unsolved problem with building foreigh architectures
> using kas-docker.
> 
> - qemuamd64 images are buildable in kas-docker, but some changes
> in kas are reqired (like installing additional packages and adding
> 'builder' user to 'sbuild group). I used the following changes to
> build ghcr.io/siemens/kas/kas-isar:2.6.2-sbuild image based on
> current ghcr.io/siemens/kas/kas-isar:2.6.2:
> https://github.com/WiseLord/kas/commit/5b7b02aa33
> 
> - parallel building of several packages requires more free space
> than current buildchroot-based architecture uses. This happens due
> the sbuild architecture which uses some basic layer (common for all
> packages) and per-package separate layer (where builddeps are
> downloaded and installed).
> 
> - recently merged to 'next' ccache support is not yet implemented
> in case of sbuild used.
> 
> For experiments, the code can be taken from Isar 'ubely/sbuild'
> branch. This is an dev branch, so sometimes it can be force-pushed
> when some fixes are applied of rebased to 'next' branch.
> 
> Anton Mikanovich (12):
>   dpkg: Install raw package files to source root
>   isar-bootstrap: Export bootstrap to schroot config
>   linux-module: Do not use shell environment
>   u-boot: Do not use shell environment
>   trusted-firmware: Do not use shell environment
>   optee-os: Do not use shell environment
>   kselftest: Do not use shell environment
>   dpkg: Build packages with sbuild
>   sbuild: Introduce environment variables export API
>   dpkg-gbp: Migrate to schroot
>   linux-mainline: Move cfg fragment test to debian/rules
>   linux-custom: Prepare kernel config inside sbuild
> 
> Uladzimir Bely (12):
>   dpkg-gbp: Use separate command to export tarball
>   sbuild: Add recipes for host and target rootfs to run sbuild
>   sbuild: Mount base-apt in schroot
>   sbuild: Add sbuildshell task
>   dpkg-gbp: Preinstall gbp utils in schroot
>   dpkg: Remove builddeps install task.
>   dpkg-base: Switch devshell to use schroot
>   dpkg-base: Switch apt_fetch and apt_unpack to use schroot
>   dpkg-base: Cleanup from buildchroot parts.
>   dpkg-gbp: Use host tools for dsc preparation
>   doc: Add sbuild-related documentation
>   sbuild: Replace isar-apt mounting with copying
> 
>  doc/user_manual.md                            |  22 ++-
>  .../optee-os/optee-os-stm32mp15x_3.11.0.bb    |   2 +-
>  .../linux/linux-mainline_5.4.70.bb            |  16 +-
>  meta/classes/dpkg-base.bbclass                |  80 ++------
>  meta/classes/dpkg-gbp.bbclass                 |  25 +--
>  meta/classes/dpkg-raw.bbclass                 |   8 +-
>  meta/classes/dpkg.bbclass                     |  56 +++---
>  meta/classes/sbuild.bbclass                   | 177
> ++++++++++++++++++ meta/conf/bitbake.conf                        |
> 2 + .../files/debian/{rules => rules.tmpl}        |   4 +-
>  meta/recipes-bsp/optee-os/optee-os-custom.inc |  10 +-
>  .../files/debian/{rules => rules.tmpl}        |   4 +-
>  .../trusted-firmware-a-custom.inc             |  10 +-
>  .../u-boot/files/debian/{rules => rules.tmpl} |   2 +-
>  meta/recipes-bsp/u-boot/u-boot-custom.inc     |  10 +-
>  .../sbuild-chroot/sbuild-chroot-host.bb       |  13 ++
>  .../sbuild-chroot/sbuild-chroot-target.bb     |  10 +
>  .../sbuild-chroot/sbuild-chroot.inc           |  36 ++++
>  .../kselftest/files/{rules => rules.tmpl}     |   0
>  meta/recipes-kernel/kselftest/kselftest.inc   |  21 +--
>  .../files/debian/{rules => rules.tmpl}        |  14 +-
>  meta/recipes-kernel/linux-module/module.inc   |  23 +--
>  meta/recipes-kernel/linux/linux-custom.inc    |   7 +-
>  23 files changed, 382 insertions(+), 170 deletions(-)
>  create mode 100644 meta/classes/sbuild.bbclass
>  rename meta/recipes-bsp/optee-os/files/debian/{rules => rules.tmpl}
> (75%) rename meta/recipes-bsp/trusted-firmware-a/files/debian/{rules
> => rules.tmpl} (77%) rename
> meta/recipes-bsp/u-boot/files/debian/{rules => rules.tmpl} (94%)
> create mode 100644
> meta/recipes-devtools/sbuild-chroot/sbuild-chroot-host.bb create mode
> 100644 meta/recipes-devtools/sbuild-chroot/sbuild-chroot-target.bb
> create mode 100644
> meta/recipes-devtools/sbuild-chroot/sbuild-chroot.inc rename
> meta/recipes-kernel/kselftest/files/{rules => rules.tmpl} (100%)
> rename meta/recipes-kernel/linux-module/files/debian/{rules =>
> rules.tmpl} (50%)
>