From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7032253102499561472 X-Received: by 2002:a1c:96:: with SMTP id 144mr3762887wma.126.1637358519335; Fri, 19 Nov 2021 13:48:39 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:adf:f1c2:: with SMTP id z2ls1210911wro.2.gmail; Fri, 19 Nov 2021 13:48:38 -0800 (PST) X-Google-Smtp-Source: ABdhPJyEaORgxEJRNHkgOJab1Ycu74rGb5/N8FAqeESVGOA/QkEsf0ITqHSy32VQgl7/hzw6UZcd X-Received: by 2002:a5d:4a44:: with SMTP id v4mr11552007wrs.246.1637358518408; Fri, 19 Nov 2021 13:48:38 -0800 (PST) ARC-Seal: i=1; a=rsa-sha256; t=1637358518; cv=none; d=google.com; s=arc-20160816; b=L3OGWGXmf9jde7tNaUInbrLHOdLI5YL6sb1ICz2tWVEsAII1gW+ryYZahpBELySf9D ah6FrZTAhIrc7deyZYujnLmxf7UZ6Jsm1L1t5m4Ko15I+QCRFIj/stzu839b7Ehm9XAR H6oERIPUhRJO5Tuld8EWicC59kMVnoo+uCMhtf5PF/qn9PV5uvBFy2INx4rO1f8PrToQ gfP7wL5Pg5/gpeC/dfV7lM6LUPKlOPejzbrJDqv/Yicmg1YnHEqrW6Iarr3P3OhlbdIU f/ftrOW6t7dsizIFMYRZzyzumtdn2PaWy8mqKtZrZboYjn77MBFdrrGhndd4lK8iE6eA L+Ow== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date; bh=T8Hf71eA6sqpZjDPjoIykegOhNt99ION7Kr83NRlxPo=; b=Vn2abT5nygmku3VHrs+qyJLsZxlVI58xcGwbBCMmyNbZVOKvU3IePV3IAXFQcqdoEb Y6ZtZ/Y0K/254ynk3RKreq9VfHDePMVZsg0zh3xy7vC3ufgKabB/Uqg7dUK16Nbjc0Ml fDRSCUzNZNLVCFQ3Y++2Sg6wrI1fcHbQj5oc9CNom47yaaiv1FFJy8poalWbuqVwr+r7 aVSQ2Zm/2EUOiVe4J5IvLdW1uAGeBKjtDlZaveECRiyQMlGfpWKy7bL5YMSSSQzVa+F7 AKg1/DwxU+oSfyu8jr9GtJi6nJ+ucg8zSS9gSm7sLas8qO35H4W8l44ZmCQxB7PR6k/d 5YFw== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.2 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from thoth.sbs.de (thoth.sbs.de. [192.35.17.2]) by gmr-mx.google.com with ESMTPS id p11si908643wms.3.2021.11.19.13.48.38 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 19 Nov 2021 13:48:38 -0800 (PST) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.2 as permitted sender) client-ip=192.35.17.2; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.2 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Received: from mail1.sbs.de (mail1.sbs.de [192.129.41.35]) by thoth.sbs.de (8.15.2/8.15.2) with ESMTPS id 1AJLmbSO024471 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Fri, 19 Nov 2021 22:48:37 +0100 Received: from md1za8fc.ad001.siemens.net ([139.22.33.220]) by mail1.sbs.de (8.15.2/8.15.2) with ESMTP id 1AJLmQsd020303; Fri, 19 Nov 2021 22:48:31 +0100 Date: Fri, 19 Nov 2021 22:48:03 +0100 From: Henning Schild To: Uladzimir Bely Cc: isar-users@googlegroups.com Subject: Re: [PATCH v2 00/24] Sbuild/Schroot migration Message-ID: <20211119224803.34dfa19a@md1za8fc.ad001.siemens.net> In-Reply-To: <20211119121333.13805-1-ubely@ilbers.de> References: <20211119121333.13805-1-ubely@ilbers.de> X-Mailer: Claws Mail 3.18.0 (GTK+ 2.24.33; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-TUID: E7661RfPnSD7 Did not look into any of the patches so far ... but the number 24 makes it close to impossible to review. Can this q be split up to ease review? Henning Am Fri, 19 Nov 2021 13:13:09 +0100 schrieb Uladzimir Bely : > This is a patchset showing how sbuild/schroot tools can be integrated > into Isar build system. > > Base schroot image is created with sbuild-chroot-target (or > sbuild-chroot-host in case of cross-build) recipe. These images are > based on isar-bootstrap ones, but include some build-related stuff > preinstalled. > > To use this changes you need to have sbuild and schroot installed and > configured. Current user should be added to sbuild group. > > Changes since v1: > - parallel builds with different BUILD_DIR are supported > - parallel multiconfig targets in one build are supported > - per-task schroot configuration in /etc/schroot/ is now used > - patchset now passes Jenkins CI (so patches changes RFC => PATCH) > > Current limitations: > - there is an unsolved problem with building foreigh architectures > using kas-docker. > > - qemuamd64 images are buildable in kas-docker, but some changes > in kas are reqired (like installing additional packages and adding > 'builder' user to 'sbuild group). I used the following changes to > build ghcr.io/siemens/kas/kas-isar:2.6.2-sbuild image based on > current ghcr.io/siemens/kas/kas-isar:2.6.2: > https://github.com/WiseLord/kas/commit/5b7b02aa33 > > - parallel building of several packages requires more free space > than current buildchroot-based architecture uses. This happens due > the sbuild architecture which uses some basic layer (common for all > packages) and per-package separate layer (where builddeps are > downloaded and installed). > > - recently merged to 'next' ccache support is not yet implemented > in case of sbuild used. > > For experiments, the code can be taken from Isar 'ubely/sbuild' > branch. This is an dev branch, so sometimes it can be force-pushed > when some fixes are applied of rebased to 'next' branch. > > Anton Mikanovich (12): > dpkg: Install raw package files to source root > isar-bootstrap: Export bootstrap to schroot config > linux-module: Do not use shell environment > u-boot: Do not use shell environment > trusted-firmware: Do not use shell environment > optee-os: Do not use shell environment > kselftest: Do not use shell environment > dpkg: Build packages with sbuild > sbuild: Introduce environment variables export API > dpkg-gbp: Migrate to schroot > linux-mainline: Move cfg fragment test to debian/rules > linux-custom: Prepare kernel config inside sbuild > > Uladzimir Bely (12): > dpkg-gbp: Use separate command to export tarball > sbuild: Add recipes for host and target rootfs to run sbuild > sbuild: Mount base-apt in schroot > sbuild: Add sbuildshell task > dpkg-gbp: Preinstall gbp utils in schroot > dpkg: Remove builddeps install task. > dpkg-base: Switch devshell to use schroot > dpkg-base: Switch apt_fetch and apt_unpack to use schroot > dpkg-base: Cleanup from buildchroot parts. > dpkg-gbp: Use host tools for dsc preparation > doc: Add sbuild-related documentation > sbuild: Replace isar-apt mounting with copying > > doc/user_manual.md | 22 ++- > .../optee-os/optee-os-stm32mp15x_3.11.0.bb | 2 +- > .../linux/linux-mainline_5.4.70.bb | 16 +- > meta/classes/dpkg-base.bbclass | 80 ++------ > meta/classes/dpkg-gbp.bbclass | 25 +-- > meta/classes/dpkg-raw.bbclass | 8 +- > meta/classes/dpkg.bbclass | 56 +++--- > meta/classes/sbuild.bbclass | 177 > ++++++++++++++++++ meta/conf/bitbake.conf | > 2 + .../files/debian/{rules => rules.tmpl} | 4 +- > meta/recipes-bsp/optee-os/optee-os-custom.inc | 10 +- > .../files/debian/{rules => rules.tmpl} | 4 +- > .../trusted-firmware-a-custom.inc | 10 +- > .../u-boot/files/debian/{rules => rules.tmpl} | 2 +- > meta/recipes-bsp/u-boot/u-boot-custom.inc | 10 +- > .../sbuild-chroot/sbuild-chroot-host.bb | 13 ++ > .../sbuild-chroot/sbuild-chroot-target.bb | 10 + > .../sbuild-chroot/sbuild-chroot.inc | 36 ++++ > .../kselftest/files/{rules => rules.tmpl} | 0 > meta/recipes-kernel/kselftest/kselftest.inc | 21 +-- > .../files/debian/{rules => rules.tmpl} | 14 +- > meta/recipes-kernel/linux-module/module.inc | 23 +-- > meta/recipes-kernel/linux/linux-custom.inc | 7 +- > 23 files changed, 382 insertions(+), 170 deletions(-) > create mode 100644 meta/classes/sbuild.bbclass > rename meta/recipes-bsp/optee-os/files/debian/{rules => rules.tmpl} > (75%) rename meta/recipes-bsp/trusted-firmware-a/files/debian/{rules > => rules.tmpl} (77%) rename > meta/recipes-bsp/u-boot/files/debian/{rules => rules.tmpl} (94%) > create mode 100644 > meta/recipes-devtools/sbuild-chroot/sbuild-chroot-host.bb create mode > 100644 meta/recipes-devtools/sbuild-chroot/sbuild-chroot-target.bb > create mode 100644 > meta/recipes-devtools/sbuild-chroot/sbuild-chroot.inc rename > meta/recipes-kernel/kselftest/files/{rules => rules.tmpl} (100%) > rename meta/recipes-kernel/linux-module/files/debian/{rules => > rules.tmpl} (50%) >