From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7075595997826514944 X-Received: by 2002:a2e:9f02:0:b0:244:8e4b:5aaa with SMTP id u2-20020a2e9f02000000b002448e4b5aaamr19552628ljk.249.1647417041552; Wed, 16 Mar 2022 00:50:41 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6512:3f8e:b0:448:2012:773d with SMTP id x14-20020a0565123f8e00b004482012773dls753094lfa.3.gmail; Wed, 16 Mar 2022 00:50:40 -0700 (PDT) X-Google-Smtp-Source: ABdhPJwLz8sBCPY6n+/9FEZS8S9BC55eEMEnaLOIZocH5MtRlBe1N9Gz8T+JLzU7/K3uHJDlEdMb X-Received: by 2002:a05:6512:260d:b0:445:c06e:8242 with SMTP id bt13-20020a056512260d00b00445c06e8242mr18393092lfb.157.1647417040536; Wed, 16 Mar 2022 00:50:40 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1647417040; cv=none; d=google.com; s=arc-20160816; b=ppg7ELmOqFWB8NQP12RpbB9g/tmVzNKD7PXTVuIaB5YBr00DKaTJ7s2jcAysMpb0YK Thj+BpunYJmnhD2SAJYVcZsZy/YaES2Znj5oTzxZLie7cnDCRCJ/VFcM/1mlAMEmvnyt WH+7Gn2oiuIqg3gzPGk1uMPAsAFZwsxMqU90aM0hfj330RGub9z6qAejkSdIorKA96H+ Qmkia8/kQJh04lRIYt9gLgepUZo3EED1xGuOocHIPa+/VMx+oUfb1WtK92XTBi19iE8P aT8yWKlGSL5tfC76phd4L9+2yPwexZBMBX/wDmi+ToOApxklM++Yi/qLurONO5fQkWoU 9EeQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:date:subject:cc:to:from; bh=Tp82aZjtTy+7T6RbgvPp2nGQfhTqNwaxY99R7esDJmg=; b=vC9dpk9UGVIKEIYReSBT33Rhtr8gtCuKlvU+eJUt8yDlEqH3mKojI6lUhV0tIZR4Wa YrtR859HVkUWdqIP3B8N4V1ogrWKhYO41f3GNsEEMT7fPBlGzjiY/xouyzikJjUfqbdU BzHTp79ZF7I4GGAhli9hSCmkq31vBz6oHwLDHtyFjRUb1v2GzUUs9hOQl5Z0L5pbN2Zj DfTqraBUTmHopls9TVXRpz8ZQ/d3BxIQt53gqz7ydGpQJkdNchGOPOq2MsUuF6nvAAyi 9I8e8pZF63FRnGr6KT1H0i04jrcM19PhRSy9d4SDugeEtKZKzmgv7JplOWAFgaGlrpGF s74w== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Return-Path: Received: from shymkent.ilbers.de (shymkent.ilbers.de. [85.214.156.166]) by gmr-mx.google.com with ESMTPS id br37-20020a056512402500b00448b7726e65si75832lfb.5.2022.03.16.00.50.40 for (version=TLS1_2 cipher=ECDHE-ECDSA-CHACHA20-POLY1305 bits=256/256); Wed, 16 Mar 2022 00:50:40 -0700 (PDT) Received-SPF: pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) client-ip=85.214.156.166; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of ubely@ilbers.de designates 85.214.156.166 as permitted sender) smtp.mailfrom=ubely@ilbers.de Received: from home.localnet (44-208-124-178-static.mgts.by [178.124.208.44] (may be forged)) (authenticated bits=0) by shymkent.ilbers.de (8.15.2/8.15.2/Debian-8) with ESMTPSA id 22G7oc1o021950 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT); Wed, 16 Mar 2022 08:50:39 +0100 From: Uladzimir Bely To: isar-users@googlegroups.com Cc: Uladzimir Bely Subject: Re: [PATCH v8 00/15] Sbuild/Schroot migration Date: Wed, 16 Mar 2022 10:50:38 +0300 Message-ID: <5409029.IbC2pHGDlb@home> In-Reply-To: <20220316072607.20518-1-ubely@ilbers.de> References: <20220316072607.20518-1-ubely@ilbers.de> MIME-Version: 1.0 Content-Transfer-Encoding: 7Bit Content-Type: text/plain; charset="us-ascii" X-Spam-Status: No, score=-1.0 required=5.0 tests=ALL_TRUSTED autolearn=unavailable autolearn_force=no version=3.4.2 X-Spam-Checker-Version: SpamAssassin 3.4.2 (2018-09-13) on shymkent.ilbers.de X-TUID: ZW6dlSBnWRUp In the email from Wednesday, 16 March 2022 10:25:52 +03 user Uladzimir Bely wrote: Sorry, forgot to add and test the patch "[PATCH 19/19] fix: support build of packages with epoch version" from Felix Moessbauer. I've just picked it and will run a full CI test before sending updated patchset including this patch. > This is a patchset showing how sbuild/schroot tools can be integrated > into Isar build system. > > Base schroot images are created with sbuild-chroot-target or, in case > of cross-build, sbuild-chroot-host recipes. These images are based on > isar-bootstrap ones, but include some build-related stuff preinstalled. > > To use these changes you need to have sbuild and schroot installed and > configured. User who runs build should be added to sbuild group. > > Currently, sbuild-related stuff is supported in latest kas. > > If Gilab CI is used, the following configuration changes are required: > - external dir for schroot overlay should be set in the config > /etc/gitlab-runner/config.toml: > > volumes = ["/path/to/overlay:/var/lib/schroot/union/overlay"] > > The patchset was tested with 'meta-iot2050' and 'xenomai-images' > downstreams in combination with kas image mentioned above. > > Current limitations: > - parallel building of several packages requires more free space in > comparison with buildchroot-based architecture. This happens due > the sbuild architecture which uses some basic layer (common for all > packages) and per-package separate layer (where builddeps are downloaded > and installed). > > Changes since v7: > - fixed work with proxy by adding some environment filters in sbuild; > - DEB_BUILD_PROFILES support simplified and improved > - Fixed gbp-based recipes rebuilding (get back --git-ignore-new option > previously removed) > - fixed base-apt caching for packages and source packages temporary > installed in sbuild isolated environment > - fixed rare build error related to ccache setup (added locking) > > Changes since v6: > - added patch that switches sbuild from using source directory to using > .dsc file. The file is generated before sbuild call by `dpkg-source`. > > Changes since v5: > - warning about shell exports in dpkg_runbuild_prepend. This should > avoided be reworked to templates. > > Changes since v4: > - consider shell exports done in dpkg_runbuild_prepend and pass them > to sbuild environment; > - fixed ccache work. > > Changes since v3: > - dpkg_do_mounts() and dpkg_undo_mounts() are not removed for downstreams > compatibility; > - dpkg_build_export is used for adjusting sbuild environment; > - DEB_BUILD_PROFILES support for sbuild is fixed in case of cross-build. > > Changes since v2: > - patches reworked/squashed for easier reading and understanding; > - fixed building foreigh architectures with kas-docker; > - implemented support of ccache; > - fixed devshell and devshell_nodeps. > > Changes since v1: > - parallel builds with different BUILD_DIR are supported; > - parallel multiconfig targets in one build are supported; > - per-task schroot configuration in /etc/schroot/ is now used; > - patchset now passes Jenkins CI (so patches changes RFC => PATCH). > > Anton Mikanovich (1): > dpkg: Build packages with sbuild > > Uladzimir Bely (14): > dpkg-gbp: Use separate command to export tarball > dpkg-gbp: Use host tools for dsc preparation > sbuild: Add recipes for host and target rootfs to run sbuild > sbuild: Introduce a class for another build method > sbuild: Support of DEB_BUILD_PROFILES > sbuild: Support of shell exports from dpkg_runbuild_prepend > dpkg: Remove builddeps install task. > sbuild: Add ccache support > dpkg-base: Switch devshell to use schroot > dpkg-base: Switch apt_fetch and apt_unpack to use schroot > doc: Add sbuild-related documentation > sbuild: Use .dsc file instead of source directory. > sbuild: Fixed proxy support > sbuild: Fix debsrc_download for packages dependencies > > doc/user_manual.md | 22 +- > meta/classes/deb-dl-dir.bbclass | 4 + > meta/classes/dpkg-base.bbclass | 78 ++++--- > meta/classes/dpkg-gbp.bbclass | 26 +-- > meta/classes/dpkg.bbclass | 104 ++++++--- > meta/classes/sbuild.bbclass | 211 ++++++++++++++++++ > meta/conf/bitbake.conf | 2 + > .../sbuild-chroot/sbuild-chroot-host.bb | 13 ++ > .../sbuild-chroot/sbuild-chroot-target.bb | 10 + > .../sbuild-chroot/sbuild-chroot.inc | 39 ++++ > 10 files changed, 428 insertions(+), 81 deletions(-) > create mode 100644 meta/classes/sbuild.bbclass > create mode 100644 > meta/recipes-devtools/sbuild-chroot/sbuild-chroot-host.bb create mode > 100644 meta/recipes-devtools/sbuild-chroot/sbuild-chroot-target.bb create > mode 100644 meta/recipes-devtools/sbuild-chroot/sbuild-chroot.inc -- Uladzimir Bely