From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7057122428766388224 X-Received: by 2002:a1c:2942:: with SMTP id p63mr2864796wmp.75.1643739256299; Tue, 01 Feb 2022 10:14:16 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a1c:a1c5:: with SMTP id k188ls1713666wme.1.gmail; Tue, 01 Feb 2022 10:14:15 -0800 (PST) X-Google-Smtp-Source: ABdhPJwi908+o0iSBtRtyGvyfkigdDEeGVxOgiAsBeyiAUjAZmieowstiyVwoTIes1RYMDfmgnUP X-Received: by 2002:a05:600c:3049:: with SMTP id n9mr2856393wmh.121.1643739255267; Tue, 01 Feb 2022 10:14:15 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1643739255; cv=pass; d=google.com; s=arc-20160816; b=YXbUKdvaEGfIZwBcIUD+Z/7HYXUYZO0az4d9nVsCQ8j5jHbzHHwXvBPGOyvwY4k5CN y3ruZi6ePZ8NMMsah3i52Srlkms8otaJPILQ8eH8VaLjScDmYyyCjA1KvxH6s8wvZAEF FRMaQO5czqeyukz48D7v5g4zyyesRxO459fS8JdoYZepp3PfyzUqMGp0qndW8nZx2XTo t2R92fmx9WrsA+egDbQb6dY/73/9+mW9h6+R6wvNGsYOTr5a49kacRjxUYH9RkxWJGOS ftBWVUANorP5zrj0JDB8k0LRSfY1lU55ohn2ZVpI7j+NQRiyxG3KU0DYxosPMMIVyXl7 GnsA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:in-reply-to:from:references:to :content-language:subject:user-agent:mime-version:date:message-id :dkim-signature; bh=Zbld3nl1O+L1wE5BXmKuq/EED8tCGogMRtEIrircpP0=; b=uhTwWp1j/njEM5ZpbsYjAv+Vj/FvOZVn4y5vEefWVt2n5nzTXP853cD/iM3zib4NJR +LRWZysurMAff2LY4+r+HarAHmnrrP2CwE2BHYXWpHmxWSHhPOC3UNriZls92fgA+SWZ V3SNhMGMCVYz1JPqwg4lxsv7+eC70FstAEoNw365VnAkmLCezgDUJ8nbaluKOo4a4HYZ lKcFYXm5J/8HMVHGHh5LSNSP44hUN2VJW6GNDkIPauTSo6bprxYnFx63TgSTlCJYEe/X JjQJUhqLVNrYZ74iiDpN7jJ5Sk8LbXL5f3hU8430AU5anyMCIfpgRKsTZWFWuea6tMkz AvXw== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=TE8+l88i; arc=pass (i=1 spf=pass spfdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 40.107.15.79 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR01-DB5-obe.outbound.protection.outlook.com (mail-eopbgr150079.outbound.protection.outlook.com. [40.107.15.79]) by gmr-mx.google.com with ESMTPS id az22si1006263wrb.5.2022.02.01.10.14.15 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 01 Feb 2022 10:14:15 -0800 (PST) Received-SPF: pass (google.com: domain of jan.kiszka@siemens.com designates 40.107.15.79 as permitted sender) client-ip=40.107.15.79; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=TE8+l88i; arc=pass (i=1 spf=pass spfdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 40.107.15.79 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=TJUbJzsrddSBe7y8WIGUT/6ycqwRc8VFygF8wsBhHCgr4lxv4bjsR/pKIiBKIrdWAECOc5sSS3rPX+u5JxWbCnpatdaDHm7Kfcm9w+aXm+dXL/+GyCH/7jOH5GXwht+Tz+Q3+QheAQQ6JKJ7iC+JWmm0wUWO9DFc6uiWvvzGe/3exH6gJhAbXGaujBckO6kDO4yyzAhTiXWjgWfVdlFUOwen9A1Iw2xvtOBSJc5S6sjtTKWpS+9/1kj56vAnolL+kaZL9JJ3tqGxMM8KxboOmFAC14IHcmK1HMGUKE1mp1OV+7Gl5hH6hnUDc526VNlHv3J1z1BJywVrVtwcfkcGow== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Zbld3nl1O+L1wE5BXmKuq/EED8tCGogMRtEIrircpP0=; b=eN/Ou7ENAr78o4j12/rJVoCzuXHwD88FIxI4Inp89PcODitF1mpZDhElBRBkDxgh6waLwUELch1zTNl/a5AOmz/7zk7vSohzCOrDG0NrksTf4wxJ2fV8lqbm+Fqb5+iA4RD82wdnWAkGB74lCB0sOJ6U6cVEFpaVvSd/S6yZM9Bk1Zic4x3jDdIEroqUuXmsm2m45VCylgUYkZh1uptTK51ASMNthQLLb7qvkE6dG0A9HJ1lkNlBHi7IgHTwKLVe9564eKyMM12dwV8btdX0SkZytjyh/09Aw2tLKu2/Ki0JMpLuzX873hFV/s/tCL6D83VRk2leuX3xH82vgIad6g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 194.138.21.73) smtp.rcpttodomain=ilbers.de smtp.mailfrom=siemens.com; dmarc=pass (p=none sp=none pct=100) action=none header.from=siemens.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Zbld3nl1O+L1wE5BXmKuq/EED8tCGogMRtEIrircpP0=; b=TE8+l88icNyEazZEMJyl76gmi6WABJ+AUdGDgz4VT6jtTwXdCUv8rTyeZaL+Vfu6GOvYpME208tDs0sOQO2yOw/RfV5YyG5BlinKIzwiu5FGincw2yc0whYkhFsRfVcxa4cNDQwkWcr/CdOAiGt0OoeKyhJmb+YxRF/rTGyJZlzKXtxXXXrm7mCYMxUfrb4QK4F9Hpbefqtyxw+fEHC8DjdqcsYcaDFO1jsFGxCY1rT2ughasKB5tNUCL2Yk831CxoKTZP8H92neplF6hRZJJAEV8xx0TM6mLlP4QDX49vyfDkkcbr85H2a/V4hytiA2+84ZCztAgxuw0bTTwcyChA== Received: from AM0PR04CA0129.eurprd04.prod.outlook.com (2603:10a6:208:55::34) by PAXPR10MB5133.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:218::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4930.17; Tue, 1 Feb 2022 18:14:14 +0000 Received: from VE1EUR01FT062.eop-EUR01.prod.protection.outlook.com (2603:10a6:208:55:cafe::16) by AM0PR04CA0129.outlook.office365.com (2603:10a6:208:55::34) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4930.22 via Frontend Transport; Tue, 1 Feb 2022 18:14:14 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 194.138.21.73) smtp.mailfrom=siemens.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=siemens.com; Received-SPF: Pass (protection.outlook.com: domain of siemens.com designates 194.138.21.73 as permitted sender) receiver=protection.outlook.com; client-ip=194.138.21.73; helo=hybrid.siemens.com; Received: from hybrid.siemens.com (194.138.21.73) by VE1EUR01FT062.mail.protection.outlook.com (10.152.3.68) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.20.4930.15 via Frontend Transport; Tue, 1 Feb 2022 18:14:13 +0000 Received: from DEMCHDC8A0A.ad011.siemens.net (139.25.226.106) by DEMCHDC9SNA.ad011.siemens.net (194.138.21.73) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.18; Tue, 1 Feb 2022 19:14:13 +0100 Received: from [167.87.32.84] (167.87.32.84) by DEMCHDC8A0A.ad011.siemens.net (139.25.226.106) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.17; Tue, 1 Feb 2022 19:14:13 +0100 Message-ID: <66cd9f89-9a20-5f5b-72c1-0bb5520b8f56@siemens.com> Date: Tue, 1 Feb 2022 19:14:12 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.5.0 Subject: Re: [PATCH v5 00/12] Sbuild/Schroot migration Content-Language: en-US To: Uladzimir Bely , References: <20220201170038.5723-1-ubely@ilbers.de> From: Jan Kiszka In-Reply-To: <20220201170038.5723-1-ubely@ilbers.de> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit Return-Path: jan.kiszka@siemens.com X-Originating-IP: [167.87.32.84] X-ClientProxiedBy: DEMCHDC89XA.ad011.siemens.net (139.25.226.103) To DEMCHDC8A0A.ad011.siemens.net (139.25.226.106) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: cf6ab973-0381-4e7e-2de6-08d9e5aea70a X-MS-TrafficTypeDiagnostic: PAXPR10MB5133:EE_ X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:9508; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 7XJe7M3cGtxiPplUDlJDKLnYHH3A3fX3MqNPXbKspil+LWtKql7MxqezyBgAjoLfpmUWkojBAYpNP1nOhMvroEeGizteQsUtRWiXiMXM0+T5JBI2y7HKrdfaxEGcnz6hTou24i0uCu84fZ2ZfzSOBHCaYf66z1r2Zg/ge2Kzcv7OWEmxFcuz2eO69gv5KlOEhwOzRoM62TaqUiSy6+RjXvfLFYI3DpuvK3lN1qfsKuVPtco/DXzbIIv0mO02LfC0XXXWgVUtvEtEaXHafvgkekygru31Z7nyWLBlk8EVMjQet/XRxBlyEgJwcLtgQevGgbTBrL6XnpmXT0KdUO/Rg0RWo/e3d+WMXQhYnehvqLucxB3gd3loGrjdy7xIetz0sBoxEQ90A/hmI0hvAz9fCCanuGNSfihs9MCwU2fufQI5rVuXl0nPD4/H/OOksngHY5g+nYrOTvJu5pqOBiXdtxyPAwmJW6xTwssqJs3SIP0zyKSz4aYHgh68VLsiIKCScPluzrg3XlkVXwmnbtLu6YHjwS6dGFQ+/UPt+h6XNaMyJGi64YKE7AMqdJOSzFUMW4fE0bNBxqOUro65NJbgw6yaB4aYAmlcVTBCztvKZwT/YLkpz7pXgI+a9vG2wRSSXBPRzZ6GP4fgIirDlq/OP9nV8tE0fKaMhkZk1Q+dA2z7jvqvCv6rGAaVjY2Z5A9h3eFWjS8zq1j3jk9JWIlia8ZNuMBgsm0GUp75nNcah2vrchoMwqoSlF0yLW+XUcHKoXovuDgNR/sgao8mvdvL8w== X-Forefront-Antispam-Report: CIP:194.138.21.73;CTRY:DE;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:hybrid.siemens.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230001)(4636009)(36840700001)(40470700004)(46966006)(110136005)(31686004)(83380400001)(36860700001)(36756003)(316002)(16576012)(6706004)(186003)(26005)(336012)(16526019)(47076005)(956004)(2616005)(2906002)(44832011)(86362001)(31696002)(82960400001)(70586007)(8936002)(53546011)(5660300002)(508600001)(356005)(81166007)(8676002)(82310400004)(40460700003)(70206006)(3940600001)(36900700001)(43740500002)(20210929001);DIR:OUT;SFP:1101; X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 01 Feb 2022 18:14:13.8699 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: cf6ab973-0381-4e7e-2de6-08d9e5aea70a X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=38ae3bcd-9579-4fd4-adda-b42e1495d55a;Ip=[194.138.21.73];Helo=[hybrid.siemens.com] X-MS-Exchange-CrossTenant-AuthSource: VE1EUR01FT062.eop-EUR01.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: PAXPR10MB5133 X-TUID: fmT0uhykeuDe On 01.02.22 18:00, Uladzimir Bely wrote: > This is a patchset showing how sbuild/schroot tools can be integrated > into Isar build system. > > This patchset should be applied on top of "preparation" patchset > named "Avoid using shell environment during the build". > > Base schroot image is created with sbuild-chroot-target (or > sbuild-chroot-host in case of cross-build) recipe. These images are based > on isar-bootstrap ones, but include some build-related stuff preinstalled. > > To use this changes you need to have sbuild and schroot installed and > configured. Current user should be added to sbuild group. > > If 'kas-container' is used, it should be modified to support sbuild: > - /var/lib/schroot/union/overlay should be externally mounted (-v option) > > Currently, sbuild-related stuff is supported in kas-isar:next image > > To use the patchset with KAS: > - export KAS_IMAGE_VERSION=next > > If 'gitlab' is used, the similar changes are required: > - `next` tag for kas image should be set > - external dir for schroot overlay should also be specified in > /etc/gitlab-runner/config.toml: > volumes = ["/path/to/overlay:/var/lib/schroot/union/overlay"] > > The patchset was tested with 'meta-iot2050' and 'xenomai-images' > downstreams in combination with kas image mentioned above. > > Current limitations: > - parallel building of several packages requires more free space in > comparison with buildchroot-based architecture. This happens due > the sbuild architecture which uses some basic layer (common for all > packages) and per-package separate layer (where builddeps are downloaded > and installed). > > Changes since v4: > - consider shell exports done in dpkg_runbuild_prepend and pass them > to sbuild environment; > - fixed ccache work. > > Changes since v3: > - dpkg_do_mounts() and dpkg_undo_mounts() are not removed for downstreams > compatibility; > - dpkg_build_export is used for adjusting sbuild environment; > - DEB_BUILD_PROFILES support for sbuild is fixed in case of cross-build. > Changes since v2: > - patches reworked/squashed for easier reading and understanding; > - fixed building foreigh architectures with kas-docker; > - implemented support of ccache; > - fixed devshell and devshell_nodeps, > Changes since v1: > - parallel builds with different BUILD_DIR are supported; > - parallel multiconfig targets in one build are supported; > - per-task schroot configuration in /etc/schroot/ is now used; > - patchset now passes Jenkins CI (so patches changes RFC => PATCH). > > Anton Mikanovich (1): > dpkg: Build packages with sbuild > > Uladzimir Bely (11): > dpkg-gbp: Use separate command to export tarball > dpkg-gbp: Use host tools for dsc preparation > sbuild: Add recipes for host and target rootfs to run sbuild > sbuild: Introduce a class for another build method > sbuild: support of DEB_BUILD_PROFILES > sbuild: support of shell exports from dpkg_runbuild_prepend > dpkg: Remove builddeps install task. > sbuild: add ccache support > dpkg-base: Switch devshell to use schroot > dpkg-base: Switch apt_fetch and apt_unpack to use schroot > doc: Add sbuild-related documentation > > doc/user_manual.md | 22 ++- > meta/classes/dpkg-base.bbclass | 79 ++++---- > meta/classes/dpkg-gbp.bbclass | 26 +-- > meta/classes/dpkg.bbclass | 80 +++++--- > meta/classes/sbuild.bbclass | 184 ++++++++++++++++++ > meta/conf/bitbake.conf | 2 + > .../sbuild-chroot/sbuild-chroot-host.bb | 13 ++ > .../sbuild-chroot/sbuild-chroot-target.bb | 10 + > .../sbuild-chroot/sbuild-chroot.inc | 39 ++++ > 9 files changed, 375 insertions(+), 80 deletions(-) > create mode 100644 meta/classes/sbuild.bbclass > create mode 100644 meta/recipes-devtools/sbuild-chroot/sbuild-chroot-host.bb > create mode 100644 meta/recipes-devtools/sbuild-chroot/sbuild-chroot-target.bb > create mode 100644 meta/recipes-devtools/sbuild-chroot/sbuild-chroot.inc > Does this functionally obsoletes buildchroot completely? I see that the recipes are still there. If they aren't used anymore by core Isar, only kept to make some special, not-yet-converted downstream layers happy, they may still quickly regress. Jan -- Siemens AG, Technology Competence Center Embedded Linux