From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7057122428766388224 X-Received: by 2002:a05:600c:4146:: with SMTP id h6mr2470941wmm.49.1643984935973; Fri, 04 Feb 2022 06:28:55 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:600c:3487:: with SMTP id a7ls6316889wmq.2.canary-gmail; Fri, 04 Feb 2022 06:28:55 -0800 (PST) X-Google-Smtp-Source: ABdhPJx75boR1odJanF/V3TheDqBbXZOc0Pd/uuzAlwOF0QjGwpSE412ks1A1gu+1V8szrVZ95SP X-Received: by 2002:a05:600c:3386:: with SMTP id o6mr2470659wmp.79.1643984934893; Fri, 04 Feb 2022 06:28:54 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1643984934; cv=pass; d=google.com; s=arc-20160816; b=iNuAN9bBZhMbs0SOMvL7O7EVflptk+wNSLk+JNQsh1M5lvjE8JawbdBvDSm7fn+/lm MBYX0I8tpgdXw8T3HQkL7Z7UnolvTOVrzrqSzjR7upgx/P0NW3PzpP/9pDPqGhTn+2Qj b9gFVPR94QF+4uPhtsCvO1nQSmZ05EV27AeCFVGh+X8zvmtSwdQc5DXogfbMpQ4q4X7u dTD/PY+w3CNNiph4ZnhWl2gpHREOYcEDc1lTzY6Kfdz46kc7mewDqXgYbrgOcBK+9uzg M4DwkUavsMtfOnF6g5OlCKiVmlFrYwhvbdjhW+QrQAPKeLr90xp5efRdX7f4WsUos20s WSpA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:in-reply-to:from:cc:references:to :content-language:subject:user-agent:mime-version:date:message-id :dkim-signature; bh=lCd/oL3w+LaTFZIMedA825HVrLXpDU//mhHlUNqTh9I=; b=IYp23JVHdPQz1y18RZ05Y49/nNzEUw+XH8UCgNrCwNx8J8PsENiAY0fgQvcfswTSTs XCGwV2qu84pfz9lgeAYm37hgPK4Ktilj16PFKt1d8w1UnwqCGITtY4Iuu+EEXoqlUG18 B50/kM8PfGvthtTpflnft4E1/Z3TOtD9vZWPHwdH6y/Si5yntn/Wi+yUI/ixUgQJMV8W sBl1k/i2qVBBowGH830Vxwuj7gm1uHc1NHKnd6AygnwN1CPYt9LzPyU+InaMZY7UZJYn Yf884jm5TUiZbjPuSa0iFwM2NDbJrqwewHlbi53kPfza2/3WJEeIbEu3NY8rD2wqI3jS iJZQ== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=G3DZUJfn; arc=pass (i=1 spf=pass spfdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f400:fe09::60e as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR03-VE1-obe.outbound.protection.outlook.com (mail-ve1eur03on060e.outbound.protection.outlook.com. [2a01:111:f400:fe09::60e]) by gmr-mx.google.com with ESMTPS id c4si547827wmq.1.2022.02.04.06.28.54 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 04 Feb 2022 06:28:54 -0800 (PST) Received-SPF: pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f400:fe09::60e as permitted sender) client-ip=2a01:111:f400:fe09::60e; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=G3DZUJfn; arc=pass (i=1 spf=pass spfdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f400:fe09::60e as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=TkJFzJVhibX9wptO1A0lEBfS7r+9hyd6ikAU0tf/auKu3nnWtCxfoGIZ/2ecSJd8ytg5MCIuWDbNbFrWU1ZV+hDM2TZu//BPWWVnMnEd8Ug3ONT7hKiWbxIGH8LQu+eOWQupqFhleSdS+6Hrz/JMJ0zRmgkfIKx81l5X04NS3m//wERkNF1Ww87O8NFAgqbQZFhEnTlPuhbmI1HGh6sTupWvOMHLoBV44gS0WKA7wnXKOzay5sT6A77cR3sJl5FzxY+rN0dBK9129ZoMFP/VwPjy/VGBYtUc9ubL5rcDAMbVknd2bdHl06picLQFPqhWDq6CUve3BtupWBRwRYGItg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=lCd/oL3w+LaTFZIMedA825HVrLXpDU//mhHlUNqTh9I=; b=G6b1w75iuzmqqtFIIYTG4fMH3HtYX8/NIeb/2SYLpPhKCQipOGxUBXCkAKhoPPU9SZlRAZT52SvvRom9/Q7etyi7E1D2+Pb6o1BQZ/i95k3IoWY26ISYonqKLoJJjldwDp8M9Gvww+tEcXcrUGiyJaworxi/llEp0GtZy+B94xsIBnfV9jn2Xrpcbz87/33o0O0Hfib7TKb0SIQVVpctVgulzRgqR1I97JsbV/8Olk+msLSrE1x7oUS23bByRmvc25K0vxB9BIAthMyQUyF9dqUMi9K/s9p2tLBMUiZIfFYMMlsrNkIKpCzANNh21GnrbFjqE5o5pCMs3kabHzAwaA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 194.138.21.71) smtp.rcpttodomain=googlegroups.com smtp.mailfrom=siemens.com; dmarc=pass (p=none sp=none pct=100) action=none header.from=siemens.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=lCd/oL3w+LaTFZIMedA825HVrLXpDU//mhHlUNqTh9I=; b=G3DZUJfnKi5DbqvTgm+jzBRpyUoXlQeM2RLegmLfS0bJLMXTriTlhjIPVqoe03r21v96uYABl2/VuDshRC9OPrF4A7h/B49w+7hRsP39DCDDahlqRP1CfMMvfbS5LRlAhhn43sGiU53bntHUEbjAElG2EjOTHufwYHJ47aGhnH0lT138zdhoAvwRH60rNK4w2KvymOCo7PFd7rlr6sNvFVMvmXA49SHPeFb3qOokA31RI4YSJU5jcueWLhERXKYtY8IUSAyaOybPFUhKvtGWD+uQVxeK0wR/u85I1dmVdT+6yghe3qAIs5KEotDtIC+O9AFg8E+LQO8X+i4G3MfCRQ== Received: from DU2PR04CA0342.eurprd04.prod.outlook.com (2603:10a6:10:2b4::21) by DB8PR10MB3864.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:165::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4951.12; Fri, 4 Feb 2022 14:28:53 +0000 Received: from DB5EUR01FT031.eop-EUR01.prod.protection.outlook.com (2603:10a6:10:2b4:cafe::a6) by DU2PR04CA0342.outlook.office365.com (2603:10a6:10:2b4::21) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4951.17 via Frontend Transport; Fri, 4 Feb 2022 14:28:53 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 194.138.21.71) smtp.mailfrom=siemens.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=siemens.com; Received-SPF: Pass (protection.outlook.com: domain of siemens.com designates 194.138.21.71 as permitted sender) receiver=protection.outlook.com; client-ip=194.138.21.71; helo=hybrid.siemens.com; Received: from hybrid.siemens.com (194.138.21.71) by DB5EUR01FT031.mail.protection.outlook.com (10.152.4.253) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.20.4951.12 via Frontend Transport; Fri, 4 Feb 2022 14:28:53 +0000 Received: from DEMCHDC8A0A.ad011.siemens.net (139.25.226.106) by DEMCHDC9SKA.ad011.siemens.net (194.138.21.71) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.18; Fri, 4 Feb 2022 15:28:53 +0100 Received: from [167.87.72.47] (167.87.72.47) by DEMCHDC8A0A.ad011.siemens.net (139.25.226.106) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.18; Fri, 4 Feb 2022 15:28:52 +0100 Message-ID: <0ca3459c-56ab-ebf8-37c4-db1f3e1085af@siemens.com> Date: Fri, 4 Feb 2022 15:28:51 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.5.0 Subject: Re: [PATCH v4 00/12] Sbuild/Schroot migration Content-Language: en-US To: , , References: <20220125123915.1053-1-ubely@ilbers.de> CC: "Schmidl, Tobias (T CED SES-DE)" From: Jan Kiszka In-Reply-To: Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 8bit Return-Path: jan.kiszka@siemens.com X-Originating-IP: [167.87.72.47] X-ClientProxiedBy: DEMCHDC89XA.ad011.siemens.net (139.25.226.103) To DEMCHDC8A0A.ad011.siemens.net (139.25.226.106) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: e2e8d056-208a-4c02-af54-08d9e7eaab8d X-MS-TrafficTypeDiagnostic: DB8PR10MB3864:EE_ X-Microsoft-Antispam-PRVS: X-MS-Oob-TLC-OOBClassifiers: OLM:10000; X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: p9N5vQ7Ku0PAU5PZe3bjCLMqeKNdIMDcbwZV0SiRJDI9t5OgfpNm2dhTB1R06WV4x6siDLyMRwOIHlpObj+TDQTKVq8hsb82i5RTMdmsemE0ZZdOJ2AeeSJoAXQHZkqHjuyhfgNEK3vaKnRmx2MH+Hb78K8o3B7EAztmnaN4t6ipTRHyyAN5asgntxY9Rf5CBMEPEnzZdwNsJbqhYNggSuVD2V3satN7KB1BJy8JlheS6fICRQdlTX5Xy50/2yuE4tk5qRCJDCLChLtVSSk8ikm2UbJLc+BP/9i3oQnQz/GeLN4LL9Z7tKUdJakUxCzDTAiuHcGAUUtzARJf0O3fp59u1kVxT1Yo7bQ20Qbd4DKsqIcPTiPbisc6EMyzPLWOZ/IuoKW7WLA7h47VQ+n90OP1ChTpLRWzPgy2y0CqwP87GzkZFQvLrmUg61o9R0iAa015rHfNF2SXG4bSFzRfBRC25XBxkhxMuzBRKk4ZDfBVAAEA20Q1cNey+uVfGiJZ8c1yz/gui6txtlMHNPv+UbAg7wBH+8I5cdfLTyMZrz4YaBoJsRT7SgV6nnwAlmBHv1OlR2HszlN6gAamFqr2qSVpHAJH4d+QCuaxetPpjoaUBQMcZ45zgtD5oMHzROr7POM9GawNZOx1fUxK2DJYjbYe3bGxgot5jar9dN9cUoU3YXFoTxjS4WERQHcr3I9Ow9nT/xE01rot08sMAovgy3ygr8Mb5PTP5KO0cRzO6ZHISwNyUYF2tgLnhOgS/BBd5okViFf5koofJOYpRidtsPbV6hCuRHu9ujgsUfjZa6tZ1F3VwowU5A1J9PR+eRUwTejxeeG+Db881y3/Zd8jW9BI2YdkLqH4i8vQh102UFXuSgQcjPTZ15wgXDAwnzfW03nJXQo2Gv5THC2GJWc0+A== X-Forefront-Antispam-Report: CIP:194.138.21.71;CTRY:DE;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:hybrid.siemens.com;PTR:InfoDomainNonexistent;CAT:NONE;SFS:(13230001)(4636009)(40470700004)(46966006)(36840700001)(356005)(82310400004)(70586007)(8676002)(4326008)(8936002)(81166007)(5660300002)(110136005)(70206006)(83380400001)(82960400001)(84970400001)(508600001)(956004)(107886003)(2616005)(16576012)(53546011)(316002)(6706004)(966005)(336012)(186003)(26005)(16526019)(36860700001)(2906002)(40460700003)(47076005)(44832011)(86362001)(31696002)(36756003)(31686004)(3940600001)(43740500002)(36900700001);DIR:OUT;SFP:1101; X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 04 Feb 2022 14:28:53.5407 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: e2e8d056-208a-4c02-af54-08d9e7eaab8d X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=38ae3bcd-9579-4fd4-adda-b42e1495d55a;Ip=[194.138.21.71];Helo=[hybrid.siemens.com] X-MS-Exchange-CrossTenant-AuthSource: DB5EUR01FT031.eop-EUR01.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB8PR10MB3864 X-TUID: 5+8hh+Vslazw On 04.02.22 14:39, quirin.gylstorff@siemens.com wrote: > Hi, > > > On 1/25/22 13:39, Uladzimir Bely wrote: >> This is a patchset showing how sbuild/schroot tools can be integrated >> into Isar build system. >> >> This patchset should be applied on top of "preparation" patchset >> named "Avoid using shell environment during the build". >> >> Base schroot image is created with sbuild-chroot-target (or >> sbuild-chroot-host in case of cross-build) recipe. These images are based >> on isar-bootstrap ones, but include some build-related stuff >> preinstalled. >> >> To use this changes you need to have sbuild and schroot installed and >> configured. Current user should be added to sbuild group. >> >> If 'kas-container' is used, it should be modified to support sbuild: >> - /var/lib/schroot/union/overlay should be externally mounted (-v option) >> >> Currently, official `kas` images don't include all required software, so >> there was an alternative docker image prepared: >> `docker pull ghcr.io/wiselord/kas/kas-isar:next-sbuild` >> >> To use it with KAS: >> - export KAS_IMAGE_VERSION=3.0.0-sbuild >> - export KAS_CONTAINER_IMAGE_PATH=ghcr.io/wiselord/kas >> >> If 'gitlab' is used, the similar changes are required: >> - 'image: ghcr.io/wiselord/kas/kas-isar:3.0.0-sbuild' in .gitlab-ci.yml >> - external dir for schroot overlay should also be specified in >> /etc/gitlab-runner/config.toml: >> volumes = ["/path/to/overlay:/var/lib/schroot/union/overlay"] >> >> The patchset was tested with 'meta-iot2050' and 'xenomai-images' >> downstreams. Some patches are required for these downstreams, >> appropriate pull requests will be created soon. >> >> Current limitations: >> - parallel building of several packages requires more free space in >> comparison with buildchroot-based architecture. This happens due >> the sbuild architecture which uses some basic layer (common for all >> packages) and per-package separate layer (where builddeps are downloaded >> and installed). >> >> Changes since v3: >> - dpkg_do_mounts() and dpkg_undo_mounts() are not removed for downstreams >> compatibility; >> - dpkg_build_export is used for adjusting sbuild environment; >> - DEB_BUILD_PROFILES support for sbuild is fixed in case of cross-build. >> Changes since v2: >> - patches reworked/squashed for easier reading and understanding; >> - fixed building foreigh architectures with kas-docker; >> - implemented support of ccache; >> - fixed devshell and devshell_nodeps, >> Changes since v1: >> - parallel builds with different BUILD_DIR are supported; >> - parallel multiconfig targets in one build are supported; >> - per-task schroot configuration in /etc/schroot/ is now used; >> - patchset now passes Jenkins CI (so patches changes RFC => PATCH). >> >> Anton Mikanovich (1): >>    dpkg: Build packages with sbuild >> >> Uladzimir Bely (11): >>    dpkg-gbp: Use separate command to export tarball >>    dpkg-gbp: Use host tools for dsc preparation >>    sbuild: Add recipes for host and target rootfs to run sbuild >>    sbuild: Introduce a class for another build method >>    sbuild: support of DEB_BUILD_PROFILES >>    sbuild: add ccache support >>    dpkg: Remove builddeps install task. >>    dpkg-base: Switch devshell to use schroot >>    dpkg-base: Switch apt_fetch and apt_unpack to use schroot >>    dpkg-base: Cleanup from buildchroot parts. >>    doc: Add sbuild-related documentation >> >>   doc/user_manual.md                            |  22 ++- >>   meta/classes/dpkg-base.bbclass                |  81 ++++---- >>   meta/classes/dpkg-gbp.bbclass                 |  26 +-- >>   meta/classes/dpkg.bbclass                     |  62 +++--- >>   meta/classes/sbuild.bbclass                   | 185 ++++++++++++++++++ >>   meta/conf/bitbake.conf                        |   2 + >>   .../sbuild-chroot/sbuild-chroot-host.bb       |  13 ++ >>   .../sbuild-chroot/sbuild-chroot-target.bb     |  10 + >>   .../sbuild-chroot/sbuild-chroot.inc           |  39 ++++ >>   9 files changed, 359 insertions(+), 81 deletions(-) >>   create mode 100644 meta/classes/sbuild.bbclass >>   create mode 100644 >> meta/recipes-devtools/sbuild-chroot/sbuild-chroot-host.bb >>   create mode 100644 >> meta/recipes-devtools/sbuild-chroot/sbuild-chroot-target.bb >>   create mode 100644 >> meta/recipes-devtools/sbuild-chroot/sbuild-chroot.inc >> > > any thoughts on the clean source behavior[1]. > > "When running sbuild from within an unpacked source tree, run the > 'clean' target before generating the source package. This might require > some of the build dependencies necessary for running the 'clean' target > to be installed on the host machine. Only disable if you start from a > clean checkout and you know what you are doing."[1] > [1]: > https://manpages.debian.org/unstable/sbuild/sbuild.conf.5.en.html#CLEAN_SOURCE > > > If this is necessary you need to install dh-*(e.g. dh-lua, dh-python) in > the build environment. > Then we would need to expand the host side (builder) dependency list. And also kas-isar. Jan -- Siemens AG, Technology Competence Center Embedded Linux