From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7088670669347487744 X-Received: by 2002:a05:6512:b12:b0:44a:ba81:f874 with SMTP id w18-20020a0565120b1200b0044aba81f874mr17767451lfu.449.1650526592673; Thu, 21 Apr 2022 00:36:32 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6512:2815:b0:471:b373:9bb9 with SMTP id cf21-20020a056512281500b00471b3739bb9ls4006052lfb.3.gmail; Thu, 21 Apr 2022 00:36:31 -0700 (PDT) X-Google-Smtp-Source: ABdhPJy7dsorcURvDV0+rObH1czzOZUe2ulmuAihVaApQ+WxpaFE6mtF0a362mzW55zFMscVuOUB X-Received: by 2002:a05:6512:1051:b0:471:ac48:505e with SMTP id c17-20020a056512105100b00471ac48505emr7990811lfb.306.1650526591363; Thu, 21 Apr 2022 00:36:31 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1650526591; cv=pass; d=google.com; s=arc-20160816; b=EMIkwpVb5q/msYTS5qtwoy7gz4lyDu9xh52TbCk63B2dtnptn+w6qs8WMDBBghy/Om IL0XHwL1uAf+xb2AQ+enSlBFY9x0CZipHHdjB5LFoEYNyyC/vstmdW0q+wYxfbrc0zf8 BgHXzwhNn8Ial6yHYIp4pyxVVJICG69aYNJ6YAN29Mkq8zYfLndHKh8GhbwzLtdjYhQO C0Zd+MRLXhrA8X52m0kxQSsOs1ilSwvRnuz9+WU0ES0yV2aGMDGg6LZs1WlFQDD74Puo V1VhF7L9zTsiv6CIa5Tbm1ZRDQfFdosKwg6Qad4LbD+M+BRgwlJDw20JLqLgtxR5YAfW z/PA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:references:in-reply-to :message-id:subject:cc:to:from:date:dkim-signature; bh=c6RCmJDrujvjtINzKViB5xd217pE+j544scWIZRsIBE=; b=n9uZhgfbfb/aHXhZ/yFnMRWwgO4OtkzyYfhSLdvNhSQ76iaWEpa4TRPq3VK1a6mz/0 JeQIAc3uYBqKNZq6XQs67QUTiW3Cx4ApppsoT5s8l9DCZAAzmsotoFy5T+QQM/aB0Gr8 l18uix86dD2drD4WXSLPAv2wPdXAKAKA/r8o4UDpkJF60do7rE4l0m/6oRCH2FozpwqF zzx1Cr2M0uvb1hiL2HykKJtemexQXXBPsuU/eADYlhiWH3TD/Aj41OnVuLGH7xJHsMTS /aOR1C38VKsf5guSvE6hImUH10IxUryqo5dMRM9ukMPu/b/y10MCwm/UbVQpFfrR+3rF HuwQ== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=OvzJjdb6; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 2a01:111:f400:7e1a::618 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR05-DB8-obe.outbound.protection.outlook.com (mail-db8eur05on20618.outbound.protection.outlook.com. [2a01:111:f400:7e1a::618]) by gmr-mx.google.com with ESMTPS id d11-20020a2e96cb000000b0024d9b30d79dsi90654ljj.4.2022.04.21.00.36.31 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 21 Apr 2022 00:36:31 -0700 (PDT) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 2a01:111:f400:7e1a::618 as permitted sender) client-ip=2a01:111:f400:7e1a::618; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=OvzJjdb6; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of henning.schild@siemens.com designates 2a01:111:f400:7e1a::618 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=T6v2aUOK++EX3PWHkWDLldV1AIexzOdvTh9DT6GHJ+WpWKNZmJOS9SO8pVNSPtOfc7mFQOs0J+t36R97X5cYLmnNETLw9FYtt/b4b31Zp1ETK3RRW1Aq91+fy+1Bo6jHJB0Ltsj/pH7PrZD99HoYZ6i9m7kEY1EOeu0RhgRJtLME2GnuKnKdZdzc8yS2RlTLj8IKaUfm9o1Y1p9s0ebKwFVjtklP1yAzOn8BDlooanxsUn/mN5eG1WsnmMOyO+bgF5feRYyGCLmboFDu+e1zexM2eRz8fcXNGGTKEy1v53MCdSrS4wuuMj24rRXYujHSu0TWfbAQQnIrpyGStFgatw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=c6RCmJDrujvjtINzKViB5xd217pE+j544scWIZRsIBE=; b=kcgVvXj71BMp3bY1kI+U7aBHRJz3L/XIOl/NARbRjrjxOc15Rz9+dIg+zBey0xmYXzamAW9I3+ycH5HJhRCSY8afd18oG/pJvqJ4KCmPZjm6Xaxjk3jLVA7LRhBNVf75t29+7NRelUOw0RFLNmZs2NkaTTL3eqXTD1pRIk8KYukwBzuaKOPJSbFkr0Vr71xJEcr2HnDhncWisCpKqPltkzIeZ7V7UGQoTtdqAAFOmAlcYfOF/Pzp/XUqjWRPOyr+kfGsYTq7YSUOuXe6tNyoOM9P5OOelvGvcqW++VeMj8IjBkARQWcGxfhrV91F07n7OLeRY+HfWLUVrYjEXkBBbA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=c6RCmJDrujvjtINzKViB5xd217pE+j544scWIZRsIBE=; b=OvzJjdb6sCIUCrLTnaIxjDzCpTl+DWeGOzqQHN1VZodOvYMz0YOOxYsDxWUtX810EUH0YLxy2ND9gAVbaXlzlb+SfadO0pU8g0QzV2booZeIsFApSyaq8cjJP3mIdaePYKoEmxhMAywyt+YVwUuKCjywYjqgH3PCaUE7+x+g5AvkM4sKts6cfgeul4jrSPxmN3OYHp2oAC7xtfu3lMINBPxhDFpsXylq7YZY+V2xBmZfpGY+yjmqZnqEel4ewk8bqX35aHPYf7giiUZI3UU+AlMWLF1XyLqsQueTjaEj4zJd2sUtBydoXQdpOlcuf4PU/UhOmRKMyiJnEKTd97ESTQ== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=siemens.com; Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) by AM5PR10MB1812.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:206:1c::16) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5186.14; Thu, 21 Apr 2022 07:36:29 +0000 Received: from PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::f4be:8b5d:4314:c2d8]) by PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM ([fe80::f4be:8b5d:4314:c2d8%4]) with mapi id 15.20.5186.014; Thu, 21 Apr 2022 07:36:29 +0000 Date: Thu, 21 Apr 2022 09:36:22 +0200 From: Henning Schild To: Baurzhan Ismagulov Cc: isar-users@googlegroups.com Subject: Re: [PATCH] wic-img: use python3.9 in bookworm Message-ID: <20220421093622.4f45b7f1@md1za8fc.ad001.siemens.net> In-Reply-To: References: <20220420130221.23398-1-henning.schild@siemens.com> <20220420150448.748aa6bd@md1za8fc.ad001.siemens.net> X-Mailer: Claws Mail 3.18.0 (GTK+ 2.24.33; x86_64-pc-linux-gnu) Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit X-ClientProxiedBy: CH0PR13CA0031.namprd13.prod.outlook.com (2603:10b6:610:b2::6) To PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:102:269::8) Return-Path: henning.schild@siemens.com MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: 048b7f31-df34-42f6-25dc-08da2369a62f X-MS-TrafficTypeDiagnostic: AM5PR10MB1812:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: ukaS9NaxGj4JTESfPlBVTXkaQbXFmexKC8YdqUt8Q0Cu6DpsIz33jLpdLgSUXrfESJnyxfSYbVbIwLrLUGBW/P6wE3zeVt6Yu1Q4yAJSo38HHi3tDhTkEZReRYPy/A74ZysgeZTS4FZK2G0V+ro3KlLqlsGsFsFLiOqlzoZs/GBRP394tFUsS0/mFrPOphxPp1jB61+iY/ISJ2AXUlPb+H59OQs/p0VqQf4KYidPmY8ke/gVsEB0kzIAwggDWmmDu/aXIjqNOImTFV52+SD8YbcoTe1v727LnCkuw7KVgcrUYlbdbzWXIvoXB/PPi+Oiim61HT67aHFyMDlvjOauQtftHtpMxPYNd1rHH2o8BcppOmaBxflOtaEhgRSS7gx49ukpdEqE51NT0EfcuaFCnBKRy0K3Ev0Q1mM91ecVS48aWAzSJFS5q5e8044oofaZIcHjVPRVZ3ecPCN4TK6TJGOeMQi9V+F7fBAtFPPF+wH26NX2vSwzJjyMfNhiDK0a3/Lf+Goj2vP0lUwmskrDFq33Nn3nAaoVhnLhshDrI+qIGZNEwVjEWVpa/tx7q/yOoOSTIQMl3542CN4p84hL0J4a/yO3RErOeAc9NhWrxRPzNfVWShWsDLV8SegeizzIY2atYt1xPY4wtHxQvLPhalwgBe1iTE4+vOCrHiUPhHMAN6AAyqWAZcOsPlGBZT/KMvIc9VJ4f9Y6ow2Z9Bwc4A== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230001)(4636009)(366004)(8936002)(5660300002)(2906002)(44832011)(6666004)(6506007)(26005)(66946007)(66476007)(66556008)(8676002)(4326008)(86362001)(38100700002)(82960400001)(6512007)(9686003)(186003)(1076003)(316002)(6916009)(508600001)(966005)(6486002)(83380400001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?us-ascii?Q?1Aw4i02OGbtI4lCm4B1Y7B4y5OUybB6/epbOrFJjc4Xxk+8+FEYmj1wBrhAu?= =?us-ascii?Q?oG3YpOxctX2QZMWPXJgg5PlVT7DKtIt7Q1GLGgwHNFpkHUZ/sE/+cspTooW7?= =?us-ascii?Q?79inluUEuiN7lrTCu0xIjzvOdGEGz0XRxRCkuHv83yzt7bqTvWdpboiJ968Y?= =?us-ascii?Q?HcLcsqwU64CIHwxji1+/buvcrZOb1MJ603ap5P0ijtewtJ0nLsCUGyg2Dx+W?= =?us-ascii?Q?k8Ba0MgxDooGxacomNG/nl8J3A89mbN4ppt5Ziwtl3J7dpHpkFbfx764JYjM?= =?us-ascii?Q?ahXWSQ07cyl9gdp7vr6MeYlK/Cll6cL4tdByx3VtR1NmtHwzVBYW+Wor4Ai9?= =?us-ascii?Q?/+InQD+03i57vkQlRFQLEYa3FRj0ngsS/aV8Uee5Ro5xdO5EdCW5oOxOF/t5?= =?us-ascii?Q?XQkkYWbUOUi7WQTG+hpMDD/xL2jDb2cahKBADZdFI5ZAgSZS1w9qRv2opzqK?= =?us-ascii?Q?4EdW+pIKFkVLJcdgV5SXxGUKOl2Qho2XKO7bACDIZDBCkd8rv31LYCDcjt78?= =?us-ascii?Q?Py8xQkv2ypYZQ8gvf4BM1RhOME9Yx+lsG+q/368SxPMO/W6rCVAp6I3Lh+rK?= =?us-ascii?Q?FTYn/6wbFmWMikQeOtRw8PBF0oX+Msf/NZEbZa/qqgNL1IqNxx0n2kYNnV19?= =?us-ascii?Q?JyVycNnycr2oEN8Kl9Ug6J5WedSRBbX8DXmZ0ShROJtsT5fB20cTOasunWqQ?= =?us-ascii?Q?3hZvEoEMTEV9gl4AWGwzyaiR02wBukg4jcPdr4y9dy0TLJcBf1PQtUdW1A18?= =?us-ascii?Q?KuusT5NT6QJtpG9qpPEaWbnq12XLf0+oF4OllK5HrF3SB5u9XXDbzGXyZsog?= =?us-ascii?Q?D/9D9xmh6UEoNQ8AUx78AOuQ4MqP32ppys3woRtGeLCLZad7y/F7Ni2TPGM7?= =?us-ascii?Q?l4ZMiO3q6QGmsgw3nLktkbtlwN80FSrol2VYSmif+jiBRKVcxmPPJd8KuWZj?= =?us-ascii?Q?ZfJ9qkg/UuZGm55iTX9/QoemIZ5d4tvdEfHJv2++f+Bn47ULBPe7ri+/6gCA?= =?us-ascii?Q?7awo4836zRpXHJ9f+URkxHx0mOT1YecV1Sb9xAg1fhBKXE8tWgk9lVPvt5G5?= =?us-ascii?Q?TR8F36c/4IGMsK+9K5zwThxUEZJTU57kD/hs+AFpjUAq3cMrzp5VG2GBjtdJ?= =?us-ascii?Q?LhGTjzCIN9J0DX7c8/HgEAK8SsPjNs4WnHHMzP07YCm7zp3BoJMYEVKZv8cI?= =?us-ascii?Q?eNn2xgO7XtTeXlTbalB5/+dNOXb/rnpUJdaw6gePb8/6Hpa6e2E1wfa2PCb3?= =?us-ascii?Q?6T+iVQM6xRGAhh68PGqz/xZocr5bLZVwVdbnb00JoGZkMoW+C+/3cDghjmJt?= =?us-ascii?Q?jBsGDDY74xbokjDZpkVPzTfClfUBSWU5l13xauYl8pqiI0LPSUaraa+6c8G6?= =?us-ascii?Q?zskbEvhgfC9qzO/NnsVBYGN9OWC6SYvm2NfQQ4CmB/kSNc90AhtngAYuE9LD?= =?us-ascii?Q?wTH76L5aeuyYKClis7uT+GGHZlNEZy2F9/pGaT1+KgjjCq7YXkfykQ+IAKrU?= =?us-ascii?Q?bAycHm0+8me6RPHFGLErxS6hnrF+YaD+Lt/NljJ1VYNxLr161suqeU8fyuOO?= =?us-ascii?Q?ktjLUPIMUJiG7xcHwZdy0Uh8DfEAdKLDx13l4T1K/mCe51YZBGWsHqivjdpj?= =?us-ascii?Q?uWI9HN0KFkysJOMMtaRQhST1SO5UmAAkRFB/jmlN+N8q6c69JnYjDtG+TYQG?= =?us-ascii?Q?lGJM0PaVBEiRZ6yVocO0piYjnwwJvRIv+jMPAOLqa7bqF1I6EG8VcHEcMafK?= =?us-ascii?Q?dl0wQECaTG46wd3xnQdPjhBMUp16It8=3D?= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: 048b7f31-df34-42f6-25dc-08da2369a62f X-MS-Exchange-CrossTenant-AuthSource: PA4PR10MB5780.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Apr 2022 07:36:29.5179 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: m4SPT5+c1k45TMSSKMJmpDC114ir9iJo6Okz09GB2bzMl6e2K8lOivLdVwzo663WV30HiGefEi6O2L3jFio91OsaaNSJmhpOjl2LQ6+A6es= X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM5PR10MB1812 X-TUID: bgiPB29394we Am Wed, 20 Apr 2022 18:21:08 +0200 schrieb Baurzhan Ismagulov : > On Wed, Apr 20, 2022 at 03:04:48PM +0200, Henning Schild wrote: > > I wonder why CI did not find that like 30 days ago ... are the > > bookworm tests allowed to fail, or what is that KFAIL thing? > > > > If so, why? and is that still valid? > > KFAIL is "known failure" similar to that in GNU development (gdb, > etc.). Bookworm uses it since its initial introduction because the > upstream is not stable, so it's still valid IMO. It is more than valid, with the same argument you could say you would not want to support it at all. We do product dev on testing so we get the most out of the stable-phase and can detect problems early enough for upstream fixes. > We could convert bookworm to fail (by dropping try-except and calling > self.perform_build_test() directly); in that case, any upstream > problems would have to be analyzed quickly, and we might have to wait > for upstream fixes. For our maintenance work, we'd have to implement > some support for local KFAIL tagging. I guess we want to be aware of any upstream problem. That will cause some friction but hopefully not too much. If concrete issues block isar dev we could disable for a moment or merge a red pipeline. But running such expensive CI and ignoring the result is kind of pointless, at least i do not read CI logs regularly. Also i think in the old CI we had bullseye without "allowed to fail" for some time, way before it was stable. And i do not even remember buster. I am all for "bookwork has to succeed in CI"! We have several bookworm layer CIs which found that downstream, now they all need to understand and try to fix on their own. > The issue is seen in > http://ci.isar-build.org:8080/job/isar_next/1328/console (green due > to KFAIL), but not in earlier runs. > > (10/23) > /build-auto/isar_next/1328/testsuite/citest.py:NoCrossTest.test_nocross_bookworm: > ERROR: mc:qemui386-bookworm:isar-image-base-1.0-r0 do_wic_image: > Error executing a python function in... > > > > > --- a/meta/classes/wic-img.bbclass > > > +++ b/meta/classes/wic-img.bbclass > > > @@ -192,11 +192,16 @@ generate_wic_image() { > > > mkdir -p /usr/bin/python3-native/ > > > if [ $(head -1 $(which bmaptool) | grep python3) ];then > > > ln -fs /usr/bin/python3 > > > /usr/bin/python3-native/python3 > > > + # python 3.10 is too new for our bitbake version > > > + if [ "$( readlink /usr/bin/python3 )" = "python3.10" > > > ]; then > > > + ln -fs /usr/bin/python3.9 > > > /usr/bin/python3-native/python3 > > Wow, I'd expect they'd have update-alternatives for that, but seems > they don't. Even if, it should not be used as long as the buildchroot is used for building all recipes. Otherwise this step would switch from 3.10 to 3.9 and the next recipe would get 3.9. > > > > --- a/meta/conf/distro/debian-bookworm.conf > > > +++ b/meta/conf/distro/debian-bookworm.conf > > > @@ -6,6 +6,8 @@ BASE_DISTRO_CODENAME = "bookworm" > > > > > > HOST_DISTRO ?= "debian-${BASE_DISTRO_CODENAME}" > > > > > > +WIC_IMAGER_INSTALL += "python3.9-distutils" > > We've started testing this, but I wonder how this works. When I > debootstrap bookworm, it picks python3-distutils and installs > python3.10. Yes, and you add this one as well ... also pulling in 3.9. You will have both python versions installed. > Bitbake 1.50.4 has been picked as the last tagged version before > overrides syntax change. Please let us know whether bitbake 1.50.5 > works; in that case we wouldn't have to swim against the upstream. It does work but also needs a wic bump, which also does work. I am working on that already but am not sure how quick that will be. Maybe i get it done today. If you at ilbers want a quick workaround and this one here is acceptable, please take it and i will revert it with the bumps. While some people claim that their layers do not build anymore ... which i am sure is right ... it can not be too pressing given they did not find it 30 days ago when bookworm switched to python 3.10. It is a thing that would be nice to solve quickly, but not in a hurry. regards, Henning > > With kind regards, > Baurzhan. >