From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7319406651323187200 X-Received: by 2002:a17:90a:cb8f:b0:28f:fd7a:bdff with SMTP id a15-20020a17090acb8f00b0028ffd7abdffmr288246pju.88.1705561186339; Wed, 17 Jan 2024 22:59:46 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:90a:f2d0:b0:290:207a:fafa with SMTP id gt16-20020a17090af2d000b00290207afafals157048pjb.0.-pod-prod-02-us; Wed, 17 Jan 2024 22:59:45 -0800 (PST) X-Google-Smtp-Source: AGHT+IF0MQiOoUtYWZi0Cp+VfHVWk7K71Cm8yClQxhvhWV6jddo3FD+WzDOY4OA2LVeGyI6I8VBl X-Received: by 2002:a05:6a21:47cb:b0:19b:7f80:274 with SMTP id as11-20020a056a2147cb00b0019b7f800274mr282489pzc.124.1705561184997; Wed, 17 Jan 2024 22:59:44 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1705561184; cv=pass; d=google.com; s=arc-20160816; b=KhbUzt4+0lIR1NoPyLb9UtIt0ezxH7WIH80zy1lAXwPvyZww7dAO79wqnzTvbfmFed RKJynIDZJf8MClA5YezOy4iibGr/ZVtsZKDevnKrX0qYiC9QCaxt/1j5Q6fcwnj5aMKD BCZ5nO+Be4cFtl4/i8w2zjQdClqnLryiIE9ZUwDMB+PHjwmBEuMr7WvE60nD9zGzjQhS 67JTwJm+dTyWG5874HSk8sQK48JLYiH37Heti6+fiGX5ryUCDG/kpI3WWK7kgWCgd/Qh yund+4pJ0hF9bQUYAMqqBuE31iSyVN3NXFj/wj9DRbsihQ5y4CnLBnXOvrVJeJex9H8P F4Ig== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:in-reply-to:from:references :to:content-language:subject:user-agent:date:message-id :dkim-signature; bh=xGvq0N9BFwkmlGUnQnbxkC/ZPDXW6cuWWJiAsfYIuYw=; fh=qYjLjom2XYK2EGXTfM32+e6Y5m6bxV+vwmPCS15rMNY=; b=s06AcCz5fxexP2PoMwF89bhSqFKZ5fcqEZVAo1UAFUMxWhuQxpf8bTQDvCXlauvmHk nSaDKwIniABjvpejWAiYRHlLrlR22MPWeEEQ1EhDTlY7XaR/gDFYa6aqPUswqnNshxLS x7cOn6idNU3mTGuWwN5Le3slgDgbGX78w4096bXDdy1MJXLVmFuYBiQ8iU2HMZH3U9Ig k+X+OZ77twchOqEiopj7YiIb9jCuSoVlh0z4vE5DKRZMkm9V8N3HP3Ipn3IpC46qodVR D8mw9qJ7lwldjoXnGAqVLKB0TkAJ3yI6JIyCeckkbSKGPi3ewB5cPLjBrmBhwuu89wU6 7Hnw== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b="ZZXBO6M/"; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f400:fe0d::621 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Return-Path: Received: from EUR04-HE1-obe.outbound.protection.outlook.com (mail-he1eur04on0621.outbound.protection.outlook.com. [2a01:111:f400:fe0d::621]) by gmr-mx.google.com with ESMTPS id f22-20020a17090a639600b00290036f0633si25586pjj.1.2024.01.17.22.59.44 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Wed, 17 Jan 2024 22:59:44 -0800 (PST) Received-SPF: pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f400:fe0d::621 as permitted sender) client-ip=2a01:111:f400:fe0d::621; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b="ZZXBO6M/"; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f400:fe0d::621 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=QOzXE3/SprDlEA3AuiWTj8ZFreQARG2CQdOSf9OppUS5eu7mLEDnEyq6XAJMdzdltTBw18XRfq9qefiRvQgaznEg22pDuZOie3NkUWpO8UCyvx7qo/TJlZX1s0nknLVHjFA8CgphgN+CceflTjv5rhoEo2eH2TXgdJZBQhUrDqaI01EhfApUWaX3y0XRNEOnu8trJR5HKPsxLLDuQexFHyEYwScF1NXx5+9jQqH6X1WoB9xoxiR71+Orjzs8ndIjW5AzKzX/m5e5z4MXXLIyFcPvfX6Eve1zsxukrps7i1SEKFY6Go3RiNRrZbkRTo0OtflyLyKKbfuOskvPdvXvyw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=xGvq0N9BFwkmlGUnQnbxkC/ZPDXW6cuWWJiAsfYIuYw=; b=b2Hpym/usq6PusY1kWZt7XeCvY14AkLHFWlw1xpZXaaBovKP4Nvj1Gtbajrzef6gLLlg2lRfdSJwc2BK9nZ+72fr5aTmaV4TEJQ+O6gmOCRmIUHbRJzkgBaXRyGQh2FWEE8Vq1hBP4qOz0EJH/sDERI9vfpmCq96jJYhAnbgAz7gSYBorO2RKK5uqI0bkInlo8JMMlwTJfjeZcd7zeRxPBJXQW46XAg/fNyCv4mgwTvyuLDtwvTcMXSXp1WIYBx6DGV4nEUCsvr3c205VjbFkJ6HU3hLwJoH13w7hoEig6Bh/vI69owiRjhrkPbwD6NZFOHR0QLEp21XR+gyn5jxSA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=xGvq0N9BFwkmlGUnQnbxkC/ZPDXW6cuWWJiAsfYIuYw=; b=ZZXBO6M/tS8ZZP1rWshmEQD7BmOUZL7i/ktniIJoA8FOTjLfEyQ8gDsnOw/WBbu5oXPKLo5U8E94jkPj95FcEQ3+cCsbZkGKeKmjSLo5A60mSIGenxG2qo+A0xYsbMJ+geHJ94OQBIm48YSmHO8hEiZKPhIsIrjuUfhivdIhaxeJq1pun3bvv5+7nRLlOryrSyuNpUCTtKmMjhXgVSD42vwp1W6Ad7oIhBXXdTrPfpbYNlF/m5gEKflYYkrRci/MtWAAG7egfjYkVDNFmQNNCiS4RwQBlCocvfx8LDKTD38M0Ek1DtgQAxr3OhbHXX2KR+i2M7hMUn801Tr4JRZ+og== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=siemens.com; Received: from AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:588::19) by DB4PR10MB6288.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:380::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7202.24; Thu, 18 Jan 2024 06:59:42 +0000 Received: from AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM ([fe80::8d16:7fbb:4964:94fe]) by AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM ([fe80::8d16:7fbb:4964:94fe%3]) with mapi id 15.20.7202.024; Thu, 18 Jan 2024 06:59:41 +0000 Message-ID: Date: Thu, 18 Jan 2024 07:59:39 +0100 User-Agent: Mozilla Thunderbird Subject: Re: [PATCH v5] dpkg: Restore support for replacing pre-installed packages in sbuild-chroot Content-Language: en-US To: Uladzimir Bely , isar-users References: <028f69ac16ec3769875a03d6ec5d062271e3752c.camel@ilbers.de> From: Jan Kiszka In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit X-ClientProxiedBy: FR4P281CA0228.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:e9::9) To AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:588::19) Return-Path: jan.kiszka@siemens.com MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: AS4PR10MB6181:EE_|DB4PR10MB6288:EE_ X-MS-Office365-Filtering-Correlation-Id: d829d84c-1659-4700-ce06-08dc17f30b7f X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 25nsCN2gmhYykNj2uvtMiFPmRCwtjzBSS7RPDziFKaBSZncah2C+LV3UXcJ7p88w9GtLg2cXbDvxz2dd/HuBp2uywYfN3iYRIOlWodGNIAiBxcH+Q8eb63vzBViEusS7GEQIcStsNXsEGUr865X02rdEGnXNiuZUWSOxNK1gpkXe2oEH9wIi/vx/JfWyxjrj/njg3/qgwv6NAgdC3B16BMWFhOOrF+quyM9lGxVAuJgN9CXGmrMbh/LO0AXbeclbeq4ntfdzFzfJ3WzzkLSsWFVXR3Qkz0FEFSSuEix3cuPtG+M54uZoifP5kJUCVmtch5JDijLFtW5wPJxtBl9OuZXf2rhGDS+fVbB0SjwsdvsF2lQxaGJJ9dB86D0T27zMV/MjS28zPTh03v7DHLxOlgCERR9FCfCHyTQA07IfpM8mc0OSOlXnaKBfIIQjAUVyvqwYCvC66aIXdPlRAMOTlaWtkp1ohSacopYX6+LIbmfXi8/40/FLTERGdTKg3LLuympE0axjrNjEXhlLJ8TMcfyGfOOJpqCv6ZnCOzRG32RGxEkl7IAEvkpWzRH2VgjJaEKYFtBqTqD/+gN6evDgqrCkrE9QGEdV5IBOoWVLi4VY96xx4GEGvhelpV6EmEVKc0pYhG0fI2ZHkwvYPCApmvEX+TJtaTsxCcfK2O0th5bcAya5wuwQ2qWs+yLVsr4V X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230031)(136003)(396003)(376002)(366004)(39860400002)(346002)(230273577357003)(230922051799003)(230173577357003)(451199024)(1800799012)(186009)(64100799003)(8936002)(8676002)(53546011)(6506007)(41300700001)(26005)(36756003)(5660300002)(2616005)(38100700002)(2906002)(31696002)(86362001)(83380400001)(82960400001)(6512007)(44832011)(66476007)(316002)(6486002)(66556008)(66946007)(110136005)(478600001)(31686004)(43740500002)(45980500001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?ZllBVHIzeTVCMS9oWE8xeVg3eWlheGp0aG54dStYTnV5ZUltczhwcnBFN1lP?= =?utf-8?B?MjMvS1Bmc0ZycTVHdDlFZktvdGFHSGJvS0hINHlzZW9Pek50aWprdGZIWitn?= =?utf-8?B?TThEbTlyMnlNZ1BCNGxrRGdzSHhKQithVjRuN1l4dEhkc2JEQitJVlA1cUti?= =?utf-8?B?THR0RGMyWnJzcXZIUVFMTzVwV2I5Qk1Zc1Nha2R3NU9kSmFydXBETFdOTkdt?= =?utf-8?B?eVduY0YvVDFteGZtOU9pcGsxZnY4NE9RUjlGN2FTbDM2LzlLbWJoWndEbEhH?= =?utf-8?B?VTBtTW84VHNnUENReFpDczFsR0FJUy8vNFo1WnpyYTkxcVBMekt6Y1lXNmJG?= =?utf-8?B?UjNJWStmK2wvZjBzUFJOSFJ0TDNmbzR3Yzczd0I0VmxRVE1aZlRpaTJxckZK?= =?utf-8?B?L2k1MlV2aHFhSDVtVUltaXlOMFpJbkZtVGw3OVRzMjd4RjFGOS9SMXNGUUk3?= =?utf-8?B?Z01VY2J0aFI5V3R1SVlpM3ZsVDI0UTY4VmZabVlVODhVcW1pV05uSUhHamxE?= =?utf-8?B?M0hJNm92TDlYdzNXUUhTOHVybVZ2U0Y3WW81Z1BzdzZuQ2t2YkNaWklmemVs?= =?utf-8?B?ek9EVzhkTnhKa1VhckRWTWVSU1hQejVSUEJaMFlIaU5CR3p5V0dHdk9CdWh5?= =?utf-8?B?UXY5T1NyWTlNUHNINmVLV0Z0NFVqcUQwN2FiNHErM0tFZ3hmQUNCajUwdHcz?= =?utf-8?B?ZGdWOFdpeFJ6ZDg5YW9qUlBST3FHTWVaRGZ5NmEyaWZrWTZ2WE5ZNjkvS2ZO?= =?utf-8?B?TzZDcnFWbDh0aTM2b2lkSSt1NU53L3kwUENZZ3ZzZ3llZEE2VkZPdVFaVnBL?= =?utf-8?B?YTNrZ1FJVStvTHVwenU1dFZrSUtYY01nKzlMS1h3SzZtTjZmdUt1NkRVVmpG?= =?utf-8?B?anRhTXFpTkIybkwreU1VTHp5d0xYZEc4Y2pyeTVoVm9Pc2dyeWNFUmpCeHlZ?= =?utf-8?B?QlJPS2d3bWpzb0J6ajZLSEVOSlRnZW5aTTNDWDNwUDR0K05mdWF3K3RkVGpK?= =?utf-8?B?S2ltQWFKNnp4MUNBcnhWWVFVZTA0dFNBQ21pRStoc2hzb2hEM0ZNMkh2dDY4?= =?utf-8?B?bFhtWGZ1UlI5cHJwdDVPYjFBSXlZS0JIZUQ3TVYyMERwekg2ZXIrelhaN2xB?= =?utf-8?B?TWRoTnRFV0ZKeXR5V1ZXR2JzUG1DdTdvMi80SWxSWkZaYkZ6NklCRmhFRWww?= =?utf-8?B?di8zaEd1c2FiSEtXdFZEeTRYVksrdE5CdU1CVmRJSi8vbjVpVUFEZGJ0S3Ji?= =?utf-8?B?aDRyeWxrZW9OeS80TldXRlNuYnBWeldjZ3g2NlphYW9pVlhLa2UwcmdMSy9w?= =?utf-8?B?TWNQaWI2N3VHZEJTVHR0Y2dYQmNIOEJIWkV0dit1RjljRGoySkl0OEFKQUNq?= =?utf-8?B?b1l6L2Vxa3pTK2NlUlhTdE1IR2JlRVluNU1EZFo4OVBxWW0rRkFOVGZ6cU13?= =?utf-8?B?MUNLOXBvdjVvMkZoeHowWm0xTXRZenhaTXIvcjJQMXdjZGd4R3ZmUFFXUnh1?= =?utf-8?B?a0ZIclBCeG1GbjY1bWVhMmFINUFIZmdJcWZoeUJTQWswVUJ3YlE4cC90V1NL?= =?utf-8?B?dCsxNmFIWlRHYmxTQWs1cUROZnYvVzlwZmNVQVo1UWlZcTlSWXNmei91NkxE?= =?utf-8?B?cnl1QitjMU01SWx0WFBjQjZYaUl2TVIyaHpFbzNrdmpjSFpXaGxEb2xiRzB1?= =?utf-8?B?WkdQMHMzeHh3WUsyVGc1U1VMWnczaGxDY1dzVENXOStTWXg1YnhMV0kwaUY5?= =?utf-8?B?cmVyYnhWWXh3U3ZmNjNPLzRWYTE3aFloWXRzemhCRXM5WVl1NEswUC8wTTE4?= =?utf-8?B?cVVnM1hzYUp3N0diSW8wOXVqVjRRamxFaFZrL2p1L0tsQ1VFNnQvKzNTNHpD?= =?utf-8?B?d2NCTU9SYk1jOWdlU29BMUJ3YXppWXVXV0h6eXNWbk5UNEk5dmJKZzdlN3E4?= =?utf-8?B?S2lidWE4bXA4dGszODVhN3JSTDdUalQyZXpPc2dkY2FjQnBnNjEweTN1b1p2?= =?utf-8?B?NS8zMDdyemhkbFBJWVJZejF0eTl4c0NuMmkyN3JLQVBvU1JqWGhrSEVPY05m?= =?utf-8?B?TFJHb3JYR3dpUGk5Z1gxWGs0bkM3aysxU0VvTEpGVFFQUHhndG5jRyt3VVJV?= =?utf-8?B?cFhlcG9zZTFlbm5QYi9uQnBtSGU5a2wxOS9NMkNBVkhUcTJScTM1elRoK3F1?= =?utf-8?B?OFE9PQ==?= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: d829d84c-1659-4700-ce06-08dc17f30b7f X-MS-Exchange-CrossTenant-AuthSource: AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 18 Jan 2024 06:59:41.8065 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: RT908JPfBZigmpgpO47ZLCprVcB+6DddsJxdRpXRgyYbAFTxIz6rrtvV0iKr9EkiWt/F77NCOo/0VnOW7jWyTQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB4PR10MB6288 X-TUID: gtLh5sQYGkZQ On 18.01.24 07:34, Uladzimir Bely wrote: > On Thu, 2024-01-18 at 09:28 +0300, Uladzimir Bely wrote: >> On Tue, 2024-01-16 at 09:22 +0100, Jan Kiszka wrote: >>> From: Jan Kiszka >>> >>> During the migration to sbuild, support for using self-built >>> packages >>> in >>> the build environment was lost if those were already part of the >>> sbuild-chroot. This restores it by adding --apt-distupgrade to the >>> sbuild call. But that is not enough because sbuild will only >>> upgrade >>> packages from already configured sources, not those specified via >>> --extra-repository. We therefore have to switch back to configuring >>> isar-apt during sbuild-chroot creation. >>> >>> As rootfs_configure_isar_apt configures the isar repo under >>> /isar-apt, we bind-mount the one in /home/builder/${PN} to that >>> folder. >>> Another difference is that we now need to run apt-get update >>> explicitly, >>> but only for isar-apt. >>> >>> And because the sbuild-chroots are now left behind with isar-apt >>> configured, the configuration in imager_run can be removed (credits >>> to >>> Srinuvasan Arjunan). >>> >>> Signed-off-by: Jan Kiszka >>> --- >>> >>> Changes in v5: >>>  - also use dpkg_schroot_create_configs for apt_fetch and >>> apt_unpack >>>    (while I wasn't able to reproduce the issue, I think this should >>>    resolve the CI problems) >>> >> >> Unfortunately, the picture in full CI didn't change. Even worse, one >> more job (NoCrossTest.test_nocross has failed with the similar error. >> >> tmp/work/debian-bullseye-amd64/hello/1.0- >> r0/temp/log.do_apt_unpack.1785250: >> ``` >> DEBUG: Executing shell function do_apt_unpack >> cp: cannot stat '/downloads/deb-src/debian-bullseye/hello/hello_2.10- >> 2+isar.debian.tar.xz': No such file or directory >> cp: cannot stat '/downloads/deb-src/debian-bullseye/hello/hello_2.10- >> 2+isar.dsc': No such file or directory >> ``` >> >> I'm continuing debugging the issue. >> > > Just one addition: previously (in v4) builds were failing in > hello:apt_fetch, not they fail in hello:apt_unpack. > Logs? The pattern above looks rather different from the previous issue. > Also, now repro tests failed earlier - during base_apt:do_cache. E.g: > > tmp_repro_signed/work/debian-bullseye-arm64/base-apt/1.0- > r0/temp/log.do_cache.2901916: > > ``` > ... > Exporting indices... > Error opening '/build/isar_ub_devel/359/downloads/deb-src/debian- > bullseye/hello/hello_2.10-2+isar.dsc': No such file or directory > There have been errors! > WARNING: exit code 254 from a shell command. > DEBUG: Python function do_cache finished > ``` > How can this be reproduced locally in kas? That would be essential in order to debug. Jan -- Siemens AG, Technology Linux Expert Center