From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7325169112896765952 X-Received: by 2002:a05:6e02:1285:b0:360:6344:48a0 with SMTP id y5-20020a056e02128500b00360634448a0mr640721ilq.55.1705570998575; Thu, 18 Jan 2024 01:43:18 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6e02:f81:b0:361:98a3:1b11 with SMTP id v1-20020a056e020f8100b0036198a31b11ls690887ilo.2.-pod-prod-06-us; Thu, 18 Jan 2024 01:43:17 -0800 (PST) X-Google-Smtp-Source: AGHT+IEVuAE/ACgofPBlRqXYqicdad65wGOi86oKOd+Gho7krmbphIAMI6sA+bbReRB2YI6vZqj5 X-Received: by 2002:a6b:fa05:0:b0:7bf:525b:3b5d with SMTP id p5-20020a6bfa05000000b007bf525b3b5dmr660780ioh.6.1705570997735; Thu, 18 Jan 2024 01:43:17 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1705570997; cv=pass; d=google.com; s=arc-20160816; b=i3IXnrPnLOJDQMiut3Lx/Bx9ePhGfBkRA9UrgbqFn3kcCX/upZeV10RD+0Zur/feo/ GNdoXVDbJNsMO0c/lJ2gRudQXFSdTh/y0rieHf1DXWJoYa40tV9p+iHnMnjZ+qeCImoW 7PBt9sv99uEIOsJZ+fOlKTLy6E3Kz88ihBsHoA7S2Vsy7Uesv1Eg5JE+udatpdv42cHv MZ27zGFgWeVQtfaEhzEA/RIRZ0PMyQxTUMZxKPTOpN7ZU4S0P5qi6JBjCZlW7HzKsVOS kTe1IlzgT2BrOjItZAy1P90VQyrhZH+CKnE8Dw2t+CgcwiE3Aob/xPrGudFi5jRUensL nUtA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:in-reply-to:from:references :cc:to:content-language:subject:user-agent:date:message-id :dkim-signature; bh=wppTqxp1viOIy9iuGv7Y5zwu1rasWDsW05XlTGjhsAo=; fh=5xtN4Bf3JGt+xqSgjIN+QESmJHC1SFMuN9gksjPcHnk=; b=NHY3QWYcfDmxbtLxHFjTA0lE5tzEGxtf/Vnuwv1jFEOWh8r2kiLD4OmkBnb+JWC4I6 CnPJpJAbRrCXf9P9LsqD0uehSuV0o4FK4unIDMa+zJmElg4v2fxmJZkWztTzv16p5V3f Z7sqq1/gGHiDcTrRTWz1nIW6RUtOmTib8BORJvMwU7+rcLIejjP0u2opDkH9jq+RoOqM aIwx1ylNJwLxpfaGkFguIxgkYUPCwWOWQOQmmylOUiXpoRsz/2h6cvWTIYWiSOEy4e0R SX8PIv88fI3qiZ0tPbnZ9y5FPe4WhksbpEEf/SpkdoNsGewWV7kAlesVoyfO2g8cNndS bx2g== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=P1Nw1c35; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f403:260e::600 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com Return-Path: Received: from EUR03-AM7-obe.outbound.protection.outlook.com (mail-am7eur03on20600.outbound.protection.outlook.com. [2a01:111:f403:260e::600]) by gmr-mx.google.com with ESMTPS id g3-20020a02c543000000b0046e3ec8d7d2si231941jaj.3.2024.01.18.01.43.17 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 18 Jan 2024 01:43:17 -0800 (PST) Received-SPF: pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f403:260e::600 as permitted sender) client-ip=2a01:111:f403:260e::600; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=P1Nw1c35; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f403:260e::600 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=REJECT sp=REJECT dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=cNW6M4f7wEzVfV5tmwCT5sBTPKmWdhCN3p7fTe2bI7yumwW9vDePLAU+CQU3d882Ue+Lb02qcYemAl9XhabGoo4M6PeWTEgSS0+oC7vyEGTkrTluf/oAEsB3olltOi2vZKDkyuE1IoztBc+XihWNcEirLZ2WCKtCUltpbjHkfV90xgZAfBYbRF3bV5Cbqx6voerXOpuzBWv9EbLazIvhLAmtRAi2iIRhERqTSzc5YJJm5RTuLllpvGTKqK2hWFGPIrW0DDUzF3RvI+vh/gMNbT212gUco7ibU1bBTFm+FbWp5xItdQkGTueSMcOtAu8PY5W8zN4mO3IQ8mY46vhRcQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=wppTqxp1viOIy9iuGv7Y5zwu1rasWDsW05XlTGjhsAo=; b=bVg0Z6q5qOU757+wz3rhIMf9qzPRklRB2mBhWVNcVEGnAGtbjT6H6csWoMwJTEVEuDVURIpVLZEI80DEwOPCg+qFzht2+1SpC+dhg3GixsmOoD3U01jb8Pmhrzcm5a2dYq2X08pOQLkmy+AKvWxDEr/amqAj0WU8byrmtbdje9P4E1igZmRPVE9z6KlVCY2czfD6NEfu35Rj3jpqaaEa3XJeOskMYMP2muX73mJMmaMUEzX+OMDIfmDqW5qA6rTe/owHdBJlmc+Cqs67waF38fEFyW3FA/d683BqUL8eEMWWfaevyEPu6Bz3jHPptF2gUFeljPSYRGB+kz3/HG4LXg== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=wppTqxp1viOIy9iuGv7Y5zwu1rasWDsW05XlTGjhsAo=; b=P1Nw1c35MElUJKKw4w5JV/ivRYVePBceyFkd+ZWph2iUxplVkz+Xo+245202oA192VvHxo/3xtYixYOXWrWXbcoHJfZV1+AltCEii/SVO4mhNbC++Sttjri5F8z7+OVq3dIntRYWHJmzMYI0geD67Xwy1NqZVdivs8EGcE0eH744SHb8ZKlRdd0V1UkIwjflUCU760nYcdTML+mzfx9L95Sw7cXOxoAtMcsYHvzsphOOl9zkA4M+aGnFRNMKuXpgMD8NoVjw7ipX8ej9J0ur4HaIq1J+qUe16Lrb3tJvr/Wxs9qLvGpsD7vI8uGkKDUY5MHwTInDd/KajcTlpm6IcA== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=siemens.com; Received: from AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:588::19) by AS4PR10MB6063.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:582::14) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.7202.24; Thu, 18 Jan 2024 09:43:15 +0000 Received: from AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM ([fe80::8d16:7fbb:4964:94fe]) by AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM ([fe80::8d16:7fbb:4964:94fe%3]) with mapi id 15.20.7202.024; Thu, 18 Jan 2024 09:43:14 +0000 Message-ID: Date: Thu, 18 Jan 2024 10:43:09 +0100 User-Agent: Mozilla Thunderbird Subject: Re: custom-kernel headers: scripts are wrong architecture Content-Language: en-US To: "Moessbauer, Felix (T CED OES-DE)" , "isar-users@googlegroups.com" Cc: "Koch, Stefan (DI PA DCP R&D 3)" References: <7904e3a1-226f-48ce-b286-cc009ee5c049@siemens.com> From: Jan Kiszka In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-ClientProxiedBy: FR4P281CA0248.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:f5::14) To AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:588::19) Return-Path: jan.kiszka@siemens.com MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: AS4PR10MB6181:EE_|AS4PR10MB6063:EE_ X-MS-Office365-Filtering-Correlation-Id: de8d0021-d31b-4718-fbc4-08dc1809e452 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: DpHHgDtHFnoEti6T0Ir3AW108XdLMWkoqMY1y9J2KmUUgUESAhQVRFZd/mXjgmQ3QhGAMDwew2/6qZOFC7fDrphAp/GndmMNPcV2zh0HriNIwo8DIed7WU7GJt0di17Th1DYAB8DykyDTa112T79JnWAin/opfjM8dF9DSXA6+KT9t3QsSRxmQ/WFNh6BtoZITD2mshzM6FfHUCA1mu7tdncgbHTU1VIDXjlnn2GaMhm9dpRrQYV2M+KaWhXv15udJAMLsXf38NYMjcfufgVppvbeh2YtCnCuq3HXXA608i09hLAzkK2jMH+AKh8STc11GThKLURU6usIKStbn3QWWVRtM8aKOGmCLdZon32dxGhU7gPFzkO7K0ir+JxPRhDyHGW9RXARZsTVCU5/9lpIViXK355EhuT0BWrnrCBXgQqy/LBl8PsFkZNRt1nZGhD5zPWQ+a1fPu5peKDuDWV03dl/wyS6NmFOD96vyJjfHhAuB7GutvLdP42c+U0INftpNSmCK3+aJMu8TO9alYb6Ckc5v0XEAUZK5m1SVBqbI9wCHgdZsEg1kqQVsLSBq0Ctu4YZjE9sWkbHxpnguGiDWAY7jm/qo0jOFgmM7DwXSZAK0aeXtbQctfIZsQJlrobEMSA8ySl7FzjzxZYxJeQiw== X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230031)(396003)(346002)(376002)(136003)(39860400002)(366004)(230922051799003)(186009)(451199024)(1800799012)(64100799003)(2616005)(107886003)(26005)(83380400001)(6666004)(478600001)(6506007)(53546011)(6512007)(5660300002)(2906002)(4326008)(44832011)(41300700001)(110136005)(6486002)(8676002)(8936002)(66946007)(66556008)(66476007)(316002)(82960400001)(36756003)(31696002)(86362001)(38100700002)(31686004)(45980500001)(43740500002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?WG9RNmpXczA4MHI3L2hqOGxkbUFlK1lpSWM3MHJBTFFNWEZ2azNWaWJmdTFv?= =?utf-8?B?MzVQWUp3L01lMU5UR05LM25KVlBnbnhFcHE2V3hFZ2gydU5zTTF2cFNheno5?= =?utf-8?B?elhrbitJaHZpcmJ3eFVNWlZkZzZXMjVqL3NLeHVWNTAyREdYZDV3Z24rOG01?= =?utf-8?B?MzdOUkJUQys3cE1qS2poUzJ1alA1dnpVbnl0VTNvczVEaVRCUjlrditTcC9k?= =?utf-8?B?cTVhL1NWNWNnUDk4ZGdDRzFKTTFvOWZzSWllRXpUczFaVlNDUEh3bzZRLzha?= =?utf-8?B?QlZheEI2dm5zZEo4eWlRRjRIWmlPYll5MVFoMmlBWkNFdTR2MDVjK0l4a2JO?= =?utf-8?B?L3dqWEk0NEdKWEx1SE9sTldIU3ZZeExMYzcyQVAxYTAvSkpNWEo4WWZRTnZr?= =?utf-8?B?dElzcFhRRDhQdjBWdVhPdVJ0KzQvYzRrS1V5VldBQktJcHl2cXVjNkc1TTVU?= =?utf-8?B?ejgvbVdUeE85SnNBMDh5Z21EazhjdkdoaHkvRVhkZjVnMU42SVBhTEtKR1RL?= =?utf-8?B?NUN5ellheWRKdUczUnBqT0xMenBEUUVid01VVm9EazhyQlJsRFNXQXpvWHZ6?= =?utf-8?B?ZjFZcDJNd1dyMGpwSDJ5SHpiMXcrb0FyaGlNVmNqWFUrSjJlUHVBUy9lR3Q4?= =?utf-8?B?R3BvQzBBUzJlRmZCajJGSU05cEdhYTczTzhXanlpU1I1VzVCSGFsY243N1h0?= =?utf-8?B?b2NFOHhaMTQ0Q2hFSFZzczJicjlwVGxMOCtEM1UwYnJwdHNhdHFETUNHc0RF?= =?utf-8?B?R1pDNGRwb1ZJRk9IVmczRlh1OFJkMmQwREdFUi9FbGoyOWduK09yQjgyZkRr?= =?utf-8?B?ckFJendOdmp6WGJUQUdINTdpWERGclZRZi9uTWxpRTFjejhSeksrT0F0R1Nl?= =?utf-8?B?bjVRWjFkUnRRM2llcTRnOXkrZ04zNnJiUDliK0lMVW51NGZoU01RSGw1Qm96?= =?utf-8?B?QWZ3TG0zNjlLV3VNbUZqbmtWN2dkYmFYVzJoS3ZaQWZvYThhOHNoM0M3MXVu?= =?utf-8?B?My9uZm9yaHlmZElVcmZ0Wm1PSkRyMXBzWUlnUEFZZ3lsY21LRTdJb2NWbC9D?= =?utf-8?B?TU9yU1lBTTYyRFFUcUNxQkNYWlU3QmpnR1Zjb1ZrcEd6dTRPQTJWQko5ZC9y?= =?utf-8?B?VWZpc3RDcG5uVVhZTCtFZXNTcnJ3QUVuSHQzTmJWU2VzaHFmTDk5VE5xU1JM?= =?utf-8?B?ZFQ4bTkyT1o4SFI4L2RLaFg0clBoYkFOTWMwaC9YZ1JxMWE0Vy9HWTBtVlUx?= =?utf-8?B?T3YwbHlCMndlQm9BNFBXZWdWNEtjdGU3cmdKWndoaUxoT3JtUFlnR1V0ZFla?= =?utf-8?B?TnR4RjhrS2M5TFcwNEIzMlBJRHRDcFpDbmxheUJWN0piUXJ0K1dkc0l5VFc0?= =?utf-8?B?OHpWcHFDSGptUUd0emNsNS9wV3FDVFUzamp6bGNzYzA2U29WMFZyTEdGTzJP?= =?utf-8?B?SVNQbHlBZnhTTENWZXJzSHV6NGw2d21oOXpxOWNvRFlmcUVyZnEvVzFrZ1Fn?= =?utf-8?B?MkxYM3NnYUN2ZFh1eFlaQ3hwRFpIQnd4aURNc1Vqb3NYcUFUc1A4ckZ2WURn?= =?utf-8?B?Skp1Nks4b1ZRUnRUanU1aEhBMHRNdlZEaGFFSFIxOXVhZHI1Qi9pdnVDTE9G?= =?utf-8?B?OGhPMEx3M1FCMG44SzVaSjdxNmpzKzZuSmRDNzR6TUdId3czTFZzcFUxelFh?= =?utf-8?B?VUFKNVo2RStzNVRUendBL01MN1BHRlUvTFFINGdEWDN5eHJSMkZYYnc3Vi9B?= =?utf-8?B?ejlNVUNRcEZpc28yVzBEMTh3aXN5dWpmR0haKzhRK210aHhZUlkzemJ0ajFK?= =?utf-8?B?SS9BdXRKUWE0YVN4L1I3VlRNaklwbXFTbmo1RTdPTDNDa1Q0R0Y1NDJwdDhL?= =?utf-8?B?L2ZKYjNpZWN5MTFHdWRhSEpoMXl2eTJqSGdtc0JPSWdGajhNaDZVWEZtelgv?= =?utf-8?B?NG9vMXZPV2NUUmZLTFVPTGV4ZEFhYjRUMTlBb0g3aU5BL2RyanVHb1dnZm13?= =?utf-8?B?SzBUVHV2ZzFyZmpjTWJIeVlKVUJlNWJ3ekNpa1hPVHVHKy9JSFQrQnZQcFhp?= =?utf-8?B?OFpRTEE5d0pLR2VYVUVFOGdxbnZyQXdjMkFwUElzSXMwU2JvMWtJV05nRlNz?= =?utf-8?B?QVhCZnpHQ2NkVzNCU3A0UVBtem5HVU14Y3d3bHYzR3BuN1VDQnpTWWhNd0Vx?= =?utf-8?B?L2c9PQ==?= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: de8d0021-d31b-4718-fbc4-08dc1809e452 X-MS-Exchange-CrossTenant-AuthSource: AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 18 Jan 2024 09:43:14.5000 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: gdkFAAgOwpN28mp3Nx/wbzYhTRPXGo9s5vMUFoK05ohXw2C6ojk/fgZj40YCDXFny8lGwRmYvWuXXhvilAtMAA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS4PR10MB6063 X-TUID: frPog8VFeTmk On 18.01.24 10:41, Moessbauer, Felix (T CED OES-DE) wrote: > On Thu, 2024-01-18 at 08:52 +0100, Jan Kiszka wrote: >> On 17.01.24 21:37, Moessbauer, Felix (T CED OES-DE) wrote: >>> Dear devs, >>> >>> while debugging a broken non-cross kernel module build, I found >>> that >>> there is a more generic issue about our linux-headers- >>> ${KERNEL_NAME} >>> package: It might contain the kernel scripts (ELF binaries) in the >>> wrong architecture. This only happens if the kernel itself is >>> cross- >>> compiled. >>> >>> Let's consider the following example, where we compile for a debian >>> bookworm arm64 target. We further look at the 'fixdeps' script from >>> the >>> kernel tools (required during kmod builds). >>> >>> Example 1 (stock kernel): >>> >>> The script is located in package linux-kbuild-6.1 (dependency of >>> linux- >>> headers-<...>). >>> - file /usr/lib/linux-kbuild-6.1/scripts/basic/fixdep: ELF 64-bit >>> LSB >>> pie executable, ARM aarch64, ... >>> - linux-headers-arm64 : arm64 >>> - linux-kbuild-6.1 : arm64 >>> >>> Example 2 (custom kernel): >>> >>> - file /usr/src/linux-headers-6.1.54-cip6-rt3/scripts/basic/fixdep: >>> ELF >>> 64-bit LSB pie executable, x86-64 >>> - linux-headers-iot2050-rt : arm64 >>> >>> In example 2, the kmod build is obviously broken, as the emulated >>> build >>> will not be able to execute the x64 binary. Also, in an :arm64 >>> package, >>> there must be no foreign architecture binaries. >>> >>> This behavior can also be reproduced, by cross-compiling a target >>> with >>> a custom kernel and disabling the cross-build for a module, using >>> ISAR_CROSS_COMPILE="0" in the module build recipe. >>> >>> It would be great, if someone could have a look there. At a first >>> glance, this issue looks closely related to "linux-custom: Split up >>> binaries from kernel headers to kbuild packages". Maybe Stefan can >>> comment on this as well. >> >> That is exactly what that patch is addressing. Stefan told me >> recently >> that he rebased and refreshed that, and I hope we will see an update >> soon. His aim is also resolving the issue that we currently build the >> header and later on the kbuild package for the builder arch, rather >> than > > I just rebased the v4 of Stefans series and checked it against this > issue: Unfortunately also the new approach with having the scripts in > the kbuild package still contains the scripts in the wrong > architecture: > > linux-kbuild-iot2050-rt-cross : arm64 > file /usr/lib/linux-kbuild-6.1.54-cip6-rt3/scripts/basic/fixdep > /usr/lib/linux-kbuild-6.1.54-cip6-rt3/scripts/basic/fixdep: ELF 64-bit > LSB pie executable, x86-64 > > By that I'm pretty sure, the issue here is independent and actually > arises from how we build the kernel (for building the scripts the wrong > compiler / toolchain is used). > Yes, there is more need than just the cited patch, and it's more complex than just "do X". That's why it wasn't solved yet. At the same time, we had not many use cases where the current behaviour of Isar was a practical problem, and that's why it is like it is for, I don't know, 5 years now. Jan -- Siemens AG, Technology Linux Expert Center