From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7200999274326261760 X-Received: by 2002:a17:90b:1650:b0:22b:e754:fe0 with SMTP id il16-20020a17090b165000b0022be7540fe0mr1255772pjb.58.1676618202034; Thu, 16 Feb 2023 23:16:42 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a17:90b:895:b0:236:6df7:76b0 with SMTP id bj21-20020a17090b089500b002366df776b0ls1337387pjb.2.-pod-canary-gmail; Thu, 16 Feb 2023 23:16:41 -0800 (PST) X-Google-Smtp-Source: AK7set+F25ks6Sm/3rjCqCV4adj29Qia200qbnABdrGJDMaoTpP60F0QovHO2xX6Xitr063FU28D X-Received: by 2002:a05:6a20:6d9e:b0:c7:2c0e:b1e6 with SMTP id gl30-20020a056a206d9e00b000c72c0eb1e6mr3924690pzb.15.1676618201081; Thu, 16 Feb 2023 23:16:41 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1676618201; cv=pass; d=google.com; s=arc-20160816; b=zW9cvzybtgpd/lsrCSlKDWqsRY9tSRRbQVhvRR33+DYDABkshq14IUqfpvYJI4VqQJ CC/oOXd+TkHvCC2QQijKHxwOk7p9i19S4dnVyF6DHo9pCbDIWhQW1Ahqc9M4kccoSQnj 9fq8Pn/xmBcQ3o52xIkZRqaxCQTUuEDcZUbkMdgv+7bY65qD5El2kDKGWtweWUCrf3Fc dU+CQaw79tsEDJGM1Fg10jDFE3GuT+wGzbYW1arVqqz0gfMtiunvXIy9hQIjVQNV38TO OaTJuROfGGjCwWNME+fX60U02RA9dht6sJMwQsaXq417GDld7/ELCpAwlUWytdW/VesD 0n/g== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:in-reply-to:from:references :to:content-language:subject:user-agent:date:message-id :dkim-signature; bh=1X83TFELKyWWibwOoYUxrHu9lfWVpv+xwNA1QrWhBro=; b=kZvup2KgoQS/8Dd+LX8k5NpsgMCeqR32eWUtq0WI/DwX04VcDBdOW0otCxd1Mkz+8/ J1UcQJABvhBM6PnlkoMNMd4e+X3GsyYmtnDLPeSdDoNFAlK6PiOsHZ0bmaFjd5czCHz4 vaLi31XETmXQgp2wlAJljSZkpGEryRbBjtEdh6Q/C1t0mhUBGk+cC+kg1PXYKV/aFoBF pVnblNeOGuycIb9s0Wvl2Pm4j6r4n5Vk/3jpClmd/EZrpBqq2kZopAdstrOfrH2DEdn6 y/ZVnrQT0m8bE+zBpzfBMFsQCeIndHerkgwwWucVfPcFxkT+YnX0lBhNySpYGUANxaXJ cz3w== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b="Fg/kK+yF"; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f400:fe16::60d as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR02-VI1-obe.outbound.protection.outlook.com (mail-vi1eur02on2060d.outbound.protection.outlook.com. [2a01:111:f400:fe16::60d]) by gmr-mx.google.com with ESMTPS id q34-20020a631f62000000b004fb931e5f18si178307pgm.0.2023.02.16.23.16.40 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Thu, 16 Feb 2023 23:16:41 -0800 (PST) Received-SPF: pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f400:fe16::60d as permitted sender) client-ip=2a01:111:f400:fe16::60d; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b="Fg/kK+yF"; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f400:fe16::60d as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=nJXhy09XuTQSFRW4ySllqUdDCkmdKv+zzk50Q6l8JxGXaFNOoK8JO0fgdRgQ2pxhfCre7GzsIlNrowQVDwHuQzL3EkctZZwuRzj0iFTrAx3tSaiMAhYuALU5OaEaCWoLjhURYELz+k32sGFaMofRGhFavQd70ZkdBiJdvS/ywTdQrRWwkUx4vD7WKLgQkXAyJvbZF22Wivb+YLAFDglDW3yNsRq8kVkuqR2vA2Do0waaFsVYoYqU9RDFrkEEUw+Ng3nb0v4pDIGki+J8Sp9l9gMuNj8vBji8MxfzslBsiUQwW6MsGc1qw2++mkyAl5Y3NqMFzk/Qkf42nEczbElq8g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=1X83TFELKyWWibwOoYUxrHu9lfWVpv+xwNA1QrWhBro=; b=Aa/tGT/k0NLv8bJ6zEIODhjHOHC2yC3p86JdKcudo4rFzGMgVwtwdICa74PrMMfV47v2ZgAAEVQxl4fYsPQuCf8zTgeAz0TpjBOqnvrcvNPfZUNRdLIWHJLrB96Z+miNfA5X/6ywFP6DkDi4JXvTyV6/KMXg3XFNJWp4XwW4mR42f5vBiHGNfMlM3n0rlchzp9uWMncQfskOfEs0MUbhM6L8g5PqM8JP9Umig3QrQ6vnhkPqYeeDwApcuffAgcQOSaufte6pnRkd06F9pZ6FUDSHGmk1F1uHwgZQ6vVMfD1Hsim16BwrGAXZgnuJoPiEehHWbfKfpXiEVLJ+dl4COA== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=1X83TFELKyWWibwOoYUxrHu9lfWVpv+xwNA1QrWhBro=; b=Fg/kK+yF1mdh03kIdwpt7qI+47owqLcwtqp1tvd1Fj7JR02JOK8L4k0CritBIU6vVkFEz4pdO2bSwCasRTtsEYn25uytT24eZiMgoAu9oIKGwa2PtgxT2q5C9gDHt5mg1XAub2dCg50FZQK6BT54RWlzEf35Wc705feGowZVUiDt0qVSvbz5lIvfDTTrZTrZT9TJfXTU3u4YpIkWkvC6hcCgxN431m4ss/yMo3HNahkQbfYPgndagh2ur+St2BMKTOFiF92gEok7dfJ0ZiJg8G71TdTeKy1DRpcXpj+oH52xWYVe2vSXTLzVFrUc1pJDCEEkOagjYHONlIXdskG4UQ== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=siemens.com; Received: from AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:588::19) by AM9PR10MB4086.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:1f5::19) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.6111.13; Fri, 17 Feb 2023 07:16:36 +0000 Received: from AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM ([fe80::784b:e95b:b855:dcc5]) by AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM ([fe80::784b:e95b:b855:dcc5%9]) with mapi id 15.20.6086.026; Fri, 17 Feb 2023 07:16:36 +0000 Message-ID: Date: Fri, 17 Feb 2023 08:16:33 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.7.1 Subject: Re: Issues creating images with custom initramfs Content-Language: en-US To: "Moessbauer, Felix (T CED INW-CN)" , "isar-users@googlegroups.com" , "Gylstorff, Quirin (T CED SES-DE)" , "Schild, Henning (T CED SES-DE)" References: From: Jan Kiszka In-Reply-To: Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-ClientProxiedBy: DU2PR04CA0042.eurprd04.prod.outlook.com (2603:10a6:10:234::17) To AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:588::19) Return-Path: jan.kiszka@siemens.com MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: AS4PR10MB6181:EE_|AM9PR10MB4086:EE_ X-MS-Office365-Filtering-Correlation-Id: d7a2e01c-999a-488f-9758-08db10b6e7f5 X-LD-Processed: 38ae3bcd-9579-4fd4-adda-b42e1495d55a,ExtAddr X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: 4Gzp57lxB83GmEhcqhMqfl+Sr37jP9SVZup9xt6W8dwGi4Yuneu65BZg3M1nN98WEXu2gMAqDpDzC4PLNA7xBUPYuUSVZ3MFKZWiPmW0JO92xr8aXo4FoN1/fONAslAl7npAkXNNB610C0LXFmDNgQLfAKeuCgFJMV26ZLSWv2lm+riqCraD+oFPMyH57MDrghNE6cSJ5Jc4pM9aqw18g4PYVKY2Jbg4fddTQtdc9E0/V2Uxevvp6peaiYZlt8cqfmlxzLymq0tNCxF572ZI7d0Dj2HYCGz9CvjiIeiPpJDLAKCiKXDApebAvCrgKUGvWjVrff/zDmJ9P0mtCqnPXg8uwT0wBE2+f4udlZzpv8fpRK3fTQzGPyuQrmqwOLplwJ7pthmD/rl47b/F/M7RkN/m8R8hfCR64dZephPuAmyP2R647KK6u8ixmRTs5W/Ci1kNaj0Qpj8RlH0M3GwHWi24PSIFOaE5SNNyz07tJ4B3UyhvCePXcCqouXEU0QPBEYIUX62ScSjPpf2C1O/fVzZ+VH6B4nmg098/mNrOlpxvFlM5PMVCg6FCfldXVBMlpHa7zl9YkP3dpB8F8xgqu0lGS1T43vxCrf71PNbrnu0Ydzh2H+WEiDK+5JfJ4ZbMWLya1TXXJEb5nWgWGAiTSQuRfrBOgTRtM8GcnH304xUUDFJTCEIhvpjVTjhfbxy5guj/Bes1GUm1Bz7WmgRAeDrh7vXESbpuB29wtTmwlOU= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230025)(4636009)(39860400002)(136003)(396003)(376002)(366004)(346002)(451199018)(31686004)(36756003)(66556008)(8936002)(66946007)(8676002)(66476007)(2906002)(44832011)(5660300002)(82960400001)(38100700002)(31696002)(86362001)(6666004)(41300700001)(478600001)(6486002)(110136005)(6636002)(316002)(83380400001)(6506007)(2616005)(26005)(6512007)(186003)(53546011)(45980500001)(43740500002);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?ZEllMGRvY1VHUFFjOTNIb2ZEaDBoVm8rTnlCMlk5Rkk4WVd6M3creGZVby9a?= =?utf-8?B?bzZIYy9OTytVblVYUEJicFBMd0VVNkhlSVZiTDVaSWNMbDQ0ZVFyR0lLcUlI?= =?utf-8?B?VXJrM0hlVlRkMEdWT0J5bDZtUUYvbGY5Y0htNmlnTHpDVklEZHcwNXpHMEpL?= =?utf-8?B?UXNIWW9YUWF1Wm51dWdXSENhSWJKd1FzRnVFd0V6blZBMElsK1FHSHFqcFZD?= =?utf-8?B?L3c1dHpRc3c2WUlPa3B5N25JRTdub0hiNGxMMkNsY0s4NmhoN1hHQ05kbEJk?= =?utf-8?B?clREYnowbDNQZkdjQ3Fjck1JRmlZWE11RldQTENibWVnRVlrUlRFaDBzeFJH?= =?utf-8?B?bkY5UG9zbTREclh5c2Z1MWRzM0FMdUZocllXMXBkQjlnN1lXVlRBa2VERXVk?= =?utf-8?B?ZXVxYkFOcEduL0R1NzA5bUFZVG5yTk5MaHdITGkxK3JGM1g5eW8xTE1KVzNk?= =?utf-8?B?bDk2SWZtSURKNnhQbTZlN3hwOTVjSFhKWTJmNzNrN3JaZ2JKS3ZOdjNvOTl5?= =?utf-8?B?Wk8yR1AxUll1TDRia3ExVkhqRjZ3TWpsY0pLa1RQOHdwTm94ZEdxc0d1dUE0?= =?utf-8?B?QzNVVmpubE1SUXRKZzFVbTgvMVVBbXRJeE9CZ3dJcCtTMlFzTzlZYmU0Wlpy?= =?utf-8?B?blFjME5PbkVGMHMxTkh1QjhJNUZ4TEtqTjlKbitTbERYOWJEVkwrMzRjNXhl?= =?utf-8?B?RmdudGppam9taHMrM2pOb3REYThqQ3NudGRSdS9KSFVsd0o3bitUc2ZnbTRz?= =?utf-8?B?RTlQbDRrZ1hRUG1OQVFwWk1pOHZjNGVJTHR0TUE3OWVSS0F4dFdpMVdCY1BB?= =?utf-8?B?TjZUTEZnMXl3d3EwZHg5OW5FSi9heFEwWDRRdVNNaUpxcERvVGlCTFZNY0s1?= =?utf-8?B?MUVaeC9KQ2RNRllOTjJaUlV6OWtKbE5yV05JaE5jdTFTNFVMWU1FWkZNYXFG?= =?utf-8?B?VUw2eExjQzRGNWYweHpSMnRYNU9zekNTN3g1aEJlVm1uR24rYk9VdFk3NXd1?= =?utf-8?B?WkJyWGFKbU9DV0MwMjZQRjNPTjNWOXZzNHNBSHdsa0xpQW0wazBDVkw5dCsr?= =?utf-8?B?SlBUSnlZcVpSR0IwNUUrZHVTWFJMSWpRekpBUHc1Z0JZekJtNGUwbWFWY3Vq?= =?utf-8?B?VWRKZFlOZ2U0bnlGT044azJSeGVYS2Eyc2Fqa20vYmE3QjVNaTVVTEdNcUdo?= =?utf-8?B?T21QYklubEE3SEh2N3poTEdNMUFRMUY4R2NGSU0rQkdQeWdtTTlDOTRENi9p?= =?utf-8?B?bm5nK3pRTEFyaGdrMUpvUE1Id3dJUmVtYWZ5eGFrdXAxeVI5c1VLcGgxaTNm?= =?utf-8?B?b0xkQzBKM3hlOFpYQmUyREVFaWIweDV2TmVRSk11b2xXNHJoN2FiWEFNR0FR?= =?utf-8?B?ZjNYaDhaRDhra3pOVG9PRWFOOUlkL1pUR1BXYm9jR1ZaNFVnMlo2dytCTVVV?= =?utf-8?B?RWhiWXFxdmlHYW41ckRmQXJhUHNDbHZLTnFSUXYzTVU2VmJ1VTFGOFJPdjZO?= =?utf-8?B?TWZHcldwY2JUdFUzS2wzaGYxUHliZHZFTzBaY2RZYjg3VzlGbWs1SmlqamtL?= =?utf-8?B?RVpRNWE4dnFCUlRibUV6T0lkZGxmWWZ4UGhFME5WeGtuRWNqVVBnNGIwSHJJ?= =?utf-8?B?M1VKVFprMm5wRGZHYTRpUUtFczVwSnUrQ3RoQ1lBQ2ZJc25kSnNHWWxnWG1W?= =?utf-8?B?c0QzdXVkcTMybUM4djhVaHlCNUJIa2NUb1hGcmJObnUyUjlsTWMrVDJJQjI1?= =?utf-8?B?YWY4VU5IRy9DSC9ENVREcjZCbHVEOWRYbW9HUzVvSWh4enNaSEVNZjVPdXl6?= =?utf-8?B?Sy9uRmg0VVpLeG95ekVxUGlUd21vOWoxV3ZmNGpkQzVGSlpJY0w2Wm84c1N5?= =?utf-8?B?M1Qvb0ZERmNsK1JOUDdsSmUyK2oxeHlNdERiZlFFeFZxVDZYbThoWHk2M2Ni?= =?utf-8?B?MXpUUGdMcEllbDFOeGwydkt0UHdCeUVBREVyYS9wUVhOQjZFMytmeDR0NDZ1?= =?utf-8?B?RFUxbDVhWmQ2bHVBVU1VeTZWQ2lhNnpCQ2lHV2ltYVJqWlM3amo2Znd1bnoy?= =?utf-8?B?Smk0N2VIZkN3WmIvQnN4dGh4MWdWZkx2eHdYS0hmbTYwS0dmQVp0ZnZnMnEr?= =?utf-8?B?OEV1bFNEWTBBV0kvS2FrOFhNVGJOK212UzVvYW5CK1JRMEpPWEozZmlSc2Vn?= =?utf-8?B?YVE9PQ==?= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: d7a2e01c-999a-488f-9758-08db10b6e7f5 X-MS-Exchange-CrossTenant-AuthSource: AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 17 Feb 2023 07:16:36.5874 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: Us3ROwa/oMDqIS/d9/3r4PnhJKzMz7LCO0RmsUfW6gkloBbqdiMMQPvkWsw76FnxXGp6+Y47Js+B/paIkR3hwA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM9PR10MB4086 X-TUID: uh14stMeUr59 On 17.02.23 06:54, Moessbauer, Felix (T CED INW-CN) wrote: > Dear ISAR devs, > > yesterday I observed an issue in an image with a custom initramfs (on > current next, using systemd-boot). > The image should mount a squashfs as rootfs and for that the squashfs > module is required in the initrd (for stock Debian kernels). > > The problem is, that the module is never included in the initrd that > ends up in the final image (but with the efibootguard WIC plugin it is > sometimes!! included). > > A very minimal reproducer is (using the squashfs hook from isar-cip- > core): > > my-image.bb > inherit image > INITRAMFS_RECIPE = "my-initramfs" > INITRD_IMAGE = "${INITRAMFS_RECIPE}-${DISTRO}-${MACHINE}.initrd.img" > do_image_wic[depends] += "${INITRAMFS_RECIPE}:do_build" > > my-initramfs.bb > inherit initramfs > > INITRAMFS_INSTALL += " \ > initramfs-squashfs-hook \ > " > > What I debugged so far: > > Initial build: > > lsinitramfs /my-initramfs-debian-bullseye-siemens- > ipc427e.initrd.img | grep squashfs : shows squashfs module path > > Loop mount of /boot partition > lsinitramfs /mnt/loop1/initrd.img-5.10.0-21-amd64 | grep squashfs: > squashfs module is sometimes missing > > bitbake -c cleansstate my-image > bitbake -c build my-image > > lsinitramfs /my-initramfs-debian-bullseye-siemens- > ipc427e.initrd.img | grep squashfs : squashfs module is missing > > Loop mount of /boot partition > lsinitramfs /mnt/loop1/initrd.img-5.10.0-21-amd64 | grep squashfs: > squashfs module is missing > > Especially the non-determinism in the initramfs in the deploy dir > somehow indicates a race-condition. Another thing I don't understand is > how that should work at all. If I read the code correctly, > do_copy_boot_files copies the stock initrd from the rootfs recipe into > the deploy dir and potentially overwrites the existing initrd there. > But which version of the initrd does WIC read? The one from the rootfs > or the one in the deploy dir? There is INITRD_IMAGE describing the target initramfs filename in DEPLOY_DIR_IMAGE. An initramfs recipe should generally depend on the rootfs to be ready, thus also do_copy_boot_files was already run by then. That task pulled the initramfs from the rootfs, and the initramfs recipe will later on simply overwrite that. wic plugins will therefore use the overwritten version. But you should be able to visualize this dependency graph to confirm this or prove it to be wrong for the case that showed undeterministic behavior. Jan -- Siemens AG, Technology Competence Center Embedded Linux