From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7156869355346591744 X-Received: by 2002:adf:df8b:0:b0:230:5212:d364 with SMTP id z11-20020adfdf8b000000b002305212d364mr11211475wrl.124.1666344976590; Fri, 21 Oct 2022 02:36:16 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a5d:6f04:0:b0:22e:5d8a:c92d with SMTP id ay4-20020a5d6f04000000b0022e5d8ac92dls1403106wrb.1.-pod-prod-gmail; Fri, 21 Oct 2022 02:36:15 -0700 (PDT) X-Google-Smtp-Source: AMsMyM5Soh3S1ITZ9nQ1qTJtaBvBOkaREydFjMxpwynDrdKaO2Pp87eO/QjQfVvzfwiHL9XfUNPR X-Received: by 2002:adf:f345:0:b0:22e:3c6a:7797 with SMTP id e5-20020adff345000000b0022e3c6a7797mr11558267wrp.374.1666344975201; Fri, 21 Oct 2022 02:36:15 -0700 (PDT) ARC-Seal: i=2; a=rsa-sha256; t=1666344975; cv=pass; d=google.com; s=arc-20160816; b=OM2VqUIawSxId4LHuylWL7VIY2siROtXsqOqQKdFIZZA9swsXs84G/qjZaI8DwX7SO Bw08yMMHaHUz6IbYR23ugENYsAXOgToIu1GNYBdX3nassaMRarurVb+kU+VBRBslI0mU MVNt/1y3RHbI9lcBikK8NBJHxwguQoYngplJHR9MokM0CDgHwLTdxCYbdvbtVeDqtT9P g9+NygwGjzeW5WVu5+JTvQWkUjtdCag1DFbgEeBcqtgW8zu+aMxfQ4mTm+Y6jRE4iGj8 RX8SMHYd84Wunrl9qJyv0E+FDyLKRDtwmF+q73S5+uMWC1NNWKu9M823/T2oNRkSdnCb ZGow== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:in-reply-to:from:references :to:content-language:subject:user-agent:date:message-id :dkim-signature; bh=9Esvmg72EXHLNeBAKwBGUAsSa/G21LUJf8tFjeA/pFM=; b=Kbp5cGuJOk/n6CIwLWr4pE8I49krWjRIT295iwY/ujWJTfRnvGgNdZua1+fpI58uW5 Lrzzt3tQxonWNAOiKvAmq2RCvKawFSGurp3qwMGqXkwJPqGD/C3Ebcxc/8NoCMsc3dVy HFlWx8YxTCDDprhK93UpY81mgAw7nOe4Mw5XEGItrpyZnNoODfXlGR/5lHKBsZc8qFhd 1cyVZwCVO9Zlxp3RyltvyoQyqW3dG0qj383bmApRAoZp/oWcvFLhdYsXLUaPxATBiGGl Kez1j5M5h+HIXRAMLeXkkgAydpPAC52wFs8zjzmB5rS7QnbcdRK7NG8lkh/dLk9ReLQP ihtQ== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=I0ueQxVW; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of raphael.lisicki@siemens.com designates 40.107.20.63 as permitted sender) smtp.mailfrom=raphael.lisicki@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR05-DB8-obe.outbound.protection.outlook.com (mail-db8eur05on2063.outbound.protection.outlook.com. [40.107.20.63]) by gmr-mx.google.com with ESMTPS id b4-20020a05600003c400b0022e3df50e0bsi739322wrg.2.2022.10.21.02.36.15 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Fri, 21 Oct 2022 02:36:15 -0700 (PDT) Received-SPF: pass (google.com: domain of raphael.lisicki@siemens.com designates 40.107.20.63 as permitted sender) client-ip=40.107.20.63; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=I0ueQxVW; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of raphael.lisicki@siemens.com designates 40.107.20.63 as permitted sender) smtp.mailfrom=raphael.lisicki@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=UGSIjUQfDo3fddNHEHb3OkLSDtKfzWQwjx3mfATLE6HJurH5w3f2/Nc5KJmE+JwFWHDREZw4U1cZrLki3zB5Lwx5d4scxsB1VTrXmINhYdTFvoP8M5GwQNauZ+UknjZ551gGYgMBtqwyzVzpdgBD+SvZcaIyLJ+0rnebXAnfJLSLQF4EAeTMnyi2g6blvEvsIT953sMIOv9iyytBrQCVNhY5VdSrAQqv7G3Jr6wUeNM/QMTai8lU7JhkX6ISiMvmSkx6jhliMuht8V2Q5qp5o6Fw7yp9PpaJ6z6CGbrMTG28u9Yu+IOvvqoJU+zDFQPIEFSmZrkiQcs7h6FQF8Rdyg== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=9Esvmg72EXHLNeBAKwBGUAsSa/G21LUJf8tFjeA/pFM=; b=S8emkcHjVTIVJN3qykgMKGQcfGObelyzvxC78cUMJ6a4x+ljO04N4gR+muO2mkSo5FtAocYdsZRKMpa3Nkt81RtZpZucQwImyV6sLAq4jLly6VsYB6zF5Oc92EOXHwaNu/IrVhh32TR5wDyj+CCR0MlKHrOLKE+5T4Ozie+/hSwKrs1MkmT2fdkxv2iYa8RJ1ToxrvqY3TiUEy7VtTcV60Xvb2cjigoAlCOmjsV6zW6NPtmmKIB6e1c6D3paLc1f/0fd8UkddJvh2501pcqSJwWWI9UXjgwNarrVQ3DsFxWF8VS4rpp2LVcpEyKKS02DZD73HcZIu7JgiMqE+M142A== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=9Esvmg72EXHLNeBAKwBGUAsSa/G21LUJf8tFjeA/pFM=; b=I0ueQxVWMNAtQrHrFSpomrDk40EXGL0dskicHeNBZRUKqIvZQm7qMY5ss2dYtPGxwQVZbEvJSmRJiYPBSt/MI1ytS3mhFEp686R7a/rE2iKrAQeICsB0KxL+5hYnPN1tDTbteIIrRnwUIsyNgbqL3vEkurJeLrNohR2wLWTAT91e5MZDTtLHBoInOn3w1Im75LlH1GJNOuG0Oe+KjgWpHWNsGbBynHs9qzUHaityC493Qn6OCuTmqes9hdt6cnYWfvBlEuvSufLBYvPYC7s/yvlFbgpneRpQVhcyJ38nX5wUPALO3hEENqpuS2NtyuSR1JVkfOhqdOHcfQQFXjhYTg== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=siemens.com; Received: from AS2PR10MB6685.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:55c::6) by GV1PR10MB6242.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:150:92::5) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5723.34; Fri, 21 Oct 2022 09:36:13 +0000 Received: from AS2PR10MB6685.EURPRD10.PROD.OUTLOOK.COM ([fe80::91b8:e5ba:a609:78e9]) by AS2PR10MB6685.EURPRD10.PROD.OUTLOOK.COM ([fe80::91b8:e5ba:a609:78e9%9]) with mapi id 15.20.5723.033; Fri, 21 Oct 2022 09:36:13 +0000 Message-ID: <06b9570d-b711-f325-f915-9f3612b0d6dd@siemens.com> Date: Fri, 21 Oct 2022 11:36:11 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.2.2 Subject: Re: expand-on-first-boot and surprising umounts Content-Language: de-DE, en-US To: "Bezdeka, Florian (T CED SES-DE)" , "isar-users@googlegroups.com" References: <6f036245bbe00d69fc3492a1ffbf91a862c2951c.camel@siemens.com> From: Raphael Lisicki In-Reply-To: <6f036245bbe00d69fc3492a1ffbf91a862c2951c.camel@siemens.com> Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-ClientProxiedBy: BE1P281CA0052.DEUP281.PROD.OUTLOOK.COM (2603:10a6:b10:23::6) To AS2PR10MB6685.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:55c::6) Return-Path: raphael.lisicki@siemens.com MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: AS2PR10MB6685:EE_|GV1PR10MB6242:EE_ X-MS-Office365-Filtering-Correlation-Id: 9e81c9a1-ede5-4724-c247-08dab347b1b9 X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: PVjQ+Sh8Kb1C2MNEpS7OOF3TQdZEu/QLr5czbOHVYS40DcJD8He5l5iQQdwR6DFgd6loi1iSIElzin6f9NGuvP0ZFaPY2k6PFbDWP0qu+oLiN0i8lhJbtVBC27/Caaoql+I7VO8J3iopyfcklDDbVj8n+LwSkSEqLmC5vo97rZXcaSfjd9yRuw1i9y/dCTLHlWhf/bghRlHWRQYDJIcScalTcNPU3GFj0jC36bH7nhWWRKiv+tXJ4zx6ANJiLlMxxSNx14F+Q12XCEBO3Ku9AXoY5jOeD/IFTsahAKVoAp2f26Ky/PZola7sHSMS2gmpvN80rQrw/vCu8bpo3gsyURzw8pSXGTRk4dZ3A5L1XF/pEQRJx7NLcOTtH4OVSZg5V7LtFbl/64nyY7P64wsuwDJjMf47GzugXZp5iN8uQI8puU/dgHCmt88Fxfvo8Dzh6qntrgZ6pO1S99brDkn30ocPgrMxcvBrZ5xy6kAM6roL4fFGMr7+XjFidhZ9oxO7QYA3RRGrzNwlWwTT5w3ABNGqWuC6lb6wW0Ni7P+qna+gLF25mFoA3G/rg07ChBsCwkAHH2h77d7JlCiAKhMqD9wdBIIOuW7i17q2yLtmJkaAQjeqPEfWTtnctoBX/jwWmfruvVujhF8RW8JiDUM0nJpQC/DGYtfJ/SjipvEF1qbhooBQZjp8/YkACy1jO+LvbZk2t3aUByExk3rv3pYx4xhzt3GSy4kC6xnBfMywA2yozmi5+IDIIyN919CQa9mAXyQxczKLRZNwoyJnVp4lMOEEE4zaQTjHXIWyH1r74cs= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AS2PR10MB6685.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230022)(4636009)(39860400002)(396003)(136003)(376002)(346002)(366004)(451199015)(2906002)(44832011)(66476007)(8676002)(31696002)(41300700001)(5660300002)(38100700002)(66556008)(6512007)(86362001)(4001150100001)(82960400001)(6506007)(26005)(83380400001)(53546011)(110136005)(6486002)(8936002)(186003)(478600001)(2616005)(66946007)(316002)(36756003)(31686004)(43740500002)(45980500001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?d2JpYUFad0hDWGV1OFd4TUgxYklLSm8wSHlVM1ozcFFCOGRTTW02Kzkvemlh?= =?utf-8?B?OU9MamZ4TU1jaElQYnlyRDdINmRzYWpKclN2dTIxSnRFSFhCMUFGMzVqaXdU?= =?utf-8?B?SmhySHlPbjF5SGE3Q012d20vWmxsMUorTjdWYjhDQVpmNXhYRC9UTVI5OUg2?= =?utf-8?B?c1BuN2lZTDg2TmgraEhqNm9MSWRlQ09IZ1Bqb2g4VC9LcUtqSG1WVkJvcTdS?= =?utf-8?B?Y2FrNGZnVFhaL3RxaE54SW53Szl2cG9rN3lQZ3FCMC9GTlZlOWFiRWhwYlFq?= =?utf-8?B?OEQ3Sm5UbmNmMjFhYkFQeGViTEw3Mm84OUhYNzJVb3NFM001QXcwZ3g5bllL?= =?utf-8?B?dldaK0VUOWUvWXcweDFpRXhSb2FGVWpKSDg2emIyME1EcEphRlN3UldoNWN0?= =?utf-8?B?MXNBWVFwd3o3WFdISUppR1JNQ21KVjk1OFRIQldhVkRPejlkcmJEMUdPV3RY?= =?utf-8?B?VnVGK3ViMlRvK0EwcFA0RDRJckpnVlFwQ3dkU0lVTERvbzArT0x5UU5rQXpv?= =?utf-8?B?ckxBcjl4SWNmeXV2UEhQVUMzbWhHakVTVEcyLzQ5NjJ1bzl3SWlQWmx0Vnpq?= =?utf-8?B?SjcraXM1VjZhNVZjeVJqL0EzMWlGTW5HMTJHb2UzOFBPWkhpTFNLcGlNcUwr?= =?utf-8?B?eHFlcFZNbENVdjdSYmRhTmtVL1diUFJtUXRnZEJ6ZzhSejdWa0UrVnRmMEll?= =?utf-8?B?aDhUSGRnSGpMNlpXWVh4d3RvNGxCaGRjRklaZzRTYmZQNjVzT25URmZTMDVk?= =?utf-8?B?VEVUWm1CZXhqeWx3eXFWdldCWkZobW1FeVExQWJnVHUxS1BzOWlpUjN1RU9I?= =?utf-8?B?UWdTMHROalRUWkE5dFBkSWpQVEtiaC9UV29XeFRaYkN2QnNSWHBRNjI2OTVP?= =?utf-8?B?dWZ4S0ppS3FSSUdybkFsbFNia2J1QXY3SW01YUg2OHEzWWp0dHFHb0JKY1JU?= =?utf-8?B?ZS8yZC9XUkN3UXp6WkRoMTgvR25yNzBKVk5memlHZ2FtejFqd0txS3RNN010?= =?utf-8?B?S204NlV0NW1pWHNoaDF4SHhtK2cyNDZDMjR2NVdPZE42Ry9VTTJVUFhFUnM4?= =?utf-8?B?OWlYcnpmNWpGYkJyVVVKalJYc2hRTEJUVUZlaUFha1lBRkdsOEZnMGNWNWFD?= =?utf-8?B?Z1BPQmVGaVNDS0pUSkFMQXlLNUJkbmZpQm9GWGlDZ0pYcjVNa01tRTR2ODB3?= =?utf-8?B?MXV1c3QvN3cxcGkrckFQWTlUMk1HVG9IQ0poNDdaRGlQV0hiR3VMeTJGbHV3?= =?utf-8?B?NVQ1QjFFRyt1Q1N6T3luVUJudUpSVEpucVQzNzJoVEpoc0UzNFpMME9qa3hE?= =?utf-8?B?aFpWNDBOZm90VERudk04cks1M29ncnVwc2lHSlpIR3Rsa2FoM0JiQlNxUEV5?= =?utf-8?B?Q09CU1A2SU50d2s0WlFMWkkrVlFCZ2kyYk9wblZPVHUyRGlkRGoybm1vYVh3?= =?utf-8?B?VXVxcDQxZ0FOY3ErQ3NSTHpsbythck1MRFBQbnQ3TWNNT1NIRU91L0tOMjZT?= =?utf-8?B?Z01TelJZUWY0YlBHSGZkT2cyM1dPL0NwMlplQktRYXk5R1VpK0djUkxvanR0?= =?utf-8?B?d2hjblNDdGhlL3picFdkelJpSyswOXhxYVNZM1UxUXR3cXBtT0RUNWlma2E5?= =?utf-8?B?c2ptblVDbTdVbGphaG10Y3dydTk1Q0FVc01tUnhpUXZWcDJRR3AvRHdHOEV2?= =?utf-8?B?TmI3RlZSNzZ2K1MwL3JyWkhSaUw1VEN3MTUxUVJZeXhSd1BGSmpZNGJhWFFs?= =?utf-8?B?MEc5WU9wdERCNFRLL2Y4UDlORkFtMFZvV3NSOUI1K3R0NlBxanJBclBLTDlz?= =?utf-8?B?NUZWVTFzcVIwdnRTOUhJZnl3UmY5dWFJbisvajgwZlFMR29IU2NsWERZMmpu?= =?utf-8?B?Y2lLNm9ONlR0MFk0VXg4Q2dGY1hNc3lzd09nQlY3QnE3ZTR3VUdBalFzK0o0?= =?utf-8?B?Lzg3THFTMjFNNm01eVdSbWhOM2ZqQmo4R1RwaHZzSFlMeWxkTnhQcGtPdExN?= =?utf-8?B?MjNUS1hmVUttQSt3bUpyUVo3ZkZMRWNoOTZEVCtrS1V0OWdJbmdxdmVYK2JH?= =?utf-8?B?M05uUGVJUzh5SmZrSG1tQjYrdHN6bUtuQjZIUElrdFVwb0xyWENnclY4cUV6?= =?utf-8?B?SVRTQ003SGpvTlRDdlVNcm5Fd3FPTFB3NkNQc2xkUGxuUmNzM1B1NEJhaG5r?= =?utf-8?B?bmc9PQ==?= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: 9e81c9a1-ede5-4724-c247-08dab347b1b9 X-MS-Exchange-CrossTenant-AuthSource: AS2PR10MB6685.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 21 Oct 2022 09:36:13.3074 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: aiAUfN911/VPbuoPVtfMHDj0HUP04xU1iK4o/j0mK107IYP1MZUIdYLzANtF1rrFDWnXr6hI/JlOew/enT+U1eV9001Q8ATwW6lbfkw+CxE= X-MS-Exchange-Transport-CrossTenantHeadersStamped: GV1PR10MB6242 X-TUID: pJrSffEDuTN0 On 21.10.22 10:45, Bezdeka, Florian (T CED SES-DE) wrote: > On Fri, 2022-10-21 at 09:48 +0200, Raphael Lisicki wrote: >> Hi everybody, >> >> I am using a debian bullseye based system and use expand-on-first-boot >> to expand the last partition. It is not the root file system but an >> extra ext4 partition to be mounted under /data. The mounting happens >> after expand-on-first boot has succeeded. >> >> Sometimes, on some builds more often than others, /data gets (attempted >> to be) umounted immediately after being mounted and subsequent units >> will fail. > > Hm... Nothing happens on build time. Everything takes place on the > "first" boot (until expand-on-first-boot disables itself). "more often" > is also confusing me because expand-on-first-boot should run exactly > once. Yes, it runs on first boot, but I can use the very same original image multiple times (after restoring it). And I can also try the same with other builds (doing a first boot) and some builds seem to be more often affected than others. My guess from this is that the exact alignment/size/padding/moon phase of some things in the image also plays a role. > >> >> Removing expand-on-first-boot resolves the issue, so does adding >> "ExecStartPost=/usr/bin/udevadm settle" to expand-on-first-boot but I am >> not sure if this is only a sophisticated way of solving a race condition >> with "sleep". >> >> My gut feeling is that after expand-on-first boot finishes, the kernel >> still processes block device events, which systemd gets after /data has >> already been mounted and then cause it to be umounted, as systemd was >> already picky with umounting stuff in the past [1]. Unfortunately I have >> no idea how to test this hypothesis. > > Nothing should be mounted (except the rootfs) until expand-on-first > completed. See below. > >> >> Did anyone already experience something like this? The racy-ness of the >> issue makes creating a minimal reproduction hard. > > Nope, have never seen that, but that doesn't mean that there is no > race. > > We have > > After=systemd-remount-fs.service > Before=local-fs-pre.target shutdown.target > ConditionPathIsReadWrite=/etc > > inside the expand-on-first-boot.service file. > > So we should be done before systemd tries to mount your /data > (according to Before=) and start after systemd did remounting in case > mount options (ro, rw, ...) have to be adjusted. > > I guess you should check your startup order (systemd-analyze might > help) and report back if we missed something. systemd-analyze shows exactly what you described: after expand-on-first-boot has finished, /data gets mounted (and immedeately umounted again). best regards raphael