From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7071655505424285696 X-Received: by 2002:a2e:b994:0:b0:247:e5d4:a1e8 with SMTP id p20-20020a2eb994000000b00247e5d4a1e8mr2185807ljp.474.1646646399371; Mon, 07 Mar 2022 01:46:39 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:6512:1693:b0:448:3742:2320 with SMTP id bu19-20020a056512169300b0044837422320ls100552lfb.1.gmail; Mon, 07 Mar 2022 01:46:38 -0800 (PST) X-Google-Smtp-Source: ABdhPJy24eR7nAVbqRCXFmhNgDiRrgZhhyeamKornG3SCI001Cns2+FNRa4BcDNxjvp66WbnTShD X-Received: by 2002:ac2:434c:0:b0:445:bfb1:c37a with SMTP id o12-20020ac2434c000000b00445bfb1c37amr7185314lfl.657.1646646398288; Mon, 07 Mar 2022 01:46:38 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1646646398; cv=pass; d=google.com; s=arc-20160816; b=anjlxl3JKdl7P9ktETJhcfa6P2p0ukCYeVjJBCpd0mTGngAWhuEKc/MEn99GaRzN25 Hdbur6BPcZP/DsHJKZNzDqpP0bPqfac2Y6FAamqFN8oRIUeEgh0LcIhdfQn6NNplmXDt F62iv+YtHrcx/mCuYON7vGSJiG/6TJwWPeyl0aM2K+XeFHLltSfcPP72gzPdmjsTU7Id IUFzgwCArkkHjdEBN7Lf3q2EXZu/LRjNoOuAhVwWzfS+ExBP3H4JfDPO0MldfjpAA7ne yGpg7gkcMHGrZ29uH3ubJ3+0RNyhUsjqcPBNlEM2weDx9YBqVM59wjrMTpHOIwk7Rkhv /Qvw== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:in-reply-to:from:references:cc:to :content-language:subject:user-agent:mime-version:date:message-id :dkim-signature; bh=tVCEvo0h5BkcNqkOT722cbxXWF5PylhKDvRy06GxvLc=; b=EBIa6/m0168Lb1EIzL3GDryPgQX6eKkNrY/077hYaOsV0zCIFFdvY53Jypa+hUbAs6 QsweR6QdQjxRj0IKw2wHTXgOo4fMvTMnvikracNYWKUO6lm727jklAno5+RY1ZrTzMVv 7T/+iiBoxs8w+3uLsSh8XMy0u58dvEKCAYONlKQq1e3IVoTQO2CxeGvfnwxQXNbqgzIk hJI5ZV9vb7NOgndHFCdjeMo7fBZuNWNvlXQcYjNGDDRDm5Sn8+uqGIeQTV0hnXbulTnq Maby1fe0nJFFrc/qKmBNUbtOfpcaqqh57AK8k1zrsBkNp1sT+L9nATd3yLjwkboWUi1a PlxQ== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b="cMDF/9Ud"; arc=pass (i=1 spf=pass spfdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f400:fe07::627 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR02-AM5-obe.outbound.protection.outlook.com (mail-am5eur02on0627.outbound.protection.outlook.com. [2a01:111:f400:fe07::627]) by gmr-mx.google.com with ESMTPS id b19-20020a05651c099300b00247e331d3c1si149333ljq.5.2022.03.07.01.46.37 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 07 Mar 2022 01:46:38 -0800 (PST) Received-SPF: pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f400:fe07::627 as permitted sender) client-ip=2a01:111:f400:fe07::627; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b="cMDF/9Ud"; arc=pass (i=1 spf=pass spfdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 2a01:111:f400:fe07::627 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=L81B0oi5Lcx3pnFLziNtodI7J/UYbDlMIBCzEicrr8xwqypSdVkXpffmfM0aMUVYrmU5gz2s/L3xsILwWmmu8h6HhVgxJfQwLFRevqPN9Rme6Gb7SVKVBt/N0s1wvnj0reB8h2E3NkSXS8xd70N6NFiI4RFb0wGlo8hW2nJQaS9DC6DWHGE/1XOmODQCd0SHLPQIx0qrqUcoxlFZw30ihL+5OW29bSDcUrfHrpOGQWivM1wC9Z3fVI88FEA4SqGH2HZp/19lfAQrWvzVZFmPr9M9zsGohnB8aKjAFpIrxEdW+o94OilFNK6/SfUTQJYeaUua0wIduvCPGf47XxlbrQ== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=tVCEvo0h5BkcNqkOT722cbxXWF5PylhKDvRy06GxvLc=; b=VPABBSkUMphbT88jT7E85FudmVR94O5leENjr1KDVoxFDtw9bT9rLcDRpC2+qjtX+UMIT6zr8QRga0sdFCJMztxDAJJKuhCL3Pd3SaBEGCqKWw94EvGnWupU5B9YM7mjLUJCwjqLcaw00hMHdHkA9b+yFic38idNwrUw5F0YT4zqlW7VRfE/AZA866u7vDutIZ1Y0A5Rhxi+DP9GR95CAzR3DqclYGK3Yuleu7QIzWSlQP0Xt5MD2+GBgxxvq/jGDbavJrRnfYKrYgVvesR0qv/YtathtoeLWgIAOlgrbimjTA4oGq/FCQkYyi1i3QdH43HF7OGm+1RJOt1rBoKKrQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass (sender ip is 194.138.21.70) smtp.rcpttodomain=googlegroups.com smtp.mailfrom=siemens.com; dmarc=pass (p=none sp=none pct=100) action=none header.from=siemens.com; dkim=none (message not signed); arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=tVCEvo0h5BkcNqkOT722cbxXWF5PylhKDvRy06GxvLc=; b=cMDF/9UdxM31TyQYgs30GQuvYxvyz32HgIoZasjnesvQY6ERveLjU//45B+O/mv7Ct4TzC/Mkh70MEt+dV7K6Nd4+jyp0NgAUvSUU6uusYtSKPh/hLUb0yONiTBvQCljnPx36FJjsRbmRaY9Z7mX232a/j2Mj27t8dw5dCWtjM0ZevAKLvx8OQFhkWY9ZqmSkos+OIWGJiXwOTy0khKT+Bmus0cK6iO9D7d0jd+4B6nfvKWjT7wZ6Bgr3/a12eCkk+CGmhGnppB9gUdUXFo2ULbgQKm+aiv8my2aUjj4TMqrlKp4MubaxY/bKsad0qaXkHoDxSIqGmEZ5uSQAeOaZw== Received: from OL1P279CA0022.NORP279.PROD.OUTLOOK.COM (2603:10a6:e10:13::9) by DB8PR10MB2777.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:10:a3::33) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5038.14; Mon, 7 Mar 2022 09:46:36 +0000 Received: from HE1EUR01FT021.eop-EUR01.prod.protection.outlook.com (2603:10a6:e10:13:cafe::58) by OL1P279CA0022.outlook.office365.com (2603:10a6:e10:13::9) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5038.15 via Frontend Transport; Mon, 7 Mar 2022 09:46:36 +0000 X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 194.138.21.70) smtp.mailfrom=siemens.com; dkim=none (message not signed) header.d=none;dmarc=pass action=none header.from=siemens.com; Received-SPF: Pass (protection.outlook.com: domain of siemens.com designates 194.138.21.70 as permitted sender) receiver=protection.outlook.com; client-ip=194.138.21.70; helo=hybrid.siemens.com; Received: from hybrid.siemens.com (194.138.21.70) by HE1EUR01FT021.mail.protection.outlook.com (10.152.0.167) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.20.5038.14 via Frontend Transport; Mon, 7 Mar 2022 09:46:36 +0000 Received: from DEMCHDC8A0A.ad011.siemens.net (139.25.226.106) by DEMCHDC9SJA.ad011.siemens.net (194.138.21.70) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.18; Mon, 7 Mar 2022 10:46:35 +0100 Received: from [167.87.0.7] (167.87.0.7) by DEMCHDC8A0A.ad011.siemens.net (139.25.226.106) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2375.18; Mon, 7 Mar 2022 10:46:35 +0100 Message-ID: Date: Mon, 7 Mar 2022 10:46:34 +0100 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:91.0) Gecko/20100101 Thunderbird/91.6.1 Subject: Re: [PATCH 3/3] vm-img: Handle sparse files efficiently Content-Language: en-US To: Henning Schild CC: isar-users References: <20220307100403.3ac04025@md1za8fc.ad001.siemens.net> From: Jan Kiszka In-Reply-To: <20220307100403.3ac04025@md1za8fc.ad001.siemens.net> Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: 7bit Return-Path: jan.kiszka@siemens.com X-Originating-IP: [167.87.0.7] X-ClientProxiedBy: DEMCHDC89YA.ad011.siemens.net (139.25.226.104) To DEMCHDC8A0A.ad011.siemens.net (139.25.226.106) X-EOPAttributedMessage: 0 X-MS-PublicTrafficType: Email X-MS-Office365-Filtering-Correlation-Id: e48d4954-c079-4af3-a2cd-08da001f5ef3 X-MS-TrafficTypeDiagnostic: DB8PR10MB2777:EE_ X-Microsoft-Antispam-PRVS: X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: lD323+Po7hjA9AiEEWnmTu0/Gm5C/y9s2BCko1EewsG170+NBnudfoGtfwbsumk31Uoli1QClQaBz9R6024mxF/ii2zgvLxgC2GqWgRZ19Fxq0psfvks1ZjJ5HiyK4mY1hPHl5nGzHRFSy3Zz5oCkgAGVX7QM5ncW992YivvT2F66iZZGRwBxSwPy1dGP7UYo+9ru4XWeCgFxzLh4ZdCusty4FtcHR0DyofiPB4/+VL79Z36rzkyNyudmJptPjeWFH48SHnDx8ZgH17Xu8Xj8wYtoEh7KWERugpSYxcurW5Fxal9onnGfTdEGxKDGDBPrvO1ctVBWb+zW8qsCNIUsrivzP5tzbBrc2aZZ9p1OTuuNojkAJa5s1DlLz91ZLWzJwfj6X7pcZwwVqZpUyvcJ/a4X7hzstztwP6SkdecMAe14iE8rHYqlrHnp1f3xlKkI1ZrRx7zzFjVl2WmI/+MOGwyE/UIOweqnnqw+BSa3BRzXqhP2jInorYt8iknK8fzjn2NGhMfiQnbpgR0jNxu4cbJGWP6MYHqfs5vjq1SfH5hONi8EHPdF3EeHBYQ0ndbgR29bD/mX1wIMXpI7gtvFSDDjDw/TStxUSJjR/uyD23VLOqhthHlC3c1kMJfJ1xEEvJ+VzzuRrtBjIgkpcvFZBQg3osNJ3MxEAs21WkOycHSoN8GRca8rKkkQaFfnUynB2Wh9kMQGtERpQgGfklWqsbNV31fnfl3+ZVcmFQIT9s= X-Forefront-Antispam-Report: CIP:194.138.21.70;CTRY:DE;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:hybrid.siemens.com;PTR:hybrid.siemens.com;CAT:NONE;SFS:(13230001)(4636009)(40470700004)(46966006)(36840700001)(186003)(36860700001)(37006003)(16526019)(44832011)(6636002)(6706004)(2906002)(31686004)(26005)(16576012)(316002)(40460700003)(7636003)(7596003)(82310400004)(53546011)(356005)(82960400001)(336012)(47076005)(8936002)(70586007)(956004)(2616005)(83380400001)(86362001)(36756003)(4326008)(6862004)(8676002)(5660300002)(70206006)(31696002)(508600001)(3940600001)(43740500002);DIR:OUT;SFP:1101; X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-OriginalArrivalTime: 07 Mar 2022 09:46:36.2576 (UTC) X-MS-Exchange-CrossTenant-Network-Message-Id: e48d4954-c079-4af3-a2cd-08da001f5ef3 X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=38ae3bcd-9579-4fd4-adda-b42e1495d55a;Ip=[194.138.21.70];Helo=[hybrid.siemens.com] X-MS-Exchange-CrossTenant-AuthSource: HE1EUR01FT021.eop-EUR01.prod.protection.outlook.com X-MS-Exchange-CrossTenant-AuthAs: Anonymous X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem X-MS-Exchange-Transport-CrossTenantHeadersStamped: DB8PR10MB2777 X-TUID: R9uNqgPMVnlQ On 07.03.22 10:04, Henning Schild wrote: > Am Sat, 5 Mar 2022 17:34:50 +0100 > schrieb Jan Kiszka : > >> From: Jan Kiszka >> >> Saves space in case the image contains any sparse files. >> >> Signed-off-by: Jan Kiszka >> --- >> meta/classes/vm-img.bbclass | 6 +++--- >> 1 file changed, 3 insertions(+), 3 deletions(-) >> >> diff --git a/meta/classes/vm-img.bbclass b/meta/classes/vm-img.bbclass >> index 4bc977b9..27aedf12 100644 >> --- a/meta/classes/vm-img.bbclass >> +++ b/meta/classes/vm-img.bbclass >> @@ -93,15 +93,15 @@ do_create_ova() { >> export VM_UUID=$(uuidgen) >> # create ovf >> cat ${PP_WORK}/${OVF_TEMPLATE_STAGE2} | envsubst > >> ${PP_DEPLOY}/${OVA_NAME}.ovf >> - tar -cvf ${PP_DEPLOY}/${OVA_NAME}.ova -C ${PP_DEPLOY} >> ${OVA_NAME}.ovf >> + tar -cvSf ${PP_DEPLOY}/${OVA_NAME}.ova -C ${PP_DEPLOY} >> ${OVA_NAME}.ovf >> # VirtualBox needs here a manifest file. VMware does accept >> that format. if [ "${VMDK_SUBFORMAT}" = "monolithicSparse" ]; then > > Not sure that already suggested it but we did not do it. > >> echo >> "SHA${OVA_SHA_ALG}(${VIRTUAL_MACHINE_IMAGE_FILE})=$(sha${OVA_SHA_ALG}sum >> ${PP_DEPLOY}/${VIRTUAL_MACHINE_IMAGE_FILE} | cut -d' ' -f1)" >> >> ${PP_DEPLOY}/${OVA_NAME}.mf echo >> "SHA${OVA_SHA_ALG}(${OVA_NAME}.ovf)=$(sha${OVA_SHA_ALG}sum >> ${PP_DEPLOY}/${OVA_NAME}.ovf | cut -d' ' -f1)" >> >> ${PP_DEPLOY}/${OVA_NAME}.mf >> - tar -uvf ${PP_DEPLOY}/${OVA_NAME}.ova -C ${PP_DEPLOY} >> ${OVA_NAME}.mf >> + tar -uvSf ${PP_DEPLOY}/${OVA_NAME}.ova -C ${PP_DEPLOY} >> ${OVA_NAME}.mf fi >> - tar -uvf ${PP_DEPLOY}/${OVA_NAME}.ova -C ${PP_DEPLOY} >> ${VIRTUAL_MACHINE_IMAGE_FILE} >> + tar -uvSf ${PP_DEPLOY}/${OVA_NAME}.ova -C ${PP_DEPLOY} >> ${VIRTUAL_MACHINE_IMAGE_FILE} EOSUDO > > Did you get around to testing this on vmware and vbox? Do you think it > would need to be tested? I could to that. > That would be valuable. Just add a sparse file to the image (dd if=/dev/zero of=sparse.file bs=1G seek=1 count=0) and check if that bloats the files. And, of course, check if things still boot. Thanks, Jan -- Siemens AG, Technology Competence Center Embedded Linux