From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7184069459095584768 X-Received: by 2002:a05:600c:805:b0:3d2:1759:e7a8 with SMTP id k5-20020a05600c080500b003d21759e7a8mr2981490wmp.114.1672673583175; Mon, 02 Jan 2023 07:33:03 -0800 (PST) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a05:600c:3d89:b0:3d1:be63:3b63 with SMTP id bi9-20020a05600c3d8900b003d1be633b63ls16020279wmb.1.-pod-canary-gmail; Mon, 02 Jan 2023 07:33:01 -0800 (PST) X-Google-Smtp-Source: AMrXdXtEN+tRWv4tjYVgQngxMajkipmKCnAku/Z8eBBv71sfXAEd2XcichQfsMs03PwSHnfBjLjE X-Received: by 2002:a05:600c:214a:b0:3cf:6910:51d4 with SMTP id v10-20020a05600c214a00b003cf691051d4mr28646102wml.29.1672673581847; Mon, 02 Jan 2023 07:33:01 -0800 (PST) ARC-Seal: i=2; a=rsa-sha256; t=1672673581; cv=pass; d=google.com; s=arc-20160816; b=Kyz3hsq5VIsH3uUiIM74mwUUUzvioy+f5up6eL/WeCJE8fjZlDVs+rH9JALbG2vWJz buSG+X5ZA5q8wUFUZaGGSZTW9nL9TIqQTXXWDtZr4OfszuHRbAqBI9pixjh1bGHmY0Zv kpv+x07VXifTCaFaFZKXgxybXbZlDfjnThzrsKAmiFq+rzIGjKFpZs6gEh0Lkkr7Nxol 7/2NL4g20AwSj8L//N+ygUUdFQk4/HjqY6P7iIOj+lfP9oYz/dy6HKk3DnYWcKmsyUHl 9M2LLNv1vb7Ng912jpX9EGIPgfYUn75coH3Y7R4msWTDK4tvJwW7bur0/Y62fWSJ0kx2 MjtA== ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=mime-version:content-transfer-encoding:in-reply-to:from:references :cc:to:content-language:subject:user-agent:date:message-id :dkim-signature; bh=Wh81waB9Dkqv10B5bB2i0E7msESdtAGtFFMaqBUZRxA=; b=wEGyecVXlbor/wUnBpviTiFFNkuyw0V9unWQT0F0GVWs2QY8lZLQkT3AZibIUbG9T0 9cQAMLhA8NHP0ybJvRBMy+poQJ+9a4nNJilGw+N1onoaMPl/icjr8Dd3oVaH7BWpiLkm 9gSz6rQNqExxPxJKrV+wBXlAOBq4cZPwR/jB+qJgBOOk7UJcf8jDCxjLHZs1u9wZm62R RBd1o3bVlQ5QtaRhui/cyDZZivd8mkgArFfDojZJpkMGOM/C4XGDt3GEVB6Jz4QHHLwF n6po0v1xloVf2Xz/O3zjuPpcPEe7zD4ITBIardiiOJZgSGO8eoG8dHbe/YW7ssIvbDQi DDNQ== ARC-Authentication-Results: i=2; gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=EqbJUt+N; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 40.107.21.77 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from EUR05-VI1-obe.outbound.protection.outlook.com (mail-vi1eur05on2077.outbound.protection.outlook.com. [40.107.21.77]) by gmr-mx.google.com with ESMTPS id v6-20020a7bcb46000000b003d9ae6cfd2esi213277wmj.2.2023.01.02.07.33.01 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Mon, 02 Jan 2023 07:33:01 -0800 (PST) Received-SPF: pass (google.com: domain of jan.kiszka@siemens.com designates 40.107.21.77 as permitted sender) client-ip=40.107.21.77; Authentication-Results: gmr-mx.google.com; dkim=pass header.i=@siemens.com header.s=selector2 header.b=EqbJUt+N; arc=pass (i=1 spf=pass spfdomain=siemens.com dkim=pass dkdomain=siemens.com dmarc=pass fromdomain=siemens.com); spf=pass (google.com: domain of jan.kiszka@siemens.com designates 40.107.21.77 as permitted sender) smtp.mailfrom=jan.kiszka@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=oH3iI+FdQC6Dn0CHfQF6dDgLy6sVFQsu7f1Qr8OpO/su1nzA91AAEs81RVXhuWvcI418DYNAbPB5F8n75gmbGFqhPVG3Dx2vRO+N8PpSH88gEHQSR+oTf/OD5gCOYkFU+6W32wjgYlPH+VlUEQ4vl6iHdUbGN+tc0pONQyojEStHL69I5fQVD0tK9qcHr9/qGDGNZRz6dq1oAJyXOwNA+Zrds/bTQIuMhW866Z56137pNxXnVI7xno3/mollG0G6Am4nkwHGNS6knQTaFmKi6Kv4R1E+rL6eNiiPmPCPhulW0bNabyNqIMq4BnYY+rYl8CLO0bizhEGG/eQIuHoP6w== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=Wh81waB9Dkqv10B5bB2i0E7msESdtAGtFFMaqBUZRxA=; b=IEp80vPNBlEHzXJSjPqdUvDF0vSPW28fHJJRhBBjrE0cGdOB4BEQBWu74RtuX4GQvMoZK+c52a4fFM7uO0SEZpA8JtgfreQkzd2r6upA1eQdrYBT26M6+CMJj6CxZiNNal9T34nMfDrU7d8xHswGtLb0V5Av4WTycpnpBnkpSS8h0T+HrLxDlSuTRFklLJobXL6NLhvCusYf5geAWvGr3I93byhaswGRZRyCC8SBV4CPJmXarzkXhrzeyn05RKf7k3hMaejGcVv5EsYTkqnixQGkhjDiUvB6SVKkkpxRE/P8SO7ywWLXUh7wtwYkXKExRdK3c1O+YcUiwB5Fiu/ldw== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=siemens.com; dmarc=pass action=none header.from=siemens.com; dkim=pass header.d=siemens.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=siemens.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=Wh81waB9Dkqv10B5bB2i0E7msESdtAGtFFMaqBUZRxA=; b=EqbJUt+NP3ZiBNm6VjGb0JrK9/WucjNsqnVaTzjroiDeSbsGRVvJhqoEUX3oodHu51MJody3OPDPH4gSLPQFME1jtoMXgCmGdToGZFTojHM/8PMJJ/IUQIQ6xjlPJR1GscBsIKQ/TLNG+mXpygiObZiivWbeYcpuv9dYOyMdEL6QxmY/WACX5DwNfgmt2RqvZp2ELFFEor3n3W+gaJMBP60WUcYCtG5Dj10e1rTLW4kMXjBlvQK4T/4Kt3k26ok0HadoC1fn2rT1S6xK5nsFbfWR6GyJMDgBXMfl9TFqHX2w87VIQ/TAxFcrh89v4XM92ECIV7MCsjFiGKYSDtm/IQ== Authentication-Results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=siemens.com; Received: from AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:588::19) by AS2PR10MB7395.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:604::15) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.5944.19; Mon, 2 Jan 2023 15:33:00 +0000 Received: from AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM ([fe80::2957:50e8:8ce6:124a]) by AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM ([fe80::2957:50e8:8ce6:124a%9]) with mapi id 15.20.5944.019; Mon, 2 Jan 2023 15:33:00 +0000 Message-ID: Date: Mon, 2 Jan 2023 16:32:55 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.6.1 Subject: Re: [PATCH] image.bbclass: fix non-reproducible file time-stamps inside rootfs image Content-Language: en-US To: venkata.pyla@toshiba-tsip.com, isar-users@googlegroups.com Cc: amikan@ilbers.de, henning.schild@siemens.com, kazuhiro3.hayashi@toshiba.co.jp, dinesh.kumar@toshiba-tsip.com References: <20230102145828.32763-1-venkata.pyla@toshiba-tsip.com> From: Jan Kiszka In-Reply-To: <20230102145828.32763-1-venkata.pyla@toshiba-tsip.com> Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit X-ClientProxiedBy: FR3P281CA0140.DEUP281.PROD.OUTLOOK.COM (2603:10a6:d10:95::12) To AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM (2603:10a6:20b:588::19) Return-Path: jan.kiszka@siemens.com MIME-Version: 1.0 X-MS-PublicTrafficType: Email X-MS-TrafficTypeDiagnostic: AS4PR10MB6181:EE_|AS2PR10MB7395:EE_ X-MS-Office365-Filtering-Correlation-Id: 02fa174b-15c0-444a-61d0-08daecd6a1ba X-MS-Exchange-SenderADCheck: 1 X-MS-Exchange-AntiSpam-Relay: 0 X-Microsoft-Antispam: BCL:0; X-Microsoft-Antispam-Message-Info: xnEfdwXdRcRWLbd3bXFzKKCRlb2ex3JrpxWWcwdLapBhGQ7rUJmPevYRWTGD+fmdqRfrHK8+M/JZo3ppiVKUeURU8/C2Yy0nBLEfCjLFw7nWfRVLQn+9k4GtJS0bNmK8Pwo9CoPUzeBGUyQofdFR6aNHb4Dazkj2aPW9N6cJ6IHj7jGTY+z0PlDf9J59HAxcFIdiVxqfQtruqhzuuk5Z99mQmyVk/KUEGSRBDB6iY43wY9aV7CXZAjWt0OExid9rx6gXE/BvmAXtFG+giYNVnEzQ8IhnQK9YA1/qlUMfy0xsss8Cz3OHm30m0/a1l/geRoyQQwd7EfGK12OTgZpST3eazuMjsWE1ZDP8DGHzuPjh8e0s1yzyN7BfLfwOn2LpY7vxmKU6eHbKB4lQ1msL4d494/U+brrpP6hUPIJC7choa8VWkzpBj07FgbTB0hrog8Y0tjA0gPM5bO0XAfpkdO4v1KkuXwro7EOrAbKKkbEVAIx11287lsjxoPBZGYehT4OajzD1XwtRe8eSBEhKclU820RDE2H/eVJuXLP/x8e1qHkPHhJ29ukR2jT9z9jvjXylW68urpIuTqbD60Se9yJ0QVg2LEBW8KbrN1ITldXek/6so0ae3JPBOZbrO462dPYB13c9jQ6FmoORXuJKRQWhJJDU3pqPhCjsBBb24+vEVrUNqwooM7wKKKqgnmJeDHG0sIdfJ5bbvfc4Y56JvyBBdkr1kIkG4XqHtAnnon/LPDeP3i9eDAJW6Mcp+XxoK0p+Wy08hljSShz+cSxnjNdnMXLwZ3ZDXOyhzpUnz0Q= X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(13230022)(4636009)(366004)(39860400002)(346002)(376002)(396003)(136003)(451199015)(44832011)(31686004)(5660300002)(41300700001)(316002)(2906002)(66946007)(66476007)(4326008)(66556008)(8676002)(8936002)(6486002)(36756003)(478600001)(53546011)(6666004)(6506007)(2616005)(26005)(186003)(6512007)(966005)(83380400001)(82960400001)(31696002)(86362001)(38100700002)(22166006)(43740500002)(45980500001);DIR:OUT;SFP:1101; X-MS-Exchange-AntiSpam-MessageData-ChunkCount: 1 X-MS-Exchange-AntiSpam-MessageData-0: =?utf-8?B?NldNeWRJMjhNUUtSTGZnM2pHVlU3ejVxeVZQT1I2S0kwbFN0U1J6bS9vTXI2?= =?utf-8?B?UU5kNmF0UlRpbkNTc3ZuSlpmbTV1eGhyb0NxZjlTRmk4SWxSb21uajVpWmdq?= =?utf-8?B?OWFLN3pTd3pmRkNqcnhoZjNnK29QTnNoL0d3NEJ4QXBZcjUxWVFVTm1WYm9I?= =?utf-8?B?d1VxT3dSTTdHY005emN4WVBmb2VTNVRncnFzWWlxTk5nREZvdXNNejdlbGc4?= =?utf-8?B?OG5FaHFFSTJYUXJhWnF4VmI4TVRGRE1GRG9QcjJsdEtOVCtMRUYvRGV6Vlpj?= =?utf-8?B?dk5hNkZtbk9oOXgxYVIxaXBNSGg1b1docUZqTzlTdDRsb0h2cFk4b1d4RXpU?= =?utf-8?B?cE4vNThSb09zeWwvSEN6dFc4Ny9HNXBqa3dyeEVnQzZYQ1ZHRHNSOTZYR3Vs?= =?utf-8?B?amErRmhoa3ROa3N2aSsvUEtmQjZGOWVVdHF0YjB4b1loWUY3RTBHN1VwOWpU?= =?utf-8?B?ZUwwZWRXMjFZZTlRcEs5R3NJMlhPZWI5RHlHUk16MlRQUzk2R2JjUlc5WjR6?= =?utf-8?B?WnRCSVo5SWFHZ3JEMUc4VWFXUk1zTkRhdEFleUpFQTBIckxPbGlHZDFtbkVH?= =?utf-8?B?bGtvMEZOMGlaK0hxVVkwZFpxSjlrRUp4b1IyNWdKOXpTU3JIZnMrVXExVHV3?= =?utf-8?B?emtpYnVpb0hPaU9PRjlYZVBzS2k1dzBiVSs2OXptdVdxaXJRWDJFcndlVlRH?= =?utf-8?B?N3hMMFcxbmNKT2dZd3l5TnBiSWRxbWpmT05pVVhFeFZ5VHcrVnY5MU9qMjRv?= =?utf-8?B?U2FKb2FPUCswekJHSTVuN1NJZlcvVjZXdk5FbFZyeXp6bnM2V0lFMzF4YS91?= =?utf-8?B?bWI3clRNTDNzVFZSTGhYSWYvMGN2c0lLS3M5aXlCVWMvdDVzUEwxWlJvTTJ1?= =?utf-8?B?bFBVSDNFSFQvWVlqWU1FT3NPb1BnaHJFSTU0Ymkrc1BNRStGYzFMaDJPdVpt?= =?utf-8?B?K0hQZzNSbWlWczIwSWpmNnJZM01iRDN3UWY1WG8xRTJtUHJqVWNnYzhjWkxG?= =?utf-8?B?ZG1Qdk40eDhjQzZUb3dGRmR2eDVJQVpqdXN5THBwTlp2anFLQ09wUERTdlZV?= =?utf-8?B?UmNsb3FXLysrQWZIRTdGdGZqenljK0FZLy9sU2tjeDBaTHJ5eUVROUJ4S0Jj?= =?utf-8?B?NFVJRitkVWdEZStQL1RYME1OcEVMZXdjL2ttMGNKdS9uK0hJaEt2a2E4Skda?= =?utf-8?B?ZC9FSnRpdjZlQ1AxeGdSa0pWMXNaZVhYV2ExNTBpNWVhdTM5Mk4zeFVpS0lG?= =?utf-8?B?MFZyWTlyTk53a3RGcThIUFlzWVVNcTVSTTFibGxxQ3E4cTg5amF3ZjNrcUdm?= =?utf-8?B?aHc3N0w3OEdIaUN6UDh2Q0Z4MkZkQVpLK0tjN2VwWEE3TlZmQXJCamJ4dXdo?= =?utf-8?B?VzRFVnhOdkxpU2hITTlET1ZDRkNyYlRrdWttMGRCYkEzMDNKdGdhd3BzSWtR?= =?utf-8?B?a3dTZnZvWFNPdnB3R29ka1RDNkFPVHVxNHhlQ1lrbURYcEZSQWtTbWp3S3ZF?= =?utf-8?B?ODd6eGNyZW5GdGR6aENReGFjQjQvRWxDMHBCNlVKV0FOQjlJS1QwYmxOUFdv?= =?utf-8?B?VEtseHgweDdvYmpxUzFPSzVmMkVDajBSOTVlOXJ4UUJPVjRBSXdiUWNIQktx?= =?utf-8?B?cHpCZTRTdVEybG90dVgzR2l2UjloSnZKYmFCQ2h6Y2lQajhzYnFGR2JIYWJS?= =?utf-8?B?cWl5ZS9vM0RLSmR2S3FmaTdPQ3h1VFRFdFV3QUhDdzJoU0FGRTl4cXlsUTR2?= =?utf-8?B?TXU0QVlYWXUxV1MrNXJXN0ZWQWgvbFRSVUdQWHFkZlQzSFhoZVlWNUs2cjJY?= =?utf-8?B?SnNWQzJPY0JNekNwdyt4bWs2eXl6M1VPQXlobldVdVpIQTZjZnBNSklGR0x6?= =?utf-8?B?VFpXcnJMQUxvSE9uTG1XWmliREsxRXpiN3JBVnhPRHJqOTdvVkxRd1A1amUz?= =?utf-8?B?TElRV0RlaWJrYjkyckQ2RDFvVTM1UDJRN2JTNFJGK1d4dDVucitsa0NTb244?= =?utf-8?B?SjhaT3NkKzZGdE9hS1hNMVNuSHdPRGo2eDdCZjEzYjM1MmkzMVNnODRQRU8v?= =?utf-8?B?VTQ3SnQ3MEJGM1UwR1ZwbTRPTXJyNjVaa3pBTUZKZ2lVSDU3YS9Nak12eHR0?= =?utf-8?B?R1l0UG8wU1I1V1krcTNSVkZCVUlQNHFUVVBWZWwwd1Y4a1BqK1M3QlpPODNN?= =?utf-8?B?OHc9PQ==?= X-OriginatorOrg: siemens.com X-MS-Exchange-CrossTenant-Network-Message-Id: 02fa174b-15c0-444a-61d0-08daecd6a1ba X-MS-Exchange-CrossTenant-AuthSource: AS4PR10MB6181.EURPRD10.PROD.OUTLOOK.COM X-MS-Exchange-CrossTenant-AuthAs: Internal X-MS-Exchange-CrossTenant-OriginalArrivalTime: 02 Jan 2023 15:33:00.7943 (UTC) X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted X-MS-Exchange-CrossTenant-Id: 38ae3bcd-9579-4fd4-adda-b42e1495d55a X-MS-Exchange-CrossTenant-MailboxType: HOSTED X-MS-Exchange-CrossTenant-UserPrincipalName: tAZ/H1vX2oA+LEkITZSMOsbMz8CCzGp74wWQ+vR2a4SOzOA8bVyDePsQftUVb039B//3DHebgD8YCGLzt6u5pA== X-MS-Exchange-Transport-CrossTenantHeadersStamped: AS2PR10MB7395 X-TUID: M05j4c5pQi+L On 02.01.23 15:58, venkata.pyla@toshiba-tsip.com wrote: > From: venkata pyla > > As part of reproducible-build work, the rootfs images generated on same > source should be identical between two builds. > > In this commit it tries to solve one of the non-reproducible problem > i.e. the rootfs file time-stamps generated during build time are not > reproducible, it uses one of the solution provided in the debian > live-build image project (refer [1]), it fixes by finding all the > files/folders that are gernerated newly and set the time-stamp provided > by `SOURCE_DATE_EPOCH` environment variable. > > [1] https://salsa.debian.org/live-team/live-build/-/merge_requests/218 > Just out of curiosity: How does Yocto address this? Jan > Signed-off-by: venkata pyla > --- > meta/classes/image.bbclass | 9 +++++++++ > 1 file changed, 9 insertions(+) > > diff --git a/meta/classes/image.bbclass b/meta/classes/image.bbclass > index 813e1f3..f592a12 100644 > --- a/meta/classes/image.bbclass > +++ b/meta/classes/image.bbclass > @@ -430,6 +430,15 @@ do_rootfs_finalize() { > "${ROOTFSDIR}/etc/apt/sources.list.d/bootstrap.list" > > rm -f "${ROOTFSDIR}/etc/apt/sources-list" > + > + # Set same time-stamps to the newly generated file/folders in the > + # rootfs image for the purpose of reproducible builds. > + test ! -z "${SOURCE_DATE_EPOCH}" && \ > + find ${ROOTFSDIR} -newermt \ > + "$(date -d@${SOURCE_DATE_EPOCH} '+%Y-%m-%d %H:%M:%S')" \ > + -printf "%y %p\n" \ > + -exec touch '{}' -h -d@${SOURCE_DATE_EPOCH} ';' > + > EOSUDO > } > addtask rootfs_finalize before do_rootfs after do_rootfs_postprocess -- Siemens AG, Technology Competence Center Embedded Linux