public inbox for isar-users@googlegroups.com
 help / color / mirror / Atom feed
From: "MOESSBAUER, Felix" <felix.moessbauer@siemens.com>
To: "isar-users@googlegroups.com" <isar-users@googlegroups.com>,
	"venkata.pyla@toshiba-tsip.com" <venkata.pyla@toshiba-tsip.com>
Cc: "Kiszka, Jan" <jan.kiszka@siemens.com>,
	"kazuhiro3.hayashi@toshiba.co.jp"
	<kazuhiro3.hayashi@toshiba.co.jp>,
	"dinesh.kumar@toshiba-tsip.com" <dinesh.kumar@toshiba-tsip.com>
Subject: Re: [PATCH 0/5] Make ext4 images reproducible
Date: Fri, 8 Dec 2023 10:29:57 +0000	[thread overview]
Message-ID: <3397cb2d254bc8a2e45c47b5a4094e34c85bec32.camel@siemens.com> (raw)
In-Reply-To: <20231207154114.20400-1-venkata.pyla@toshiba-tsip.com>

On Thu, 2023-12-07 at 21:11 +0530, venkata.pyla@toshiba-tsip.com wrote:
> From: venkata pyla <venkata.pyla@toshiba-tsip.com>
> 
> Hi,
> 
> The following series of patches will help to fix reproducible build
> issues in ext4 file systems.
> 
> Verified with following steps:
> 
> ```
> 
> $ git clone http://github.com/ilbers/isar.git
> $ cd isar
> $ . isar-init-build-env ../build
> 
> configure image parameters
> $ cd isar
> $ cat <<EOT >> conf/local.conf
> SOURCE_DATE_EPOCH = "$(git log -1 --pretty=%ct)"
> IMAGE_FSTYPES = "wic"
> WIC_DEPLOY_PARTITIONS = "1"
> EOT
> 
> # First Build
> $ cd ../build
> $ sudo rm -rf tmp sstate-cache
> $ bitbake mc:qemuamd64-bookworm:isar-image-base
> $ mv tmp/deploy/images/qemuamd64/ ../qemuamd64-1
> 
> # Second Build
> $ sudo rm -rf tmp sstate-cache

Hi,

just out of curiosity: Did you also have a look a building with sstate
cache? Are there reproducibility issues?

In the past I fixed a couple of these, but I'm not 100% sure if we
still have some (esp. around the rootfs caching).

Happy Coding!
Felix

> $ bitbake mc:qemuamd64-bookworm:isar-image-base
> $ mv tmp/deploy/images/qemuamd64/ ../qemuamd64-2
> 
> # compare ext4 images with diffoscope
> $ diffoscope qemuamd64-1/isar-image-base-debian-bookworm-
> qemuamd64.wic.p2 \
>         qemuamd64-2/isar-image-base-debian-bookworm-qemuamd64.wic.p2
> 
> ```
> 
> venkata pyla (5):
>   linux-module: Use debug-prefix-map to build modules
> deterministically
>   wic: Set file system uuid to ext4 partitions
>   wic: use E2FSPROGS_FAKE_TIME and hash_seed to generate reproducible
>     ext4 images
>   wic: honor the SOURCE_DATE_EPOCH in case of updated fstab
>   wic: make ext2/3/4 images reproducible
> 
>  .../lib/wic/canned-wks/common-isar.wks.inc    |  2 +-
>  .../lib/wic/canned-wks/de0-nano-soc.wks.in    |  2 +-
>  .../lib/wic/canned-wks/efi-plus-pcbios.wks    |  2 +-
>  .../scripts/lib/wic/canned-wks/hikey.wks      |  2 +-
>  .../lib/wic/canned-wks/multipart-efi.wks      |  4 +-
>  .../lib/wic/canned-wks/nanopi-neo-efi.wks.in  |  2 +-
>  .../lib/wic/canned-wks/nanopi-neo.wks.in      |  2 +-
>  .../scripts/lib/wic/canned-wks/rpi-sdimg.wks  |  2 +-
>  .../wic/canned-wks/sdimage-efi-sb-debian.wks  |  2 +-
>  .../lib/wic/canned-wks/sdimage-efi-sd.wks     |  2 +-
>  .../lib/wic/canned-wks/sdimage-efi.wks        |  2 +-
>  .../lib/wic/canned-wks/sifive-fu540.wks       |  2 +-
>  .../canned-wks/starfive-visionfive2.wks.in    |  2 +-
>  .../lib/wic/canned-wks/stm32mp15x.wks.in      |  2 +-
>  .../linux-module/files/debian/rules.tmpl      |  5 ++-
>  scripts/lib/wic/partition.py                  | 37
> ++++++++++++++++++-
>  scripts/lib/wic/plugins/imager/direct.py      |  3 ++
>  scripts/lib/wic/plugins/source/rootfs.py      |  2 +-
>  18 files changed, 59 insertions(+), 18 deletions(-)
> 


  parent reply	other threads:[~2023-12-08 10:30 UTC|newest]

Thread overview: 27+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <AQHaKSPYp2dXzOOhJUivzLFOKAgd4rF2a70A>
2023-12-07 15:41 ` venkata.pyla
2023-12-07 15:41   ` [PATCH 1/5] linux-module: Use debug-prefix-map to build modules deterministically venkata.pyla
2023-12-08 10:27     ` MOESSBAUER, Felix
2023-12-07 15:41   ` [PATCH 2/5] wic: Set file system uuid to ext4 partitions venkata.pyla
2023-12-07 15:41   ` [PATCH 3/5] wic: use E2FSPROGS_FAKE_TIME and hash_seed to generate reproducible ext4 images venkata.pyla
2023-12-08 10:33     ` MOESSBAUER, Felix
2023-12-08 18:14       ` Venkata.Pyla
2023-12-09 11:07         ` Florian Bezdeka
2023-12-12 14:06           ` Venkata.Pyla
2023-12-28  6:02             ` Venkata.Pyla
2023-12-28  8:47               ` Florian Bezdeka
2023-12-28 10:10                 ` Anton Mikanovich
2024-03-13 10:01                   ` Adithya.Balakumar
2024-03-13 16:00                     ` Anton Mikanovich
2024-03-14  4:37                       ` Adithya.Balakumar
2024-04-25  6:24                       ` MOESSBAUER, Felix
2024-04-25  6:30                         ` Jan Kiszka
2024-04-25  7:02                           ` MOESSBAUER, Felix
2024-04-26  8:58                         ` Anton Mikanovich
2024-04-23  9:17     ` MOESSBAUER, Felix
2024-07-05 12:13       ` Adithya Balakumar
2024-07-08 10:43         ` 'MOESSBAUER, Felix' via isar-users
     [not found]           ` <CAM=oSXcw+sH3VYsstvDmRbLTK-H0ncFEbuqOhG2R0_P4bUYXjw@mail.gmail.com>
2024-07-08 11:12             ` Adithya.Balakumar
2023-12-07 15:41   ` [PATCH 4/5] wic: honor the SOURCE_DATE_EPOCH in case of updated fstab venkata.pyla
2023-12-07 15:41   ` [PATCH 5/5] wic: make ext2/3/4 images reproducible venkata.pyla
2023-12-08 10:29   ` MOESSBAUER, Felix [this message]
2023-12-08 18:12     ` [PATCH 0/5] Make ext4 " Venkata.Pyla

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=3397cb2d254bc8a2e45c47b5a4094e34c85bec32.camel@siemens.com \
    --to=felix.moessbauer@siemens.com \
    --cc=dinesh.kumar@toshiba-tsip.com \
    --cc=isar-users@googlegroups.com \
    --cc=jan.kiszka@siemens.com \
    --cc=kazuhiro3.hayashi@toshiba.co.jp \
    --cc=venkata.pyla@toshiba-tsip.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox