public inbox for isar-users@googlegroups.com
 help / color / mirror / Atom feed
From: <Venkata.Pyla@toshiba-tsip.com>
To: <felix.moessbauer@siemens.com>, <isar-users@googlegroups.com>
Cc: <jan.kiszka@siemens.com>, <kazuhiro3.hayashi@toshiba.co.jp>,
	<dinesh.kumar@toshiba-tsip.com>
Subject: RE: [PATCH 0/5] Make ext4 images reproducible
Date: Fri, 8 Dec 2023 18:12:15 +0000	[thread overview]
Message-ID: <OS3PR01MB6856CC0938536DB4272AA8CFA48AA@OS3PR01MB6856.jpnprd01.prod.outlook.com> (raw)
In-Reply-To: <3397cb2d254bc8a2e45c47b5a4094e34c85bec32.camel@siemens.com>



> -----Original Message-----
> From: 'MOESSBAUER, Felix' via isar-users <isar-users@googlegroups.com>
> Sent: Friday, December 8, 2023 4:00 PM
> To: isar-users@googlegroups.com; pyla venkata(TSIP TMIEC ODG
> Porting) <Venkata.Pyla@toshiba-tsip.com>
> Cc: Kiszka, Jan <jan.kiszka@siemens.com>; hayashi kazuhiro(林 和宏 DME
> ○DIG□MPS○MP4) <kazuhiro3.hayashi@toshiba.co.jp>; dinesh
> kumar(TSIP TMIEC ODG Porting) <dinesh.kumar@toshiba-tsip.com>
> Subject: Re: [PATCH 0/5] Make ext4 images reproducible
> 
> On Thu, 2023-12-07 at 21:11 +0530, venkata.pyla@toshiba-tsip.com wrote:
> > From: venkata pyla <venkata.pyla@toshiba-tsip.com>
> >
> > Hi,
> >
> > The following series of patches will help to fix reproducible build
> > issues in ext4 file systems.
> >
> > Verified with following steps:
> >
> > ```
> >
> > $ git clone http://github.com/ilbers/isar.git $ cd isar $ .
> > isar-init-build-env ../build
> >
> > configure image parameters
> > $ cd isar
> > $ cat <<EOT >> conf/local.conf
> > SOURCE_DATE_EPOCH = "$(git log -1 --pretty=%ct)"
> > IMAGE_FSTYPES = "wic"
> > WIC_DEPLOY_PARTITIONS = "1"
> > EOT
> >
> > # First Build
> > $ cd ../build
> > $ sudo rm -rf tmp sstate-cache
> > $ bitbake mc:qemuamd64-bookworm:isar-image-base
> > $ mv tmp/deploy/images/qemuamd64/ ../qemuamd64-1
> >
> > # Second Build
> > $ sudo rm -rf tmp sstate-cache
> 
> Hi,
> 
> just out of curiosity: Did you also have a look a building with sstate cache? Are
> there reproducibility issues?

I just checked, with sstate cache the images are reproducible as well.
In my steps I have cleaned the sstate cache, because it should not hide any issues due to caching.

> 
> In the past I fixed a couple of these, but I'm not 100% sure if we still have
> some (esp. around the rootfs caching).
> 
> Happy Coding!
> Felix
> 
> > $ bitbake mc:qemuamd64-bookworm:isar-image-base
> > $ mv tmp/deploy/images/qemuamd64/ ../qemuamd64-2
> >
> > # compare ext4 images with diffoscope
> > $ diffoscope qemuamd64-1/isar-image-base-debian-bookworm-
> > qemuamd64.wic.p2 \
> >         qemuamd64-2/isar-image-base-debian-bookworm-qemuamd64.wic.p2
> >
> > ```
> >
> > venkata pyla (5):
> >   linux-module: Use debug-prefix-map to build modules
> > deterministically
> >   wic: Set file system uuid to ext4 partitions
> >   wic: use E2FSPROGS_FAKE_TIME and hash_seed to generate reproducible
> >     ext4 images
> >   wic: honor the SOURCE_DATE_EPOCH in case of updated fstab
> >   wic: make ext2/3/4 images reproducible
> >
> >  .../lib/wic/canned-wks/common-isar.wks.inc    |  2 +-
> >  .../lib/wic/canned-wks/de0-nano-soc.wks.in    |  2 +-
> >  .../lib/wic/canned-wks/efi-plus-pcbios.wks    |  2 +-
> >  .../scripts/lib/wic/canned-wks/hikey.wks      |  2 +-
> >  .../lib/wic/canned-wks/multipart-efi.wks      |  4 +-
> >  .../lib/wic/canned-wks/nanopi-neo-efi.wks.in  |  2 +-
> >  .../lib/wic/canned-wks/nanopi-neo.wks.in      |  2 +-
> >  .../scripts/lib/wic/canned-wks/rpi-sdimg.wks  |  2 +-
> >  .../wic/canned-wks/sdimage-efi-sb-debian.wks  |  2 +-
> >  .../lib/wic/canned-wks/sdimage-efi-sd.wks     |  2 +-
> >  .../lib/wic/canned-wks/sdimage-efi.wks        |  2 +-
> >  .../lib/wic/canned-wks/sifive-fu540.wks       |  2 +-
> >  .../canned-wks/starfive-visionfive2.wks.in    |  2 +-
> >  .../lib/wic/canned-wks/stm32mp15x.wks.in      |  2 +-
> >  .../linux-module/files/debian/rules.tmpl      |  5 ++-
> >  scripts/lib/wic/partition.py                  | 37
> > ++++++++++++++++++-
> >  scripts/lib/wic/plugins/imager/direct.py      |  3 ++
> >  scripts/lib/wic/plugins/source/rootfs.py      |  2 +-
> >  18 files changed, 59 insertions(+), 18 deletions(-)
> >
> 
> --
> You received this message because you are subscribed to the Google Groups
> "isar-users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to isar-users+unsubscribe@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/isar-
> users/3397cb2d254bc8a2e45c47b5a4094e34c85bec32.camel%40siemens.c
> om.

      reply	other threads:[~2023-12-08 18:12 UTC|newest]

Thread overview: 27+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
     [not found] <AQHaKSPYp2dXzOOhJUivzLFOKAgd4rF2a70A>
2023-12-07 15:41 ` venkata.pyla
2023-12-07 15:41   ` [PATCH 1/5] linux-module: Use debug-prefix-map to build modules deterministically venkata.pyla
2023-12-08 10:27     ` MOESSBAUER, Felix
2023-12-07 15:41   ` [PATCH 2/5] wic: Set file system uuid to ext4 partitions venkata.pyla
2023-12-07 15:41   ` [PATCH 3/5] wic: use E2FSPROGS_FAKE_TIME and hash_seed to generate reproducible ext4 images venkata.pyla
2023-12-08 10:33     ` MOESSBAUER, Felix
2023-12-08 18:14       ` Venkata.Pyla
2023-12-09 11:07         ` Florian Bezdeka
2023-12-12 14:06           ` Venkata.Pyla
2023-12-28  6:02             ` Venkata.Pyla
2023-12-28  8:47               ` Florian Bezdeka
2023-12-28 10:10                 ` Anton Mikanovich
2024-03-13 10:01                   ` Adithya.Balakumar
2024-03-13 16:00                     ` Anton Mikanovich
2024-03-14  4:37                       ` Adithya.Balakumar
2024-04-25  6:24                       ` MOESSBAUER, Felix
2024-04-25  6:30                         ` Jan Kiszka
2024-04-25  7:02                           ` MOESSBAUER, Felix
2024-04-26  8:58                         ` Anton Mikanovich
2024-04-23  9:17     ` MOESSBAUER, Felix
2024-07-05 12:13       ` Adithya Balakumar
2024-07-08 10:43         ` 'MOESSBAUER, Felix' via isar-users
     [not found]           ` <CAM=oSXcw+sH3VYsstvDmRbLTK-H0ncFEbuqOhG2R0_P4bUYXjw@mail.gmail.com>
2024-07-08 11:12             ` Adithya.Balakumar
2023-12-07 15:41   ` [PATCH 4/5] wic: honor the SOURCE_DATE_EPOCH in case of updated fstab venkata.pyla
2023-12-07 15:41   ` [PATCH 5/5] wic: make ext2/3/4 images reproducible venkata.pyla
2023-12-08 10:29   ` [PATCH 0/5] Make ext4 " MOESSBAUER, Felix
2023-12-08 18:12     ` Venkata.Pyla [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=OS3PR01MB6856CC0938536DB4272AA8CFA48AA@OS3PR01MB6856.jpnprd01.prod.outlook.com \
    --to=venkata.pyla@toshiba-tsip.com \
    --cc=dinesh.kumar@toshiba-tsip.com \
    --cc=felix.moessbauer@siemens.com \
    --cc=isar-users@googlegroups.com \
    --cc=jan.kiszka@siemens.com \
    --cc=kazuhiro3.hayashi@toshiba.co.jp \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox