From mboxrd@z Thu Jan 1 00:00:00 1970 X-GM-THRID: 7003728059744387072 X-Received: by 2002:adf:f507:: with SMTP id q7mr18285543wro.7.1631616093236; Tue, 14 Sep 2021 03:41:33 -0700 (PDT) X-BeenThere: isar-users@googlegroups.com Received: by 2002:a7b:c2b2:: with SMTP id c18ls519471wmk.2.gmail; Tue, 14 Sep 2021 03:41:32 -0700 (PDT) X-Google-Smtp-Source: ABdhPJzd0u3OZPc90DhPqx0KAdaV9bbNXfkpLPmrwNZTsF3p3HRniGMoAEmhTcoH8MAwS8K6+0V3 X-Received: by 2002:a05:600c:510a:: with SMTP id o10mr1371746wms.81.1631616092209; Tue, 14 Sep 2021 03:41:32 -0700 (PDT) ARC-Seal: i=1; a=rsa-sha256; t=1631616092; cv=none; d=google.com; s=arc-20160816; b=PNHd2LXdQzglneIV3s5NSJVJ8XDngcyDNwebTNyBwwG+stfLGdTbVyizXfBrYZhMIq coUywI8NwYm+4aOUHrjJ1defAAYUgClfP8KP9cB9d1Bqv02cD5OhTkA3moxGzrZzMt0h 8Z/vMF7WVgJQ0r/Eq9IPHgSRgJX3ce8RQpbg7bA28Lz671AmMT+VElXLwxjX3idMRFyi VPFlPo25ePqCVcjhtpbIvsC8yiyfhBSS0ZunXkbEa7JMWs/Q+RIILTuVXsjZB0GZQcFk df7R28gShoR3gE+kLIqaSXlE/AAzM7B162WrP6gACg7SGIhz2ybg5OfR46EE3eFd1aU7 1fpw== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=arc-20160816; h=content-transfer-encoding:mime-version:references:in-reply-to :message-id:subject:cc:to:from:date; bh=/YZ22rpPeMwndeYjcvIPwLgNpQ81Zg/NELIMOZiKdps=; b=OCQJsTKnNLodCMVk6rEnmuZ/eeqdumlLBsScilZ+huCLeJ3IPwJ84v6oa724hnZEBp Sa77cxHfdd+SGJi54O6lM4JXNgDELyzTVfr7zjsIyzIXMSE7yc/APPQHvseif3OXug6c SA91+9TcQnIsLzFZKMMWKBbnKs94Uu7mCyEtogPmGz+retq+Ml7jEFHUTkAaydUPqoTP 1NnqKYWjc/QBwRfehsCKvaoaO5sKoZeE5u3A4FqO3pJbgzL0P3czkirc/KROJZhqspHE 7YdJZy3BKm5mAkCDCppiy8lgCnZPz+U/qIvXbZ+8mVDncmi5vXPhLU71StZJuuV/9lDH F1QA== ARC-Authentication-Results: i=1; gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.14 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Return-Path: Received: from david.siemens.de (david.siemens.de. [192.35.17.14]) by gmr-mx.google.com with ESMTPS id f20si97848wmj.3.2021.09.14.03.41.32 for (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128); Tue, 14 Sep 2021 03:41:32 -0700 (PDT) Received-SPF: pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.14 as permitted sender) client-ip=192.35.17.14; Authentication-Results: gmr-mx.google.com; spf=pass (google.com: domain of henning.schild@siemens.com designates 192.35.17.14 as permitted sender) smtp.mailfrom=henning.schild@siemens.com; dmarc=pass (p=NONE sp=NONE dis=NONE) header.from=siemens.com Received: from mail2.sbs.de (mail2.sbs.de [192.129.41.66]) by david.siemens.de (8.15.2/8.15.2) with ESMTPS id 18EAfVpZ010967 (version=TLSv1.2 cipher=DHE-RSA-AES256-GCM-SHA384 bits=256 verify=OK); Tue, 14 Sep 2021 12:41:31 +0200 Received: from md1za8fc.ad001.siemens.net ([139.25.0.59]) by mail2.sbs.de (8.15.2/8.15.2) with ESMTP id 18EAfUt2001731; Tue, 14 Sep 2021 12:41:30 +0200 Date: Tue, 14 Sep 2021 12:41:29 +0200 From: Henning Schild To: Cc: , , , Subject: Re: [isar] reproducible build failures Message-ID: <20210914124129.74af46e2@md1za8fc.ad001.siemens.net> In-Reply-To: References: <20210906104145.305cf2fd@md1za8fc.ad001.siemens.net> X-Mailer: Claws Mail 3.18.0 (GTK+ 2.24.33; x86_64-pc-linux-gnu) MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable X-TUID: ebg7xzKmCawL Am Tue, 14 Sep 2021 07:29:07 +0000 schrieb : > Hi Henning, >=20 > Thanks for the below patches >=20 > "[PATCH 1/3] debianize: make changelog date reproducible" > "[PATCH 3/3] isar-exclude-docs: include "native" package changelogs" >=20 > >-----Original Message----- > >From: Henning Schild > >Sent: 06 September 2021 14:12 > >To: pyla venkata(=EF=BC=B4=EF=BC=B3=EF=BC=A9=EF=BC=B0) > >Cc: isar-users@googlegroups.com; jan.kiszka@siemens.com; sangorrin > >daniel(=E3=82=B5=E3=83=B3=E3=82=B4=E3=83=AA=E3=83=B3 =E3=83=80=E3=83=8B= =E3=82=A8=E3=83=AB =E2=96=A1=EF=BC=B3=EF=BC=B7=EF=BC=A3=E2=97=AF=EF=BC=A1= =EF=BC=A3=EF=BC=B4) > >; dinesh kumar(=EF=BC=B4=EF=BC=B3=EF=BC= =A9=EF=BC=B0) > > Subject: Re: [isar] reproducible > >build failures > > > >Am Fri, 3 Sep 2021 15:19:21 +0000 > >schrieb : > > =20 > >> Hi, > >> > >> I am using isar system in isar-cip-core project [1] where I found > >> some reproducible failures, which may be good to fix in the isar > >> system. I am not good in modifying the isar system, so could you > >> please guide me to fix these problems? > >> > >> Here are the steps to check the reproducible failures in > >> isar-cip-core project: > >> https://eur01.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fgi= tl > >> ab.com%2Fcip-project%2Fcip-core%2Fisar-cip-core%2F-%2Fissues%2F12& > >> data=3D04%7C01%7Cde173c00-e982-4fda-8644- =20 > >47edf4671d63%40ad011.siemens.co =20 > >> =20 > >m%7C186fea861bb04bae174708d96eee3bfb%7C38ae3bcd95794fd4addab42e14 > >95d55 =20 > >> =20 > >a%7C1%7C0%7C637662792787877923%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi > >MC4wLjA =20 > >> =20 > >wMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdat > >a=3Do =20 > >> fcsE0TXKbwL%2FPUTD2hAEQWvOLXNRFrIvunSOblUAho%3D&reserved=3D0 > >> https://eur01.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fgi= tl > >> ab.com%2Fcip-project%2Fcip-core%2Fisar-cip-core%2F-%2Fissues%2F13& > >> data=3D04%7C01%7Cde173c00-e982-4fda-8644- =20 > >47edf4671d63%40ad011.siemens.co =20 > >> =20 > >m%7C186fea861bb04bae174708d96eee3bfb%7C38ae3bcd95794fd4addab42e14 > >95d55 =20 > >> =20 > >a%7C1%7C0%7C637662792787877923%7CUnknown%7CTWFpbGZsb3d8eyJWIjoi > >MC4wLjA =20 > >> =20 > >wMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C2000&sdat > >a=3DM =20 > >> =20 > >7pZHme2TzX7ZhNbaZW%2BKn26K65ZnKFW4BvnQJldLnw%3D&reserved=3D0 =20 > >> > >> I also verified the reproducibility in the isar system and found > >> similar failures that are copied below: > >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D =20 > >tmp/gpghomefHv8eRhk43/ =20 > >> tmp/gpghomefHv8eRhk43/private-keys-v1.d/ > >> usr/share/doc/hello/changelog.Debian.gz =20 > > > >I was wondering why only one package is affected here, it should be > >more. Turns out that isar-exclude-docs might be a little to thorough. > > > >I sent a patch for that > > [PATCH 3/3] isar-exclude-docs: include "native" package changelogs > > =20 >=20 > Thanks for change, I have tested with this patch and found more > changelogs differences in reproducible check, >=20 > > > >And "[PATCH 1/3] debianize: make changelog date reproducible" makes > >sure we always use the same date while still allowing user control > >and prepending to upstream without "going back in time". =20 >=20 > also this patch fixed the timestamp difference in the changelog and > so the reproducible check doesn=E2=80=99t show any difference for the > changelogs. >=20 > So, these patches will be available in master branch? In isar things are usually merged to next and master follows pretty slowly. But next is never rebased so it is safe to use as well. So far the patches are on the list for review. If no review comments suggest that change is needed, they will eventually be picked up. You might be able to speed that up by giving explicit positive review feedback like you did here. But i guess we will just wait and and the meantime you can apply those patches locally if you care about them a lot. Henning > Thanks, > Venkata. >=20 > > > >Henning > > =20 > >> var/cache/debconf/config.dat > >> var/cache/debconf/config.dat-old > >> var/cache/ldconfig/aux-cache > >> var/lib/dpkg/info/enable-fsck.md5sums > >> var/lib/dpkg/info/example-raw.md5sums > >> var/lib/dpkg/info/hello.md5sums > >> var/lib/dpkg/info/isar-disable-apt-cache.md5sums > >> var/lib/dpkg/info/isar-exclude-docs.md5sums > >> var/lib/dpkg/info/sshd-regen-keys.md5sums > >> var/lib/initramfs-tools/4.19.0-17-amd64 > >> var/lib/systemd/catalog/database > >> var/log/alternatives.log > >> var/log/bootstrap.log > >> var/log/dpkg.log > >> var/log/apt/history.log > >> var/log/apt/term.log > >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > >> > >> Steps to check reproducible failures in isar > >> =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > >> $ . isar-init-build-env ../build1 && bitbake > >> mc:qemuamd64-buster-tgz:isar-image-base $ . isar-init-build-env > >> ../build2 && bitbake mc:qemuamd64-buster-tgz:isar-image-base $ > >> mkdir -p rootfs1 rootfs2 $ tar -xzvf > >> ./build1/tmp/deploy/images/qemuamd64/isar-image-base-debian-buster-qem > >> uamd64.tar.gz > >> -C ./rootfs1/ $ tar -xzvf > >> ./build2/tmp/deploy/images/qemuamd64/isar-image-base-debian-buster-qem > >> uamd64.tar.gz -C ./rootfs2/ $ rsync -nrclv ./rootfs1/ ./rootfs2/ > > >> difference.txt =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D= =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D > >> > >> From the reproducible failures I found there are three different > >> areas to fix these problem > >> > >> 1. Changelog file generation, which is embedding the build > >> time date value at here > >> (https://eur01.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fg= it > >> =20 > >hub.com%2Filbers%2Fisar%2Fblob%2Fmaster%2Fmeta%2Fclasses%2Fdebianize.b > >=20 > >> bclass%23L34&data=3D04%7C01%7Cde173c00-e982-4fda-8644- =20 > >47edf4671d63%4 =20 > >> =20 > >0ad011.siemens.com%7C186fea861bb04bae174708d96eee3bfb%7C38ae3bcd95 > >794f =20 > >> =20 > >d4addab42e1495d55a%7C1%7C0%7C637662792787877923%7CUnknown%7CTW > >FpbGZsb3 =20 > >> =20 > >d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D > >%7 =20 > >> =20 > >C2000&sdata=3DsSB%2BhM1xQauyMIju%2FlJ0GsgdBXYds2C61qpUoQPwuQw > >%3D& =20 > >> ;reserved=3D0 > >> ) > >> > >> 2. Log files generated by different application, which are > >> adding build time values, I think we can remove these files if it > >> is not required after build. ( I tried at here > >> https://eur01.safelinks.protection.outlook.com/?url=3Dhttps%3A%2F%2Fgi= th > >> =20 > >ub.com%2Filbers%2Fisar%2Fblob%2Fmaster%2Fmeta%2Fclasses%2Fimage.bbcla > >s =20 > >> s%23L183&data=3D04%7C01%7Cde173c00-e982-4fda-8644- =20 > >47edf4671d63%40ad0 =20 > >> =20 > >11.siemens.com%7C186fea861bb04bae174708d96eee3bfb%7C38ae3bcd95794f > >d4ad =20 > >> =20 > >dab42e1495d55a%7C1%7C0%7C637662792787877923%7CUnknown%7CTWFpb > >GZsb3d8ey =20 > >> =20 > >JWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C > >200 =20 > >> =20 > >0&sdata=3DkUZoEeqRwUQWk8jZQ%2Bp6t3zO4czouhLQjGKh9RPB8kc%3D&a > >mp;reser =20 > >> ved=3D0 > >> but it did not work) > >> > >> 3. Cache and temporary files, I think we can delete these > >> files also. > >> > >> Please guide me to fix these issues. > >> > >> Thanks, > >> Venkata. =20 >=20